On Sun, Aug 11, 2019 at 10:08 AM kbuild test robot <lkp(a)intel.com> wrote:
>
> CC: kbuild-all(a)01.org
> TO: Daniel Borkmann <daniel(a)iogearbox.net>
> CC: "Greg Kroah-Hartman" <gregkh(a)linuxfoundation.org>
> CC: Thomas Gleixner <tglx(a)linutronix.de>
>
> tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/stable/linux-stabl… linux-4.14.y
> head: 3ffe1e79c174b2093f7ee3df589a7705572c9620
> commit: e28951100515c9fd8f8d4b06ed96576e3527ad82 [8386/9999] x86/retpolines: Disable switch jump tables when retpolines are enabled
> config: x86_64-rhel-7.6 (attached as .config)
> compiler: clang version 10.0.0 (git://gitmirror/llvm_project 45a3fd206fb06f77a08968c99a8172cbf2ccdd0f)
> reproduce:
> git checkout e28951100515c9fd8f8d4b06ed96576e3527ad82
> # save the attached .config to linux build tree
> make ARCH=x86_64
>
> If you fix the issue, kindly add following tag
> Reported-by: kbuild test robot <lkp(a)intel.com>
>
> All warnings (new ones prefixed by >>):
>
> In file included from drivers/gpu/drm/i915/gvt/opregion.c:25:
> In file included from drivers/gpu/drm/i915/i915_drv.h:61:
> In file included from drivers/gpu/drm/i915/intel_uc.h:31:
> In file included from drivers/gpu/drm/i915/i915_vma.h:34:
> drivers/gpu/drm/i915/i915_gem_object.h:290:1: warning: attribute declaration must precede definition [-Wignored-attributes]
> __deprecated
> ^
Was there another patch that fixes this that should have been
backported to stable (4.14) along with this?
> include/linux/compiler-gcc.h:106:37: note: expanded from macro '__deprecated'
> #define __deprecated __attribute__((deprecated))
> ^
> include/drm/drm_gem.h:247:20: note: previous definition is here
> static inline void drm_gem_object_reference(struct drm_gem_object *obj)
> ^
> In file included from drivers/gpu/drm/i915/gvt/opregion.c:25:
> In file included from drivers/gpu/drm/i915/i915_drv.h:61:
> In file included from drivers/gpu/drm/i915/intel_uc.h:31:
> In file included from drivers/gpu/drm/i915/i915_vma.h:34:
> drivers/gpu/drm/i915/i915_gem_object.h:300:1: warning: attribute declaration must precede definition [-Wignored-attributes]
> __deprecated
> ^
> include/linux/compiler-gcc.h:106:37: note: expanded from macro '__deprecated'
> #define __deprecated __attribute__((deprecated))
> ^
> include/drm/drm_gem.h:285:20: note: previous definition is here
> static inline void drm_gem_object_unreference(struct drm_gem_object *obj)
> ^
> In file included from drivers/gpu/drm/i915/gvt/opregion.c:25:
> In file included from drivers/gpu/drm/i915/i915_drv.h:61:
> In file included from drivers/gpu/drm/i915/intel_uc.h:31:
> In file included from drivers/gpu/drm/i915/i915_vma.h:34:
> drivers/gpu/drm/i915/i915_gem_object.h:303:1: warning: attribute declaration must precede definition [-Wignored-attributes]
> __deprecated
> ^
> include/linux/compiler-gcc.h:106:37: note: expanded from macro '__deprecated'
> #define __deprecated __attribute__((deprecated))
> ^
> include/drm/drm_gem.h:273:1: note: previous definition is here
> drm_gem_object_unreference_unlocked(struct drm_gem_object *obj)
> ^
> 3 warnings generated.
> >> drivers/gpu/drm/i915/gvt/opregion.o: warning: objtool: intel_vgpu_emulate_opregion_request()+0xbe: can't find jump dest instruction at .text+0x6dd
>
> ---
> 0-DAY kernel test infrastructure Open Source Technology Center
> https://lists.01.org/pipermail/kbuild-all Intel Corporation
--
Thanks,
~Nick Desaulniers
With the existing pintbl, we already have many entries in it. it is
better to figure out a new match to reduce the size of the pintbl.
For example, there are over 10 entries in the pintbl for:
0x10ec0255, 0x1028, "Dell", ALC255_FIXUP_DELL1_MIC_NO_PRESENCE
If we define a new tbl like below, and with the new adding match
function, we can remove those over 10 entries:
SND_HDA_PIN_QUIRK(0x10ec0255, 0x1028, "Dell", ALC255_FIXUP_DELL1_MIC_NO_PRESENCE,
{0x19, 0x40000000},
{0x1a, 0x40000000},),
Here we put 0x19 and 0x1a in the tbl just because these two pins are
undefined on Dell laptops with the codec alc255, and these two pins
will be overwritten by ALC255_FIXUP_DELL1_MIC_NO_PRESENCE.
In summary: the new match will check vendor id and codec id first,
then check the pin_cfg defined in the tbl, only all pin_cfgs in the
tbl are undef and the corresponding pin_cfgs on the laptop are undef
too, this match returns true.
This new match function has lower priority than existing match
functions, so the existing tbls still work as before after applying this
patch.
My plan is to change the existing tbl to undef tbl for MIC_NO_PRESENCE
fixups gradually.
Signed-off-by: Hui Wang <hui.wang(a)canonical.com>
---
sound/pci/hda/hda_auto_parser.c | 32 +++++++++++++++++++++++++++++++-
1 file changed, 31 insertions(+), 1 deletion(-)
diff --git a/sound/pci/hda/hda_auto_parser.c b/sound/pci/hda/hda_auto_parser.c
index 92390d457567..cfada7401b86 100644
--- a/sound/pci/hda/hda_auto_parser.c
+++ b/sound/pci/hda/hda_auto_parser.c
@@ -915,6 +915,36 @@ static bool pin_config_match(struct hda_codec *codec,
return true;
}
+/* match the pintbl which only contains specific pins with undef configuration */
+static bool pin_config_match_undef(struct hda_codec *codec,
+ const struct hda_pintbl *pins)
+{
+ bool match = false;
+
+ for (; pins->nid; pins++) {
+ const struct hda_pincfg *pin;
+ int i;
+
+ if ((pins->val & 0xf0000000) != 0x40000000)
+ return false;
+
+ match = false;
+ snd_array_for_each(&codec->init_pins, i, pin) {
+ if (pin->nid != pins->nid)
+ continue;
+ if ((pin->cfg & 0xf0000000) != 0x40000000)
+ return false;
+ match = true;
+ break;
+ }
+
+ if (match == false)
+ return false;
+ }
+
+ return match;
+}
+
/**
* snd_hda_pick_pin_fixup - Pick up a fixup matching with the pin quirk list
* @codec: the HDA codec
@@ -935,7 +965,7 @@ void snd_hda_pick_pin_fixup(struct hda_codec *codec,
continue;
if (codec->core.vendor_id != pq->codec)
continue;
- if (pin_config_match(codec, pq->pins)) {
+ if (pin_config_match(codec, pq->pins) || pin_config_match_undef(codec, pq->pins)) {
codec->fixup_id = pq->value;
#ifdef CONFIG_SND_DEBUG_VERBOSE
codec->fixup_name = pq->name;
--
2.17.1
Hi Sasha,
On Mon, Aug 12, 2019 at 07:05:47PM +0000, Sasha Levin wrote:
> Hi,
>
> [This is an automated email]
>
> This commit has been processed because it contains a "Fixes:" tag,
> fixing commit: d3862e44daa7 dma-buf/sw-sync: Fix locking around sync_timeline lists.
>
> The bot has tested the following trees: v5.2.8, v4.19.66, v4.14.138, v4.9.189.
>
> v5.2.8: Build OK!
> v4.19.66: Build OK!
> v4.14.138: Build OK!
> v4.9.189: Failed to apply! Possible dependencies:
> Unable to calculate
>
>
> NOTE: The patch will not be queued to stable trees until it is upstream.
>
> How should we proceed with this patch?
The backporting instruction has an explicit # v4.14+ in there, so failure
to apply to older kernels is expected.
Can you perhaps teach this trick to your script perhaps? Iirc we're using
the official format even.
-Daniel
--
Daniel Vetter
Software Engineer, Intel Corporation
http://blog.ffwll.ch
Hello,
We ran automated tests on a patchset that was proposed for merging into this
kernel tree. The patches were applied to:
Kernel repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git
Commit: d36a8d2fb62c - Linux 5.2.8
The results of these automated tests are provided below.
Overall result: PASSED
Merge: OK
Compile: OK
Tests: OK
All kernel binaries, config files, and logs are available for download here:
https://artifacts.cki-project.org/pipelines/100903
We hope that these logs can help you find the problem quickly. For the full
detail on our testing procedures, please scroll to the bottom of this message.
Please reply to this email if you have any questions about the tests that we
ran or if you have any suggestions on how to make future tests more effective.
,-. ,-.
( C ) ( K ) Continuous
`-',-.`-' Kernel
( I ) Integration
`-'
______________________________________________________________________________
Merge testing
-------------
We cloned this repository and checked out the following commit:
Repo: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git
Commit: d36a8d2fb62c - Linux 5.2.8
We grabbed the d6535b968bdc commit of the stable queue repository.
We then merged the patchset with `git am`:
revert-pci-add-missing-link-delays-required-by-the-pcie-spec.patch
iio-ingenic-jz47xx-set-clock-divider-on-probe.patch
iio-cros_ec_accel_legacy-fix-incorrect-channel-setting.patch
iio-imu-mpu6050-add-missing-available-scan-masks.patch
iio-adc-gyroadc-fix-uninitialized-return-code.patch
iio-adc-max9611-fix-misuse-of-genmask-macro.patch
staging-gasket-apex-fix-copy-paste-typo.patch
staging-wilc1000-flush-the-workqueue-before-deinit-the-host.patch
staging-android-ion-bail-out-upon-sigkill-when-allocating-memory.patch
staging-fbtft-fix-probing-of-gpio-descriptor.patch
staging-fbtft-fix-reset-assertion-when-using-gpio-descriptor.patch
crypto-ccp-fix-oops-by-properly-managing-allocated-structures.patch
crypto-ccp-add-support-for-valid-authsize-values-less-than-16.patch
crypto-ccp-ignore-tag-length-when-decrypting-gcm-ciphertext.patch
driver-core-platform-return-enxio-for-missing-gpioint.patch
usb-usbfs-fix-double-free-of-usb-memory-upon-submiturb-error.patch
revert-usb-rio500-simplify-locking.patch
usb-iowarrior-fix-deadlock-on-disconnect.patch
sound-fix-a-memory-leak-bug.patch
mmc-cavium-set-the-correct-dma-max-segment-size-for-mmc_host.patch
mmc-cavium-add-the-missing-dma-unmap-when-the-dma-has-finished.patch
loop-set-pf_memalloc_noio-for-the-worker-thread.patch
bdev-fixup-error-handling-in-blkdev_get.patch
input-usbtouchscreen-initialize-pm-mutex-before-using-it.patch
input-elantech-enable-smbus-on-new-2018-systems.patch
input-synaptics-enable-rmi-mode-for-hp-spectre-x360.patch
x86-mm-check-for-pfn-instead-of-page-in-vmalloc_sync_one.patch
x86-mm-sync-also-unmappings-in-vmalloc_sync_all.patch
mm-vmalloc-sync-unmappings-in-__purge_vmap_area_lazy.patch
coresight-fix-debug_locks_warn_on-for-uninitialized-attribute.patch
perf-annotate-fix-s390-gap-between-kernel-end-and-module-start.patch
perf-db-export-fix-thread__exec_comm.patch
perf-record-fix-module-size-on-s390.patch
x86-purgatory-do-not-use-__builtin_memcpy-and-__builtin_memset.patch
x86-purgatory-use-cflags_remove-rather-than-reset-kbuild_cflags.patch
genirq-affinity-create-affinity-mask-for-single-vector.patch
gfs2-gfs2_walk_metadata-fix.patch
usb-host-xhci-rcar-fix-timeout-in-xhci_suspend.patch
usb-yurex-fix-use-after-free-in-yurex_delete.patch
usb-typec-ucsi-ccg-fix-uninitilized-symbol-error.patch
usb-typec-tcpm-free-log-buf-memory-when-remove-debug-file.patch
usb-typec-tcpm-remove-tcpm-dir-if-no-children.patch
usb-typec-tcpm-add-null-check-before-dereferencing-config.patch
usb-typec-tcpm-ignore-unsupported-unknown-alternate-mode-requests.patch
can-rcar_canfd-fix-possible-irq-storm-on-high-load.patch
can-flexcan-fix-stop-mode-acknowledgment.patch
can-flexcan-fix-an-use-after-free-in-flexcan_setup_stop_mode.patch
can-peak_usb-fix-potential-double-kfree_skb.patch
powerpc-fix-off-by-one-in-max_zone_pfn-initializatio.patch
netfilter-nfnetlink-avoid-deadlock-due-to-synchronou.patch
vfio-ccw-set-pa_nr-to-0-if-memory-allocation-fails-f.patch
vfio-ccw-don-t-call-cp_free-if-we-are-processing-a-c.patch
netfilter-fix-rpfilter-dropping-vrf-packets-by-mista.patch
netfilter-nf_tables-fix-module-autoload-for-redir.patch
netfilter-conntrack-always-store-window-size-un-scal.patch
netfilter-nft_hash-fix-symhash-with-modulus-one.patch
scripts-sphinx-pre-install-fix-script-for-rhel-cento.patch
scripts-sphinx-pre-install-don-t-use-latex-with-cent.patch
scripts-sphinx-pre-install-fix-latexmk-dependencies.patch
rq-qos-don-t-reset-has_sleepers-on-spurious-wakeups.patch
rq-qos-set-ourself-task_uninterruptible-after-we-sch.patch
rq-qos-use-a-mb-for-got_token.patch
netfilter-nf_tables-support-auto-loading-for-inet-na.patch
drm-amd-display-no-audio-endpoint-for-dell-mst-displ.patch
drm-amd-display-clock-does-not-lower-in-updateplanes.patch
drm-amd-display-wait-for-backlight-programming-compl.patch
drm-amd-display-fix-dmcu-hang-when-going-into-modern.patch
drm-amd-display-use-encoder-s-engine-id-to-find-matc.patch
drm-amd-display-put-back-front-end-initialization-se.patch
drm-amd-display-allocate-4-ddc-engines-for-rv2.patch
drm-amd-display-fix-dc_create-failure-handling-and-6.patch
drm-amd-display-only-enable-audio-if-speaker-allocat.patch
drm-amd-display-increase-size-of-audios-array.patch
iscsi_ibft-make-iscsi_ibft-dependson-acpi-instead-of.patch
nl80211-fix-nl80211_he_max_capability_len.patch
mac80211-fix-possible-memory-leak-in-ieee80211_assig.patch
mac80211-don-t-warn-about-cw-params-when-not-using-t.patch
allocate_flower_entry-should-check-for-null-deref.patch
hwmon-occ-fix-division-by-zero-issue.patch
hwmon-nct6775-fix-register-address-and-added-missed-.patch
arm-dts-imx6ul-fix-clock-frequency-property-name-of-.patch
powerpc-papr_scm-force-a-scm-unbind-if-initial-scm-b.patch
arm64-force-ssbs-on-context-switch.patch
arm64-entry-sp-alignment-fault-doesn-t-write-to-far_.patch
iommu-vt-d-check-if-domain-pgd-was-allocated.patch
drm-msm-dpu-correct-dpu-encoder-spinlock-initializat.patch
drm-silence-variable-conn-set-but-not-used.patch
arm64-dts-imx8mm-correct-sai3-rxc-txfs-pin-s-mux-opt.patch
arm64-dts-imx8mq-fix-sai-compatible.patch
cpufreq-pasemi-fix-use-after-free-in-pas_cpufreq_cpu.patch
s390-qdio-add-sanity-checks-to-the-fast-requeue-path.patch
alsa-compress-fix-regression-on-compressed-capture-s.patch
alsa-compress-prevent-bypasses-of-set_params.patch
alsa-compress-don-t-allow-paritial-drain-operations-.patch
alsa-compress-be-more-restrictive-about-when-a-drain.patch
perf-script-fix-off-by-one-in-brstackinsn-ipc-comput.patch
perf-tools-fix-proper-buffer-size-for-feature-proces.patch
perf-stat-fix-segfault-for-event-group-in-repeat-mod.patch
perf-session-fix-loading-of-compressed-data-split-ac.patch
perf-probe-avoid-calling-freeing-routine-multiple-ti.patch
drbd-dynamically-allocate-shash-descriptor.patch
acpi-iort-fix-off-by-one-check-in-iort_dev_find_its_.patch
nvme-ignore-subnqn-for-adata-sx6000lnp.patch
nvme-fix-memory-leak-caused-by-incorrect-subsystem-f.patch
arm-davinci-fix-sleep.s-build-error-on-armv4.patch
arm-dts-bcm-bcm47094-add-missing-cells-for-mdio-bus-.patch
scsi-megaraid_sas-fix-panic-on-loading-firmware-cras.patch
scsi-ibmvfc-fix-warn_on-during-event-pool-release.patch
scsi-scsi_dh_alua-always-use-a-2-second-delay-before.patch
test_firmware-fix-a-memory-leak-bug.patch
tty-ldsem-locking-rwsem-add-missing-acquire-to-read_.patch
perf-x86-intel-fix-slots-pebs-event-constraint.patch
perf-x86-intel-fix-invalid-bit-13-for-icelake-msr_of.patch
perf-x86-apply-more-accurate-check-on-hypervisor-pla.patch
perf-core-fix-creating-kernel-counters-for-pmus-that.patch
s390-dma-provide-proper-arch_zone_dma_bits-value.patch
gen_compile_commands-lower-the-entry-count-threshold.patch
hid-sony-fix-race-condition-between-rumble-and-device-remove.patch
alsa-usb-audio-fix-a-memory-leak-bug.patch
kvm-nsvm-properly-map-nested-vmcb.patch
can-peak_usb-pcan_usb_pro-fix-info-leaks-to-usb-devices.patch
can-peak_usb-pcan_usb_fd-fix-info-leaks-to-usb-devices.patch
hwmon-nct7802-fix-wrong-detection-of-in4-presence.patch
hwmon-lm75-fixup-tmp75b-clr_mask.patch
drm-i915-fix-wrong-escape-clock-divisor-init-for-glk.patch
alsa-firewire-fix-a-memory-leak-bug.patch
alsa-hiface-fix-multiple-memory-leak-bugs.patch
alsa-hda-don-t-override-global-pcm-hw-info-flag.patch
alsa-hda-workaround-for-crackled-sound-on-amd-controller-1022-1457.patch
mac80211-don-t-warn-on-short-wmm-parameters-from-ap.patch
dax-dax_layout_busy_page-should-not-unmap-cow-pages.patch
smb3-fix-deadlock-in-validate-negotiate-hits-reconnect.patch
smb3-send-cap_dfs-capability-during-session-setup.patch
nfsv4-fix-delegation-state-recovery.patch
nfsv4-check-the-return-value-of-update_open_stateid.patch
nfsv4-fix-an-oops-in-nfs4_do_setattr.patch
kvm-fix-leak-vcpu-s-vmcs-value-into-other-pcpu.patch
kvm-arm-arm64-sync-ich_vmcr_el2-back-when-about-to-block.patch
mwifiex-fix-802.11n-wpa-detection.patch
iwlwifi-don-t-unmap-as-page-memory-that-was-mapped-as-single.patch
iwlwifi-mvm-fix-an-out-of-bound-access.patch
iwlwifi-mvm-fix-a-use-after-free-bug-in-iwl_mvm_tx_tso_segment.patch
iwlwifi-mvm-don-t-send-geo_tx_power_limit-on-version-41.patch
iwlwifi-mvm-fix-version-check-for-geo_tx_power_limit-support.patch
Compile testing
---------------
We compiled the kernel for 3 architectures:
aarch64:
make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg
ppc64le:
make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg
x86_64:
make options: -j30 INSTALL_MOD_STRIP=1 targz-pkg
Hardware testing
----------------
We booted each kernel and ran the following tests:
aarch64:
⚡ Internal infrastructure issues prevented one or more tests (marked
with ⚡⚡⚡) from running on this architecture.
This is not the fault of the kernel that was tested.
ppc64le:
Host 1:
✅ Boot test [0]
✅ xfstests: xfs [1]
✅ selinux-policy: serge-testsuite [2]
✅ lvm thinp sanity [3]
✅ storage: software RAID testing [4]
🚧 ✅ Storage blktests [5]
Host 2:
✅ Boot test [0]
✅ Podman system integration test (as root) [6]
✅ Podman system integration test (as user) [6]
✅ LTP lite [7]
✅ Loopdev Sanity [8]
✅ jvm test suite [9]
✅ AMTU (Abstract Machine Test Utility) [10]
✅ LTP: openposix test suite [11]
✅ Ethernet drivers sanity [12]
✅ Networking socket: fuzz [13]
✅ audit: audit testsuite test [14]
✅ httpd: mod_ssl smoke sanity [15]
✅ iotop: sanity [16]
✅ tuned: tune-processes-through-perf [17]
✅ pciutils: update pci ids test [18]
✅ Usex - version 1.9-29 [19]
x86_64:
Host 1:
✅ Boot test [0]
✅ xfstests: xfs [1]
✅ selinux-policy: serge-testsuite [2]
✅ lvm thinp sanity [3]
✅ storage: software RAID testing [4]
🚧 ✅ Storage blktests [5]
Host 2:
✅ Boot test [0]
✅ Podman system integration test (as root) [6]
✅ Podman system integration test (as user) [6]
✅ LTP lite [7]
✅ Loopdev Sanity [8]
✅ jvm test suite [9]
✅ AMTU (Abstract Machine Test Utility) [10]
✅ LTP: openposix test suite [11]
✅ Ethernet drivers sanity [12]
✅ Networking socket: fuzz [13]
✅ audit: audit testsuite test [14]
✅ httpd: mod_ssl smoke sanity [15]
✅ iotop: sanity [16]
✅ tuned: tune-processes-through-perf [17]
✅ pciutils: sanity smoke test [20]
✅ pciutils: update pci ids test [18]
✅ Usex - version 1.9-29 [19]
✅ storage: SCSI VPD [21]
✅ stress: stress-ng [22]
Test source:
💚 Pull requests are welcome for new tests or improvements to existing tests!
[0]: https://github.com/CKI-project/tests-beaker/archive/master.zip#distribution…
[1]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/filesystems…
[2]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/packages/se…
[3]: https://github.com/CKI-project/tests-beaker/archive/master.zip#storage/lvm/…
[4]: https://github.com/CKI-project/tests-beaker/archive/master.zip#storage/swra…
[5]: https://github.com/CKI-project/tests-beaker/archive/master.zip#storage/blk
[6]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/container/p…
[7]: https://github.com/CKI-project/tests-beaker/archive/master.zip#distribution…
[8]: https://github.com/CKI-project/tests-beaker/archive/master.zip#filesystems/…
[9]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/jvm
[10]: https://github.com/CKI-project/tests-beaker/archive/master.zip#misc/amtu
[11]: https://github.com/CKI-project/tests-beaker/archive/master.zip#distribution…
[12]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/networking/…
[13]: https://github.com/CKI-project/tests-beaker/archive/master.zip#/networking/…
[14]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/aud…
[15]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/htt…
[16]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/iot…
[17]: https://github.com/CKI-project/tests-beaker/archive/master.zip#packages/tun…
[18]: https://github.com/CKI-project/tests-beaker/archive/master.zip#pciutils/upd…
[19]: https://github.com/CKI-project/tests-beaker/archive/master.zip#standards/us…
[20]: https://github.com/CKI-project/tests-beaker/archive/master.zip#pciutils/san…
[21]: https://github.com/CKI-project/tests-beaker/archive/master.zip#storage/scsi…
[22]: https://github.com/CKI-project/tests-beaker/archive/master.zip#stress/stres…
Waived tests (marked with 🚧)
-----------------------------
This test run included waived tests. Such tests are executed but their results
are not taken into account. Tests are waived when their results are not
reliable enough, e.g. when they're just introduced or are being fixed.