Lkft-triage August 2025

lkft-triage@lists.linaro.org

43 participants
106 discussions

Daily report for validation - 2025-Aug-14

by lava＠validation.linaro.org

Total jobs: 811 Total errors: 425 (52.40%) LAVA errors: 9 (1.11%) Test errors: 0 (0.00%) Job errors: 108 (13.32%) Infra errors: 308 (37.98%) Canceled jobs: 0 (0.00%) Device type: bcm2837-rpi-3-b-32 Total jobs: 352 Total errors: 207 (58.81%) Error type: Infrastructure Error count: 128 (36.36%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 128 (36.36%) IDs: rpi3-b-32-03: 4188184 4188187 4188197 4188246 4188250 4188254 4188258 4188262 4188274 4188281 4188282 4188285 4188297 4188301 4188307 4188310 4188311 4188318 4188322 4188326 4188330 4188335 4188341 4188348 4188359 4188371 4188375 4188378 4188385 4188387 4188394 4188399 4188403 4188419 4188421 4188434 4188437 4188462 4188483 4188493 4188499 4188506 4188509 4188512 4188516 4188528 4188529 4188544 4188548 4188552 4188556 4188560 4188568 4188573 4188576 4188578 4188590 4188604 4188617 4188637 4188640 4188645 4188648 4188655 4188708 4188736 4188739 4188746 4188748 4188770 4188771 4188777 4188782 4188786 4188791 4188793 4188798 4188810 4188816 4188820 4188823 4188829 4188835 4188851 4188865 4188869 4188879 4188886 4188904 4188908 4188915 4188922 4188924 4188927 4188930 4188934 4188942 4188946 4188951 4188959 4188963 4188985 4188992 4189003 4189007 4189011 4189015 4189020 4189023 4189027 4189040 4189048 4189051 4189078 4189086 4189092 4189102 4189113 4189117 4189123 4189127 4189142 4189143 4189147 4189158 4189161 4189163 4189167 Error type: Job Error count: 75 (21.31%) Error: wait for prompt timed out Count: 75 (21.31%) IDs: rpi3-b-32-03: 4188189 4188193 4188201 4188220 4188230 4188268 4188271 4188278 4188289 4188293 4188303 4188315 4188333 4188339 4188344 4188352 4188363 4188380 4188390 4188397 4188406 4188415 4188424 4188429 4188479 4188490 4188496 4188502 4188564 4188582 4188609 4188613 4188620 4188622 4188625 4188627 4188630 4188634 4188642 4188652 4188656 4188700 4188714 4188728 4188733 4188743 4188754 4188781 4188801 4188806 4188813 4188825 4188896 4188911 4188919 4188938 4188949 4188955 4188975 4188982 4188989 4188996 4189000 4189016 4189030 4189032 4189036 4189044 4189054 4189131 4189135 4189136 4189139 4189151 4189155 Error type: Bug Error count: 4 (1.14%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 4 (1.14%) IDs: rpi3-b-32-03: 4188266 4188356 4188367 4188410 Device type: beaglebone-black Total jobs: 368 Total errors: 188 (51.09%) Error type: Infrastructure Error count: 179 (48.64%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 66 (17.93%) IDs: beaglebone-black03: 4188073 4188076 4188103 4188115 4188122 4188137 4188141 4188145 4188150 4188169 4188177 4188186 4188195 4188252 4188256 4188265 4188270 4188273 4188287 4188291 4188305 4188317 4188332 4188337 4188350 4188354 4188361 4188464 4188508 4188518 4188522 4188533 4188542 4188550 4188554 4188558 4188601 4188606 4188612 4188629 4188703 4188710 4188715 4188735 4188741 4188745 4188758 4188773 4188779 4188788 4188799 4188846 4188848 4188863 4188880 4188906 4188913 4188928 4188932 4188940 4189002 4189076 4189080 4189090 4189110 4189141 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 49 (13.32%) IDs: beaglebone-black03: 4188079 4188084 4188119 4188157 4188173 4188181 4188203 4188228 4188236 4188240 4188244 4188248 4188280 4188324 4188358 4188448 4188456 4188474 4188495 4188497 4188504 4188562 4188587 4188615 4188624 4188690 4188725 4188750 4188764 4188768 4188855 4188861 4188871 4188875 4188883 4188899 4188921 4188926 4188936 4188977 4188980 4188994 4189064 4189084 4189088 4189115 4189121 4189134 4189138 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 12 (3.26%) IDs: beaglebone-black03: 4188276 4188328 4188343 4188369 4188481 4188784 4188795 4188917 4188971 4188984 4189125 4189129 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 26 (7.07%) IDs: beaglebone-black03: 4188126 4188128 4188133 4188222 4188284 4188295 4188299 4188309 4188320 4188373 4188463 4188486 4188489 4188501 4188514 4188566 4188702 4188707 4188722 4188775 4188836 4188877 4188948 4188991 4189099 4189119 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 15 (4.08%) IDs: beaglebone-black03: 4188153 4188232 4188260 4188313 4188365 4188525 4188546 4188619 4188763 4188902 4188910 4188944 4188953 4189095 4189100 Error: matched a bootloader error message Count: 4 (1.09%) IDs: beaglebone-black03: 4188331 4188618 4188787 4189056 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 6 (1.63%) IDs: beaglebone-black03: 4188161 4188191 4188598 4188730 4188808 4188987 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 43 seconds' Count: 1 (0.27%) IDs: beaglebone-black03: 4188530 Error type: Bug Error count: 5 (1.36%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 5 (1.36%) IDs: beaglebone-black03: 4188165 4188224 4188346 4188738 4188998 Error type: Job Error count: 4 (1.09%) Error: wait for prompt timed out Count: 4 (1.09%) IDs: beaglebone-black03: 4188199 4188473 4188803 4188894 Device type: dragonboard-410c Total jobs: 20 Total errors: 19 (95.00%) Error type: Job Error count: 19 (95.00%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 16 (80.00%) IDs: dragonboard-410c-01: 4188455 4188472 4188538 4188597 4188696 4188732 4188760 4188840 4188859 4188868 4188889 4188892 4188974 4189074 4189107 4189111 Error: Invalid job data Count: 3 (15.00%) IDs: dragonboard-410c-01: 4188719 4188966 4189072 Device type: dragonboard-845c Total jobs: 22 Total errors: 4 (18.18%) Error type: Job Error count: 3 (13.64%) Error: Invalid job data Count: 3 (13.64%) IDs: dragonboard-845c-06: 4188720 4189070 dragonboard-845c-08: 4188968 Error type: Infrastructure Error count: 1 (4.55%) Error: Connection closed Count: 1 (4.55%) IDs: dragonboard-845c-05: 4188427 Device type: x15 Total jobs: 47 Total errors: 7 (14.89%) Error type: Job Error count: 7 (14.89%) Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 1 (2.13%) IDs: x15-01: 4188897 Error: No match for error type 'Job', message 'login-action timed out after 273 seconds' Count: 1 (2.13%) IDs: x15-01: 4188884 Error: auto-login action timed out Count: 1 (2.13%) IDs: x15-01: 4188607 Error: No match for error type 'Job', message 'login-action timed out after 275 seconds' Count: 4 (8.51%) IDs: x15-01: 4188475 4188484 4188487 4188600 Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

Re: [PATCH 6.15 000/480] 6.15.10-rc1 review

by Ron Economos

On 8/13/25 10:25, Jon Hunter wrote: > On Wed, Aug 13, 2025 at 08:48:28AM -0700, Jon Hunter wrote: >> On Tue, 12 Aug 2025 19:43:28 +0200, Greg Kroah-Hartman wrote: >>> This is the start of the stable review cycle for the 6.15.10 release. >>> There are 480 patches in this series, all will be posted as a response >>> to this one. If anyone has any issues with these being applied, please >>> let me know. >>> >>> Responses should be made by Thu, 14 Aug 2025 17:42:20 +0000. >>> Anything received after that time might be too late. >>> >>> The whole patch series can be found in one patch at: >>> https://www.kernel.org/pub/linux/kernel/v6.x/stable-review/patch-6.15.10-rc… >>> or in the git tree and branch at: >>> git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable-rc.git linux-6.15.y >>> and the diffstat can be found below. >>> >>> thanks, >>> >>> greg k-h >> Failures detected for Tegra ... >> >> Test results for stable-v6.15: >> 10 builds: 10 pass, 0 fail >> 28 boots: 28 pass, 0 fail >> 120 tests: 119 pass, 1 fail >> >> Linux version: 6.15.10-rc1-g2510f67e2e34 >> Boards tested: tegra124-jetson-tk1, tegra186-p2771-0000, >> tegra186-p3509-0000+p3636-0001, tegra194-p2972-0000, >> tegra194-p3509-0000+p3668-0000, tegra20-ventana, >> tegra210-p2371-2180, tegra210-p3450-0000, >> tegra30-cardhu-a04 >> >> Test failures: tegra194-p2972-0000: boot.py > I am seeing the following kernel warning for both linux-6.15.y and linux-6.16.y … > > WARNING KERN sched: DL replenish lagged too much > > I believe that this is introduced by … > > Peter Zijlstra <peterz(a)infradead.org> > sched/deadline: Less agressive dl_server handling > > This has been reported here: https://lore.kernel.org/all/CAMuHMdXn4z1pioTtBGMfQM0jsLviqS2jwysaWXpoLxWYoG… > > Jon Seeing this kernel warning on RISC-V also.

1 year, 2 months

next-20250813: x86_64 iov_iter.h:171:7: error: variable 'remain' is used uninitialized whenever 'if'

by Naresh Kamboju

Regressions noticed while building x86_64 and i386 builds with clang-nightly and clang-20 toolchains on the Linux next-20250813 tag. First seen on the Linux next-20250813 Good: next-20250812 Bad: next-20250813 Regression Analysis: - New regression? Yes - Reproducibility? Yes ## Build regressions * x86_64, build - clang-20-lkftconfig-compat Build regression: next-20250813 x86_64 iov_iter.h:171:7: error: variable 'remain' is used uninitialized whenever 'if' Reported-by: Linux Kernel Functional Testing <lkft(a)linaro.org> ## Build log In file included from net/core/skbuff.c:66: include/linux/iov_iter.h:171:7: error: variable 'remain' is used uninitialized whenever 'if' condition is true [-Werror,-Wsometimes-uninitialized] 171 | if (skip >= fsize) | ^~~~~~~~~~~~~ include/linux/iov_iter.h:190:7: note: uninitialized use occurs here 190 | if (remain) | ^~~~~~ include/linux/iov_iter.h:171:3: note: remove the 'if' if its condition is always false 171 | if (skip >= fsize) | ^~~~~~~~~~~~~~~~~~ 172 | goto next; | ~~~~~~~~~ include/linux/iov_iter.h:163:22: note: initialize the variable 'remain' to silence this warning 163 | size_t part, remain, consumed; | ^ | = 0 1 error generated. make[5]: *** [scripts/Makefile.build:287: net/core/skbuff.o] Error 1 In file included from net/core/datagram.c:53: include/linux/iov_iter.h:171:7: error: variable 'remain' is used uninitialized whenever 'if' condition is true [-Werror,-Wsometimes-uninitialized] 171 | if (skip >= fsize) | ^~~~~~~~~~~~~ include/linux/iov_iter.h:190:7: note: uninitialized use occurs here 190 | if (remain) | ^~~~~~ include/linux/iov_iter.h:171:3: note: remove the 'if' if its condition is always false 171 | if (skip >= fsize) | ^~~~~~~~~~~~~~~~~~ 172 | goto next; | ~~~~~~~~~ include/linux/iov_iter.h:163:22: note: initialize the variable 'remain' to silence this warning 163 | size_t part, remain, consumed; | ^ | = 0 1 error generated. make[5]: *** [scripts/Makefile.build:287: net/core/datagram.o] Error 1 In file included from lib/iov_iter.c:14: include/linux/iov_iter.h:171:7: error: variable 'remain' is used uninitialized whenever 'if' condition is true [-Werror,-Wsometimes-uninitialized] 171 | if (skip >= fsize) | ^~~~~~~~~~~~~ include/linux/iov_iter.h:190:7: note: uninitialized use occurs here 190 | if (remain) | ^~~~~~ include/linux/iov_iter.h:171:3: note: remove the 'if' if its condition is always false 171 | if (skip >= fsize) | ^~~~~~~~~~~~~~~~~~ 172 | goto next; | ~~~~~~~~~ include/linux/iov_iter.h:163:22: note: initialize the variable 'remain' to silence this warning 163 | size_t part, remain, consumed; | ^ | = 0 1 error generated. ## Source * Git tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git * Project: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250813/ * kernel version: next-20250813 * Architectures: x86_64, i386 * Toolchains: clang-20 * Kconfigs: defconfig ## Test * Test log: https://qa-reports.linaro.org/api/testruns/29479215/log_file/ * Test details: https://regressions.linaro.org/lkft/linux-next-master/next-20250813/log-par… * Test plan: https://tuxapi.tuxsuite.com/v1/groups/linaro/projects/lkft/builds/31DcGmmPg… * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/31DcGmmPgATtnxuFKXwu… * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/31DcGmmPgATtnxuFKXwu… ## steps to reproduce * tuxmake --runtime podman --target-arch x86_64 --toolchain clang-20 --kconfig x86_64_defconfig LLVM=1 LLVM_IAS=1 -- Linaro LKFT https://lkft.linaro.org

1 year, 2 months

Daily cts/vts report for lkft - 2025-Aug-13

by lava＠validation.linaro.org

Total jobs: 268 Total errors: 174 (64.93%) LAVA errors: 0 (0.00%) Test errors: 94 (35.07%) Job errors: 62 (23.13%) Infra errors: 17 (6.34%) Canceled jobs: 1 (0.37%) Device type: qrb5165-rb5 Total jobs: 118 Total errors: 87 (73.73%) Error type: Test Error count: 65 (55.08%) Error: Device NOT found! Count: 6 (5.08%) IDs: rb5-03: 8392407 8394880 8394894 8395049 rb5-06: 8392390 rb5-07: 8394898 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 2 (1.69%) IDs: rb5-03: 8391541 8395048 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 14 (11.86%) IDs: rb5-01: 8391993 8394893 8394937 8395000 rb5-03: 8391521 8391995 8392411 8394999 rb5-06: 8391497 8392055 8394877 rb5-07: 8392054 8392077 8395043 Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 38 (32.20%) IDs: rb5-01: 8391456 8392438 8392443 8394953 8394959 8394963 8395020 rb5-03: 8391494 8392019 8392374 8392377 8392441 8392502 8392574 8394955 8394961 8395019 rb5-06: 8391493 8392448 8392501 8392504 8394951 8394962 8394965 8395018 8395022 rb5-07: 8391454 8391457 8391495 8392038 8392439 8392442 8392483 8392500 8392503 8393680 8394966 8395021 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 592 seconds' Count: 1 (0.85%) IDs: rb5-03: 8394900 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 594 seconds' Count: 2 (1.69%) IDs: rb5-06: 8392376 8394213 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 295 seconds' Count: 1 (0.85%) IDs: rb5-07: 8393678 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 596 seconds' Count: 1 (0.85%) IDs: rb5-03: 8392540 Error type: Infrastructure Error count: 15 (12.71%) Error: fastboot-flash-action timed out Count: 1 (0.85%) IDs: rb5-07: 8395047 Error: Connection closed Count: 13 (11.02%) IDs: rb5-01: 8391455 8391458 8391496 8391550 8392017 8392018 8392041 8392051 8392068 8392076 8394899 8394934 8394958 Error: No match for error type 'Infrastructure', message 'boot-fastboot timed out after 883 seconds' Count: 1 (0.85%) IDs: rb5-07: 8392570 Error type: Job Error count: 6 (5.08%) Error: No match for error type 'Job', message 'login-action timed out after 875 seconds' Count: 2 (1.69%) IDs: rb5-01: 8392440 rb5-03: 8392447 Error: No match for error type 'Job', message 'job-cleanup timed out after 299 seconds' Count: 1 (0.85%) IDs: rb5-07: 8392445 Error: No match for error type 'Job', message 'login-action timed out after 876 seconds' Count: 2 (1.69%) IDs: rb5-03: 8392069 8392444 Error: No match for error type 'Job', message 'test-definition timed out after 300 seconds' Count: 1 (0.85%) IDs: rb5-03: 8392371 Error type: Canceled Error count: 1 (0.85%) Error: The job was canceled Count: 1 (0.85%) IDs: rb5-06: 8387197 Device type: sm8550-hdk Total jobs: 17 Total errors: 11 (64.71%) Error type: Test Error count: 11 (64.71%) Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 10 (58.82%) IDs: sm8550-hdk-01: 8391461 8391462 8391463 8391464 8391465 8392450 8392451 8392452 8392453 8392454 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 1 (5.88%) IDs: sm8550-hdk-01: 8391524 Device type: e850-96 Total jobs: 1 Total errors: 0 (0.00%) Device type: x86 Total jobs: 1 Total errors: 0 (0.00%) Device type: dragonboard-845c Total jobs: 129 Total errors: 76 (58.91%) Error type: Job Error count: 56 (43.41%) Error: No match for error type 'Job', message 'login-action timed out after 873 seconds' Count: 12 (9.30%) IDs: db845c-03: 8392497 db845c-04: 8391440 8391448 8391487 8392433 8392475 db845c-06: 8391483 db845c-09: 8392474 8392478 8392495 8392527 db845c-10: 8391484 Error: No match for error type 'Job', message 'login-action timed out after 872 seconds' Count: 10 (7.75%) IDs: db845c-02: 8391488 db845c-03: 8392515 8392526 db845c-04: 8392492 8392496 db845c-05: 8391451 8391481 8392493 8392525 db845c-09: 8392524 Error: No match for error type 'Job', message 'login-action timed out after 869 seconds' Count: 4 (3.10%) IDs: db845c-03: 8392523 db845c-05: 8392432 8392511 8392519 Error: No match for error type 'Job', message 'login-action timed out after 870 seconds' Count: 5 (3.88%) IDs: db845c-03: 8392518 db845c-05: 8391435 8392428 8392517 db845c-09: 8392512 Error: wait for prompt timed out Count: 17 (13.18%) IDs: db845c-02: 8391446 db845c-03: 8392415 db845c-04: 8391434 8391480 8392430 8392507 db845c-05: 8392425 8392473 8392477 db845c-06: 8391445 8391491 db845c-09: 8391449 8391482 8391490 8392423 8392431 8392508 Error: No match for error type 'Job', message 'login-action timed out after 867 seconds' Count: 1 (0.78%) IDs: db845c-03: 8392434 Error: No match for error type 'Job', message 'login-action timed out after 871 seconds' Count: 4 (3.10%) IDs: db845c-04: 8392424 db845c-06: 8391436 db845c-09: 8392426 db845c-10: 8391433 Error: No match for error type 'Job', message 'login-action timed out after 576 seconds' Count: 1 (0.78%) IDs: db845c-03: 8391485 Error: No match for error type 'Job', message 'login-action timed out after 849 seconds' Count: 1 (0.78%) IDs: db845c-10: 8391478 Error: No match for error type 'Job', message 'login-action timed out after 862 seconds' Count: 1 (0.78%) IDs: db845c-04: 8391432 Error type: Test Error count: 18 (13.95%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 7 (5.43%) IDs: db845c-02: 8391526 db845c-03: 8392416 db845c-05: 8391372 8391395 db845c-06: 8391366 8391370 db845c-09: 8391402 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 298 seconds' Count: 1 (0.78%) IDs: db845c-04: 8392368 Error: Device NOT found! Count: 6 (4.65%) IDs: db845c-02: 8391365 db845c-05: 8392040 db845c-10: 8391379 8391396 8392052 8392367 Error: No match for error type 'Test', message 'tradefed - adb device lost[476f370a]' Count: 1 (0.78%) IDs: db845c-10: 8392039 Error: No match for error type 'Test', message 'tradefed - adb device lost[a6622a22]' Count: 2 (1.55%) IDs: db845c-09: 8391363 8391407 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 339 seconds' Count: 1 (0.78%) IDs: db845c-05: 8391406 Error type: Infrastructure Error count: 2 (1.55%) Error: Connection closed Count: 1 (0.78%) IDs: db845c-05: 8391431 Error: No match for error type 'Infrastructure', message 'Failed to clean after job' Count: 1 (0.78%) IDs: db845c-09: 8391380 Device type: rk3399-rock-pi-4b Total jobs: 1 Total errors: 0 (0.00%) Device type: hi960-hikey Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

Daily report for validation - 2025-Aug-13

by lava＠validation.linaro.org

Total jobs: 761 Total errors: 385 (50.59%) LAVA errors: 18 (2.37%) Test errors: 0 (0.00%) Job errors: 98 (12.88%) Infra errors: 269 (35.35%) Canceled jobs: 0 (0.00%) Device type: bcm2837-rpi-3-b-32 Total jobs: 263 Total errors: 145 (55.13%) Error type: Infrastructure Error count: 90 (34.22%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 89 (33.84%) IDs: rpi3-b-32-03: 4187339 4187348 4187353 4187357 4187361 4187369 4187373 4187377 4187381 4187504 4187520 4187534 4187538 4187544 4187552 4187553 4187565 4187573 4187577 4187580 4187582 4187586 4187588 4187592 4187596 4187601 4187605 4187609 4187613 4187617 4187625 4187629 4187633 4187636 4187640 4187644 4187650 4187711 4187727 4187731 4187735 4187739 4187743 4187747 4187881 4187913 4187919 4187923 4187943 4187951 4187967 4187969 4187979 4187981 4187991 4187996 4188005 4188014 4188018 4188022 4188026 4188030 4188043 4188064 4188068 4188074 4188096 4188104 4188109 4188113 4188117 4188123 4188125 4188130 4188131 4188135 4188148 4188151 4188155 4188159 4188171 4188175 4188179 4188182 4188214 4188229 4188234 4188238 4188242 Error: No match for error type 'Infrastructure', message 'compress-ramdisk timed out after 3 seconds' Count: 1 (0.38%) IDs: rpi3-b-32-03: 4187476 Error type: Job Error count: 46 (17.49%) Error: wait for prompt timed out Count: 46 (17.49%) IDs: rpi3-b-32-03: 4187365 4187368 4187457 4187478 4187481 4187493 4187518 4187527 4187530 4187541 4187548 4187557 4187561 4187569 4187572 4187621 4187646 4187654 4187718 4187722 4187726 4187751 4187786 4187811 4187833 4187867 4187898 4187903 4188000 4188008 4188034 4188038 4188042 4188047 4188050 4188054 4188058 4188062 4188071 4188081 4188089 4188139 4188146 4188163 4188167 4188226 Error type: Bug Error count: 9 (3.42%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 9 (3.42%) IDs: rpi3-b-32-03: 4187775 4187792 4187828 4187836 4187926 4188077 4188082 4188120 4188143 Device type: beaglebone-black Total jobs: 365 Total errors: 185 (50.68%) Error type: Infrastructure Error count: 172 (47.12%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 85 (23.29%) IDs: beaglebone-black03: 4187025 4187029 4187037 4187048 4187051 4187055 4187062 4187067 4187088 4187093 4187096 4187104 4187113 4187124 4187211 4187215 4187329 4187343 4187351 4187355 4187363 4187367 4187371 4187454 4187474 4187482 4187488 4187495 4187517 4187524 4187546 4187550 4187555 4187571 4187575 4187579 4187581 4187584 4187594 4187598 4187611 4187615 4187619 4187638 4187698 4187706 4187714 4187725 4187729 4187733 4187737 4187741 4187745 4187749 4187771 4187819 4187829 4187844 4187855 4187866 4187882 4187885 4187916 4187918 4187922 4187928 4187936 4187942 4187954 4187963 4187965 4187971 4187974 4187993 4188011 4188020 4188024 4188036 4188045 4188052 4188066 4188087 4188092 4188111 4188213 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 38 (10.41%) IDs: beaglebone-black03: 4185958 4187033 4187058 4187064 4187071 4187075 4187081 4187084 4187117 4187127 4187130 4187312 4187344 4187346 4187441 4187455 4187484 4187503 4187506 4187532 4187563 4187627 4187648 4187777 4187791 4187808 4187816 4187834 4187837 4187864 4187887 4187902 4187983 4188040 4188056 4188107 4188206 4188212 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 16 (4.38%) IDs: beaglebone-black03: 4187133 4187526 4187560 4187590 4187607 4187642 4187784 4187794 4187815 4187892 4187894 4187999 4188028 4188060 4188070 4188094 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 19 (5.21%) IDs: beaglebone-black03: 4187040 4187108 4187121 4187304 4187529 4187540 4187543 4187603 4187631 4187635 4187765 4187810 4187859 4187911 4187953 4187989 4188016 4188032 4188049 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 7 (1.92%) IDs: beaglebone-black03: 4187359 4187375 4187471 4187516 4187567 4187939 4187977 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 3 (0.82%) IDs: beaglebone-black03: 4187100 4187707 4187785 Error: matched a bootloader error message Count: 4 (1.10%) IDs: beaglebone-black03: 4187044 4187623 4187713 4187721 Error type: Bug Error count: 9 (2.47%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 9 (2.47%) IDs: beaglebone-black03: 4187221 4187308 4187449 4187477 4187773 4187776 4187842 4187986 4188003 Error type: Job Error count: 4 (1.10%) Error: wait for prompt timed out Count: 4 (1.10%) IDs: beaglebone-black03: 4187379 4187536 4187917 4187931 Device type: dragonboard-410c Total jobs: 22 Total errors: 21 (95.45%) Error type: Job Error count: 21 (95.45%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 18 (81.82%) IDs: dragonboard-410c-01: 4187334 4187446 4187463 4187490 4187508 4187704 4187770 4187823 4187826 4187853 4187874 4187875 4187900 4187906 4187950 4187957 4188100 4188218 Error: Invalid job data Count: 3 (13.64%) IDs: dragonboard-410c-01: 4187465 4187702 4187805 Device type: dragonboard-845c Total jobs: 29 Total errors: 11 (37.93%) Error type: Infrastructure Error count: 7 (24.14%) Error: Connection closed Count: 7 (24.14%) IDs: dragonboard-845c-04: 4187489 4187498 dragonboard-845c-05: 4187460 dragonboard-845c-06: 4187447 4187491 4187499 dragonboard-845c-08: 4187877 Error type: Job Error count: 4 (13.79%) Error: No match for error type 'Job', message '[ 0.000000] Kernel panic - not syncing: Attempted to kill the idle task! [ 0.000000] ---[ end Kernel panic - not syncing: Attempted to kill the idle task! ]---' Count: 1 (3.45%) IDs: dragonboard-845c-04: 4187849 Error: Invalid job data Count: 3 (10.34%) IDs: dragonboard-845c-04: 4187468 dragonboard-845c-06: 4187701 4187804 Device type: x15 Total jobs: 80 Total errors: 23 (28.75%) Error type: Job Error count: 23 (28.75%) Error: No match for error type 'Job', message 'login-action timed out after 275 seconds' Count: 9 (11.25%) IDs: x15-01: 4187342 4187712 4187716 4187719 4187914 4187941 4187966 4187978 4188093 Error: No match for error type 'Job', message 'ipconfig: no devices [ 206.991027] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 207.002685] CPU: 0 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 207.010467] Hardware name: Generic DRA74X (Flattened Device Tree) [ 207.016601] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 207.024383] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 207.031646] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 207.038665] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 207.045379] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 207.052581] [<c034c2d4>] (do_group_exit) from [<b6f29010>] (0xb6f29010) [ 207.059234] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4188012 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.834320] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 configure ipconfig: no devices to configure ipconfig: no devi[ 204.846160] CPU: 1 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 ces to configure ipconfig: no devices to configure ipconfig: n[ 204.859527] Hardware name: Generic DRA74X (Flattened Device Tree) o devices to configure ipconfig: no devices to configure /init[ 204.871246] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) : 384: .: Can't open /run/net-*.conf [ 204.884582] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.895141] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 204.902160] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 204.908905] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 204.916046] [<c034c2d4>] (do_group_exit) from [<b6f64010>] (0xb6f64010) [ 204.922698] CPU0: stopping [ 204.925445] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 204.933654] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.939788] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.947570] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.954833] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.962524] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.970123] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.979400] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 204.989166] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 204.997924] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.006317] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.013824] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.018920] 1f00: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 205.027130] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000ef0a c1901f58 [ 205.035339] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.040405] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.047851] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 205.055969] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 205.063751] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.071380] [<c037b63c>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.079589] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4188010 Error: No match for error type 'Job', message 'ipconfig: no devices [ 206.976745] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 206.988372] CPU: 0 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 206.996154] Hardware name: Generic DRA74X (Flattened Device Tree) [ 207.002319] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 207.010101] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 207.017364] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 207.024353] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 207.031097] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 207.038269] [<c034c2d4>] (do_group_exit) from [<b6f76010>] (0xb6f76010) [ 207.044952] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4188006 Error: No match for error type 'Job', message 'ipconfig: no devices [ 204.908782] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 204.920501] CPU: 1 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 vices to configure ipconfig: no devices to configure ipconfig:[ 204.933837] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 204.945556] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 204.958923] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.969665] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 204.976654] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 204.983398] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 204.990570] [<c034c2d4>] (do_group_exit) from [<b6f62010>] (0xb6f62010) [ 204.997192] CPU0: stopping [ 204.999938] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 205.008148] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.014282] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.022064] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 205.029327] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.037017] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.044616] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.053894] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 205.063659] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 205.072418] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.080810] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.088317] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.093414] 1f00: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 205.101623] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000fa4a c1901f58 [ 205.109832] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.114898] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.122344] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 205.130493] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 205.138275] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.145874] [<c037b63c>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.154083] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4188001 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.871826] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 204.883758] CPU: 0 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 204.891540] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.897674] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.905487] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.912750] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 204.919738] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 204.926483] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 204.933654] [<c034c2d4>] (do_group_exit) from [<b6f1b010>] (0xb6f1b010) [ 204.940307] CPU1: stopping [ 204.943023] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 204.951263] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.957397] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.965179] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.972442] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.980133] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.987762] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.997009] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 205.006805] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 205.015563] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.023956] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.031463] Exception stack(0xc212df48 to 0xc212df90) [ 205.036560] df40: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 205.044769] df60: c1904d5c c212c000 00000000 00000000 c212c000 c1904d74 0000d272 c212df98 [ 205.052978] df80: c0331648 c0309478 60000013 ffffffff [ 205.058074] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.065490] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 205.073638] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 205.081420] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.089019] [<c037b63c>] (cpu_startup_entry) from [<8030202c>] (0x8030202c) [ 205.096038] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4187997 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.768249] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 configure ipconfig: no devices to configure ipconfig: no devi[ 204.780181] CPU: 1 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 ces to configure ipconfig: no devices to configure ipconfig: n[ 204.793548] Hardware name: Generic DRA74X (Flattened Device Tree) o devices to configure ipconfig: no devices to configure /init[ 204.805267] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) : 384: .: Can't open /run/net-*.conf [ 204.818603] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.829162] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 204.836181] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 204.842926] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 204.850097] [<c034c2d4>] (do_group_exit) from [<b6fc6010>] (0xb6fc6010) [ 204.856719] CPU0: stopping [ 204.859466] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 204.867675] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.873809] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.881591] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.888854] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.896545] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.904144] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.913421] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 204.923217] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 204.931945] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 204.940338] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 204.947845] Exception stack(0xc1901f08 to 0xc1901f50) [ 204.952941] 1f00: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 204.961151] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000f466 c1901f58 [ 204.969360] 1f40: c0331648 c0309478 60000013 ffffffff [ 204.974426] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 204.981872] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 204.989990] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 204.997772] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.005401] [<c037b63c>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.013610] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4187994 Error: No match for error type 'Job', message 'ipconfig: no devices [ 206.974395] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 206.986022] CPU: 0 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 206.993804] Hardware name: Generic DRA74X (Flattened Device Tree) [ 206.999938] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 207.007720] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 207.014984] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 207.022003] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 207.028747] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 207.035919] [<c034c2d4>] (do_group_exit) from [<b6eeb010>] (0xb6eeb010) [ 207.042572] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4187987 Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 1 (1.25%) IDs: x15-01: 4187972 Error: No match for error type 'Job', message 'ipconfig: no devices [ 204.945648] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 204.955657] CPU: 1 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 vices to configure ipconfig: no devices to configure ipconfig:[ 204.968994] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 204.980712] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 204.994079] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 205.004791] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 205.011810] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 205.018554] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 205.025726] [<c034c2d4>] (do_group_exit) from [<b6f81010>] (0xb6f81010) [ 205.032348] CPU0: stopping [ 205.035095] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 205.043304] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.049438] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.057220] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 205.064483] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.072174] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.079772] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.089050] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 205.098846] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 205.107574] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.115966] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.123474] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.128570] 1f00: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 205.136779] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000d2f6 c1901f58 [ 205.144989] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.150085] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.157501] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 205.165649] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 205.173431] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.181030] [<c037b63c>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.189239] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4187932 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.900909] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 configure ipconfig: no devices to configure ipconfig: no devi[ 204.912780] CPU: 1 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 ces to configure ipconfig: no devices to configure ipconfig: n[ 204.926116] Hardware name: Generic DRA74X (Flattened Device Tree) o devices to configure ipconfig: no devices to configure /init[ 204.937835] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) : 384: .: Can't open /run/net-*.conf [ 204.951202] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.961761] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 204.968749] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 204.975494] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 204.982666] [<c034c2d4>] (do_group_exit) from [<b6fc8010>] (0xb6fc8010) [ 204.989318] CPU0: stopping [ 204.992034] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 205.000244] Hardware name: Generic DRA74X (Flattened Device Tree) [ 205.006378] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 205.014160] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 205.021423] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 205.029113] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 205.036743] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.045989] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 205.055786] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 205.064544] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.072937] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.080444] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.085510] 1f00: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 205.093719] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000f012 c1901f58 [ 205.101959] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.107025] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.114471] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 205.122589] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 205.130371] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.137969] [<c037b63c>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.146209] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4187924 Error: No match for error type 'Job', message 'ipconfig: no devices [ 204.858245] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 to configure ipconfig: no devices to configure ipconfig: no de[ 204.869903] CPU: 1 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 vices to configure ipconfig: no devices to configure ipconfig:[ 204.883270] Hardware name: Generic DRA74X (Flattened Device Tree) no devices to configure ipconfig: no devices to configure /in[ 204.894989] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) it: 384: .: Can't open /run/net-*.conf [ 204.908325] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.919067] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 204.926086] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 204.932800] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 204.939971] [<c034c2d4>] (do_group_exit) from [<b6fbd010>] (0xb6fbd010) [ 204.946624] CPU0: stopping [ 204.949340] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 204.957580] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.963684] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.971496] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.978729] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.986450] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.994049] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 205.003326] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 205.013092] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 205.021850] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.030242] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.037750] Exception stack(0xc1901f08 to 0xc1901f50) [ 205.042816] 1f00: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 205.051055] 1f20: c1904d5c c1900000 00000000 00000000 c1900000 c1904d74 0000df6e c1901f58 [ 205.059265] 1f40: c0331648 c0309478 60000013 ffffffff [ 205.064331] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.071777] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 205.079895] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 205.087677] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.095306] [<c037b63c>] (cpu_startup_entry) from [<c170101c>] (start_kernel+0x52c/0x564) [ 205.103515] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4187879 Error: No match for error type 'Job', message 'login-action timed out after 272 seconds' Count: 2 (2.50%) IDs: x15-01: 4187475 4187814 Error: No match for error type 'Job', message 'ipconfig: no devices to[ 204.869812] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 [ 204.881683] CPU: 0 PID: 1 Comm: init Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 204.889465] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.895599] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.903381] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.910644] [<c0ffb964>] (dump_stack) from [<c0ff77a4>] (panic+0x124/0x334) [ 204.917663] [<c0ff77a4>] (panic) from [<c034b304>] (do_exit+0x944/0x97c) [ 204.924407] [<c034b304>] (do_exit) from [<c034c2d4>] (do_group_exit+0x0/0xb8) [ 204.931579] [<c034c2d4>] (do_group_exit) from [<b6f46010>] (0xb6f46010) [ 204.938232] CPU1: stopping [ 204.940948] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 5.10.241-rc1-00193-g63bb04ac0c30 #1 [ 204.949157] Hardware name: Generic DRA74X (Flattened Device Tree) [ 204.955291] [<c0311f98>] (unwind_backtrace) from [<c030cb50>] (show_stack+0x10/0x14) [ 204.963073] [<c030cb50>] (show_stack) from [<c0ffb964>] (dump_stack+0xbc/0xd0) [ 204.970336] [<c0ffb964>] (dump_stack) from [<c030fd64>] (do_handle_IPI+0x2f8/0x334) [ 204.978057] [<c030fd64>] (do_handle_IPI) from [<c030fdb8>] (ipi_handler+0x18/0x20) [ 204.985656] [<c030fdb8>] (ipi_handler) from [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi+0x7c/0x144) [ 204.994934] [<c03a8f30>] (handle_percpu_devid_fasteoi_ipi) from [<c03a2238>] (generic_handle_irq+0x48/0x94) [ 205.004730] [<c03a2238>] (generic_handle_irq) from [<c03a2908>] (__handle_domain_irq+0x5c/0xb0) [ 205.013458] [<c03a2908>] (__handle_domain_irq) from [<c0301774>] (gic_handle_irq+0x94/0xb4) [ 205.021850] [<c0301774>] (gic_handle_irq) from [<c0300bcc>] (__irq_svc+0x6c/0x90) [ 205.029388] Exception stack(0xc212df48 to 0xc212df90) [ 205.034454] df40: c1b21480 00000000 fe600000 00000000 c1b21a20 c1904d18 [ 205.042694] df60: c1904d5c c212c000 00000000 00000000 c212c000 c1904d74 0000b8b2 c212df98 [ 205.050903] df80: c0331648 c0309478 60000013 ffffffff [ 205.055969] [<c0300bcc>] (__irq_svc) from [<c0309478>] (arch_cpu_idle+0x20/0x3c) [ 205.063415] [<c0309478>] (arch_cpu_idle) from [<c1010f4c>] (default_idle_call+0x34/0xf4) [ 205.071563] [<c1010f4c>] (default_idle_call) from [<c037b2e0>] (do_idle+0x24c/0x2ec) [ 205.079345] [<c037b2e0>] (do_idle) from [<c037b63c>] (cpu_startup_entry+0x18/0x1c) [ 205.086944] [<c037b63c>] (cpu_startup_entry) from [<8030202c>] (0x8030202c) [ 205.093933] ---[ end Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000200 ]---' Count: 1 (1.25%) IDs: x15-01: 4187787 Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

next-20250721 arm64 16K and 64K page size WARNING fs fuse file.c at fuse_iomap_writeback_range

by Naresh Kamboju

Regressions found while running LTP msync04 tests on qemu-arm64 running Linux next-20250721, next-20250722 and next-20250723 with 16K and 64K page size enabled builds. CONFIG_ARM64_64K_PAGES=y ( kernel warning as below ) CONFIG_ARM64_16K_PAGES=y ( kernel warning as below ) No warning noticed with 4K page size. CONFIG_ARM64_4K_PAGES=y works as expected First seen on the tag next-20250721. Good: next-20250718 Bad: next-20250721 to next-20250723 Regression Analysis: - New regression? Yes - Reproducibility? Yes Test regression: next-20250721 arm64 16K and 64K page size WARNING fs fuse file.c at fuse_iomap_writeback_range Reported-by: Linux Kernel Functional Testing <lkft(a)linaro.org> ## Test log ------------[ cut here ]------------ [ 343.828105] WARNING: fs/fuse/file.c:2146 at fuse_iomap_writeback_range+0x478/0x558 [fuse], CPU#0: msync04/4190 [ 343.830969] Modules linked in: btrfs blake2b_generic xor xor_neon raid6_pq zstd_compress sm3_ce sha3_ce drm fuse backlight ip_tables x_tables [ 343.833830] CPU: 0 UID: 0 PID: 4190 Comm: msync04 Not tainted 6.16.0-rc7-next-20250723 #1 PREEMPT [ 343.834736] Hardware name: linux,dummy-virt (DT) [ 343.835788] pstate: 03402009 (nzcv daif +PAN -UAO +TCO +DIT -SSBS BTYPE=--) [ 343.836455] pc : fuse_iomap_writeback_range+0x478/0x558 fuse [ 343.837294] lr : iomap_writeback_folio (fs/iomap/buffered-io.c:1586 fs/iomap/buffered-io.c:1710) [ 343.838178] sp : ffff80008b26f8d0 [ 343.838668] x29: ffff80008b26f8d0 x28: fff00000e7f8c800 x27: 0000000000000000 [ 343.839391] x26: fff00000d4b30000 x25: 0000000000000000 x24: 0000000000000000 [ 343.840305] x23: 0000000000000000 x22: fffffc1fc0334200 x21: 0000000000001000 [ 343.840928] x20: ffff80008b26fa00 x19: 0000000000000000 x18: 0000000000000000 [ 343.841782] x17: 0000000000000000 x16: ffffb8d3b90c67c8 x15: 0000000000000000 [ 343.842565] x14: ffffb8d3ba91e340 x13: 0000ffff8ff3ffff x12: 0000000000000000 [ 343.843002] x11: 1ffe000004b74a21 x10: fff0000025ba510c x9 : ffffb8d3b90c6308 [ 343.843962] x8 : ffff80008b26f788 x7 : ffffb8d365830b90 x6 : ffffb8d3bb6c9000 [ 343.844718] x5 : 0000000000000000 x4 : 000000000000000a x3 : 0000000000001000 [ 343.845333] x2 : fff00000c0b5ecc0 x1 : 000000000000ffff x0 : 0bfffe000000400b [ 343.846323] Call trace: [ 343.846767] fuse_iomap_writeback_range+0x478/0x558 fuse (P) [ 343.847288] iomap_writeback_folio (fs/iomap/buffered-io.c:1586 fs/iomap/buffered-io.c:1710) [ 343.847930] iomap_writepages (fs/iomap/buffered-io.c:1762) [ 343.848494] fuse_writepages+0xa0/0xe8 fuse [ 343.849112] do_writepages (mm/page-writeback.c:2634) [ 343.849614] filemap_fdatawrite_wbc (mm/filemap.c:386 mm/filemap.c:376) [ 343.850202] __filemap_fdatawrite_range (mm/filemap.c:420) [ 343.850791] file_write_and_wait_range (mm/filemap.c:794) [ 343.851108] fuse_fsync+0x6c/0x138 fuse [ 343.851688] vfs_fsync_range (fs/sync.c:188) [ 343.852002] __arm64_sys_msync (mm/msync.c:96 mm/msync.c:32 mm/msync.c:32) [ 343.852197] invoke_syscall.constprop.0 (arch/arm64/include/asm/syscall.h:61 arch/arm64/kernel/syscall.c:54) [ 343.852914] do_el0_svc (include/linux/thread_info.h:135 (discriminator 2) arch/arm64/kernel/syscall.c:140 (discriminator 2) arch/arm64/kernel/syscall.c:151 (discriminator 2)) [ 343.853389] el0_svc (arch/arm64/include/asm/irqflags.h:82 (discriminator 1) arch/arm64/include/asm/irqflags.h:123 (discriminator 1) arch/arm64/include/asm/irqflags.h:136 (discriminator 1) arch/arm64/kernel/entry-common.c:169 (discriminator 1) arch/arm64/kernel/entry-common.c:182 (discriminator 1) arch/arm64/kernel/entry-common.c:880 (discriminator 1)) [ 343.853829] el0t_64_sync_handler (arch/arm64/kernel/entry-common.c:899) [ 343.854350] el0t_64_sync (arch/arm64/kernel/entry.S:596) [ 343.854652] ---[ end trace 0000000000000000 ]--- ## Source * Git tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git * Project: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250723/ * Git sha: a933d3dc1968fcfb0ab72879ec304b1971ed1b9a * Git describe: 6.16.0-rc7-next-20250723 * kernel version: next-20250723 * Architectures: arm64 * Toolchains: gcc-13 * Kconfigs: defconfig + CONFIG_ARM64_64K_PAGES=y * Kconfigs: defconfig + CONFIG_ARM64_16K_PAGES=y ## Test * Test log 1: https://qa-reports.linaro.org/api/testruns/29227309/log_file/ * Test log 2: https://qa-reports.linaro.org/api/testruns/29227074/log_file/ * Test run: https://regressions.linaro.org/lkft/linux-next-master/next-20250723/testrun… * Test history: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250723/te… * Test plan: https://tuxapi.tuxsuite.com/v1/groups/linaro/projects/lkft/tests/30G3hpJVVd… * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/30G3dvSFyHHQ3E8CvKH7… * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/30G3dvSFyHHQ3E8CvKH7… -- Linaro LKFT https://lkft.linaro.org

1 year, 2 months

Daily cts/vts report for lkft - 2025-Aug-12

by lava＠validation.linaro.org

Total jobs: 167 Total errors: 80 (47.90%) LAVA errors: 0 (0.00%) Test errors: 65 (38.92%) Job errors: 6 (3.59%) Infra errors: 9 (5.39%) Canceled jobs: 0 (0.00%) Device type: dragonboard-845c Total jobs: 82 Total errors: 28 (34.15%) Error type: Job Error count: 4 (4.88%) Error: No match for error type 'Job', message 'login-action timed out after 867 seconds' Count: 2 (2.44%) IDs: db845c-03: 8391532 db845c-10: 8391056 Error: No match for error type 'Job', message 'login-action timed out after 858 seconds' Count: 1 (1.22%) IDs: db845c-06: 8391507 Error: No match for error type 'Job', message 'login-action timed out after 865 seconds' Count: 1 (1.22%) IDs: db845c-05: 8391469 Error type: Test Error count: 24 (29.27%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 10 (12.20%) IDs: db845c-03: 8391052 8391093 db845c-04: 8391106 db845c-06: 8391166 8391355 8391517 db845c-09: 8391086 8391315 db845c-10: 8391055 8391354 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 597 seconds' Count: 1 (1.22%) IDs: db845c-05: 8391356 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 596 seconds' Count: 2 (2.44%) IDs: db845c-10: 8387537 8391322 Error: Device NOT found! Count: 5 (6.10%) IDs: db845c-02: 8391301 db845c-04: 8391151 db845c-05: 8391119 db845c-06: 8391148 db845c-10: 8391054 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 593 seconds' Count: 1 (1.22%) IDs: db845c-04: 8391186 Error: No match for error type 'Test', message 'tradefed - adb device lost[a6622a22]' Count: 3 (3.66%) IDs: db845c-09: 8387544 8391049 8391180 Error: No match for error type 'Test', message 'tradefed - adb device lost[d9b7d9b]' Count: 1 (1.22%) IDs: db845c-05: 8391154 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 1 (1.22%) IDs: db845c-02: 8387534 Device type: qrb5165-rb5 Total jobs: 48 Total errors: 29 (60.42%) Error type: Test Error count: 20 (41.67%) Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 5 (10.42%) IDs: rb5-01: 8391441 8391447 8391453 rb5-03: 8391439 rb5-07: 8391443 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 897 seconds' Count: 1 (2.08%) IDs: rb5-07: 8391450 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 8 (16.67%) IDs: rb5-01: 8391177 8391416 rb5-03: 8391097 8391145 8391444 rb5-07: 8391176 8391348 8391418 Error: Device NOT found! Count: 2 (4.17%) IDs: rb5-01: 8391242 rb5-07: 8391422 Error: No match for error type 'Test', message 'tradefed - adb device lost[93dcfd96]' Count: 2 (4.17%) IDs: rb5-01: 8391125 8391143 Error: No match for error type 'Test', message 'tradefed - adb device lost[d8a1879f]' Count: 1 (2.08%) IDs: rb5-07: 8391133 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 1 (2.08%) IDs: rb5-03: 8391069 Error type: Infrastructure Error count: 9 (18.75%) Error: Connection closed Count: 9 (18.75%) IDs: rb5-01: 8391175 8391258 8391279 8391303 8391323 8391383 8391389 8391415 8391421 Device type: sm8550-hdk Total jobs: 12 Total errors: 3 (25.00%) Error type: Test Error count: 3 (25.00%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 1 (8.33%) IDs: sm8550-hdk-01: 8391426 Error: No match for error type 'Test', message 'tradefed - adb device lost[124d1c34]' Count: 2 (16.67%) IDs: sm8550-hdk-01: 8391188 8391244 Device type: hi960-hikey Total jobs: 5 Total errors: 3 (60.00%) Error type: Test Error count: 3 (60.00%) Error: Device NOT found! Count: 2 (40.00%) IDs: hi960-hikey-02: 8391087 8391257 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 1 (20.00%) IDs: hi960-hikey-05: 8391235 Device type: hi6220-hikey-r2 Total jobs: 20 Total errors: 17 (85.00%) Error type: Test Error count: 15 (75.00%) Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 7 (35.00%) IDs: hikey-6220-r2-01: 8391210 8391238 hikey-6220-r2-05: 8391223 8391234 hikey-6220-r2-06: 8391076 8391219 8391237 Error: Device NOT found! Count: 4 (20.00%) IDs: hikey-6220-r2-01: 8391222 hikey-6220-r2-03: 8391197 hikey-6220-r2-04: 8391196 hikey-6220-r2-06: 8391201 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 2 (10.00%) IDs: hikey-6220-r2-01: 8391074 hikey-6220-r2-05: 8391195 Error: No match for error type 'Test', message 'tradefed - adb device lost[4595FE84003F72FC]' Count: 1 (5.00%) IDs: hikey-6220-r2-04: 8391080 Error: No match for error type 'Test', message 'tradefed - adb device lost[235D989C003B0752]' Count: 1 (5.00%) IDs: hikey-6220-r2-03: 8391075 Error type: Job Error count: 2 (10.00%) Error: No match for error type 'Job', message 'login-action timed out after 878 seconds' Count: 1 (5.00%) IDs: hikey-6220-r2-05: 8391085 Error: No match for error type 'Job', message 'login-action timed out after 879 seconds' Count: 1 (5.00%) IDs: hikey-6220-r2-02: 8391084

1 year, 2 months

Daily report for validation - 2025-Aug-12

by lava＠validation.linaro.org

Total jobs: 741 Total errors: 398 (53.71%) LAVA errors: 5 (0.67%) Test errors: 0 (0.00%) Job errors: 101 (13.63%) Infra errors: 292 (39.41%) Canceled jobs: 0 (0.00%) Device type: beaglebone-black Total jobs: 361 Total errors: 187 (51.80%) Error type: Infrastructure Error count: 171 (47.37%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 32 (8.86%) IDs: beaglebone-black03: 4186344 4186417 4186424 4186428 4186479 4186482 4186493 4186504 4186560 4186563 4186575 4186606 4186629 4186665 4186683 4186700 4186712 4186715 4186747 4186755 4186758 4186773 4186860 4186887 4186897 4186911 4186928 4187185 4187208 4187277 4187289 4187300 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 11 (3.05%) IDs: beaglebone-black03: 4186475 4186644 4186670 4186736 4186910 4186982 4187007 4187186 4187272 4187275 4187296 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 80 (22.16%) IDs: beaglebone-black03: 4186329 4186333 4186349 4186371 4186380 4186385 4186390 4186394 4186403 4186408 4186433 4186436 4186447 4186464 4186468 4186487 4186490 4186507 4186517 4186520 4186527 4186530 4186532 4186540 4186545 4186571 4186579 4186583 4186594 4186598 4186602 4186613 4186618 4186621 4186657 4186673 4186690 4186701 4186705 4186708 4186719 4186728 4186732 4186762 4186783 4186795 4186799 4186802 4186810 4186814 4186828 4186840 4186844 4186849 4186856 4186864 4186872 4186875 4186878 4186885 4186919 4186922 4186932 4186938 4186943 4186949 4186967 4186970 4186986 4186991 4186998 4187012 4187020 4187178 4187198 4187201 4187205 4187281 4187283 4187292 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 16 (4.43%) IDs: beaglebone-black03: 4186359 4186362 4186471 4186496 4186500 4186651 4186678 4186739 4186786 4186808 4186832 4186925 4186974 4186994 4187191 4187195 Error: matched a bootloader error message Count: 3 (0.83%) IDs: beaglebone-black03: 4186536 4186631 4187006 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 16 (4.43%) IDs: beaglebone-black03: 4186354 4186367 4186376 4186397 4186421 4186451 4186456 4186523 4186549 4186553 4186610 4186686 4186723 4186776 4186953 4186963 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 12 (3.32%) IDs: beaglebone-black03: 4186440 4186443 4186460 4186567 4186587 4186591 4186632 4186647 4186743 4186823 4186936 4186948 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 163 seconds' Count: 1 (0.28%) IDs: beaglebone-black03: 4186848 Error type: Bug Error count: 5 (1.39%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 5 (1.39%) IDs: beaglebone-black03: 4186557 4186868 4186978 4187002 4187016 Error type: Job Error count: 11 (3.05%) Error: wait for prompt timed out Count: 11 (3.05%) IDs: beaglebone-black03: 4186338 4186413 4186511 4186625 4186639 4186661 4186754 4186818 4186835 4186896 4186915 Device type: bcm2837-rpi-3-b-32 Total jobs: 321 Total errors: 192 (59.81%) Error type: Job Error count: 71 (22.12%) Error: wait for prompt timed out Count: 71 (22.12%) IDs: rpi3-b-32-03: 4186477 4186480 4186484 4186485 4186494 4186509 4186513 4186515 4186519 4186531 4186534 4186558 4186561 4186565 4186577 4186589 4186614 4186619 4186627 4186630 4186655 4186675 4186679 4186681 4186696 4186710 4186721 4186745 4186779 4186803 4186806 4186811 4186826 4186830 4186858 4186876 4186879 4186881 4186895 4186923 4186965 4186972 4186976 4186983 4186988 4186992 4186996 4187005 4187014 4187017 4187021 4187023 4187038 4187053 4187056 4187059 4187060 4187065 4187073 4187082 4187089 4187102 4187112 4187122 4187193 4187203 4187231 4187287 4187306 4187309 4187314 Error type: Infrastructure Error count: 121 (37.69%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 120 (37.38%) IDs: rpi3-b-32-03: 4186489 4186491 4186497 4186498 4186502 4186505 4186521 4186524 4186525 4186528 4186538 4186541 4186543 4186547 4186551 4186555 4186564 4186569 4186573 4186581 4186584 4186585 4186593 4186596 4186600 4186604 4186608 4186611 4186616 4186623 4186634 4186637 4186642 4186645 4186649 4186653 4186659 4186663 4186668 4186671 4186688 4186703 4186706 4186713 4186717 4186724 4186726 4186730 4186738 4186741 4186750 4186757 4186771 4186792 4186796 4186816 4186819 4186821 4186833 4186836 4186838 4186842 4186847 4186851 4186854 4186862 4186866 4186870 4186873 4186903 4186917 4186930 4186933 4186935 4186940 4186947 4186955 4186968 4186980 4186984 4186999 4187000 4187003 4187010 4187027 4187031 4187035 4187042 4187046 4187050 4187063 4187069 4187077 4187079 4187086 4187091 4187094 4187098 4187106 4187109 4187115 4187119 4187125 4187128 4187129 4187182 4187196 4187206 4187213 4187217 4187219 4187223 4187227 4187276 4187285 4187290 4187294 4187298 4187302 4187311 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 34 seconds' Count: 1 (0.31%) IDs: rpi3-b-32-03: 4186734 Device type: x15 Total jobs: 34 Total errors: 9 (26.47%) Error type: Job Error count: 9 (26.47%) Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 2 (5.88%) IDs: x15-01: 4186921 4186945 Error: No match for error type 'Job', message 'login-action timed out after 275 seconds' Count: 5 (14.71%) IDs: x15-01: 4186774 4186777 4186784 4186793 4186899 Error: No match for error type 'Job', message 'login-action timed out after 273 seconds' Count: 2 (5.88%) IDs: x15-01: 4186760 4186800 Device type: dragonboard-410c Total jobs: 11 Total errors: 10 (90.91%) Error type: Job Error count: 10 (90.91%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 10 (90.91%) IDs: dragonboard-410c-01: 4186694 4186767 4186787 4186888 4186907 4186920 4186958 4187175 4187189 4187269 Device type: dragonboard-845c Total jobs: 12 Total errors: 0 (0.00%) Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

next-20250729: PREEMPT_RT: rock Pi 4b Internal error Oops kmem_cache_alloc_bulk_noprof - kernel locking rtmutex.c at __rt_mutex_slowlock_locked

by Naresh Kamboju

Regressions found while validating Linux next on the Radxa Rock Pi 4B platform, we observed kernel crashes and deadlock warnings when running LTP syscall and controller tests under specific PREEMPT_RT configurations. These issues appear to be regressions introduced in next-20250729. * CONFIG_EXPERT=y * CONFIG_PREEMPT_RT=y * CONFIG_LAZY_PREEMPT=y Regression Analysis: - New regression? Yes - Reproducibility? Intermittent First seen on the next-20250729 Good: next-20250728 Bad: next-20250729 and next-20250801 Test regression: next-20250729 rock Pi 4b Internal error Oops kmem_cache_alloc_bulk_noprof Test regression: next-20250729 rock Pi 4b WARNING kernel locking rtmutex.c at __rt_mutex_slowlock_locked Test regression: next-20250729 rock Pi 4b WARNING kernel rcu tree_plugin.h at rcu_note_context_switch Reported-by: Linux Kernel Functional Testing <lkft(a)linaro.org> ## Test log [ 527.570253] Unable to handle kernel paging request at virtual address 003f0020f94020a1 [ 527.570274] Mem abort info: [ 527.570277] ESR = 0x0000000096000004 [ 527.570282] EC = 0x25: DABT (current EL), IL = 32 bits [ 527.570288] SET = 0, FnV = 0 [ 527.570292] EA = 0, S1PTW = 0 [ 527.570297] FSC = 0x04: level 0 translation fault [ 527.570302] Data abort info: [ 527.570305] ISV = 0, ISS = 0x00000004, ISS2 = 0x00000000 [ 527.570310] CM = 0, WnR = 0, TnD = 0, TagAccess = 0 [ 527.570316] GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0 [ 527.570322] [003f0020f94020a1] address between user and kernel address ranges [ 527.570330] Internal error: Oops: 0000000096000004 [#1] SMP [ 527.570336] Modules linked in: brcmfmac rockchip_dfi brcmutil cfg80211 snd_soc_hdmi_codec dw_hdmi_i2s_audio dw_hdmi_cec snd_soc_simple_card snd_soc_audio_graph_card hci_uart snd_soc_rockchip_i2s snd_soc_es8316 snd_soc_spdif_tx snd_soc_simple_card_utils btqca rtc_rk808 rockchipdrm btbcm snd_soc_core dw_hdmi_qp bluetooth snd_compress reset_gpio analogix_dp snd_pcm_dmaengine panfrost hantro_vpu dw_mipi_dsi rfkill rockchip_rga drm_shmem_helper drm_dp_aux_bus snd_pcm gpu_sched dw_hdmi pwrseq_core videobuf2_dma_sg v4l2_vp9 snd_timer drm_display_helper v4l2_h264 v4l2_jpeg phy_rockchip_pcie snd v4l2_mem2mem cec videobuf2_dma_contig soundcore videobuf2_memops drm_client_lib videobuf2_v4l2 drm_dma_helper videobuf2_common rockchip_saradc drm_kms_helper industrialio_triggered_buffer kfifo_buf rockchip_thermal pcie_rockchip_host coresight_cpu_debug fuse drm backlight [ 527.570493] CPU: 3 UID: 0 PID: 34254 Comm: mkdir Not tainted 6.16.0-next-20250801 #1 PREEMPT_RT [ 527.570502] Hardware name: Radxa ROCK Pi 4B (DT) [ 527.570506] pstate: 20000005 (nzCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 527.570512] pc : kmem_cache_alloc_bulk_noprof (mm/slub.c:5343 (discriminator 1) mm/slub.c:5403 (discriminator 1)) [ 527.570527] lr : kmem_cache_alloc_bulk_noprof (include/linux/atomic/atomic-arch-fallback.h:457 include/linux/atomic/atomic-instrumented.h:33 include/linux/kfence.h:127 mm/slub.c:5307 mm/slub.c:5403) [ 527.570533] sp : ffff80008e24b8f0 [ 527.570536] x29: ffff80008e24b930 x28: 00ff000000584610 x27: ffff800082b30538 [ 527.570545] x26: ffff8000816b64dc x25: 0000000000000cc0 x24: 0000000000000000 [ 527.570554] x23: 0000000000000004 x22: ffff0000f7579d20 x21: 0000000000000001 [ 527.570563] x20: 0000000000000001 x19: ffff000000405b00 x18: ffff80008e24bcd0 [ 527.570572] x17: 0000000000000000 x16: ffff800081e18420 x15: 0000ffffa2670fff [ 527.570582] x14: 0000000000000000 x13: 1fffe000017942e1 x12: 0000ffffa2470fff [ 527.570591] x11: ffff00000bca1708 x10: 0000000000000001 x9 : ffff8000816e41a4 [ 527.570600] x8 : ffff80008e24b850 x7 : fefefefefefefefe x6 : ffff800082b30000 [ 527.570608] x5 : d63f0020f9402021 x4 : ffff0000f7579d58 x3 : 0000000000000000 [ 527.570617] x2 : 0000000000000000 x1 : 0000000000000100 x0 : 0000000000000080 [ 527.570627] Call trace: [ 527.570631] kmem_cache_alloc_bulk_noprof (mm/slub.c:5343 (discriminator 1) mm/slub.c:5403 (discriminator 1)) (P) [ 527.570639] mas_alloc_nodes (lib/maple_tree.c:1278) [ 527.570651] mas_node_count_gfp (lib/maple_tree.c:1339) [ 527.570661] mas_preallocate (lib/maple_tree.c:5538 (discriminator 1)) [ 527.570667] __split_vma (mm/vma.c:528 (discriminator 1)) [ 527.570677] vma_modify (mm/vma.c:1633) [ 527.570685] vma_modify_flags (mm/vma.c:1650) [ 527.570694] mprotect_fixup (mm/mprotect.c:819) [ 527.570704] do_mprotect_pkey (mm/mprotect.c:993) [ 527.570713] __arm64_sys_mprotect (mm/mprotect.c:1011) [ 527.570722] invoke_syscall (arch/arm64/include/asm/current.h:19 arch/arm64/kernel/syscall.c:54) [ 527.570731] el0_svc_common.constprop.0 (include/linux/thread_info.h:135 (discriminator 2) arch/arm64/kernel/syscall.c:140 (discriminator 2)) [ 527.570737] do_el0_svc (arch/arm64/kernel/syscall.c:152) [ 527.570744] el0_svc (arch/arm64/include/asm/irqflags.h:82 (discriminator 1) arch/arm64/include/asm/irqflags.h:123 (discriminator 1) arch/arm64/include/asm/irqflags.h:136 (discriminator 1) arch/arm64/kernel/entry-common.c:169 (discriminator 1) arch/arm64/kernel/entry-common.c:182 (discriminator 1) arch/arm64/kernel/entry-common.c:880 (discriminator 1)) [ 527.570752] el0t_64_sync_handler (arch/arm64/kernel/entry-common.c:899) [ 527.570760] el0t_64_sync (arch/arm64/kernel/entry.S:596) [ 527.570772] Code: 1400000c f94002c5 b4000aa5 b9402a60 (f86068a0) All code ======== 0: 1400000c b 0x30 4: f94002c5 ldr x5, [x22] 8: b4000aa5 cbz x5, 0x15c c: b9402a60 ldr w0, [x19, #40] 10:* f86068a0 ldr x0, [x5, x0] <-- trapping instruction Code starting with the faulting instruction =========================================== 0: f86068a0 ldr x0, [x5, x0] [ 527.570778] ---[ end trace 0000000000000000 ]--- [ 527.570800] ------------[ cut here ]------------ [ 527.570803] rtmutex deadlock detected [ 527.570827] WARNING: kernel/locking/rtmutex.c:1674 at __rt_mutex_slowlock_locked.constprop.0+0x800/0x8e0, CPU#3: mkdir/34254 [ 527.570841] Modules linked in: brcmfmac rockchip_dfi brcmutil cfg80211 snd_soc_hdmi_codec dw_hdmi_i2s_audio dw_hdmi_cec snd_soc_simple_card snd_soc_audio_graph_card hci_uart snd_soc_rockchip_i2s snd_soc_es8316 snd_soc_spdif_tx snd_soc_simple_card_utils btqca rtc_rk808 rockchipdrm btbcm snd_soc_core dw_hdmi_qp bluetooth snd_compress reset_gpio analogix_dp snd_pcm_dmaengine panfrost hantro_vpu dw_mipi_dsi rfkill rockchip_rga drm_shmem_helper drm_dp_aux_bus snd_pcm gpu_sched dw_hdmi pwrseq_core videobuf2_dma_sg v4l2_vp9 snd_timer drm_display_helper v4l2_h264 v4l2_jpeg phy_rockchip_pcie snd v4l2_mem2mem cec videobuf2_dma_contig soundcore videobuf2_memops drm_client_lib videobuf2_v4l2 drm_dma_helper videobuf2_common rockchip_saradc drm_kms_helper industrialio_triggered_buffer kfifo_buf rockchip_thermal pcie_rockchip_host coresight_cpu_debug fuse drm backlight [ 527.570965] CPU: 3 UID: 0 PID: 34254 Comm: mkdir Tainted: G D 6.16.0-next-20250801 #1 PREEMPT_RT [ 527.570973] Tainted: [D]=DIE [ 527.570976] Hardware name: Radxa ROCK Pi 4B (DT) [ 527.570979] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 527.570985] pc : __rt_mutex_slowlock_locked.constprop.0 (kernel/locking/rtmutex.c:1674 (discriminator 1) kernel/locking/rtmutex.c:1734 (discriminator 1) kernel/locking/rtmutex.c:1760 (discriminator 1)) [ 527.570993] lr : __rt_mutex_slowlock_locked.constprop.0 (kernel/locking/rtmutex.c:1674 (discriminator 1) kernel/locking/rtmutex.c:1734 (discriminator 1) kernel/locking/rtmutex.c:1760 (discriminator 1)) [ 527.571001] sp : ffff80008e24b2e0 [ 527.571004] x29: ffff80008e24b370 x28: ffff000007c1a600 x27: ffff000007c1a601 [ 527.571013] x26: ffff80008e24b318 x25: ffff000007c1a600 x24: 00000000ffffffdd [ 527.571023] x23: 00000000ffffffdd x22: 0000000000000001 x21: ffff000007c1a601 [ 527.571032] x20: ffff80008e24b2f0 x19: ffff00001d756e30 x18: 0000000000000000 [ 527.571041] x17: 65676e6172207373 x16: 6572646461206c65 x15: 0000000000000000 [ 527.571050] x14: 0000000000000020 x13: 0a64657463657465 x12: 64206b636f6c6461 [ 527.571059] x11: 656820747563205b x10: ffff800082adac08 x9 : ffff80008015020c [ 527.571068] x8 : ffff80008e24af08 x7 : 0000000000000001 x6 : ffff800082a5e000 [ 527.571077] x5 : ffff000007c1a600 x4 : 0000000000000000 x3 : 0000000000000027 [ 527.571086] x2 : 0000000000000000 x1 : 0000000000000000 x0 : ffff000007c1a600 [ 527.571094] Call trace: [ 527.571097] __rt_mutex_slowlock_locked.constprop.0 (kernel/locking/rtmutex.c:1674 (discriminator 1) kernel/locking/rtmutex.c:1734 (discriminator 1) kernel/locking/rtmutex.c:1760 (discriminator 1)) (P) [ 527.571107] __rwbase_read_lock (kernel/locking/rwbase_rt.c:114) [ 527.571117] down_read (kernel/locking/rwsem.c:1540) [ 527.571126] acct_collect (arch/arm64/include/asm/jump_label.h:36 include/linux/mmap_lock.h:41 include/linux/mmap_lock.h:454 kernel/acct.c:597) [ 527.571135] do_exit (kernel/exit.c:932) [ 527.571143] make_task_dead (arch/arm64/include/asm/atomic_ll_sc.h:95 (discriminator 2) arch/arm64/include/asm/atomic.h:52 (discriminator 2) include/linux/atomic/atomic-arch-fallback.h:564 (discriminator 2) include/linux/atomic/atomic-arch-fallback.h:1020 (discriminator 2) include/linux/atomic/atomic-instrumented.h:454 (discriminator 2) kernel/exit.c:1049 (discriminator 2)) [ 527.571150] die (arch/arm64/kernel/traps.c:231) [ 527.571157] die_kernel_fault (arch/arm64/mm/fault.c:313) [ 527.571167] __do_kernel_fault (arch/arm64/mm/fault.c:375 (discriminator 5)) [ 527.571177] do_bad_area (arch/arm64/mm/fault.c:482) [ 527.571186] do_translation_fault (arch/arm64/mm/fault.c:792) [ 527.571195] do_mem_abort (arch/arm64/mm/fault.c:929 (discriminator 1)) [ 527.571204] el1_abort (arch/arm64/include/asm/daifflags.h:28 arch/arm64/kernel/entry-common.c:482) [ 527.571210] el1h_64_sync_handler (arch/arm64/kernel/entry-common.c:637) [ 527.571218] el1h_64_sync (arch/arm64/kernel/entry.S:591) [ 527.571225] kmem_cache_alloc_bulk_noprof (mm/slub.c:5343 (discriminator 1) mm/slub.c:5403 (discriminator 1)) (P) [ 527.571232] mas_alloc_nodes (lib/maple_tree.c:1278) [ 527.571241] mas_node_count_gfp (lib/maple_tree.c:1339) [ 527.571251] mas_preallocate (lib/maple_tree.c:5538 (discriminator 1)) [ 527.571257] __split_vma (mm/vma.c:528 (discriminator 1)) [ 527.571265] vma_modify (mm/vma.c:1633) [ 527.571273] vma_modify_flags (mm/vma.c:1650) [ 527.571282] mprotect_fixup (mm/mprotect.c:819) [ 527.571290] do_mprotect_pkey (mm/mprotect.c:993) [ 527.571299] __arm64_sys_mprotect (mm/mprotect.c:1011) [ 527.571308] invoke_syscall (arch/arm64/include/asm/current.h:19 arch/arm64/kernel/syscall.c:54) [ 527.571314] el0_svc_common.constprop.0 (include/linux/thread_info.h:135 (discriminator 2) arch/arm64/kernel/syscall.c:140 (discriminator 2)) [ 527.571321] do_el0_svc (arch/arm64/kernel/syscall.c:152) [ 527.571327] el0_svc (arch/arm64/include/asm/irqflags.h:82 (discriminator 1) arch/arm64/include/asm/irqflags.h:123 (discriminator 1) arch/arm64/include/asm/irqflags.h:136 (discriminator 1) arch/arm64/kernel/entry-common.c:169 (discriminator 1) arch/arm64/kernel/entry-common.c:182 (discriminator 1) arch/arm64/kernel/entry-common.c:880 (discriminator 1)) [ 527.571334] el0t_64_sync_handler (arch/arm64/kernel/entry-common.c:899) [ 527.571341] el0t_64_sync (arch/arm64/kernel/entry.S:596) [ 527.571349] ---[ end trace 0000000000000000 ]--- [ 527.571354] ------------[ cut here ]------------ [ 527.571356] Voluntary context switch within RCU read-side critical section! [ 527.571372] WARNING: kernel/rcu/tree_plugin.h:332 at rcu_note_context_switch+0x4ec/0x538, CPU#3: mkdir/34254 [ 527.571383] Modules linked in: brcmfmac rockchip_dfi brcmutil cfg80211 snd_soc_hdmi_codec dw_hdmi_i2s_audio dw_hdmi_cec snd_soc_simple_card snd_soc_audio_graph_card hci_uart snd_soc_rockchip_i2s snd_soc_es8316 snd_soc_spdif_tx snd_soc_simple_card_utils btqca rtc_rk808 rockchipdrm btbcm snd_soc_core dw_hdmi_qp bluetooth snd_compress reset_gpio analogix_dp snd_pcm_dmaengine panfrost hantro_vpu dw_mipi_dsi rfkill rockchip_rga drm_shmem_helper drm_dp_aux_bus snd_pcm gpu_sched dw_hdmi pwrseq_core videobuf2_dma_sg v4l2_vp9 snd_timer drm_display_helper v4l2_h264 v4l2_jpeg phy_rockchip_pcie snd v4l2_mem2mem cec videobuf2_dma_contig soundcore videobuf2_memops drm_client_lib videobuf2_v4l2 drm_dma_helper videobuf2_common rockchip_saradc drm_kms_helper industrialio_triggered_buffer kfifo_buf rockchip_thermal pcie_rockchip_host coresight_cpu_debug fuse drm backlight [ 527.571503] CPU: 3 UID: 0 PID: 34254 Comm: mkdir Tainted: G D W 6.16.0-next-20250801 #1 PREEMPT_RT [ 527.571512] Tainted: [D]=DIE, [W]=WARN [ 527.571514] Hardware name: Radxa ROCK Pi 4B (DT) [ 527.571517] pstate: 600000c5 (nZCv daIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 527.571523] pc : rcu_note_context_switch (kernel/rcu/tree_plugin.h:332 (discriminator 1)) [ 527.571529] lr : rcu_note_context_switch (kernel/rcu/tree_plugin.h:332 (discriminator 1)) [ 527.571535] sp : ffff80008e24b1e0 [ 527.571538] x29: ffff80008e24b1e0 x28: ffff000007c1a600 x27: ffff000007c1a601 [ 527.571548] x26: 0000000000000000 x25: ffff000007c1a600 x24: ffff800082a60368 [ 527.571557] x23: 0000000000000000 x22: ffff000007c1a600 x21: ffff800083125260 [ 527.571566] x20: 0000000000000000 x19: ffff0000f7576080 x18: 0000000000000000 [ 527.571575] x17: 65676e6172207373 x16: 6572646461206c65 x15: 0000000000000000 [ 527.571583] x14: 0000000000000020 x13: 216e6f6974636573 x12: 206c616369746972 [ 527.571593] x11: 6320656469732d64 x10: 6165722055435220 x9 : ffff80008015020c [ 527.571602] x8 : 6863746977732074 x7 : 7865746e6f632079 x6 : 7261746e756c6f56 [ 527.571611] x5 : ffff80008317146f x4 : 0000000000000000 x3 : 0000000000000027 [ 527.571619] x2 : 0000000000000000 x1 : 0000000000000000 x0 : ffff000007c1a600 [ 527.571628] Call trace: [ 527.571630] rcu_note_context_switch (kernel/rcu/tree_plugin.h:332 (discriminator 1)) (P) [ 527.571638] __schedule (kernel/sched/core.c:634 kernel/sched/sched.h:1519 kernel/sched/sched.h:1841 kernel/sched/core.c:6865) [ 527.571647] rt_mutex_schedule (kernel/sched/core.c:7044 kernel/sched/core.c:7339) [ 527.571655] __rt_mutex_slowlock_locked.constprop.0 (kernel/locking/rtmutex.c:1676 kernel/locking/rtmutex.c:1734 kernel/locking/rtmutex.c:1760) [ 527.571665] __rwbase_read_lock (kernel/locking/rwbase_rt.c:114) [ 527.571674] down_read (kernel/locking/rwsem.c:1540) [ 527.571683] acct_collect (arch/arm64/include/asm/jump_label.h:36 include/linux/mmap_lock.h:41 include/linux/mmap_lock.h:454 kernel/acct.c:597) [ 527.571690] do_exit (kernel/exit.c:932) [ 527.571696] make_task_dead (arch/arm64/include/asm/atomic_ll_sc.h:95 (discriminator 2) arch/arm64/include/asm/atomic.h:52 (discriminator 2) include/linux/atomic/atomic-arch-fallback.h:564 (discriminator 2) include/linux/atomic/atomic-arch-fallback.h:1020 (discriminator 2) include/linux/atomic/atomic-instrumented.h:454 (discriminator 2) kernel/exit.c:1049 (discriminator 2)) [ 527.571703] die (arch/arm64/kernel/traps.c:231) [ 527.571710] die_kernel_fault (arch/arm64/mm/fault.c:313) [ 527.571719] __do_kernel_fault (arch/arm64/mm/fault.c:375 (discriminator 5)) [ 527.571729] do_bad_area (arch/arm64/mm/fault.c:482) [ 527.571738] do_translation_fault (arch/arm64/mm/fault.c:792) [ 527.571746] do_mem_abort (arch/arm64/mm/fault.c:929 (discriminator 1)) [ 527.571755] el1_abort (arch/arm64/include/asm/daifflags.h:28 arch/arm64/kernel/entry-common.c:482) [ 527.571761] el1h_64_sync_handler (arch/arm64/kernel/entry-common.c:637) [ 527.571769] el1h_64_sync (arch/arm64/kernel/entry.S:591) [ 527.571775] kmem_cache_alloc_bulk_noprof (mm/slub.c:5343 (discriminator 1) mm/slub.c:5403 (discriminator 1)) (P) [ 527.571782] mas_alloc_nodes (lib/maple_tree.c:1278) [ 527.571792] mas_node_count_gfp (lib/maple_tree.c:1339) [ 527.571802] mas_preallocate (lib/maple_tree.c:5538 (discriminator 1)) [ 527.571808] __split_vma (mm/vma.c:528 (discriminator 1)) [ 527.571816] vma_modify (mm/vma.c:1633) [ 527.571824] vma_modify_flags (mm/vma.c:1650) [ 527.571833] mprotect_fixup (mm/mprotect.c:819) [ 527.571842] do_mprotect_pkey (mm/mprotect.c:993) [ 527.571850] __arm64_sys_mprotect (mm/mprotect.c:1011) [ 527.571859] invoke_syscall (arch/arm64/include/asm/current.h:19 arch/arm64/kernel/syscall.c:54) [ 527.571866] el0_svc_common.constprop.0 (include/linux/thread_info.h:135 (discriminator 2) arch/arm64/kernel/syscall.c:140 (discriminator 2)) [ 527.571872] do_el0_svc (arch/arm64/kernel/syscall.c:152) [ 527.571878] el0_svc (arch/arm64/include/asm/irqflags.h:82 (discriminator 1) arch/arm64/include/asm/irqflags.h:123 (discriminator 1) arch/arm64/include/asm/irqflags.h:136 (discriminator 1) arch/arm64/kernel/entry-common.c:169 (discriminator 1) arch/arm64/kernel/entry-common.c:182 (discriminator 1) arch/arm64/kernel/entry-common.c:880 (discriminator 1)) [ 527.571885] el0t_64_sync_handler (arch/arm64/kernel/entry-common.c:899) [ 527.571893] el0t_64_sync (arch/arm64/kernel/entry.S:596) [ 527.571900] ---[ end trace 0000000000000000 ]--- [ 540.645451] sched: DL replenish lagged too much ## Source * Git tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git * Git sha: 54efec8782214652b331c50646013f8526570e8d * Git describe: next-20250729 * Project details: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250729 * Architectures: arm64 * Toolchains: gcc-13 * Kconfigs: Preempt_rt ## Test * Test log 1: https://qa-reports.linaro.org/api/testruns/29282584/log_file/ * Test log 2:https://qa-reports.linaro.org/api/testruns/29337984/log_file/ * Test lava log: https://lkft.validation.linaro.org/scheduler/job/8373114#L19186 * Test details: https://regressions.linaro.org/lkft/linux-next-master/next-20250729/log-par… * Test plan: https://tuxapi.tuxsuite.com/v1/groups/linaro/projects/lkft/tests/30XMjtCEi0… * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/30fq2ElntxgscJ13dnaD… * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/30fq2ElntxgscJ13dnaD… -- Linaro LKFT https://lkft.linaro.org

1 year, 2 months

Daily cts/vts report for lkft - 2025-Aug-11

by lava＠validation.linaro.org

Total jobs: 86 Total errors: 32 (37.21%) LAVA errors: 0 (0.00%) Test errors: 32 (37.21%) Job errors: 0 (0.00%) Infra errors: 0 (0.00%) Canceled jobs: 0 (0.00%) Device type: x86 Total jobs: 1 Total errors: 0 (0.00%) Device type: dragonboard-845c Total jobs: 85 Total errors: 32 (37.65%) Error type: Test Error count: 32 (37.65%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 14 (16.47%) IDs: db845c-02: 8379525 8381567 8387530 db845c-04: 8387527 db845c-05: 8379548 8381566 8387236 db845c-06: 8387247 db845c-09: 8379566 8387520 8387524 db845c-10: 8379541 8379567 8387535 Error: Device NOT found! Count: 9 (10.59%) IDs: db845c-02: 8379530 8385899 8386277 8387529 db845c-03: 8385910 db845c-04: 8379537 8387526 db845c-10: 8379534 8381508 Error: No match for error type 'Test', message 'tradefed - adb device lost[e875976d]' Count: 1 (1.18%) IDs: db845c-06: 8387249 Error: No match for error type 'Test', message 'tradefed - adb device lost[476f370a]' Count: 3 (3.53%) IDs: db845c-10: 8379553 8381511 8385898 Error: No match for error type 'Test', message 'tradefed - adb device lost[d9b7d9b]' Count: 1 (1.18%) IDs: db845c-05: 8379569 Error: No match for error type 'Test', message 'tradefed - adb device lost[a6622a22]' Count: 2 (2.35%) IDs: db845c-09: 8379556 8379568 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 53998 seconds' Count: 1 (1.18%) IDs: db845c-04: 8379540 Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 1 (1.18%) IDs: db845c-02: 8379538

1 year, 2 months

← Newer
1
...
5
6
7
8
9
10
11
Older →

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

Lkft-triage August 2025