Lkft-triage August 2025

lkft-triage@lists.linaro.org

43 participants
106 discussions

Daily cts/vts report for lkft - 2025-Aug-06

by lava＠validation.linaro.org

Total jobs: 215 Total errors: 90 (41.86%) LAVA errors: 0 (0.00%) Test errors: 83 (38.60%) Job errors: 2 (0.93%) Infra errors: 5 (2.33%) Canceled jobs: 0 (0.00%) Device type: dragonboard-845c Total jobs: 133 Total errors: 43 (32.33%) Error type: Test Error count: 43 (32.33%) Error: Device NOT found! Count: 10 (7.52%) IDs: db845c-02: 8382741 8383761 8384599 db845c-03: 8383758 8383771 8384719 db845c-04: 8384609 db845c-06: 8384141 db845c-09: 8384140 db845c-10: 8384747 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 24 (18.05%) IDs: db845c-02: 8383105 8383767 8384218 8384591 8384612 db845c-03: 8383124 db845c-04: 8383079 8383764 8384273 8384588 db845c-05: 8382735 8383121 8383738 8384139 8384206 db845c-06: 8383104 8384132 8384136 8384253 8384611 db845c-09: 8382702 8384116 8384217 db845c-10: 8382734 Error: No match for error type 'Test', message 'tradefed - adb device lost[a6622a22]' Count: 2 (1.50%) IDs: db845c-09: 8383118 8384578 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 2 (1.50%) IDs: db845c-02: 8382766 8384214 Error: No match for error type 'Test', message 'tradefed - adb device lost[d9b7d9b]' Count: 1 (0.75%) IDs: db845c-05: 8384144 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 584 seconds' Count: 1 (0.75%) IDs: db845c-02: 8384096 Error: No match for error type 'Test', message 'tradefed - adb device lost[f3a58ae3]' Count: 1 (0.75%) IDs: db845c-04: 8383791 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 586 seconds' Count: 1 (0.75%) IDs: db845c-03: 8383737 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 595 seconds' Count: 1 (0.75%) IDs: db845c-02: 8382758 Device type: sm8550-hdk Total jobs: 7 Total errors: 2 (28.57%) Error type: Test Error count: 2 (28.57%) Error: Device NOT found! Count: 1 (14.29%) IDs: sm8550-hdk-01: 8384664 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 1 (14.29%) IDs: sm8550-hdk-01: 8383732 Device type: qrb5165-rb5 Total jobs: 75 Total errors: 45 (60.00%) Error type: Test Error count: 38 (50.67%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 10 (13.33%) IDs: rb5-01: 8384115 8384274 8384581 rb5-03: 8383113 8384128 8384130 8384277 rb5-06: 8384112 8384172 rb5-07: 8384280 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 295 seconds' Count: 1 (1.33%) IDs: rb5-06: 8384264 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 5 (6.67%) IDs: rb5-03: 8383111 8384159 8384163 8384171 8384243 Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 17 (22.67%) IDs: rb5-01: 8382577 8382612 8384219 rb5-03: 8382579 8382583 8382609 8384233 rb5-06: 8382572 8382573 8382578 8384185 8384230 rb5-07: 8382574 8382576 8382580 8382582 8382613 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 586 seconds' Count: 1 (1.33%) IDs: rb5-06: 8384170 Error: Device NOT found! Count: 2 (2.67%) IDs: rb5-01: 8384160 rb5-03: 8384156 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 593 seconds' Count: 1 (1.33%) IDs: rb5-06: 8382611 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 599 seconds' Count: 1 (1.33%) IDs: rb5-07: 8381534 Error type: Job Error count: 2 (2.67%) Error: No match for error type 'Job', message 'Post-processing of downloads failed' Count: 2 (2.67%) IDs: rb5-01: 8384121 rb5-06: 8384123 Error type: Infrastructure Error count: 5 (6.67%) Error: Connection closed Count: 5 (6.67%) IDs: rb5-01: 8382571 8382581 8382610 8383109 8383769

1 year, 2 months

Daily report for validation - 2025-Aug-06

by lava＠validation.linaro.org

Total jobs: 458 Total errors: 232 (50.66%) LAVA errors: 9 (1.97%) Test errors: 1 (0.22%) Job errors: 30 (6.55%) Infra errors: 192 (41.92%) Canceled jobs: 0 (0.00%) Device type: beaglebone-black Total jobs: 334 Total errors: 169 (50.60%) Error type: Infrastructure Error count: 158 (47.31%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 20 (5.99%) IDs: beaglebone-black03: 4166094 4166133 4166291 4166492 4173070 4173213 4173219 4173288 4173310 4173369 4173388 4173400 4183013 4183021 4183150 4183226 4183560 4183695 4183698 4183703 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 33 (9.88%) IDs: beaglebone-black03: 4165922 4166082 4166480 4166488 4166970 4166972 4173049 4173053 4173055 4173061 4173063 4173131 4173135 4173137 4173363 4173371 4173382 4183019 4183025 4183027 4183152 4183224 4183386 4183403 4183423 4183427 4183540 4183565 4183576 4183588 4183615 4183678 4183688 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 30 (8.98%) IDs: beaglebone-black03: 4166085 4166089 4166112 4167360 4173057 4173141 4173215 4173231 4173290 4173292 4173367 4173378 4173390 4182899 4183015 4183045 4183079 4183373 4183391 4183407 4183411 4183431 4183551 4183554 4183616 4183626 4183638 4183653 4183668 4183684 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 6 (1.80%) IDs: beaglebone-black03: 4165849 4166142 4173143 4173398 4183378 4183673 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 58 (17.37%) IDs: beaglebone-black03: 4166099 4166104 4166108 4166118 4166130 4166137 4166147 4166282 4166287 4166295 4166484 4166966 4166968 4167362 4167364 4167375 4173041 4173045 4173047 4173051 4173059 4173066 4173133 4173139 4173161 4173211 4173217 4173373 4173375 4173380 4173386 4173392 4173394 4183017 4183023 4183148 4183166 4183221 4183375 4183395 4183399 4183415 4183419 4183425 4183429 4183433 4183542 4183569 4183580 4183584 4183593 4183595 4183604 4183619 4183622 4183630 4183651 4183663 Error: matched a bootloader error message Count: 2 (0.60%) IDs: beaglebone-black03: 4183263 4183587 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 9 (2.69%) IDs: beaglebone-black03: 4165838 4165932 4166126 4173043 4173384 4182959 4183154 4183160 4183572 Error type: Bug Error count: 9 (2.69%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 9 (2.69%) IDs: beaglebone-black03: 4166122 4173365 4173377 4173396 4183029 4183365 4183644 4183658 4183691 Error type: Job Error count: 2 (0.60%) Error: wait for prompt timed out Count: 2 (0.60%) IDs: beaglebone-black03: 4183228 4183634 Device type: bcm2837-rpi-3-b-32 Total jobs: 81 Total errors: 44 (54.32%) Error type: Infrastructure Error count: 33 (40.74%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 33 (40.74%) IDs: rpi3-b-32-03: 4183372 4183382 4183389 4183393 4183397 4183401 4183405 4183409 4183413 4183420 4183546 4183556 4183574 4183578 4183582 4183586 4183620 4183624 4183628 4183632 4183636 4183654 4183665 4183671 4183676 4183681 4183686 4183690 4183696 4183701 4183704 4183708 4183712 Error type: Job Error count: 11 (13.58%) Error: wait for prompt timed out Count: 11 (13.58%) IDs: rpi3-b-32-03: 4183417 4183563 4183567 4183570 4183573 4183590 4183613 4183640 4183659 4183693 4183699 Device type: x15 Total jobs: 23 Total errors: 10 (43.48%) Error type: Job Error count: 10 (43.48%) Error: No match for error type 'Job', message 'login-action timed out after 273 seconds' Count: 1 (4.35%) IDs: x15-01: 4183679 Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 8 (34.78%) IDs: x15-01: 4183548 4183550 4183557 4183558 4183655 4183661 4183666 4183674 Error: No match for error type 'Job', message 'login-action timed out after 271 seconds' Count: 1 (4.35%) IDs: x15-01: 4183669 Device type: dragonboard-410c Total jobs: 7 Total errors: 6 (85.71%) Error type: Job Error count: 6 (85.71%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 5 (71.43%) IDs: dragonboard-410c-01: 4183379 4183543 4183610 4183649 4183660 Error: Invalid job data Count: 1 (14.29%) IDs: dragonboard-410c-01: 4183368 Device type: dragonboard-845c Total jobs: 11 Total errors: 3 (27.27%) Error type: Job Error count: 1 (9.09%) Error: Invalid job data Count: 1 (9.09%) IDs: dragonboard-845c-05: 4183367 Error type: Infrastructure Error count: 1 (9.09%) Error: Connection closed Count: 1 (9.09%) IDs: dragonboard-845c-06: 4183357 Error type: Test Error count: 1 (9.09%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 1198 seconds' Count: 1 (9.09%) IDs: dragonboard-845c-05: 4183342 Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

Daily cts/vts report for lkft - 2025-Aug-05

by lava＠validation.linaro.org

Total jobs: 172 Total errors: 101 (58.72%) LAVA errors: 0 (0.00%) Test errors: 94 (54.65%) Job errors: 3 (1.74%) Infra errors: 4 (2.33%) Canceled jobs: 0 (0.00%) Device type: sm8550-hdk Total jobs: 16 Total errors: 6 (37.50%) Error type: Test Error count: 6 (37.50%) Error: No match for error type 'Test', message 'tradefed - adb device lost[124d1c34]' Count: 1 (6.25%) IDs: sm8550-hdk-01: 8383126 Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 5 (31.25%) IDs: sm8550-hdk-01: 8382585 8382586 8382587 8382588 8382589 Device type: qrb5165-rb5 Total jobs: 24 Total errors: 11 (45.83%) Error type: Test Error count: 7 (29.17%) Error: Device NOT found! Count: 2 (8.33%) IDs: rb5-01: 8383140 rb5-03: 8382088 Error: No match for error type 'Test', message 'tradefed - adb device lost[d8a1879f]' Count: 1 (4.17%) IDs: rb5-07: 8382592 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 2 (8.33%) IDs: rb5-03: 8382016 rb5-07: 8382176 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 594 seconds' Count: 1 (4.17%) IDs: rb5-03: 8382153 Error: No match for error type 'Test', message 'tradefed - adb device lost[93dcfd96]' Count: 1 (4.17%) IDs: rb5-01: 8382087 Error type: Job Error count: 2 (8.33%) Error: No match for error type 'Job', message 'login-action timed out after 876 seconds' Count: 2 (8.33%) IDs: rb5-03: 8382018 8382744 Error type: Infrastructure Error count: 2 (8.33%) Error: Connection closed Count: 2 (8.33%) IDs: rb5-01: 8382091 rb5-03: 8382017 Device type: dragonboard-845c Total jobs: 107 Total errors: 66 (61.68%) Error type: Test Error count: 64 (59.81%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 18 (16.82%) IDs: db845c-02: 8381456 8381486 db845c-04: 8381432 8382207 8383144 db845c-05: 8381441 db845c-06: 8381110 8381454 8381458 8381487 8382146 db845c-09: 8381124 8381530 db845c-10: 8381065 8381140 8381151 8381434 8382028 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 4 (3.74%) IDs: db845c-05: 8382696 db845c-06: 8381139 db845c-09: 8382664 db845c-10: 8381112 Error: No match for error type 'Test', message 'lava-test-interactive timed out after 600 seconds' Count: 24 (22.43%) IDs: db845c-02: 8382557 8382560 8382565 8382606 8382620 db845c-04: 8382568 8382616 db845c-05: 8382558 8382564 8382604 db845c-06: 8382561 8382566 8382615 8382673 db845c-09: 8382562 8382601 8382603 8382617 db845c-10: 8382556 8382559 8382563 8382605 8382619 8382621 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 2 (1.87%) IDs: db845c-02: 8381439 8382527 Error: No match for error type 'Test', message 'tradefed - adb device lost[a6622a22]' Count: 3 (2.80%) IDs: db845c-09: 8381087 8382085 8382201 Error: No match for error type 'Test', message 'tradefed - adb device lost[476f370a]' Count: 1 (0.93%) IDs: db845c-10: 8382183 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 593 seconds' Count: 1 (0.93%) IDs: db845c-10: 8382170 Error: Device NOT found! Count: 10 (9.35%) IDs: db845c-02: 8381450 8381529 8382029 8382159 db845c-04: 8381436 db845c-05: 8381113 db845c-06: 8381428 8381433 8381472 db845c-10: 8381138 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 584 seconds' Count: 1 (0.93%) IDs: db845c-10: 8381438 Error type: Infrastructure Error count: 2 (1.87%) Error: Connection closed Count: 2 (1.87%) IDs: db845c-04: 8381429 db845c-06: 8381430 Device type: hi6220-hikey-r2 Total jobs: 20 Total errors: 16 (80.00%) Error type: Test Error count: 15 (75.00%) Error: Device NOT found! Count: 1 (5.00%) IDs: hikey-6220-r2-02: 8382780 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 8 (40.00%) IDs: hikey-6220-r2-01: 8382633 8382651 hikey-6220-r2-05: 8382508 hikey-6220-r2-06: 8382497 8382543 8382593 8382636 8382756 Error: No match for error type 'Test', message 'tradefed - adb device lost[4595FE84003F72FC]' Count: 2 (10.00%) IDs: hikey-6220-r2-04: 8382628 8382742 Error: No match for error type 'Test', message 'tradefed - adb device lost[8D6E5F00030E051]' Count: 1 (5.00%) IDs: hikey-6220-r2-02: 8382656 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 28798 seconds' Count: 1 (5.00%) IDs: hikey-6220-r2-03: 8382496 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 597 seconds' Count: 1 (5.00%) IDs: hikey-6220-r2-02: 8382487 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 1 (5.00%) IDs: hikey-6220-r2-01: 8382483 Error type: Job Error count: 1 (5.00%) Error: No match for error type 'Job', message 'login-action timed out after 874 seconds' Count: 1 (5.00%) IDs: hikey-6220-r2-02: 8382740 Device type: hi960-hikey Total jobs: 4 Total errors: 2 (50.00%) Error type: Test Error count: 2 (50.00%) Error: No match for error type 'Test', message 'tradefed - adb device lost[6A522E130177F475]' Count: 2 (50.00%) IDs: hi960-hikey-01: 8382498 8382670 Device type: juno-r2 Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

Daily report for validation - 2025-Aug-05

by lava＠validation.linaro.org

Total jobs: 595 Total errors: 308 (51.76%) LAVA errors: 9 (1.51%) Test errors: 0 (0.00%) Job errors: 72 (12.10%) Infra errors: 227 (38.15%) Canceled jobs: 0 (0.00%) Device type: beaglebone-black Total jobs: 357 Total errors: 185 (51.82%) Error type: Infrastructure Error count: 164 (45.94%) Error: matched a bootloader error message Count: 2 (0.56%) IDs: beaglebone-black03: 4183096 4183220 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 36 (10.08%) IDs: beaglebone-black03: 4165757 4165760 4165800 4165804 4165812 4165816 4165834 4182444 4182551 4182585 4182590 4182594 4182630 4182674 4182705 4182725 4182733 4182758 4182831 4182837 4182862 4182895 4182931 4182948 4182990 4183002 4183040 4183053 4183056 4183082 4183124 4183138 4183170 4183172 4183203 4183219 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 7 (1.96%) IDs: beaglebone-black03: 4165774 4182657 4182667 4182767 4182998 4183200 4183217 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 19 (5.32%) IDs: beaglebone-black03: 4165782 4165791 4182543 4182580 4182624 4182648 4182659 4182769 4182871 4182918 4182935 4182982 4182986 4182994 4183073 4183142 4183191 4183196 4183214 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 82 (22.97%) IDs: beaglebone-black03: 4165753 4165778 4165787 4165796 4165808 4165820 4165826 4165830 4182427 4182497 4182548 4182560 4182566 4182569 4182575 4182602 4182627 4182633 4182636 4182639 4182641 4182643 4182651 4182663 4182665 4182670 4182672 4182678 4182702 4182706 4182737 4182742 4182745 4182750 4182760 4182762 4182764 4182830 4182852 4182866 4182875 4182879 4182882 4182892 4182900 4182902 4182915 4182920 4182923 4182940 4182945 4182950 4182954 4182955 4182958 4182963 4182976 4182980 4183005 4183007 4183009 4183058 4183064 4183068 4183077 4183086 4183092 4183100 4183104 4183108 4183116 4183121 4183128 4183131 4183140 4183144 4183146 4183174 4183178 4183183 4183206 4183210 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 10 (2.80%) IDs: beaglebone-black03: 4165768 4182655 4182661 4182729 4182754 4182835 4182907 4182927 4183011 4183112 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 6 (1.68%) IDs: beaglebone-black03: 4182555 4182568 4182606 4182609 4182646 4182708 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 43 seconds' Count: 1 (0.28%) IDs: beaglebone-black03: 4182612 Error: bootloader-interrupt timed out Count: 1 (0.28%) IDs: beaglebone-black03: 4165764 Error type: Job Error count: 12 (3.36%) Error: wait for prompt timed out Count: 12 (3.36%) IDs: beaglebone-black03: 4182525 4182530 4182539 4182598 4182620 4182676 4182857 4182911 4182973 4183033 4183041 4183182 Error type: Bug Error count: 9 (2.52%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 9 (2.52%) IDs: beaglebone-black03: 4165749 4182533 4182617 4182650 4182653 4182721 4183051 4183135 4183158 Device type: bcm2837-rpi-3-b-32 Total jobs: 165 Total errors: 94 (56.97%) Error type: Infrastructure Error count: 63 (38.18%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 63 (38.18%) IDs: rpi3-b-32-03: 4182553 4182558 4182573 4182582 4182587 4182592 4182596 4182600 4182604 4182610 4182622 4182626 4182707 4182723 4182727 4182731 4182735 4182743 4182747 4182755 4182849 4182855 4182864 4182869 4182873 4182880 4182884 4182897 4182904 4182909 4182921 4182925 4182929 4182933 4182937 4182941 4182943 4182956 4182970 4182984 4182988 4182992 4183000 4183059 4183076 4183080 4183088 4183094 4183102 4183106 4183110 4183114 4183119 4183129 4183132 4183168 4183180 4183185 4183192 4183195 4183204 4183208 4183212 Error type: Job Error count: 31 (18.79%) Error: wait for prompt timed out Count: 31 (18.79%) IDs: rpi3-b-32-03: 4182577 4182608 4182615 4182619 4182628 4182739 4182740 4182752 4182834 4182860 4182877 4182913 4182916 4182978 4182981 4182983 4182996 4182999 4183039 4183049 4183054 4183055 4183061 4183090 4183098 4183117 4183122 4183126 4183189 4183198 4183201 Device type: x15 Total jobs: 46 Total errors: 17 (36.96%) Error type: Job Error count: 17 (36.96%) Error: No match for error type 'Job', message 'login-action timed out after 273 seconds' Count: 3 (6.52%) IDs: x15-01: 4182572 4182833 4183181 Error: No match for error type 'Job', message 'login-action timed out after 275 seconds' Count: 10 (21.74%) IDs: x15-01: 4182578 4182850 4182858 4182863 4182867 4182960 4182971 4183042 4183084 4183171 Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 4 (8.70%) IDs: x15-01: 4182853 4183074 4183078 4183169 Device type: dragonboard-410c Total jobs: 12 Total errors: 11 (91.67%) Error type: Job Error count: 11 (91.67%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 10 (83.33%) IDs: dragonboard-410c-01: 4182718 4182845 4182887 4182905 4182968 4183037 4183048 4183070 4183165 4183175 Error: Invalid job data Count: 1 (8.33%) IDs: dragonboard-410c-01: 4182714 Device type: dragonboard-845c Total jobs: 13 Total errors: 1 (7.69%) Error type: Job Error count: 1 (7.69%) Error: Invalid job data Count: 1 (7.69%) IDs: dragonboard-845c-06: 4182713 Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

next-20250804: clang-nightly hardening.config boot failed on arm64 rock-pi-4b

by Naresh Kamboju

Regressions found while booting the Linux next-20250804 on the qemu-arm64, dragonboard-410c, rock-pi-4b due to following kernel log. Regression Analysis: - New regression? Yes - Reproducibility? yes First seen on the next-20250804 Good: next-20250801 Bad: next-20250804 Test regression: next-20250804 clang-nightly hardening.config boot failed on arm64 rock-pi-4b Reported-by: Linux Kernel Functional Testing <lkft(a)linaro.org> ## Rk3399-rock-pi-4b [ 0.006047] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) [ 0.007767] Unable to handle kernel execute from non-executable memory at virtual address 00000000820d0614 [ 0.008666] Mem abort info: [ 0.008933] ESR = 0x0000000086000004 [ 0.009284] EC = 0x21: IABT (current EL), IL = 32 bits [ 0.009780] SET = 0, FnV = 0 [ 0.010074] EA = 0, S1PTW = 0 [ 0.010376] FSC = 0x04: level 0 translation fault [ 0.010834] [00000000820d0614] user address but active_mm is swapper [ 0.011424] Internal error: Oops: 0000000086000004 [#1] SMP [ 0.011954] Modules linked in: [ 0.012255] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.16.0-next-20250804 #1 PREEMPT [ 0.013053] Hardware name: Radxa ROCK Pi 4B (DT) [ 0.013486] pstate: 80500205 (Nzcv Daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 0.014138] pc : 0x820d0614 [ 0.014414] lr : start_kernel+0x1d8/0x388 [ 0.014806] sp : ffff800082703e80 [ 0.015121] x29: ffff800082703e90 x28: 0000000000000000 x27: 00000000f3ff3ad0 [ 0.015802] x26: 00000000f3f2bf18 x25: 0000000000000000 x24: 0000000000000710 [ 0.016481] x23: 0000000000000003 x22: 00000000f1f31468 x21: 00000000f1ef9000 [ 0.017160] x20: ffff80008270a000 x19: ffff800082716ac0 x18: ffff800082715ac8 [ 0.017841] x17: 0000000000000004 x16: 000000000000000c x15: 00000000000000ac [ 0.018521] x14: 0000000000000400 x13: 0000000000000000 x12: ffff0000f749b2ac [ 0.019200] x11: 0000000000000000 x10: 0000000000000002 x9 : 0000000000000006 [ 0.019880] x8 : 00000000000000c0 x7 : 0000000000000000 x6 : 00000000b1f352b2 [ 0.020557] x5 : ffff800082703b78 x4 : 0000000000000000 x3 : ffff800082703d30 [ 0.021240] x2 : fffffffffffffb54 x1 : ffff0000f75b5180 x0 : 0000000000000000 [ 0.021921] Call trace: [ 0.022159] 0x820d0614 (P) [ 0.022433] __primary_switched+0x90/0x9c [ 0.022854] Unable to handle kernel write to read-only memory at virtual address 0000000000000008 [ 0.023677] Mem abort info: [ 0.023942] ESR = 0x0000000096000044 [ 0.024291] EC = 0x25: DABT (current EL), IL = 32 bits [ 0.024788] SET = 0, FnV = 0 [ 0.025078] EA = 0, S1PTW = 0 [ 0.025375] FSC = 0x04: level 0 translation fault [ 0.025831] Data abort info: [ 0.026103] ISV = 0, ISS = 0x00000044, ISS2 = 0x00000000 [ 0.026613] CM = 0, WnR = 1, TnD = 0, TagAccess = 0 [ 0.027088] GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0 [ 0.027585] [0000000000000008] user address but active_mm is swapper ## Qemu-arm64 boot failed log <6>[ 0.000056] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns <6>[ 0.003490] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) <2>[ 0.016829] Unhandled 64-bit el1h sync exception on CPU0, ESR 0x000000003a000000 -- PSTATE.IL <4>[ 0.018731] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.16.0-next-20250804 #1 PREEMPT <4>[ 0.018869] Hardware name: linux,dummy-virt (DT) <4>[ 0.019015] pstate: 72500209 (nZCV Daif +PAN -UAO +TCO -DIT -SSBS BTYPE=--) <4>[ 0.019099] pc : start_kernel+0x1e8/0x388 <4>[ 0.019688] lr : start_kernel+0x1d8/0x388 <4>[ 0.019706] sp : ffffb0d172f03e80 <4>[ 0.019723] x29: ffffb0d172f03e90 x28: 0000000000000000 x27: 0000000000000000 <4>[ 0.020240] x26: 0000000000000000 x25: 0000000000000000 x24: 0000000000000000 <4>[ 0.020264] x23: 0000000000000000 x22: 0000000000000000 x21: 0000000048000000 <4>[ 0.020288] x20: ffffb0d172f0a000 x19: ffffb0d172f16ac0 x18: ffffb0d172f15ac0 <4>[ 0.020311] x17: 0000000000000000 x16: 0000000000000008 x15: 00000000000001e8 <4>[ 0.020334] x14: 0000000000000400 x13: 0000000000000000 x12: fff00000ff395f6c <4>[ 0.020357] x11: 0000000000000000 x10: 0000000000000000 x9 : 0000000000000002 <4>[ 0.020397] x8 : 00000000000000c0 x7 : 0000000000000000 x6 : 00000000c333cce7 <4>[ 0.020419] x5 : 00000000f80cd09e x4 : 0000000000000000 x3 : ffffb0d172f03d30 <4>[ 0.020441] x2 : fffffffffffffb54 x1 : fff00000ff397cc0 x0 : 0000000000000000 <0>[ 0.020652] Kernel panic - not syncing: Unhandled exception <4>[ 0.020740] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.16.0-next-20250804 #1 PREEMPT <4>[ 0.020757] Hardware name: linux,dummy-virt (DT) <4>[ 0.020843] Call trace: <4>[ 0.020960] show_stack+0x18/0x28 (C) <4>[ 0.021107] __dump_stack+0x28/0x3c <4>[ 0.021136] dump_stack_lvl+0x24/0x6c <4>[ 0.021151] dump_stack+0x18/0x24 <4>[ 0.021166] vpanic+0x10c/0x384 <4>[ 0.021181] panic+0x48/0x4c <4>[ 0.021195] __panic_unhandled+0x68/0x6c <4>[ 0.021239] el1_abort+0x0/0x5c <4>[ 0.021258] el1h_64_sync+0x70/0x74 <4>[ 0.021341] start_kernel+0x1e8/0x388 (P) <4>[ 0.021359] __primary_switched+0x90/0x9c <0>[ 0.028904] ---[ end Kernel panic - not syncing: Unhandled exception ]--- ## Dragonboard-410c boot failed log [ 0.019420] Unable to handle kernel execute from non-executable memory at virtual address 0000000082150614 [ 0.028831] Unable to handle kernel write to read-only memory at virtual address 0000000000000008 [ 0.028839] Mem abort info: [ 0.028842] ESR = 0x0000000096000044 [ 0.028847] EC = 0x25: DABT (current EL), IL = 32 bits [ 0.028853] SET = 0, FnV = 0 [ 0.028858] EA = 0, S1PTW = 0 [ 0.028864] FSC = 0x04: level 0 translation fault [ 0.028869] Data abort info: [ 0.028872] ISV = 0, ISS = 0x00000044, ISS2 = 0x00000000 [ 0.028878] CM = 0, WnR = 1, TnD = 0, TagAccess = 0 [ 0.028884] GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0 [ 0.028892] [0000000000000008] user address but active_mm is swapper [ 0.028899] Internal error: Oops: 0000000096000044 [#1] SMP [ 0.028907] Modules linked in: [ 0.028919] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.16.0-next-20250804 #1 PREEMPT [ 0.028932] Hardware name: Qualcomm Technologies, Inc. APQ 8016 SBC (DT) [ 0.028939] pstate: 404000c5 (nZcv daIF +PAN -UAO -TCO -DIT -SSBS BTYPE=--) [ 0.028949] pc : ret_to_kernel+0x8/0x68 [ 0.028966] lr : el1h_64_irq+0x70/0x74 [ 0.028975] sp : ffff8000827837e0 [ 0.028981] x29: ffff800082783908 x28: ffff800082796ac0 x27: ffff800082b352c8 [ 0.028998] x26: 0000000000000000 x25: ffff800082d10000 x24: ffff800082796ac0 [ 0.029014] x23: 0000000020400205 x22: ffff8000801e3dfc x21: 0000000082149000 [ 0.029030] x20: 0000000000000000 x19: ffff8000827839f4 x18: ffff800082795b30 [ 0.029046] x17: 00000000a540670c x16: 00000000a540670c x15: 00000000000a0d34 [ 0.029062] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000000 [ 0.029078] x11: 0000000000000000 x10: ffff800082796ac0 x9 : ffff800082745598 [ 0.029093] x8 : 0000000000000000 x7 : 205d303234393130 x6 : 302e30202020205b [ 0.029109] x5 : ffff800082d111c8 x4 : ffff8000827837b7 x3 : ffff8000827837e0 [ 0.029125] x2 : 0000000000000000 x1 : 0000000000000000 x0 : ffff800082d10f7c [ 0.029141] Call trace: [ 0.029146] ret_to_kernel+0x8/0x68 (P) [ 0.029161] console_flush_all+0x2ac/0x3cc (P) [ 0.029175] console_unlock+0x80/0x17c [ 0.029191] vprintk_emit+0x208/0x2ac [ 0.029208] vprintk_default+0x44/0x70 [ 0.029225] vprintk+0x34/0xb4 [ 0.029236] _printk+0x54/0x80 [ 0.029249] die_kernel_fault+0x40/0x74 [ 0.029261] vma_end_read+0x0/0x94 [ 0.029277] do_page_fault+0x44/0x768 [ 0.029292] do_translation_fault+0x4c/0x68 [ 0.029307] do_mem_abort+0x54/0xa8 [ 0.029322] el1_abort+0x3c/0x5c [ 0.029335] el1h_64_sync_handler+0x50/0xfc [ 0.029346] el1h_64_sync+0x70/0x74 [ 0.029358] 0x82150614 (P) [ 0.029368] __primary_switched+0x90/0x9c [ 0.029393] Code: 944fdb51 d5184035 d5184016 a94007e0 (a800ada6) [ 0.029401] ---[ end trace 0000000000000000 ]--- [ 0.029408] Kernel panic - not syncing: Attempted to kill the idle task! [ 0.282802] ---[ end Kernel panic - not syncing: Attempted to kill the idle task! ]--- Rock-pi-4b - https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804/te… - https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804/te… Qemu-arm64 - https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804/te… - https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804/te… Dragonboard-410c - https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804/te… - https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804/te… ## Source * Git tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git * Git sha: 5c5a10f0be967a8950a2309ea965bae54251b50e * Git describe: next-20250804 * Project details: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804 * Architectures: arm64 * Toolchains: clang-nigtly Debian clang version 22.0.0 (++20250803105249+e640ca8b9adc-1~exp1~20250803225437.1615) * Kconfigs: hardening.config ## Build * Test history: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250804/te… * Test history 1: https://regressions.linaro.org/lkft/linux-next-master/next-20250804/boot/cl… * Test plan: https://tuxapi.tuxsuite.com/v1/groups/linaro/projects/lkft/tests/30oCAKqSuQ… * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/30oC7nI5ieJMRpDzpr0L… * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/30oC7nI5ieJMRpDzpr0L… -- Linaro LKFT https://lkft.linaro.org

1 year, 2 months

next-20250717: arm64: rk3399-rock-pi-4b: NFS mount failure with 64K page size

by Naresh Kamboju

The rk3399-rock-pi-4b device fails to mount the root filesystem over NFS when the kernel is built with 64K page size. CONFIG_ARM64_64K_PAGES=y This regression was first observed with the Linux next-20250717 tag and continues to persist through next-20250722. Device: rk3399-rock-pi-4b Build Configuration: lkftconfig-64k_page_size Regression Window: Good: next-20250716 Bad: next-20250717.. Still Bad: next-20250722 Kernel Config Impact: CONFIG_ARM64_64K_PAGES=y - NFS mount fails CONFIG_ARM64_4K_PAGES=y - NFS mount works as expected Regression Analysis: - New regression? Yes - Reproducibility? Yes Boot regression: next-20250717 arm64 rk3399-rock-pi-4b NFS mount failure with 64K page size Reported-by: Linux Kernel Functional Testing <lkft(a)linaro.org> ## Boot log [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x410fd034] [ 0.000000] Linux version 6.16.0-rc6-next-20250717 (tuxmake@tuxmake) (aarch64-linux-gnu-gcc (Debian 13.3.0-16) 13.3.0, GNU ld (GNU Binutils for Debian) 2.44) #1 SMP PREEMPT @1752747461 [ 0.000000] KASLR disabled due to lack of seed [ 0.000000] Machine model: Radxa ROCK Pi 4B [ 0.000000] efi: UEFI not found. [ 0.000000] earlycon: uart0 at MMIO32 0x00000000ff1a0000 (options '1500000n8') [ 0.000000] printk: legacy bootconsole [uart0] enabled [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT [ 0.000000] NUMA: Faking a node at [mem 0x0000000000200000-0x00000000f7ffffff] <trim> [ 6.520442] Sending DHCP requests .. [ 13.295867] platform sdio-pwrseq: deferred probe pending: pwrseq_simple: reset control not ready [ 13.295887] dwmmc_rockchip fe310000.mmc: IDMAC supports 32-bit address mode. [ 13.296260] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to fe310000.mmc [ 13.296278] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff650000.video-codec [ 13.297085] dwmmc_rockchip fe310000.mmc: Using internal DMA controller. [ 13.297660] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff660000.video-codec [ 13.298653] dwmmc_rockchip fe310000.mmc: Version ID is 270a [ 13.299536] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff680000.rga [ 13.300164] dwmmc_rockchip fe310000.mmc: DW MMC controller at irq 49,32 bit host data width,256 deep fifo [ 13.301117] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff880000.i2s [ 13.304227] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff8a0000.i2s [ 13.305148] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff8f0000.vop [ 13.306071] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff900000.vop [ 13.307009] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff940000.hdmi [ 13.307937] rockchip-pm-domain ff310000.power-management:power-controller: sync_state() pending due to ff9a0000.gpu [ 14.620509] ., OK [ 14.636949] IP-Config: Got DHCP answer from 10.66.16.15, my address is 10.66.30.7 [ 14.637647] IP-Config: Complete: [ 14.637955] device=eth0, hwaddr=0a:fb:82:cd:ed:a8, ipaddr=10.66.30.7, mask=255.255.240.0, gw=10.66.16.1 [ 14.638845] host=10.66.30.7, domain=lkftlab, nis-domain=(none) [ 14.639417] bootserver=0.0.0.0, rootserver=10.66.16.116, rootpath= [ 14.639440] nameserver0=10.66.16.15 [ 14.641679] clk: Disabling unused clocks [ 14.646347] dw-apb-uart ff1a0000.serial: forbid DMA for kernel console [ 14.647091] check access for rdinit=/init failed: -2, ignoring [ 14.762496] VFS: Mounted root (nfs filesystem) on device 0:22. [ 14.763768] devtmpfs: mounted [ 14.775761] Freeing unused kernel memory: 4928K [ 14.776566] Run /sbin/init as init process [ 95.816464] random: crng init done [ 195.556677] nfs: server 10.66.16.116 not responding, still trying .. [ 195.556703] nfs: server 10.66.16.116 not responding, still trying [ 195.556869] nfs: server 10.66.16.116 not responding, still trying [ 195.557010] nfs: server 10.66.16.116 not responding, still trying [ 195.557055] nfs: server 10.66.16.116 not responding, still trying [ 195.557114] nfs: server 10.66.16.116 not responding, still trying [ 195.557166] nfs: server 10.66.16.116 not responding, still trying [ 195.557217] nfs: server 10.66.16.116 not responding, still trying [ 195.557269] nfs: server 10.66.16.116 not responding, still trying [ 195.557304] nfs: server 10.66.16.116 not responding, still trying [ 227.459759] nfs: server 10.66.16.116 OK [ 227.459868] nfs: server 10.66.16.116 OK [ 227.681008] nfs: server 10.66.16.116 OK [ 319.645474] nfs: server 10.66.16.116 OK [ 407.677657] nfs: server 10.66.16.116 OK [ 499.834818] nfs: server 10.66.16.116 OK [ 587.895692] nfs: server 10.66.16.116 OK [ 680.052774] nfs: server 10.66.16.116 OK [ 768.113810] nfs: server 10.66.16.116 OK [ 860.270785] nfs: server 10.66.16.116 OK # [ 948.331418] nfs: server 10.66.16.116 OK # [ 1096.679211] nfs: server 10.66.16.116 OK # [ 1274.856436] nfs: server 10.66.16.116 OK # [ 1488.985700] nfs: server 10.66.16.116 OK ## Source * Git tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git * Project: https://qa-reports.linaro.org/lkft/linux-next-master/build/next-20250717/ * Git sha: 024e09e444bd2b06aee9d1f3fe7b313c7a2df1bb * Git describe: 6.16.0-rc6-next-20250717 * kernel version: next-20250717 * Architectures: arm64 (rock-pi-4b) * Toolchains: gcc-13 * Kconfigs: defconfig+64K page size ## Test * Test log: https://qa-reports.linaro.org/api/testruns/29168904/log_file/ * Test LAVA: https://lkft.validation.linaro.org/scheduler/job/8364278#L924 * Test run: https://regressions.linaro.org/lkft/linux-next-master/next-20250717/testrun… * Test plan: https://tuxapi.tuxsuite.com/v1/groups/linaro/projects/lkft/tests/2zzwHDuV3x… * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2zzwEbz0aS3AtluE2oRQ… * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/2zzwEbz0aS3AtluE2oRQ… -- Linaro LKFT https://lkft.linaro.org

1 year, 2 months

Daily cts/vts report for lkft - 2025-Aug-04

by lava＠validation.linaro.org

Total jobs: 162 Total errors: 51 (31.48%) LAVA errors: 0 (0.00%) Test errors: 48 (29.63%) Job errors: 2 (1.23%) Infra errors: 1 (0.62%) Canceled jobs: 0 (0.00%) Device type: dragonboard-845c Total jobs: 109 Total errors: 35 (32.11%) Error type: Test Error count: 34 (31.19%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 19 (17.43%) IDs: db845c-02: 8379983 8379987 8379999 8380044 8380487 db845c-04: 8379950 8379953 8379997 db845c-05: 8379957 8380090 8380471 db845c-06: 8379948 8379954 8380025 8380527 8380579 8381029 db845c-10: 8379956 8380099 Error: Device NOT found! Count: 8 (7.34%) IDs: db845c-02: 8379989 8380003 8380054 8380089 8380517 8380638 db845c-04: 8380578 db845c-09: 8380648 Error: No match for error type 'Test', message 'tradefed - adb device lost[e875976d]' Count: 1 (0.92%) IDs: db845c-06: 8380568 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 2 (1.83%) IDs: db845c-05: 8380475 db845c-06: 8380567 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 2 (1.83%) IDs: db845c-02: 8380506 8380522 Error: No match for error type 'Test', message 'tradefed - adb device lost[476f370a]' Count: 1 (0.92%) IDs: db845c-10: 8380486 Error: No match for error type 'Test', message 'tradefed - adb device lost[f3a58ae3]' Count: 1 (0.92%) IDs: db845c-04: 8380176 Error type: Infrastructure Error count: 1 (0.92%) Error: Connection closed Count: 1 (0.92%) IDs: db845c-05: 8380984 Device type: qrb5165-rb5 Total jobs: 46 Total errors: 13 (28.26%) Error type: Test Error count: 12 (26.09%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 5 (10.87%) IDs: rb5-01: 8381464 rb5-03: 8380639 8380986 8381028 8381553 Error: Device NOT found! Count: 4 (8.70%) IDs: rb5-03: 8380645 8381003 8381021 rb5-07: 8381462 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 587 seconds' Count: 1 (2.17%) IDs: rb5-07: 8381448 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 599 seconds' Count: 1 (2.17%) IDs: rb5-07: 8381063 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 1 (2.17%) IDs: rb5-03: 8380989 Error type: Job Error count: 1 (2.17%) Error: No match for error type 'Job', message 'login-action timed out after 876 seconds' Count: 1 (2.17%) IDs: rb5-03: 8381101 Device type: hi960-hikey Total jobs: 5 Total errors: 2 (40.00%) Error type: Test Error count: 2 (40.00%) Error: Device NOT found! Count: 1 (20.00%) IDs: hi960-hikey-02: 8381548 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 1 (20.00%) IDs: hi960-hikey-01: 8381015 Device type: x15 Total jobs: 1 Total errors: 1 (100.00%) Error type: Job Error count: 1 (100.00%) Error: No match for error type 'Job', message 'login-action timed out after 1775 seconds' Count: 1 (100.00%) IDs: x15-01: 8381255 Device type: x86 Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

Daily report for validation - 2025-Aug-04

by lava＠validation.linaro.org

Total jobs: 464 Total errors: 237 (51.08%) LAVA errors: 10 (2.16%) Test errors: 0 (0.00%) Job errors: 45 (9.70%) Infra errors: 182 (39.22%) Canceled jobs: 0 (0.00%) Device type: dragonboard-410c Total jobs: 9 Total errors: 8 (88.89%) Error type: Job Error count: 8 (88.89%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 8 (88.89%) IDs: dragonboard-410c-01: 4182333 4182344 4182419 4182437 4182447 4182492 4182563 4182576 Device type: beaglebone-black Total jobs: 350 Total errors: 178 (50.86%) Error type: Infrastructure Error count: 162 (46.29%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 77 (22.00%) IDs: beaglebone-black03: 4163146 4163147 4163159 4163161 4163171 4163173 4163175 4163177 4163181 4163191 4163200 4163204 4163315 4163533 4163535 4163537 4163539 4163545 4163547 4163551 4163553 4163836 4163838 4163840 4163842 4163848 4163850 4163858 4163864 4163866 4163868 4165328 4165350 4165354 4165362 4165372 4165376 4165470 4165484 4165492 4165496 4165499 4165532 4165536 4165541 4165545 4165564 4165642 4165648 4165668 4165678 4165686 4165690 4165695 4165699 4165703 4165708 4165737 4182336 4182341 4182354 4182359 4182370 4182374 4182378 4182382 4182390 4182392 4182398 4182400 4182428 4182459 4182485 4182488 4182498 4182510 4182520 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 18 (5.14%) IDs: beaglebone-black03: 4163151 4163167 4163531 4163846 4163870 4163874 4165332 4165336 4165358 4165522 4165718 4165726 4165741 4165745 4182394 4182432 4182462 4182514 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 42 (12.00%) IDs: beaglebone-black03: 4163149 4163153 4163163 4163169 4163183 4163185 4163187 4163189 4163193 4163206 4163317 4163543 4163549 4163852 4163862 4163872 4165342 4165346 4165381 4165384 4165460 4165466 4165488 4165513 4165518 4165528 4165549 4165638 4165645 4165652 4165655 4165674 4165682 4165733 4182343 4182364 4182429 4182452 4182470 4182478 4182481 4182505 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 8 (2.29%) IDs: beaglebone-black03: 4165634 4165659 4165714 4165722 4182441 4182446 4182474 4182501 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 3 (0.86%) IDs: beaglebone-black03: 4163195 4182386 4182467 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 11 (3.14%) IDs: beaglebone-black03: 4163179 4163202 4163856 4165368 4165508 4165663 4165729 4182342 4182349 4182396 4182450 Error: matched a bootloader error message Count: 3 (0.86%) IDs: beaglebone-black03: 4163313 4165480 4182067 Error type: Bug Error count: 10 (2.86%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 10 (2.86%) IDs: beaglebone-black03: 4163157 4163165 4163311 4163541 4163854 4165474 4165504 4165524 4165551 4182456 Error type: Job Error count: 6 (1.71%) Error: wait for prompt timed out Count: 6 (1.71%) IDs: beaglebone-black03: 4163155 4163197 4163844 4163860 4165672 4182424 Device type: x15 Total jobs: 32 Total errors: 13 (40.62%) Error type: Job Error count: 13 (40.62%) Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 4 (12.50%) IDs: x15-01: 4182511 4182512 4182515 4182523 Error: No match for error type 'Job', message 'login-action timed out after 275 seconds' Count: 8 (25.00%) IDs: x15-01: 4182340 4182347 4182352 4182360 4182365 4182422 4182500 4182502 Error: No match for error type 'Job', message 'login-action timed out after 273 seconds' Count: 1 (3.12%) IDs: x15-01: 4182356 Device type: bcm2837-rpi-3-b-32 Total jobs: 63 Total errors: 38 (60.32%) Error type: Job Error count: 18 (28.57%) Error: wait for prompt timed out Count: 18 (28.57%) IDs: rpi3-b-32-03: 4182351 4182355 4182384 4182423 4182448 4182454 4182457 4182463 4182472 4182483 4182496 4182522 4182526 4182534 4182541 4182545 4182549 4182552 Error type: Infrastructure Error count: 20 (31.75%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 20 (31.75%) IDs: rpi3-b-32-03: 4182339 4182357 4182362 4182367 4182372 4182376 4182380 4182387 4182442 4182460 4182465 4182468 4182476 4182479 4182499 4182508 4182517 4182528 4182531 4182537 Device type: dragonboard-845c Total jobs: 8 Total errors: 0 (0.00%) Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

Daily cts/vts report for lkft - 2025-Aug-03

by lava＠validation.linaro.org

Total jobs: 211 Total errors: 82 (38.86%) LAVA errors: 0 (0.00%) Test errors: 71 (33.65%) Job errors: 4 (1.90%) Infra errors: 7 (3.32%) Canceled jobs: 0 (0.00%) Device type: hi960-hikey Total jobs: 24 Total errors: 13 (54.17%) Error type: Test Error count: 12 (50.00%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 3 (12.50%) IDs: hi960-hikey-01: 8379022 8379446 8380982 Error: No match for error type 'Test', message 'tradefed - adb device lost[7A25756801BA7C0B]' Count: 3 (12.50%) IDs: hi960-hikey-02: 8380125 8380165 8380981 Error: No match for error type 'Test', message 'tradefed - adb device lost[6A522E130177F475]' Count: 3 (12.50%) IDs: hi960-hikey-01: 8378968 8379581 8380598 Error: No match for error type 'Test', message 'tradefed - adb device lost[279ABF68159019FF]' Count: 1 (4.17%) IDs: hi960-hikey-03: 8380073 Error: Device NOT found! Count: 1 (4.17%) IDs: hi960-hikey-01: 8379023 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 593 seconds' Count: 1 (4.17%) IDs: hi960-hikey-01: 8379021 Error type: Infrastructure Error count: 1 (4.17%) Error: No match for error type 'Infrastructure', message 'wait-device-boardid timed out after 1174 seconds' Count: 1 (4.17%) IDs: hi960-hikey-03: 8380096 Device type: sm8550-hdk Total jobs: 10 Total errors: 3 (30.00%) Error type: Test Error count: 3 (30.00%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 2 (20.00%) IDs: sm8550-hdk-01: 8380106 8380621 Error: No match for error type 'Test', message 'tradefed - adb device lost[124d1c34]' Count: 1 (10.00%) IDs: sm8550-hdk-01: 8380545 Device type: qrb5165-rb5 Total jobs: 88 Total errors: 40 (45.45%) Error type: Test Error count: 31 (35.23%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 15 (17.05%) IDs: rb5-01: 8380496 rb5-03: 8379968 8380008 8380032 8380532 8380534 8380542 8380585 8380595 8380599 rb5-06: 8380031 8380058 rb5-07: 8379976 8379992 8380179 Error: Device NOT found! Count: 13 (14.77%) IDs: rb5-03: 8379933 8379966 8379971 8379973 8380009 8380098 8380116 8380127 8380132 8380137 8380541 8380588 rb5-06: 8380157 Error: No match for error type 'Test', message 'tradefed - adb device lost[d8a1879f]' Count: 1 (1.14%) IDs: rb5-07: 8380130 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 597 seconds' Count: 1 (1.14%) IDs: rb5-06: 8380010 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 1 (1.14%) IDs: rb5-03: 8380001 Error type: Job Error count: 3 (3.41%) Error: No match for error type 'Job', message 'login-action timed out after 876 seconds' Count: 2 (2.27%) IDs: rb5-03: 8380011 8380540 Error: No match for error type 'Job', message 'login-action timed out after 852 seconds' Count: 1 (1.14%) IDs: rb5-03: 8380537 Error type: Infrastructure Error count: 6 (6.82%) Error: Connection closed Count: 6 (6.82%) IDs: rb5-01: 8379934 8379993 8380059 8380063 8380182 8380529 Device type: juno-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: dragonboard-845c Total jobs: 88 Total errors: 26 (29.55%) Error type: Test Error count: 25 (28.41%) Error: No match for error type 'Test', message 'tradefed - adb device lost[476f370a]' Count: 1 (1.14%) IDs: db845c-10: 8379917 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 12 (13.64%) IDs: db845c-02: 8378936 8378948 8379004 8379047 8379607 db845c-04: 8378947 db845c-06: 8378933 8378949 8378976 db845c-09: 8379906 db845c-10: 8378973 8379909 Error: No match for error type 'Test', message 'tradefed - adb device lost[a6622a22]' Count: 1 (1.14%) IDs: db845c-09: 8379905 Error: Device NOT found! Count: 6 (6.82%) IDs: db845c-02: 8378955 8379027 8379043 8379400 8379902 db845c-10: 8379005 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 2 (2.27%) IDs: db845c-02: 8379030 8379426 Error: No match for error type 'Test', message 'tradefed - adb device lost[e875976d]' Count: 1 (1.14%) IDs: db845c-06: 8379371 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 2 (2.27%) IDs: db845c-05: 8378953 db845c-06: 8378958 Error type: Job Error count: 1 (1.14%) Error: No match for error type 'Job', message 'login-action timed out after 871 seconds' Count: 1 (1.14%) IDs: db845c-09: 8378975

1 year, 2 months

Daily report for validation - 2025-Aug-03

by lava＠validation.linaro.org

Total jobs: 415 Total errors: 206 (49.64%) LAVA errors: 5 (1.20%) Test errors: 0 (0.00%) Job errors: 12 (2.89%) Infra errors: 189 (45.54%) Canceled jobs: 0 (0.00%) Device type: beaglebone-black Total jobs: 357 Total errors: 181 (50.70%) Error type: Infrastructure Error count: 174 (48.74%) Error: matched a bootloader error message Count: 4 (1.12%) IDs: beaglebone-black03: 4181453 4181619 4181888 4182050 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 92 (25.77%) IDs: beaglebone-black03: 4163126 4163130 4163136 4180232 4180413 4180506 4180556 4180563 4180567 4180569 4180585 4180635 4180637 4180639 4180661 4180715 4180719 4180749 4180764 4180941 4181139 4181163 4181303 4181437 4181443 4181445 4181448 4181457 4181459 4181463 4181467 4181483 4181522 4181528 4181530 4181532 4181536 4181540 4181544 4181561 4181601 4181604 4181608 4181612 4181618 4181623 4181625 4181626 4181628 4181630 4181632 4181636 4181638 4181640 4181644 4181648 4181650 4181654 4181656 4181658 4181660 4181662 4181664 4181668 4181670 4181672 4181678 4181682 4181684 4181686 4181695 4181697 4181701 4181703 4181819 4181822 4181831 4181834 4181840 4181843 4181850 4181859 4181866 4181869 4181898 4181899 4181909 4181911 4181915 4181935 4181950 4181954 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 7 (1.96%) IDs: beaglebone-black03: 4180244 4180250 4181441 4181538 4181868 4181900 4181948 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 6 (1.68%) IDs: beaglebone-black03: 4180562 4180717 4181082 4181634 4181646 4181946 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 13 (3.64%) IDs: beaglebone-black03: 4163128 4163134 4180230 4180554 4180931 4181451 4181546 4181610 4181824 4181847 4181875 4181931 4181939 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 43 seconds' Count: 2 (0.56%) IDs: beaglebone-black03: 4181614 4181927 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 11 (3.08%) IDs: beaglebone-black03: 4163142 4180235 4180240 4180917 4181433 4181455 4181621 4181676 4181680 4181873 4181923 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 37 (10.36%) IDs: beaglebone-black03: 4163132 4163138 4163140 4163144 4180228 4180233 4180239 4180246 4180248 4180404 4180558 4180560 4180565 4180781 4181059 4181070 4181144 4181479 4181524 4181526 4181534 4181542 4181565 4181606 4181616 4181642 4181652 4181666 4181674 4181688 4181690 4181693 4181812 4181855 4181871 4181893 4181919 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 37 seconds' Count: 1 (0.28%) IDs: beaglebone-black03: 4181699 Error: Download finished but was not expected size, check your networking. Count: 1 (0.28%) IDs: beaglebone-black03: 4181435 Error type: Job Error count: 2 (0.56%) Error: wait for prompt timed out Count: 2 (0.56%) IDs: beaglebone-black03: 4181863 4181952 Error type: Bug Error count: 5 (1.40%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 5 (1.40%) IDs: beaglebone-black03: 4180237 4180242 4180252 4181461 4181943 Device type: bcm2837-rpi-3-b-32 Total jobs: 39 Total errors: 22 (56.41%) Error type: Infrastructure Error count: 15 (38.46%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 15 (38.46%) IDs: rpi3-b-32-03: 4181832 4181836 4181841 4181851 4181853 4181857 4181861 4181907 4181913 4181921 4181925 4181929 4181933 4181937 4181941 Error type: Job Error count: 7 (17.95%) Error: wait for prompt timed out Count: 7 (17.95%) IDs: rpi3-b-32-03: 4181823 4181838 4181845 4181848 4181897 4181917 4181920 Device type: dragonboard-410c Total jobs: 3 Total errors: 2 (66.67%) Error type: Job Error count: 2 (66.67%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 2 (66.67%) IDs: dragonboard-410c-01: 4181815 4181905 Device type: dragonboard-845c Total jobs: 6 Total errors: 0 (0.00%) Device type: x15 Total jobs: 8 Total errors: 1 (12.50%) Error type: Job Error count: 1 (12.50%) Error: No match for error type 'Job', message 'login-action timed out after 275 seconds' Count: 1 (12.50%) IDs: x15-01: 4181825 Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

1 year, 2 months

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

Lkft-triage August 2025