Lkft-triage July 2025

lkft-triage@lists.linaro.org

53 participants
95 discussions

next-20250701: qemu-x86_64: BUG unable to handle page fault for address __cpa_flush_tlb

by Naresh Kamboju

Regressions While booting the next-20250701 Linux kernel on a qemu-x86_64 virtual machine, a kernel panic is observed due to a page fault in the __cpa_flush_tlb function. Test environments: - qemu-x86_64 Regression Analysis: - New regression? Yes - Reproducibility? I need more data (Testing is in progress) Boot regression: Linux next-20250701 qemu-x86_64 BUG unable to handle page fault for address __cpa_flush_tlb Reported-by: Linux Kernel Functional Testing <lkft(a)linaro.org> ## Boot log <6>[ 0.000000] Linux version 6.16.0-rc4-next-20250701 (tuxmake@tuxmake) (x86_64-linux-gnu-gcc (Debian 13.3.0-16) 13.3.0, GNU ld (GNU Binutils for Debian) 2.44) #1 SMP PREEMPT_DYNAMIC @1751364982 <6>[ 0.000000] Command line: console=ttyS0,115200 rootwait root=/dev/sda debug verbose console_msg_format=syslog systemd.log_level=warning rw earlycon <6>[ 0.000000] x86/CPU: Model not found in latest microcode list <6>[ 0.000000] BIOS-provided physical RAM map: ... <6>[ 2.292682] EXT4-fs (sda): mounted filesystem 9c9bd7ea-a7a4-4c7c-bc54-7007f029c954 r/w with ordered data mode. Quota mode: none. <6>[ 2.294012] VFS: Mounted root (ext4 filesystem) on device 8:0. <6>[ 2.296792] devtmpfs: mounted <6>[ 2.387406] Freeing unused kernel image (initmem) memory: 4092K <6>[ 2.389312] Write protecting the kernel read-only data: 32768k <6>[ 2.391640] Freeing unused kernel image (text/rodata gap) memory: 28K <1>[ 2.393647] BUG: unable to handle page fault for address: 000000000002aa97 <1>[ 2.394089] #PF: supervisor read access in kernel mode <1>[ 2.395026] #PF: error_code(0x0000) - not-present page <6>[ 2.395623] PGD 0 P4D 0 <4>[ 2.396063] Oops: Oops: 0000 [#1] SMP PTI <4>[ 2.396998] CPU: 1 UID: 0 PID: 0 Comm: swapper/1 Not tainted 6.16.0-rc4-next-20250701 #1 PREEMPT(voluntary) <4>[ 2.397726] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 1.16.3-debian-1.16.3-2 04/01/2014 <4>[ 2.398454] RIP: 0010:__cpa_flush_tlb (arch/x86/mm/pat/set_memory.c:320 arch/x86/mm/pat/set_memory.c:408) <4>[ 2.399219] Code: 1e fa 0f 1f 44 00 00 55 48 89 e5 41 54 53 48 83 7f 20 00 48 89 fb 74 5b 45 31 e4 31 ff eb 27 48 8b 13 a8 02 75 47 48 c1 e7 0c <48> 03 3a 48 01 ff 48 d1 ff e8 26 f4 ff ff 41 8d 7c 24 01 49 89 fc All code ======== 0: 1e (bad) 1: fa cli 2: 0f 1f 44 00 00 nopl 0x0(%rax,%rax,1) 7: 55 push %rbp 8: 48 89 e5 mov %rsp,%rbp b: 41 54 push %r12 d: 53 push %rbx e: 48 83 7f 20 00 cmpq $0x0,0x20(%rdi) 13: 48 89 fb mov %rdi,%rbx 16: 74 5b je 0x73 18: 45 31 e4 xor %r12d,%r12d 1b: 31 ff xor %edi,%edi 1d: eb 27 jmp 0x46 1f: 48 8b 13 mov (%rbx),%rdx 22: a8 02 test $0x2,%al 24: 75 47 jne 0x6d 26: 48 c1 e7 0c shl $0xc,%rdi 2a:* 48 03 3a add (%rdx),%rdi <-- trapping instruction 2d: 48 01 ff add %rdi,%rdi 30: 48 d1 ff sar $1,%rdi 33: e8 26 f4 ff ff call 0xfffffffffffff45e 38: 41 8d 7c 24 01 lea 0x1(%r12),%edi 3d: 49 89 fc mov %rdi,%r12 Code starting with the faulting instruction =========================================== 0: 48 03 3a add (%rdx),%rdi 3: 48 01 ff add %rdi,%rdi 6: 48 d1 ff sar $1,%rdi 9: e8 26 f4 ff ff call 0xfffffffffffff434 e: 41 8d 7c 24 01 lea 0x1(%r12),%edi 13: 49 89 fc mov %rdi,%r12 <4>[ 2.399698] RSP: 0000:ffffb316c00e0f78 EFLAGS: 00010046 <4>[ 2.400494] RAX: 0000000000000169 RBX: ffffb316c0013e30 RCX: ffffb316c0013e30 <4>[ 2.401577] RDX: 000000000002aa97 RSI: 000000008b09dcbb RDI: 0000000000000000 <4>[ 2.401910] RBP: ffffb316c00e0f88 R08: 000000000000546c R09: 0000000000000000 <4>[ 2.402961] R10: 0000000000000000 R11: ffffb316c00e0ff8 R12: 0000000000000000 <4>[ 2.403326] R13: ffff8e357bd2daa0 R14: ffff8e3500aaaeb8 R15: ffffffff95148f50 <4>[ 2.403927] FS: 0000000000000000(0000) GS:ffff8e35e47bc000(0000) knlGS:0000000000000000 <4>[ 2.404471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4>[ 2.404795] CR2: 000000000002aa97 CR3: 000000002ac48000 CR4: 00000000000006f0 <4>[ 2.405623] Call Trace: <4>[ 2.406562] <IRQ> <4>[ 2.407678] __flush_smp_call_function_queue (arch/x86/include/asm/jump_label.h:36 include/trace/events/csd.h:64 kernel/smp.c:135 kernel/smp.c:540) <4>[ 2.408101] generic_smp_call_function_single_interrupt (kernel/smp.c:458) <4>[ 2.408234] __sysvec_call_function_single (arch/x86/include/asm/jump_label.h:36 arch/x86/include/asm/trace/irq_vectors.h:98 arch/x86/kernel/smp.c:272) <4>[ 2.409077] sysvec_call_function_single (arch/x86/kernel/smp.c:266 (discriminator 35) arch/x86/kernel/smp.c:266 (discriminator 35)) <4>[ 2.409287] </IRQ> <4>[ 2.409408] <TASK> <4>[ 2.409584] asm_sysvec_call_function_single (arch/x86/include/asm/idtentry.h:709) <4>[ 2.410108] RIP: 0010:pv_native_safe_halt (arch/x86/kernel/paravirt.c:82) <4>[ 2.410323] Code: 1f 84 00 00 00 00 00 0f 1f 40 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 f3 0f 1e fa eb 07 0f 00 2d 85 ef 03 00 fb f4 <c3> cc cc cc cc 66 2e 0f 1f 84 00 00 00 00 00 66 90 90 90 90 90 90 All code ======== 0: 1f (bad) 1: 84 00 test %al,(%rax) 3: 00 00 add %al,(%rax) 5: 00 00 add %al,(%rax) 7: 0f 1f 40 00 nopl 0x0(%rax) b: 90 nop c: 90 nop d: 90 nop e: 90 nop f: 90 nop 10: 90 nop 11: 90 nop 12: 90 nop 13: 90 nop 14: 90 nop 15: 90 nop 16: 90 nop 17: 90 nop 18: 90 nop 19: 90 nop 1a: 90 nop 1b: f3 0f 1e fa endbr64 1f: eb 07 jmp 0x28 21: 0f 00 2d 85 ef 03 00 verw 0x3ef85(%rip) # 0x3efad 28: fb sti 29: f4 hlt 2a:* c3 ret <-- trapping instruction 2b: cc int3 2c: cc int3 2d: cc int3 2e: cc int3 2f: 66 2e 0f 1f 84 00 00 cs nopw 0x0(%rax,%rax,1) 36: 00 00 00 39: 66 90 xchg %ax,%ax 3b: 90 nop 3c: 90 nop 3d: 90 nop 3e: 90 nop 3f: 90 nop Code starting with the faulting instruction =========================================== 0: c3 ret 1: cc int3 2: cc int3 3: cc int3 4: cc int3 5: 66 2e 0f 1f 84 00 00 cs nopw 0x0(%rax,%rax,1) c: 00 00 00 f: 66 90 xchg %ax,%ax 11: 90 nop 12: 90 nop 13: 90 nop 14: 90 nop 15: 90 nop <4>[ 2.411151] RSP: 0000:ffffb316c00abea0 EFLAGS: 00010206 <4>[ 2.411522] RAX: ffff8e35e47bc000 RBX: ffff8e3500372e80 RCX: 0000000000000001 <4>[ 2.411691] RDX: ffffffff9523177d RSI: ffffffff96b9a3df RDI: 0000000000005464 <4>[ 2.412619] RBP: ffffb316c00abea8 R08: 0000000000005464 R09: 0000000000000001 <4>[ 2.412810] R10: 0000004d8989ef00 R11: 000000000548e0b3 R12: 0000000000000001 <4>[ 2.413067] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 <4>[ 2.413403] ? do_idle (kernel/sched/idle.c:191 kernel/sched/idle.c:330) <4>[ 2.413737] ? default_idle (arch/x86/include/asm/paravirt.h:107 arch/x86/kernel/process.c:757) <4>[ 2.413926] arch_cpu_idle (arch/x86/kernel/process.c:795) <4>[ 2.414072] default_idle_call (include/linux/cpuidle.h:144 kernel/sched/idle.c:123) <4>[ 2.414608] do_idle (kernel/sched/idle.c:191 kernel/sched/idle.c:330) <4>[ 2.414744] cpu_startup_entry (kernel/sched/idle.c:427) <4>[ 2.414961] start_secondary (arch/x86/kernel/smpboot.c:203 (discriminator 10) arch/x86/kernel/smpboot.c:283 (discriminator 10)) <4>[ 2.415531] common_startup_64 (arch/x86/kernel/head_64.S:419) <4>[ 2.415720] </TASK> <4>[ 2.415898] Modules linked in: <4>[ 2.416303] CR2: 000000000002aa97 <4>[ 2.417490] ---[ end trace 0000000000000000 ]--- <4>[ 2.417940] RIP: 0010:__cpa_flush_tlb (arch/x86/mm/pat/set_memory.c:320 arch/x86/mm/pat/set_memory.c:408) <4>[ 2.418250] Code: 1e fa 0f 1f 44 00 00 55 48 89 e5 41 54 53 48 83 7f 20 00 48 89 fb 74 5b 45 31 e4 31 ff eb 27 48 8b 13 a8 02 75 47 48 c1 e7 0c <48> 03 3a 48 01 ff 48 d1 ff e8 26 f4 ff ff 41 8d 7c 24 01 49 89 fc All code ======== 0: 1e (bad) 1: fa cli 2: 0f 1f 44 00 00 nopl 0x0(%rax,%rax,1) 7: 55 push %rbp 8: 48 89 e5 mov %rsp,%rbp b: 41 54 push %r12 d: 53 push %rbx e: 48 83 7f 20 00 cmpq $0x0,0x20(%rdi) 13: 48 89 fb mov %rdi,%rbx 16: 74 5b je 0x73 18: 45 31 e4 xor %r12d,%r12d 1b: 31 ff xor %edi,%edi 1d: eb 27 jmp 0x46 1f: 48 8b 13 mov (%rbx),%rdx 22: a8 02 test $0x2,%al 24: 75 47 jne 0x6d 26: 48 c1 e7 0c shl $0xc,%rdi 2a:* 48 03 3a add (%rdx),%rdi <-- trapping instruction 2d: 48 01 ff add %rdi,%rdi 30: 48 d1 ff sar $1,%rdi 33: e8 26 f4 ff ff call 0xfffffffffffff45e 38: 41 8d 7c 24 01 lea 0x1(%r12),%edi 3d: 49 89 fc mov %rdi,%r12 Code starting with the faulting instruction =========================================== 0: 48 03 3a add (%rdx),%rdi 3: 48 01 ff add %rdi,%rdi 6: 48 d1 ff sar $1,%rdi 9: e8 26 f4 ff ff call 0xfffffffffffff434 e: 41 8d 7c 24 01 lea 0x1(%r12),%edi 13: 49 89 fc mov %rdi,%r12 <4>[ 2.418856] RSP: 0000:ffffb316c00e0f78 EFLAGS: 00010046 <4>[ 2.419172] RAX: 0000000000000169 RBX: ffffb316c0013e30 RCX: ffffb316c0013e30 <4>[ 2.419363] RDX: 000000000002aa97 RSI: 000000008b09dcbb RDI: 0000000000000000 <4>[ 2.419552] RBP: ffffb316c00e0f88 R08: 000000000000546c R09: 0000000000000000 <4>[ 2.419864] R10: 0000000000000000 R11: ffffb316c00e0ff8 R12: 0000000000000000 <4>[ 2.420309] R13: ffff8e357bd2daa0 R14: ffff8e3500aaaeb8 R15: ffffffff95148f50 <4>[ 2.420816] FS: 0000000000000000(0000) GS:ffff8e35e47bc000(0000) knlGS:0000000000000000 <4>[ 2.421298] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4>[ 2.421675] CR2: 000000000002aa97 CR3: 000000002ac48000 CR4: 00000000000006f0 <0>[ 2.422354] Kernel panic - not syncing: Fatal exception in interrupt <0>[ 2.425278] Kernel Offset: 0x13e00000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff) <0>[ 2.426205] ---[ end Kernel panic - not syncing: Fatal exception in interrupt ]--- ## Source * Kernel version: 6.16.0-rc4-next-20250701 * Git tree: https://kernel.googlesource.com/pub/scm/linux/kernel/git/next/linux-next.git * Git sha: 3f804361f3b9af33e00b90ec9cb5afcc96831e60 * Git describe: 6.16.0-rc4-next-20250701 * Architectures: arm64 * Toolchains: gcc-13 * Kconfigs: gcc-13-lkftconfig-no-kselftest-frag ## Build arm64 * Test log: https://qa-reports.linaro.org/api/testruns/28972335/log_file/ * Test LAVA log 1: https://lkft.validation.linaro.org/scheduler/job/8336872#L5891 * Test details: https://regressions.linaro.org/lkft/linux-next-master/next-20250701/log-par… * Build link: https://storage.tuxsuite.com/public/linaro/lkft/builds/2zGk2ZJWqj1Ukob9bJAF… * Kernel config: https://storage.tuxsuite.com/public/linaro/lkft/builds/2zGk2ZJWqj1Ukob9bJAF… -- Linaro LKFT https://lkft.linaro.org

3 weeks

Daily cts/vts report for lkft - 2025-Jul-02

by lava＠validation.linaro.org

Total jobs: 142 Total errors: 31 (21.83%) LAVA errors: 0 (0.00%) Test errors: 17 (11.97%) Job errors: 9 (6.34%) Infra errors: 5 (3.52%) Canceled jobs: 0 (0.00%) Device type: hi960-hikey Total jobs: 3 Total errors: 1 (33.33%) Error type: Test Error count: 1 (33.33%) Error: No match for error type 'Test', message 'tradefed - adb device lost[6A522E130177F475]' Count: 1 (33.33%) IDs: hi960-hikey-01: 8339557 Device type: sm8550-hdk Total jobs: 10 Total errors: 1 (10.00%) Error type: Test Error count: 1 (10.00%) Error: No match for error type 'Test', message 'tradefed - adb device lost[124d1c34]' Count: 1 (10.00%) IDs: sm8550-hdk-01: 8339149 Device type: qrb5165-rb5 Total jobs: 40 Total errors: 8 (20.00%) Error type: Test Error count: 5 (12.50%) Error: Device NOT found! Count: 2 (5.00%) IDs: rb5-07: 8339138 8339441 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 3 (7.50%) IDs: rb5-03: 8339068 8339136 8339381 Error type: Infrastructure Error count: 3 (7.50%) Error: Connection closed Count: 2 (5.00%) IDs: rb5-01: 8339135 8339139 Error: fastboot-flash-action timed out Count: 1 (2.50%) IDs: rb5-07: 8339066 Device type: dragonboard-845c Total jobs: 89 Total errors: 21 (23.60%) Error type: Job Error count: 9 (10.11%) Error: No match for error type 'Job', message 'login-action timed out after 873 seconds' Count: 8 (8.99%) IDs: db845c-01: 8339234 8339238 8339239 8339242 8339245 8339247 8339364 8339367 Error: No match for error type 'Job', message 'login-action timed out after 872 seconds' Count: 1 (1.12%) IDs: db845c-01: 8339228 Error type: Test Error count: 10 (11.24%) Error: No match for error type 'Test', message 'tradefed - adb device lost[b6b742b9]' Count: 1 (1.12%) IDs: db845c-01: 8339352 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 3 (3.37%) IDs: db845c-01: 8339192 db845c-02: 8339194 8339348 Error: Device NOT found! Count: 3 (3.37%) IDs: db845c-02: 8339230 8339240 db845c-06: 8339120 Error: No match for error type 'Test', message 'tradefed - adb device lost[dd3b965f]' Count: 1 (1.12%) IDs: db845c-02: 8339237 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 595 seconds' Count: 1 (1.12%) IDs: db845c-07: 8339199 Error: No match for error type 'Test', message 'tradefed - adb device lost[c7cf1849]' Count: 1 (1.12%) IDs: db845c-07: 8339191 Error type: Infrastructure Error count: 2 (2.25%) Error: Connection closed Count: 1 (1.12%) IDs: db845c-02: 8339202 Error: fastboot-flash-action timed out Count: 1 (1.12%) IDs: db845c-01: 8339069

3 weeks

Daily report for validation - 2025-Jul-02

by lava＠validation.linaro.org

Total jobs: 605 Total errors: 298 (49.26%) LAVA errors: 4 (0.66%) Test errors: 0 (0.00%) Job errors: 41 (6.78%) Infra errors: 253 (41.82%) Canceled jobs: 0 (0.00%) Device type: beaglebone-black Total jobs: 362 Total errors: 186 (51.38%) Error type: Infrastructure Error count: 174 (48.07%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 9 (2.49%) IDs: beaglebone-black03: 4156949 4157395 4159702 4159747 4159907 4159925 4160105 4160116 4160123 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 93 (25.69%) IDs: beaglebone-black03: 4156932 4156935 4156939 4156947 4157024 4157030 4157036 4157044 4157047 4157056 4157063 4157075 4157091 4157113 4157204 4157208 4157238 4157338 4157344 4157356 4157382 4157416 4157672 4159529 4159542 4159545 4159553 4159565 4159569 4159573 4159577 4159581 4159585 4159627 4159637 4159644 4159660 4159682 4159686 4159689 4159690 4159698 4159707 4159711 4159718 4159727 4159735 4159739 4159751 4159763 4159767 4159775 4159779 4159790 4159792 4159795 4159800 4159830 4159843 4159847 4159853 4159855 4159875 4159883 4159923 4159926 4159934 4159940 4159950 4159955 4159960 4159971 4159979 4159985 4159994 4160007 4160009 4160013 4160017 4160029 4160050 4160052 4160055 4160057 4160065 4160073 4160077 4160081 4160085 4160095 4160112 4160114 4160121 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 38 (10.50%) IDs: beaglebone-black03: 4156941 4156944 4156964 4157018 4157027 4157040 4157052 4157066 4157070 4157265 4157566 4157895 4157901 4159535 4159634 4159642 4159646 4159662 4159694 4159743 4159771 4159788 4159802 4159831 4159886 4159890 4159898 4159903 4159945 4159963 4159975 4160025 4160036 4160061 4160102 4160108 4160117 4160119 Error: matched a bootloader error message Count: 6 (1.66%) IDs: beaglebone-black03: 4159837 4159954 4159983 4160003 4160069 4160107 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 9 (2.49%) IDs: beaglebone-black03: 4157060 4159759 4159784 4159845 4159918 4159938 4159967 4159997 4160098 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 14 (3.87%) IDs: beaglebone-black03: 4156956 4157199 4157366 4159540 4159557 4159561 4159654 4159715 4159721 4159731 4159798 4159879 4160051 4160091 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 3 (0.83%) IDs: beaglebone-black03: 4157033 4157212 4159868 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 37 seconds' Count: 2 (0.55%) IDs: beaglebone-black03: 4159589 4159652 Error type: Job Error count: 8 (2.21%) Error: wait for prompt timed out Count: 8 (2.21%) IDs: beaglebone-black03: 4157016 4157899 4159648 4159755 4159894 4159911 4160021 4160033 Error type: Bug Error count: 4 (1.10%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 4 (1.10%) IDs: beaglebone-black03: 4157021 4157132 4157897 4159870 Device type: bcm2837-rpi-3-b-32 Total jobs: 186 Total errors: 99 (53.23%) Error type: Infrastructure Error count: 78 (41.94%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 78 (41.94%) IDs: rpi3-b-32-03: 4159551 4159555 4159563 4159567 4159571 4159575 4159579 4159640 4159669 4159683 4159687 4159696 4159700 4159703 4159713 4159716 4159719 4159723 4159725 4159729 4159733 4159737 4159741 4159745 4159749 4159753 4159757 4159761 4159765 4159773 4159777 4159780 4159782 4159786 4159832 4159866 4159871 4159873 4159881 4159884 4159888 4159896 4159899 4159901 4159909 4159921 4159924 4159936 4159942 4159947 4159957 4159959 4159961 4159965 4159969 4159977 4159981 4159986 4159996 4160005 4160011 4160015 4160019 4160023 4160027 4160038 4160048 4160059 4160063 4160067 4160071 4160075 4160079 4160083 4160087 4160093 4160096 4160100 Error type: Job Error count: 21 (11.29%) Error: wait for prompt timed out Count: 21 (11.29%) IDs: rpi3-b-32-03: 4159537 4159559 4159562 4159583 4159649 4159656 4159692 4159705 4159709 4159769 4159842 4159849 4159877 4159892 4159905 4159932 4159952 4159953 4159973 4160031 4160089 Device type: x15 Total jobs: 31 Total errors: 3 (9.68%) Error type: Job Error count: 3 (9.68%) Error: No match for error type 'Job', message 'login-action timed out after 275 seconds' Count: 2 (6.45%) IDs: x15-01: 4159538 4159680 Error: No match for error type 'Job', message 'login-action timed out after 273 seconds' Count: 1 (3.23%) IDs: x15-01: 4159655 Device type: dragonboard-845c Total jobs: 14 Total errors: 1 (7.14%) Error type: Infrastructure Error count: 1 (7.14%) Error: Connection closed Count: 1 (7.14%) IDs: dragonboard-845c-05: 4159943 Device type: dragonboard-410c Total jobs: 10 Total errors: 9 (90.00%) Error type: Job Error count: 9 (90.00%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 9 (90.00%) IDs: dragonboard-410c-01: 4159547 4159666 4159672 4159679 4159858 4159862 4159914 4159990 4160040 Device type: hi6220-hikey-r2 Total jobs: 1 Total errors: 0 (0.00%) Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

3 weeks

Daily cts/vts report for lkft - 2025-Jul-01

by lava＠validation.linaro.org

Total jobs: 216 Total errors: 37 (17.13%) LAVA errors: 0 (0.00%) Test errors: 26 (12.04%) Job errors: 6 (2.78%) Infra errors: 5 (2.31%) Canceled jobs: 0 (0.00%) Device type: qrb5165-rb5 Total jobs: 66 Total errors: 14 (21.21%) Error type: Test Error count: 9 (13.64%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 4 (6.06%) IDs: rb5-03: 8337984 8338247 8338258 rb5-07: 8338218 Error: No match for error type 'Test', message 'tradefed - adb device lost[4fc7b22]' Count: 1 (1.52%) IDs: rb5-06: 8338174 Error: Device NOT found! Count: 2 (3.03%) IDs: rb5-03: 8338156 rb5-07: 8338145 Error: No match for error type 'Test', message 'tradefed - adb device lost[93dcfd96]' Count: 1 (1.52%) IDs: rb5-01: 8338090 Error: No match for error type 'Test', message 'tradefed - adb device lost[74d67c95]' Count: 1 (1.52%) IDs: rb5-03: 8338060 Error type: Infrastructure Error count: 5 (7.58%) Error: Connection closed Count: 5 (7.58%) IDs: rb5-01: 8337985 8338029 8338032 rb5-05: 8338027 8338209 Device type: dragonboard-845c Total jobs: 124 Total errors: 19 (15.32%) Error type: Test Error count: 13 (10.48%) Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 598 seconds' Count: 9 (7.26%) IDs: db845c-01: 8337882 8337996 8338082 db845c-02: 8338266 db845c-03: 8338240 db845c-04: 8338053 db845c-06: 8338143 db845c-07: 8337961 8338278 Error: Device NOT found! Count: 1 (0.81%) IDs: db845c-02: 8338277 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 583 seconds' Count: 1 (0.81%) IDs: db845c-02: 8338013 Error: No match for error type 'Test', message 'lava-docker-test-shell timed out after 599 seconds' Count: 1 (0.81%) IDs: db845c-01: 8337992 Error: No match for error type 'Test', message 'tradefed - adb device lost[f3a58ae3]' Count: 1 (0.81%) IDs: db845c-04: 8337908 Error type: Job Error count: 6 (4.84%) Error: No match for error type 'Job', message 'login-action timed out after 873 seconds' Count: 4 (3.23%) IDs: db845c-01: 8338019 8338161 8338227 8338230 Error: No match for error type 'Job', message 'login-action timed out after 788 seconds' Count: 1 (0.81%) IDs: db845c-01: 8338057 Error: No match for error type 'Job', message 'login-action timed out after 872 seconds' Count: 1 (0.81%) IDs: db845c-01: 8338051 Device type: sm8550-hdk Total jobs: 20 Total errors: 1 (5.00%) Error type: Test Error count: 1 (5.00%) Error: Device NOT found! Count: 1 (5.00%) IDs: sm8550-hdk-01: 8338036 Device type: hi6220-hikey-r2 Total jobs: 3 Total errors: 3 (100.00%) Error type: Test Error count: 3 (100.00%) Error: No match for error type 'Test', message 'tradefed - adb device lost[191FC75C003312EE]' Count: 1 (33.33%) IDs: hikey-6220-r2-06: 8338188 Error: No match for error type 'Test', message 'The network seems not available, as the ping command failed' Count: 2 (66.67%) IDs: hikey-6220-r2-01: 8337888 hikey-6220-r2-05: 8338106 Device type: x86 Total jobs: 1 Total errors: 0 (0.00%) Device type: hi960-hikey Total jobs: 2 Total errors: 0 (0.00%)

3 weeks, 1 day

Daily report for validation - 2025-Jul-01

by lava＠validation.linaro.org

Total jobs: 588 Total errors: 295 (50.17%) LAVA errors: 8 (1.36%) Test errors: 1 (0.17%) Job errors: 44 (7.48%) Infra errors: 242 (41.16%) Canceled jobs: 0 (0.00%) Device type: beaglebone-black Total jobs: 365 Total errors: 187 (51.23%) Error type: Infrastructure Error count: 175 (47.95%) Error: matched a bootloader error message Count: 6 (1.64%) IDs: beaglebone-black03: 4156508 4159191 4159195 4159231 4159308 4159460 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 41 seconds' Count: 84 (23.01%) IDs: beaglebone-black03: 4156155 4156213 4156262 4156331 4156421 4156453 4156859 4158750 4158754 4158757 4158771 4158775 4158779 4158787 4158791 4158797 4158806 4158810 4158816 4158820 4158824 4158833 4158836 4158842 4158848 4158851 4158854 4158863 4158864 4158871 4158875 4158905 4158913 4158928 4158941 4158949 4158952 4158963 4158968 4158972 4158974 4158978 4158984 4158987 4158995 4159002 4159013 4159016 4159045 4159049 4159056 4159060 4159064 4159073 4159080 4159093 4159097 4159100 4159104 4159108 4159149 4159159 4159189 4159192 4159211 4159215 4159228 4159230 4159232 4159237 4159333 4159336 4159353 4159357 4159366 4159372 4159390 4159402 4159410 4159414 4159418 4159435 4159437 4159441 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 39 seconds' Count: 20 (5.48%) IDs: beaglebone-black03: 4156209 4156476 4156804 4156814 4158783 4158813 4158916 4158920 4158961 4158966 4159041 4159089 4159176 4159181 4159225 4159350 4159381 4159423 4159426 4159433 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 40 seconds' Count: 33 (9.04%) IDs: beaglebone-black03: 4156174 4156327 4156338 4156342 4156374 4156425 4156733 4158765 4158839 4158845 4158884 4158898 4158924 4158933 4158937 4158945 4158955 4158982 4158989 4158997 4159003 4159030 4159033 4159052 4159077 4159126 4159132 4159147 4159155 4159200 4159219 4159370 4159429 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 42 seconds' Count: 9 (2.47%) IDs: beaglebone-black03: 4156436 4159036 4159068 4159102 4159169 4159204 4159222 4159387 4159406 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 38 seconds' Count: 16 (4.38%) IDs: beaglebone-black03: 4156335 4158858 4158867 4158902 4158909 4158970 4158976 4159014 4159128 4159145 4159165 4159172 4159208 4159235 4159383 4159398 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 44 seconds' Count: 6 (1.64%) IDs: beaglebone-black03: 4156619 4158793 4159084 4159106 4159161 4159394 Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 37 seconds' Count: 1 (0.27%) IDs: beaglebone-black03: 4159348 Error type: Bug Error count: 8 (2.19%) Error: No match for error type 'Bug', message 'Invalid max_end_time value passed to wait()' Count: 8 (2.19%) IDs: beaglebone-black03: 4156151 4156459 4156819 4158761 4158802 4158830 4158880 4159439 Error type: Job Error count: 4 (1.10%) Error: wait for prompt timed out Count: 4 (1.10%) IDs: beaglebone-black03: 4158879 4159185 4159346 4159375 Device type: bcm2837-rpi-3-b-32 Total jobs: 173 Total errors: 98 (56.65%) Error type: Job Error count: 31 (17.92%) Error: wait for prompt timed out Count: 31 (17.92%) IDs: rpi3-b-32-03: 4158808 4158811 4158818 4158868 4158873 4158907 4158922 4158943 4158947 4158957 4159008 4159028 4159043 4159062 4159071 4159078 4159095 4159134 4159157 4159170 4159183 4159190 4159194 4159213 4159359 4159369 4159412 4159419 4159421 4159424 4159430 Error type: Infrastructure Error count: 67 (38.73%) Error: No match for error type 'Infrastructure', message 'bootloader-commands timed out after 35 seconds' Count: 67 (38.73%) IDs: rpi3-b-32-03: 4158483 4158814 4158822 4158826 4158828 4158831 4158834 4158882 4158895 4158900 4158904 4158911 4158914 4158918 4158926 4158929 4158931 4158935 4158939 4158950 4158953 4158959 4159004 4159031 4159037 4159039 4159047 4159050 4159054 4159058 4159066 4159069 4159075 4159082 4159085 4159087 4159091 4159148 4159153 4159163 4159167 4159174 4159177 4159179 4159187 4159197 4159198 4159202 4159206 4159210 4159217 4159220 4159331 4159344 4159352 4159355 4159378 4159379 4159385 4159389 4159392 4159396 4159400 4159404 4159408 4159416 4159427 Device type: x15 Total jobs: 26 Total errors: 1 (3.85%) Error type: Job Error count: 1 (3.85%) Error: No match for error type 'Job', message 'login-action timed out after 274 seconds' Count: 1 (3.85%) IDs: x15-01: 4158876 Device type: dragonboard-410c Total jobs: 9 Total errors: 8 (88.89%) Error type: Job Error count: 8 (88.89%) Error: No match for error type 'Job', message 'Unable to update image rootfs: 'mount: mount exited with status 32: mount: /sysroot: wrong fs type, bad option, bad superblock on /dev/sda, missing codepage or helper program, or other error.\n dmesg(1) may have more information after failed mount system call.'' Count: 8 (88.89%) IDs: dragonboard-410c-01: 4158888 4158891 4159020 4159022 4159122 4159140 4159328 4159362 Device type: dragonboard-845c Total jobs: 12 Total errors: 0 (0.00%) Device type: hi6220-hikey-r2 Total jobs: 2 Total errors: 1 (50.00%) Error type: Test Error count: 1 (50.00%) Error: lava-test-shell timed out Count: 1 (50.00%) IDs: hi6220-hikey-r2-02: 4158985 Device type: imx93-11x11-evk Total jobs: 1 Total errors: 0 (0.00%)

3 weeks, 1 day

2025

2024

2023

2022

2021

2020

2019

2018

2017

Lkft-triage July 2025