These tests are incorrect. I'll update the tests.
The issue is caused by an incorrect setting in C/0031/fastmath.cmake. Among the four tested optimization configurations, only the configuration using -O3 -ffast-math -flto fails. The relative error tolerances for 0031_0089, 0031_0110, and 0031_0122 had already been corrected in the 20260323 branch on March 30, 2026, and the correction was incorporated into the main branch as part of the 2026-06 release on June 4, 2026. However, commit 898157e94182d9ad70b9c641be0488e2f8e15e5d removed those relative error tolerance settings from fastmath.cmake. As a result, the default tolerance for the fast-math configuration, 1.0e-14, is now used. This tolerance is too strict for the numerical differences produced by Clang with -O3 -ffast-math -flto, causing fpcmp-target to fail.
Based on the above, restore the relative error tolerance settings that were removed from C/0031/fastmath.cmake. Specifically, revert the relevant change introduced by: 898157e94182d9ad70b9c641be0488e2f8e15e5d This restores the tolerance settings that had previously been added by the correction corresponding to commit 713d97dc.
Best regards, Yasuyuki Ohno
Software Development Div., Advanced Technology Development Unit, Fujitsu Research, Fujitsu Limited, JAPAN. ________________________________ 差出人: ci_notify@linaro.org ci_notify@linaro.org 送信日時: 2026年10月31日 20:02 宛先: contact-ci-compiler-test-suite@cs.jp.fujitsu.com contact-ci-compiler-test-suite@cs.jp.fujitsu.com CC: 114733434+ohno-fj@users.noreply.github.com 114733434+ohno-fj@users.noreply.github.com; maxim.kuvyrkov@linaro.org maxim.kuvyrkov@linaro.org 件名: [Linaro-TCWG-CI] 2025-09-89-g898157e94: 3 regressions on aarch64
Dear contributor,
Our automatic CI has detected problems related to your patch(es). Please find some details below.
In tcwg_flang_test/main-aarch64-Ofast-sve_vls-lto-lld, after: | commit 2025-09-89-g898157e94 | Author: ohno-fj 114733434+ohno-fj@users.noreply.github.com | Date: Wed Sep 16 16:02:10 2026 +0900 | | Workitem 14427_0031 (for GCC) (#154) | | Co-authored-by: ohno ohno.yasuyuki@jp.fujitsu.com
Produces 3 regressions: | | regressions.sum: | Running test-suite:Fujitsu/C/0031 ... | FAIL: test-suite :: Fujitsu/C/0031/Fujitsu-C-0031_0089.test | FAIL: test-suite :: Fujitsu/C/0031/Fujitsu-C-0031_0110.test | FAIL: test-suite :: Fujitsu/C/0031/Fujitsu-C-0031_0122.test | # "FAIL" means : the execution of the compiled binary failed / output of the binary differs from the expected one
Used configuration : * Toolchain : cmake -G Ninja ../llvm/llvm "-DLLVM_ENABLE_PROJECTS=clang;lld;flang;clang-tools-extra" "-DLLVM_ENABLE_RUNTIMES=openmp" -DCMAKE_BUILD_TYPE=Release -DLLVM_ENABLE_ASSERTIONS=True -DCMAKE_INSTALL_PREFIX=../llvm-install "-DLLVM_TARGETS_TO_BUILD=AArch64" -DCLANG_DEFAULT_LINKER=lld * Testsuite : export LD_LIBRARY_PATH=$\WORKSPACE/llvm-install/lib/aarch64-unknown-linux-gnu${LD_LIBRARY_PATH:+:$\LD_LIBRARY_PATH} cmake -GNinja -DCMAKE_C_COMPILER="$\WORKSPACE/llvm-install/bin2/clang" -DCMAKE_CXX_COMPILER="$\WORKSPACE/llvm-install/bin2/clang++" -DCMAKE_Fortran_COMPILER="$\WORKSPACE/llvm-install/bin2/flang-new" -DCMAKE_BUILD_TYPE=Release -DCMAKE_C_FLAGS= -DCMAKE_CXX_FLAGS= -DCMAKE_Fortran_FLAGS= -DCMAKE_C_FLAGS_RELEASE="-O3 -ffast-math -march=armv8.4-a+sve -msve-vector-bits=256 -flto -fuse-ld=lld -DNDEBUG" -DCMAKE_CXX_FLAGS_RELEASE="-O3 -ffast-math -march=armv8.4-a+sve -msve-vector-bits=256 -flto -fuse-ld=lld -DNDEBUG" -DCMAKE_Fortran_FLAGS_RELEASE="-O3 -ffast-math -march=armv8.4-a+sve -msve-vector-bits=256 -flto -fuse-ld=lld -DNDEBUG" -DTEST_SUITE_FORTRAN=ON -DTEST_SUITE_SUBDIRS=Fujitsu -DTEST_SUITE_FUJITSU_WITH_FAST_MATH=ON "$\WORKSPACE/test/test-suite"
We track this bug report under https://linaro.atlassian.net/browse/LLVM-2301. (Require Linaro login) Please let us know if you have a fix.
If you have any questions regarding this report, please ask on linaro-toolchain@lists.linaro.org mailing list.
-----------------8<--------------------------8<--------------------------8<--------------------------
The information below contains the details of the failures, and the ways to reproduce a debug environment:
You can find the failure logs in *.log.1.xz files in * http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-l... The full lists of regressions and improvements as well as configure and make commands are in * http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-l... The list of [ignored] baseline and flaky failures are in * http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-l...
Fujitsu testsuite : https://github.com/fujitsu/compiler-test-suite/
Current build : http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-l... Reference build : http://54.172.246.49:9090/jobs/tcwg_flang_test--main-aarch64-Ofast-sve_vls-l...
Instruction to reproduce the build : https://gitlab.com/LinaroLtd/tcwg/ci/interesting-commits/-/raw/master/fujits...
Full commit : https://github.com/fujitsu/compiler-test-suite/commit/898157e94182d9ad70b9c6...