This is an automated email from the git hooks/post-receive script.

bernie.ogden pushed a change to branch bernie/benchmarking-uinstance-stability in repository toolchain/abe.

omits a7f2dbd Support injection of metadata into test runs omits 09fb5ea Replace output_param with output_{value,slot} omits 9be83a4 Apply NAME=VALUE CLI overrides before Benchmark.sh omits a1eeab3 Move output_param to top of Benchmark.sh omits 270c091 s/bench-session-debian/host-session/ omits b09f36a Tighten CoremarkPro gather script, add many tests omits 122c2c0 Template for use in trusted LAVA uinstance omits bbb395c Add missing tcpdump dependency omits 43c9228 Permit host machine to be of any type omits 09bdfbd Close all tmpdir files before deletion omits 1d8de3f Benchmark.sh: Support mustang host/target omits eb64205 Benchmark.sh: Support deploy_linaro_kernel omits bd88f32 Preserve stdout/stderr separation in cmd output omits 50d142c Output 'Running ${cmd}' to the log omits aa42d7d tee stderr to log, when there is a log. omits 2d538c1 Always set safe_output when in a trusted LAVA omits eac453a controlledrun.sh logs to /dev/console if running in LAVA omits 00b4918 controlledrun.sh output log set by board conf omits 467b46c Increase default timeout from 0.5 to 1.5 hours. omits e02a4ac Make TIMEOUT overrideable omits dc7208a Remove redundant boot_timeout parameter omits 3c16f60 Update CLI-related messages omits 4ac9fa7 Remove redundant 'tag' option omits ca1a754 Some more detail around data collection message omits 005130d Make ssh messages depend on instance omits f06b375 Defer to user-specified TARGET_SESSION omits 2b80013 Rationalize *-session YAML omits 4b05f35 Do not infer device validation from triple omits d5fc4fa Decouple triple from toolchain omits 4776e83 host-session: shift CLI args when parsing omits 46515e0 host-session invokes benchmark scripts with -x omits 21191fe Remove redundant ABE_BRANCH parameter omits 7c16e82 host-session: Consistent use of {} with args omits 2c45884 gather scripts: Provide mime type for attachments omits 718f081 benchmark.sh preserves -x for runbenchmark.sh omits db734ca gather: set -x in all gather scripts omits 3ee3e85 Return gather script exit code within post-run cmd omits 739ef0f Wait for post-run command to complete omits ce9723a Convert post-run cmd to function omits a83bb6f Convert post-run command into multiline string omits bc78241 Add comments about post-run/gather.sh omits 0a2c98d target-session: Tidy up kill/wait code omits 5a2d355 Simplify post-run-cmd-not-set NOP omits fee0475 Check post-run command exit code omits 2737c8f runbenchmark.sh: Fix indentation omits 664a22a Match tcpdump output even if user gave username omits dbb5765 Match tcpdump output even if user gave hostnames omits ab195d6 Do not report names in tcpdump omits 00efa90 benchmark.sh: Rename GCC to something more generic omits 7564dc4 Clean up toolchain usage omits 5247c78 Ensure that unset params get value None omits 98cb66e CoremarkPro.conf: Fix native paths omits 538e8c9 CoremarkPro.sh: Report sizes first omits 840c59c CoremarkPro.sh: Require exactly one log omits a2f6a36 CoremarkPro.sh: Remove commented-out code omits d6f9433 CoremarkPro.sh: Pass name to report_measured omits 5333caf CoremarkPro.sh: Make function-local var local omits cc8f4c6 CoremarkPro.sh: Count everything that can be multiple omits f08116e CoremarkPro.sh: Cosmetic changes to test IDs omits 875550c CoremarkPro.sh: Eliminate spaces in TEST_CASE_ID omits 4294622 CoremarkPro.sh: [] notation for iterations only omits 40401bf CoremarkPro.sh: Name size measurements sanely omits 85eb137 CoremarkPro.sh: Whitespace: Old comment,blank line omits 3791bcd test_CoremarkPro.sh: Don't output errors when testing fail cases omits d3d5564 CoremarkPro.sh: Attach raw data before processing omits 0e89377 CoremarkPro.sh: Unique names for time and rate omits 3bdbebf Gather script for Coremark Pro omits 4d88d39 dispatch-benchmark.py: Support Coremark Pro omits 3fa590a CoremarkPro support omits d30aab9 Add some (commented-out) debugging output omits 0090cf7 Always read configs with target context omits f7cd930 Apply target context when looking for binaries omits 850f9e8 Support external sysroot omits ac935d1 dispatch-benchmark.py: More detail on keyring fail omits 670b53f dispatch-benchmark.py: Option to set bundle stream omits aae6971 dispatch-benchmark.py: Validate input omits 4f3b11e dispatch-benchmark.py: Message on dry-run exit omits e2916a4 dispatch-benchmark.py: Move dryrun exit to more natural location omits 0966ff6 dispatch-benchmark.py: Script to dispatch benchmarks omits 3fe5540 template.yaml: Metadata must be a string omits efcde62 Remove old jobdefs omits 2872939 Benchmark.sh,template.yaml: s/BUNDLE_STREAM_NAME/BUNDLE_STREAM/ omits db3b049 Benchmark.sh: Make bundle stream default paranoid omits 592e193 Benchmark.sh: Handle enquoting in parameters omits ae8681e Benchmark.sh: Set BUNDLE_STREAM_NAME only if unset omits 25154c3 Benchmark.sh: Set the right default branch omits 6c3a29c Benchmark.sh: Remove redundant comments omits 2405952 Benchmark.sh,template.yaml: Map from target type to image omits c4ebf8e Benchmark.sh,template.yaml: Accept public key omits 4c2f3f8 Benchmark.sh,template.yaml: s/ABE_/TESTDEF_/ omits 0731d06 Benchmark.sh: Make LAVA_USER available to params omits c441b22 Benchmark.sh: Get bundle server from external LAVA_SERVER def omits da36899 Benchmark.sh: Braces-and-spaces omits d6ec046 Benchmark.sh: Allow optional parms to be undefined omits de3233a Import template.yaml from lava-jobs omits 7cb078f Add script to derive all job parameters omits 15581eb Remove redundant TODO omits 7b847ed WIP: 'Semi-trusted' concept, for testing purposes omits 86f4ae8 CPU2006.sh: Attach raw output to run omits 145055f fakebench.sh: Attach to run, not a test case omits db6df86 Gather script + tests for CPU2006 new 3118bd9 Gather script + tests for CPU2006 new 43510a0 fakebench.sh: Attach to run, not a test case new 58345c0 CPU2006.sh: Attach raw output to run new 3154ce7 WIP: 'Semi-trusted' concept, for testing purposes new 871cd82 Remove redundant TODO new a84d243 Add script to derive all job parameters new 9d16303 Import template.yaml from lava-jobs new 005052b Benchmark.sh: Allow optional parms to be undefined new d6c5d33 Benchmark.sh: Braces-and-spaces new 6280052 Benchmark.sh: Get bundle server from external LAVA_SERVER def new 495e58b Benchmark.sh: Make LAVA_USER available to params new 1f77e5e Benchmark.sh,template.yaml: s/ABE_/TESTDEF_/ new 5bfd0bd Benchmark.sh,template.yaml: Accept public key new f169e4b Benchmark.sh,template.yaml: Map from target type to image new 1401047 Benchmark.sh: Remove redundant comments new 68b1981 Benchmark.sh: Set the right default branch new c562514 Benchmark.sh: Set BUNDLE_STREAM_NAME only if unset new 6ac12d0 Benchmark.sh: Handle enquoting in parameters new 8e59dd6 Benchmark.sh: Make bundle stream default paranoid new 41d0f42 Benchmark.sh,template.yaml: s/BUNDLE_STREAM_NAME/BUNDLE_STREAM/ new 78bcf07 Remove old jobdefs new 608805f template.yaml: Metadata must be a string new 63d7267 dispatch-benchmark.py: Script to dispatch benchmarks new d65fa14 dispatch-benchmark.py: Move dryrun exit to more natural location new 56c3d58 dispatch-benchmark.py: Message on dry-run exit new 3ed8ab2 dispatch-benchmark.py: Validate input new 35b6e66 dispatch-benchmark.py: Option to set bundle stream new 523c993 dispatch-benchmark.py: More detail on keyring fail new 62fe49f Support external sysroot new 0d8c09b Apply target context when looking for binaries new 739e7bd Always read configs with target context new 55c45e1 Add some (commented-out) debugging output new 4c3081c CoremarkPro support new 6e9252a dispatch-benchmark.py: Support Coremark Pro new 94a8c93 Gather script for Coremark Pro new 3fee4d2 CoremarkPro.sh: Unique names for time and rate new 5e9c900 CoremarkPro.sh: Attach raw data before processing new f93b766 test_CoremarkPro.sh: Don't output errors when testing fail cases new 5f1acaf CoremarkPro.sh: Whitespace: Old comment,blank line new 4612f9b CoremarkPro.sh: Name size measurements sanely new d822ea8 CoremarkPro.sh: [] notation for iterations only new bfb3228 CoremarkPro.sh: Eliminate spaces in TEST_CASE_ID new 0196c19 CoremarkPro.sh: Cosmetic changes to test IDs new 75c5bb8 CoremarkPro.sh: Count everything that can be multiple new 6e5ffb5 CoremarkPro.sh: Make function-local var local new d1dbf70 CoremarkPro.sh: Pass name to report_measured new ec43b18 CoremarkPro.sh: Remove commented-out code new 2b96405 CoremarkPro.sh: Require exactly one log new 6b8a318 CoremarkPro.sh: Report sizes first new c9abbaa CoremarkPro.conf: Fix native paths new 24ccf4c Ensure that unset params get value None new ae92bca Clean up toolchain usage new dbccbf7 benchmark.sh: Rename GCC to something more generic new 6455493 Do not report names in tcpdump new a17695b Match tcpdump output even if user gave hostnames new 171b669 Match tcpdump output even if user gave username new 12afee8 runbenchmark.sh: Fix indentation new 52ea2a6 Check post-run command exit code new 032fabb Simplify post-run-cmd-not-set NOP new c0ffc80 target-session: Tidy up kill/wait code new bdd3240 Add comments about post-run/gather.sh new d85e233 Convert post-run command into multiline string new 09d2a29 Convert post-run cmd to function new 23c215c Wait for post-run command to complete new 0dd260d Return gather script exit code within post-run cmd new 7bb3835 gather: set -x in all gather scripts new 45f755b benchmark.sh preserves -x for runbenchmark.sh new f961fd2 gather scripts: Provide mime type for attachments new 6d0f835 host-session: Consistent use of {} with args new 0daa964 Remove redundant ABE_BRANCH parameter new 450285e host-session invokes benchmark scripts with -x new 3072c57 host-session: shift CLI args when parsing new 2ff8168 Decouple triple from toolchain new 2ae4a4b Do not infer device validation from triple new a368842 Rationalize *-session YAML new ef21e95 Defer to user-specified TARGET_SESSION new fbab63b Make ssh messages depend on instance new eb2085c Some more detail around data collection message new 1fc962f Remove redundant 'tag' option new c323c45 Update CLI-related messages new 1b08bca Remove redundant boot_timeout parameter new 4ee479c Make TIMEOUT overrideable new 560fc6c Increase default timeout from 0.5 to 1.5 hours. new 65e698e controlledrun.sh output log set by board conf new 18fa0a6 controlledrun.sh logs to /dev/console if running in LAVA new 8ae28c9 Always set safe_output when in a trusted LAVA new cbf4247 tee stderr to log, when there is a log. new 20d87d2 Output 'Running ${cmd}' to the log new ee93e18 Preserve stdout/stderr separation in cmd output new e81cbd0 Benchmark.sh: Support deploy_linaro_kernel new 7f9efa6 Benchmark.sh: Support mustang host/target new 8a9b513 Close all tmpdir files before deletion new 21eb203 Permit host machine to be of any type new 791b651 Add missing tcpdump dependency new d0ed7bc Template for use in trusted LAVA uinstance new d6518bc Tighten CoremarkPro gather script, add many tests new f4e959a s/bench-session-debian/host-session/ new d5a46db Move output_param to top of Benchmark.sh new ab3f3a4 Apply NAME=VALUE CLI overrides before Benchmark.sh new caf4fe7 Replace output_param with output_{value,slot} new 7f53439 Support injection of metadata into test runs

This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this:

* -- * -- B -- O -- O -- O (a7f2dbd) \ N -- N -- N refs/heads/bernie/benchmarking-uinstance-stability (7f53439)

You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B.

Any revisions marked "omits" are not gone; other references still refer to them. Any revisions marked "discards" are gone forever.

The 101 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "adds" were already present in the repository and have only been added to this reference.

Summary of changes: config/bench/gather/CPU2006.sh | 19 +------------------ 1 file changed, 1 insertion(+), 18 deletions(-)