This is an automated email from the git hooks/post-receive script.

bernie.ogden pushed a change to branch origin/bernie/benchmarking-uinstance-stability in repository toolchain/abe.

was 60cf45a Support injection of metadata into test runs

This change permanently discards the following revisions:

discards 60cf45a Support injection of metadata into test runs discards 70dcb35 Replace output_param with output_{value,slot} discards 2e8f956 Apply NAME=VALUE CLI overrides before Benchmark.sh discards 1a3da32 Move output_param to top of Benchmark.sh discards bd469b8 s/bench-session-debian/host-session/ discards 0a3303f Tighten CoremarkPro gather script, add many tests discards 7df5dad Template for use in trusted LAVA uinstance discards 714232f Add missing tcpdump dependency discards f6eaed0 Permit host machine to be of any type discards 58d9c03 Close all tmpdir files before deletion discards c0972b5 Benchmark.sh: Support mustang host/target discards ccbb3a3 Benchmark.sh: Support deploy_linaro_kernel discards b9a84c8 Preserve stdout/stderr separation in cmd output discards 6ae1b98 Output 'Running ${cmd}' to the log discards 21dcf20 tee stderr to log, when there is a log. discards 8c9803f Always set safe_output when in a trusted LAVA discards 254f27c controlledrun.sh logs to /dev/console if running in LAVA discards a8ba392 controlledrun.sh output log set by board conf discards 7935ece Increase default timeout from 0.5 to 1.5 hours. discards 10a6d5e Make TIMEOUT overrideable discards fd15217 Remove redundant boot_timeout parameter discards 5cabcee Update CLI-related messages discards 8c7b632 Remove redundant 'tag' option discards dd73e3a Some more detail around data collection message discards bf530ad Make ssh messages depend on instance discards 64bbb11 Defer to user-specified TARGET_SESSION discards 1071f91 Rationalize *-session YAML discards 4dd43f1 Do not infer device validation from triple discards 237c840 Decouple triple from toolchain discards 1355fa0 host-session: shift CLI args when parsing discards d7c4e10 host-session invokes benchmark scripts with -x discards 4b43ccb Remove redundant ABE_BRANCH parameter discards 8ea5146 host-session: Consistent use of {} with args discards 733f894 gather scripts: Provide mime type for attachments discards 73804fc benchmark.sh preserves -x for runbenchmark.sh discards 0925d63 gather: set -x in all gather scripts discards cade9d8 Return gather script exit code within post-run cmd discards e2da049 Wait for post-run command to complete discards fa2edb7 Convert post-run cmd to function discards 2567eda Convert post-run command into multiline string discards d5fbb5c Add comments about post-run/gather.sh discards f64d29b target-session: Tidy up kill/wait code discards 598dbbf Simplify post-run-cmd-not-set NOP discards e97e0c1 Check post-run command exit code discards 202a1fb runbenchmark.sh: Fix indentation discards 73e6e18 Match tcpdump output even if user gave username discards 524d996 Match tcpdump output even if user gave hostnames discards a6460a3 Do not report names in tcpdump discards bbc24f4 benchmark.sh: Rename GCC to something more generic discards f9ba865 Clean up toolchain usage discards d49b1cf Ensure that unset params get value None discards 51f8968 CoremarkPro.conf: Fix native paths discards 54294e4 CoremarkPro.sh: Report sizes first discards ba76222 CoremarkPro.sh: Require exactly one log discards 1a29fef CoremarkPro.sh: Remove commented-out code discards 400ed9f CoremarkPro.sh: Pass name to report_measured discards 15471cd CoremarkPro.sh: Make function-local var local discards dc11405 CoremarkPro.sh: Count everything that can be multiple discards cace859 CoremarkPro.sh: Cosmetic changes to test IDs discards 0983a16 CoremarkPro.sh: Eliminate spaces in TEST_CASE_ID discards 3b9a139 CoremarkPro.sh: [] notation for iterations only discards c5c4cca CoremarkPro.sh: Name size measurements sanely discards 5aff508 CoremarkPro.sh: Whitespace: Old comment,blank line discards fb29817 test_CoremarkPro.sh: Don't output errors when testing fail cases discards dc788c1 CoremarkPro.sh: Attach raw data before processing discards cc45976 CoremarkPro.sh: Unique names for time and rate discards da34e4d Gather script for Coremark Pro discards a0e931d dispatch-benchmark.py: Support Coremark Pro discards 8aa4179 CoremarkPro support discards d859677 Add some (commented-out) debugging output discards 2d5cb47 Always read configs with target context discards f0b21cc Apply target context when looking for binaries discards 18d9438 Support external sysroot discards 3326e0e dispatch-benchmark.py: More detail on keyring fail discards 686e747 dispatch-benchmark.py: Option to set bundle stream discards aac012d dispatch-benchmark.py: Validate input discards c7e8f86 dispatch-benchmark.py: Message on dry-run exit discards e0c65e3 dispatch-benchmark.py: Move dryrun exit to more natural location discards c69cfac dispatch-benchmark.py: Script to dispatch benchmarks discards 858b801 template.yaml: Metadata must be a string discards 631f66b Remove old jobdefs discards a10bf01 Benchmark.sh,template.yaml: s/BUNDLE_STREAM_NAME/BUNDLE_STREAM/ discards 72bd804 Benchmark.sh: Make bundle stream default paranoid discards b570880 Benchmark.sh: Handle enquoting in parameters discards 637d2df Benchmark.sh: Set BUNDLE_STREAM_NAME only if unset discards 247523b Benchmark.sh: Set the right default branch discards 2a92992 Benchmark.sh: Remove redundant comments discards 3b6a571 Benchmark.sh,template.yaml: Map from target type to image discards 63475a5 Benchmark.sh,template.yaml: Accept public key discards 81b344d Benchmark.sh,template.yaml: s/ABE_/TESTDEF_/ discards 35304cd Benchmark.sh: Make LAVA_USER available to params discards 92452c0 Benchmark.sh: Get bundle server from external LAVA_SERVER def discards 439ea60 Benchmark.sh: Braces-and-spaces discards 31ba4d2 Benchmark.sh: Allow optional parms to be undefined discards 4246b1d Import template.yaml from lava-jobs discards 45b7b6a Add script to derive all job parameters discards c54aeb1 Remove redundant TODO discards ec39941 WIP: 'Semi-trusted' concept, for testing purposes discards 2aa9d8a Test case where some subbenchmarks fail discards f6ec775 Use spec.cpu200x.invalid rather than ...valid discards 047be3e Multiply ratios for CPU2000 discards bcdad70 Make locals in generate_subbenchmark actually local discards aeed551 Print the leading 0 if integer part is 0 discards 80f7cd6 Test more realistic values for input sizes discards 48be5f3 Correct naming style of test input discards 48f939d Add tests for cases where the script should fail discards 549471a Update error message discards b39d49f Test non-ref input sizes discards 9753b68 Fix off-by-1 in iteration counts discards 1e8a4ca Test random mixes of subbenchmarks discards 399b3f1 Add tests for individual benchmark runs discards dcf59b2 Separate benchset definitions from individual runs discards 01c23fe Add exit, error handlers discards 8be0d1c Add a set -o pipefail discards 6bbfb61 Add (commented-out) debugging printf discards 199c6b6 Test cases where only int or fp was run discards bdda15a Move boilerplate to generate_benchmark and rename discards fc8691f Handle different spellings of benchmark names discards d1c8566 raw is global, stop passing it around everywhere. discards d1750e6 Remove unused variables discards 3a3e9b8 Lead regexp with ^ discards 9e7c2c0 CPU200x*: Support CPU2000 results. discards 94dc098 test_CPU200x: Paramaterise bits that vary for 2k discards 983f3ad Rename *CPU2006.sh to *CPU200x.sh discards bb7e88a test_CPU2006.sh: Give doit a sensible name discards b204cdd Rework CPU2006.sh to use 'raw' output discards bfb5cff CPU2006.sh: Attach raw output to run discards ba30d67 fakebench.sh: Attach to run, not a test case discards 38363e1 Gather script + tests for CPU2006 discards d9965fd gather/fakebench.sh: All output to console discards 787ec14 WIP: Experiment in collecting metadata