Tcwg-commits July 2015

tcwg-commits@lists.linaro.org

2 participants
1355 discussions

[toolchain/lavabench] 04/04: Enquote public key before writing it

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a commit to branch lastwibbles in repository toolchain/lavabench. commit 21c813a1d4bd1bbf4c6c5cbcf4cb0771656f654b Author: Bernard Ogden <bernie.ogden(a)linaro.org> Date: Tue Jul 28 11:42:53 2015 +0200 Enquote public key before writing it Change-Id: I09178f13f5b5328715f6e8224b1c4c2c3c2d8e1f --- bench-session | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/bench-session b/bench-session index a95d425..b817f8c 100755 --- a/bench-session +++ b/bench-session @@ -3,7 +3,7 @@ echo "Hostname for early debugging: $(cat /etc/hostname)" echo "IP address for early debugging: $(hostname -I)" mkdir -p ~/.ssh/ -echo $1 >> ~/.ssh/authorized_keys +echo "$1" >> ~/.ssh/authorized_keys echo "Public Key Installed: $1" /etc/init.d/ssh restart -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/lavabench] branch lastwibbles created (now 21c813a)

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a change to branch lastwibbles in repository toolchain/lavabench. at 21c813a Enquote public key before writing it This branch includes the following new commits: new 47510af Remove oe files new 756cb43 Tear out all the hacking-session-isms new f8f511f Report 'early debugging' hostname and IP as early as possible new 21c813a Enquote public key before writing it The 4 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "adds" were already present in the repository and have only been added to this reference. -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/semiautobench] 01/03: Report 'early debugging' hostname and IP as early as possible

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a commit to branch lastwibbles in repository toolchain/semiautobench. commit cf4dbe16a0c3526551f98d94291fa5560a15b55a Author: Bernard Ogden <bernie.ogden(a)linaro.org> Date: Tue Jul 28 11:32:35 2015 +0200 Report 'early debugging' hostname and IP as early as possible Change-Id: Ia395037d82b199a931cda760ce8c6b5dc02c6448 --- setup_session_debian | 8 +++----- 1 file changed, 3 insertions(+), 5 deletions(-) diff --git a/setup_session_debian b/setup_session_debian index ac6c2b5..0c28db2 100755 --- a/setup_session_debian +++ b/setup_session_debian @@ -1,6 +1,9 @@ #!/bin/bash # Usage ./setup_session <pub_key> +echo "Hostname for early debugging: $(cat /etc/hostname)" +echo "IP address for early debugging: $(hostname -I)" + chmod a+x stop_hacking_debian cp stop_hacking_debian /bin/stop_hacking chmod a+x invoke_session_debian @@ -12,8 +15,3 @@ echo "Public Key Installed: $1" /etc/init.d/ssh restart echo "sshd re-started" - -echo "Hostname for early debugging: $(cat /etc/hostname)" -echo "IP address for early debugging: $(hostname -I)" - - -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/semiautobench] 03/03: Enquote public key before writing it

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a commit to branch lastwibbles in repository toolchain/semiautobench. commit 14b79c48316cba95dd0e9a48f672e567483acc29 Author: Bernard Ogden <bernie.ogden(a)linaro.org> Date: Tue Jul 28 11:40:47 2015 +0200 Enquote public key before writing it Change-Id: I7029d04145883c1e5d36779c016ed73651e7d628 --- bench-session | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/bench-session b/bench-session index 42b650a..7493c36 100755 --- a/bench-session +++ b/bench-session @@ -8,7 +8,7 @@ echo "Hostname for early debugging: $(cat /etc/hostname)" echo "IP address for early debugging: $(hostname -I)" mkdir -p ~/.ssh/ -echo $1 >> ~/.ssh/authorized_keys +echo "$1" >> ~/.ssh/authorized_keys echo "Public Key Installed: $1" /etc/init.d/ssh restart -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/semiautobench] 02/03: Remove trailing hacking session isms

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a commit to branch lastwibbles in repository toolchain/semiautobench. commit 5117f59191b5a32f0404bb7f0006159596430ba9 Author: Bernard Ogden <bernie.ogden(a)linaro.org> Date: Tue Jul 28 11:39:30 2015 +0200 Remove trailing hacking session isms Reduce this whole thing to a couple of files Change-Id: If06218d95c824dc1745a8738065c58d61d40de32 --- invoke_session_debian => bench-session | 24 +++++++++++++++++------- bench-session-debian.yaml => bench-session.yaml | 3 +-- setup_session_debian | 17 ----------------- stop_hacking_debian | 5 ----- 4 files changed, 18 insertions(+), 31 deletions(-) diff --git a/invoke_session_debian b/bench-session similarity index 91% rename from invoke_session_debian rename to bench-session index 9c0d48f..42b650a 100755 --- a/invoke_session_debian +++ b/bench-session @@ -4,6 +4,16 @@ set -o pipefail error=1 +echo "Hostname for early debugging: $(cat /etc/hostname)" +echo "IP address for early debugging: $(hostname -I)" + +mkdir -p ~/.ssh/ +echo $1 >> ~/.ssh/authorized_keys +echo "Public Key Installed: $1" + +/etc/init.d/ssh restart +echo "sshd re-started" + function exitfunc { if test ${error} -ne 0; then if test x"${BENCH_DEBUG}" != x && test x"${BENCH_DEBUG}" != xNone; then @@ -16,20 +26,20 @@ function exitfunc { trap exitfunc EXIT -abe_branch="$1" +abe_branch="$2" #these parameters used by Benchmark.job -export benchmark="${2:?Must set a benchmark}" -export toolchain="${3:?Must set a toolchain}" -if test x"$4" = xNone; then +export benchmark="${3:?Must set a benchmark}" +export toolchain="${4:?Must set a toolchain}" +if test x"$5" = xNone; then export run_flags= else - export run_flags="$4" + export run_flags="$5" fi -if test x"$5" = xNone; then +if test x"$6" = xNone; then export compiler_flags= else - export compiler_flags="$5" + export compiler_flags="$6" fi # Set the PATH to use the LAVA api diff --git a/bench-session-debian.yaml b/bench-session.yaml similarity index 81% rename from bench-session-debian.yaml rename to bench-session.yaml index 934c8a6..307f54d 100644 --- a/bench-session-debian.yaml +++ b/bench-session.yaml @@ -35,5 +35,4 @@ install: - wget run: steps: - - ./setup_session_debian "$PUB_KEY" - - env BENCH_DEBUG="$BENCH_DEBUG" ./invoke_session_debian "$ABE_BRANCH" "$B [...] + - env BENCH_DEBUG="$BENCH_DEBUG" ./bench-session "$PUB_KEY" "$ABE_BRANCH" [...] diff --git a/setup_session_debian b/setup_session_debian deleted file mode 100755 index 0c28db2..0000000 --- a/setup_session_debian +++ /dev/null @@ -1,17 +0,0 @@ -#!/bin/bash -# Usage ./setup_session <pub_key> - -echo "Hostname for early debugging: $(cat /etc/hostname)" -echo "IP address for early debugging: $(hostname -I)" - -chmod a+x stop_hacking_debian -cp stop_hacking_debian /bin/stop_hacking -chmod a+x invoke_session_debian -cp invoke_session_debian /bin/invoke_session - -mkdir -p ~/.ssh/ -echo $1 >> ~/.ssh/authorized_keys -echo "Public Key Installed: $1" - -/etc/init.d/ssh restart -echo "sshd re-started" diff --git a/stop_hacking_debian b/stop_hacking_debian deleted file mode 100755 index a872268..0000000 --- a/stop_hacking_debian +++ /dev/null @@ -1,5 +0,0 @@ -#!/bin/bash -kill -CONT `cat /run/hacking/hacking.pid` -rm -f /run/hacking/hacking.pid -rm ~/.ssh/authorized_keys -/etc/init.d/ssh stop -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/semiautobench] branch lastwibbles created (now 14b79c4)

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a change to branch lastwibbles in repository toolchain/semiautobench. at 14b79c4 Enquote public key before writing it This branch includes the following new commits: new cf4dbe1 Report 'early debugging' hostname and IP as early as possible new 5117f59 Remove trailing hacking session isms new 14b79c4 Enquote public key before writing it The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "adds" were already present in the repository and have only been added to this reference. -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/abe] branch bernie/jenkmarking-multinode updated: Make wget quiet

by git

9 years, 3 months

[toolchain/abe] branch bernie/jenkmarking-multinode updated: Use the abe that we checked out with the LAVA definitions

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a commit to branch bernie/jenkmarking-multinode in repository toolchain/abe. The following commit(s) were added to refs/heads/bernie/jenkmarking-multinode by th [...] new 8c5c520 Use the abe that we checked out with the LAVA definitions 8c5c520 is described below commit 8c5c5206463823daf9683828c9a3437aa4281275 Author: Bernard Ogden <bernie.ogden(a)linaro.org> Date: Tue Jul 28 14:15:59 2015 +0200 Use the abe that we checked out with the LAVA definitions Change-Id: I33dde3ec51edf4690d782847cf10d48e58dafb46 --- config/bench/lava/host-session | 9 +-------- config/bench/lava/host-session.yaml | 2 +- 2 files changed, 2 insertions(+), 9 deletions(-) diff --git a/config/bench/lava/host-session b/config/bench/lava/host-session index d026ef9..a9283e4 100755 --- a/config/bench/lava/host-session +++ b/config/bench/lava/host-session @@ -45,14 +45,6 @@ fi ln /usr/share/doc/git/contrib/workdir/git-new-workdir /usr/local/bin chmod 755 /usr/local/bin/git-new-workdir -#Get abe -export ABE_DIR=~/src/abe -mkdir -p "${ABE_DIR}" || exit 1 -if ! git clone ${abe_branch:+-b ${abe_branch}} http://git.linaro.org/toolchain/abe [...] - rm -rf "${ABE_DIR}" - exit 1 -fi - #Generate one-time key mkdir ~/data || exit 1 if ! ssh-keygen -P '' -f ~/data/onetime > /dev/null < /dev/null; then @@ -120,6 +112,7 @@ done #Don't need the agent any more, kill the socket rm ~/data/socket +export ABE_DIR export targets="${target_names[@]}" export maindir="/${HOME}/bench" export post_target_cmd="shutdown -h 0" diff --git a/config/bench/lava/host-session.yaml b/config/bench/lava/host-session.yaml index 5372321..45af514 100644 --- a/config/bench/lava/host-session.yaml +++ b/config/bench/lava/host-session.yaml @@ -36,4 +36,4 @@ install: run: steps: - ./config/bench/lava/setup "$PUB_KEY" - - env BENCH_DEBUG="$BENCH_DEBUG" ./config/bench/lava/host-session "$ABE_BR [...] + - env ABE_DIR=`pwd` BENCH_DEBUG="$BENCH_DEBUG" ./config/bench/lava/host-se [...] -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/abe] 01/02: LAVA configuration

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a commit to branch bernie/jenkmarking-multinode in repository toolchain/abe. commit e6a81871f30ebe7cbf7bb14f833a3246f7ffaf50 Author: Bernard Ogden <bernie.ogden(a)linaro.org> Date: Tue Jul 28 11:57:18 2015 +0200 LAVA configuration Based on git.linaro.org/toolchain/semiautobench (host side) and git.linaro.org/toolchain/lavabench (target side), with alterations to clean out remaining hacking-session-isms. git.linaro.org/toolchain/semiautobench: c90fe30dbe0af4a41349bcaf1e7b051cc5c11546 git.linaro.org/toolchain/lavabench: c48e5f8503b61d8af7fa738c1fd1ac46ca2250b4 Change-Id: I827d445d4d3436654627bdaf76ab6778beb66e7b --- config/bench/lava/host-session | 142 ++++++++++++++++++++++++++++++++++ config/bench/lava/host-session.yaml | 39 ++++++++++ config/bench/lava/setup | 10 +++ config/bench/lava/target-session | 3 + config/bench/lava/target-session.yaml | 24 ++++++ 5 files changed, 218 insertions(+) diff --git a/config/bench/lava/host-session b/config/bench/lava/host-session new file mode 100755 index 0000000..e2c32a9 --- /dev/null +++ b/config/bench/lava/host-session @@ -0,0 +1,142 @@ +#!/bin/bash +set -u +set -o pipefail + +error=1 + +function exitfunc { + if test ${error} -ne 0; then + if test x"${BENCH_DEBUG}" != x && test x"${BENCH_DEBUG}" != xNone; then + sleep infinity + fi + fi + rm -rf ~/* + exit ${error} +} + +trap exitfunc EXIT + +abe_branch="$1" + +#these parameters used by Benchmark.job +export benchmark="${2:?Must set a benchmark}" +export toolchain="${3:?Must set a toolchain}" +if test x"$4" = xNone; then + export run_flags= +else + export run_flags="$4" +fi +if test x"$5" = xNone; then + export compiler_flags= +else + export compiler_flags="$5" +fi + +#Create directory to store src +if ! (mkdir ~/benchsrc && chmod 700 ~/benchsrc); then + echo "Failed to create directory for source" >&2 + exit 1 +fi + +#Initialize git-new-workdir - sadly not just an apt-get call +ln /usr/share/doc/git/contrib/workdir/git-new-workdir /usr/local/bin +chmod 755 /usr/local/bin/git-new-workdir + +#Get abe +export ABE_DIR=~/src/abe +mkdir -p "${ABE_DIR}" || exit 1 +if ! git clone ${abe_branch:+-b ${abe_branch}} http://git.linaro.org/toolchain/abe [...] + rm -rf "${ABE_DIR}" + exit 1 +fi + +#Generate one-time key +mkdir ~/data || exit 1 +if ! ssh-keygen -P '' -f ~/data/onetime > /dev/null < /dev/null; then + rm -rf ~/data + exit 1 +fi +eval `ssh-agent` +ssh-add ~/data/onetime + +#Need to be able to ssh to self to get local sources +#Can reuse the onetime key for this +cat ~/data/onetime.pub >> ~/.ssh/authorized_keys +if ! ssh -o NoHostAuthenticationForLocalhost=yes localhost true; then + echo "Failed to ssh to self" >&2 + exit 1 +fi + +#Generate config file for each target in multinode job +lava-network broadcast eth0 +lava-network collect eth0 +ip_addr="$(lava-network query `lava-group | grep '[[:blank:]]\+host$' | awk '{prin [...] + +#Request agent just before we need it +#This would be two keys in one agent if we wanted one for source, one for job +echo "*** WAITING FOR AGENT: ${ip_addr}" +echo "ssh -o ControlMaster=no -o ControlPath=/dev/null -A ${ip_addr}.lab 'ln -sf \ [...] +while ! test -e ~/data/socket; do + inotifywait -e create ~/data +done +#Best practice would be to use abe to do this, but I hope this is temporary +SSH_AUTH_SOCK=~/data/socket git clone "`grep ${benchmark} ${ABE_DIR}/config/source [...] +#An alternative to the following would be to pass ${benchmark}=ssh://... to abe.sh +sed -i "s#^\$${benchmark}[[:blank:]]\\+\$.*#\\1 ssh://localhost/~/benchsrc/#" "$ [...] + +target_names=() +for lava_name in `lava-group | grep -v '[[:blank:]]*host$' | awk '{print $1}'`; do + target_ip="$(lava-network query ${lava_name} ipv4)" + if test $? -ne 0; then echo "Failed to find IP for ${lava_name}"; exit 1; fi + if test -z "${target_ip}"; then echo "Failed to find IP for ${lava_name}"; exit 1; fi + + #Check that target is accessible, add it to our known_hosts, + #add our one-time key to its authorized_keys + if ! cat ~/data/onetime.pub | SSH_AUTH_SOCK=~/data/socket ssh -o StrictHostKeyCh [...] + echo "Could not access target ${target_ip} (${lava_name})" >&2 + exit 1 + fi + + #Generate configuration files for target + target_type="$(echo ${lava_name} | sed 's/[[:digit:]]*$//')" #TODO: HACK + if test $? -ne 0; then echo "Failed to find target type from ${lava_name}"; exit 1; fi + sed "s/^ip=.*/ip=${target_ip}/" "${ABE_DIR}/config/bench/boards/${target_type}.c [...] + if test $? -ne 0; then echo "Failed to generate config file for target ${lava_na [...] + + cp "${ABE_DIR}/config/bench/boards/${target_type}.services" "${ABE_DIR}/config/b [...] + if test $? -ne 0; then echo "Failed to generate services file for target ${lava_ [...] + + #Add target to list for Benchmark.job + if test "${#target_names[@]}" -eq 0; then + target_names=("${lava_name}") + else + target_names=("${target_names[@]}" "${lava_name}") + fi +done + +#Don't need the agent any more, kill the socket +rm ~/data/socket + +export targets="${target_names[@]}" +export maindir="/${HOME}/bench" +export post_target_cmd="shutdown -h 0" +mkdir "${maindir}" +chmod 700 "${maindir}" + +echo "Running benchmark... I may be some time" +if ! "${ABE_DIR}"/scripts/Benchmark.job; then + echo "Benchmark run failed" >&2 + echo "ssh -o ControlMaster=no -o ControlPath=/dev/null ${ip_addr}.lab" + error=1 + exit +fi + +echo "*** RESULTS READY" +echo "ssh -o ControlMaster=no -o ControlPath=/dev/null ${ip_addr}.lab" +echo "ssh -o ControlMaster=no -o ControlPath=/dev/null ${ip_addr}.lab 'touch ~/dat [...] +while ! test -e ~/data/resultsgone; do + inotifywait -e create ~/data +done + +error=0 +exit diff --git a/config/bench/lava/host-session.yaml b/config/bench/lava/host-session.yaml new file mode 100644 index 0000000..5372321 --- /dev/null +++ b/config/bench/lava/host-session.yaml @@ -0,0 +1,39 @@ +metadata: + name: bench-session-debian + format: "Lava-Test-Shell Test Definition 1.0" + description: "Benchmarking Session" + version: 1.0 + +params: + PUB_KEY: None + ABE_BRANCH: benchmarking + BENCHMARK: fakebench + TOOLCHAIN: https://releases.linaro.org/14.11/components/toolchain/binaries/arm [...] + RUN_FLAGS: None + COMPILER_FLAGS: None + BENCH_DEBUG: None + +install: + deps: + - autogen + - binutils + - bison + - dejagnu + - flex + - gawk + - gcc + - gcc-multilib + - g++-multilib + - git + - inotify-tools + - libgfortran3 + - libncurses5-dev + - make + - openssh-server + - rsync + - texinfo + - wget +run: + steps: + - ./config/bench/lava/setup "$PUB_KEY" + - env BENCH_DEBUG="$BENCH_DEBUG" ./config/bench/lava/host-session "$ABE_BR [...] diff --git a/config/bench/lava/setup b/config/bench/lava/setup new file mode 100755 index 0000000..633a9b7 --- /dev/null +++ b/config/bench/lava/setup @@ -0,0 +1,10 @@ +#!/bin/bash +echo "Hostname for early debugging: $(cat /etc/hostname)" +echo "IP address for early debugging: $(hostname -I)" + +mkdir -p ~/.ssh/ +echo "$1" >> ~/.ssh/authorized_keys +echo "Public Key Installed: $1" + +/etc/init.d/ssh restart +echo "sshd re-started" diff --git a/config/bench/lava/target-session b/config/bench/lava/target-session new file mode 100755 index 0000000..f042d82 --- /dev/null +++ b/config/bench/lava/target-session @@ -0,0 +1,3 @@ +#!/bin/bash +lava-network broadcast eth0 +sleep infinity diff --git a/config/bench/lava/target-session.yaml b/config/bench/lava/target-session.yaml new file mode 100644 index 0000000..6b737ab --- /dev/null +++ b/config/bench/lava/target-session.yaml @@ -0,0 +1,24 @@ +metadata: + name: bench-session + format: "Lava-Test-Shell Test Definition 1.0" + description: "Benchmarking Session" + version: 1.0 + +params: + PUB_KEY: None + +install: + deps: + - openssh-server + - wget + - make + - cpufrequtils + - binutils + - gawk + - libgfortran3 + - rsync + +run: + steps: + - ./config/bench/lava/setup "$PUB_KEY" + - ./config/bench/lava/target-session -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

[toolchain/abe] branch bernie/jenkmarking-multinode updated (d2d1903 -> 75aa194)

by git

This is an automated email from the git hooks/post-receive script. bernie.ogden pushed a change to branch bernie/jenkmarking-multinode in repository toolchain/abe. discards d2d1903 More output when we trap errors for debug discards 1013694 LAVA configuration new e6a8187 LAVA configuration new 75aa194 More output when we trap errors for debug This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (d2d1903) \ N -- N -- N refs/heads/bernie/jenkmarking-multinode (75aa194) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omits" are not gone; other references still refer to them. Any revisions marked "discards" are gone forever. The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "adds" were already present in the repository and have only been added to this reference. Summary of changes: config/bench/lava/host-session | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) -- To stop receiving notification emails like this one, please contact the administrator of this repository.

9 years, 3 months

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

Tcwg-commits July 2015