Hi Milosz,
I have no specific requirements for details. But I guess the rt-tests' benchmarks are first thing we can start. alexs@alexs-des:/mmkernels/lsk$ apt-file list rt-tests rt-tests: /usr/bin/cyclictest rt-tests: /usr/bin/hackbench rt-tests: /usr/bin/pi_stress rt-tests: /usr/bin/pip_stress rt-tests: /usr/bin/pmqtest rt-tests: /usr/bin/ptsematest rt-tests: /usr/bin/rt-migrate-test rt-tests: /usr/bin/sendme rt-tests: /usr/bin/signaltest rt-tests: /usr/bin/sigwaittest rt-tests: /usr/bin/svsematest rt-tests: /usr/sbin/hwlatdetect
and the typical boards are appreciated, like tc2, juno, and others.
For performance/power measure, the criteria may not the result value. It should be the change percentage, like the performance increase/decrease percentage. or the power(W)/energy(J) changed percentage. Guess Amit will have better suggestion on power testing.
I amn't a keen of LKP. I'd like any auto testing framework if it can give me the per/power changes of two branches. :)
Regards Alex
On 09/17/2015 06:22 PM, Milosz Wasilewski wrote:
Alex, I'm not sure if this is a good way of addressing your request. What are the benchmarks/measurements you're trying to run? Which boards would you like to be tested? What is the acceptance criteria for the benchmarks (no worse than last run or sth else)? LKP isn't as good as it looks at first. There are quite a few assumptions made by Intel that aren't true for ARM boards. So IMHO the best way forward is to define your use case and than try to find tools, not the other way around.
BTW, we also have workload automation (https://github.com/ARM-software/workload-automation/) for benchmarking and possibly power measurement.
milosz
On 17 September 2015 at 10:24, Alex Shi alex.shi@linaro.org wrote:
Good news!
Did the LKP regularly run in linaro? Could I give your a kernel branch and then you give the testing results?
Regards Alex
On 09/17/2015 05:02 PM, Chase Qi wrote:
On 09/17/2015 04:44 PM, Alex Shi wrote:
Hi All,
Is there some performance or power auto-testing system running in Linaro? Like intel's lkp porting to LAVA?
Riku/Chase, Do you have a plan to give a update or show you work in coming connection?
Alex, there is a session on Wed Sep 23rd to talk about LKP in LAVA and result comparison. If you don't want to wait ;), here is the slide decks https://docs.google.com/a/linaro.org/presentation/d/1Fj5AMu3z6DQMb4QokSBGXgB...
Thanks, Chase
If there is a system can measure the performance/power change on any SoC for each of patch, that would be perfect!
Regards Alex