On 17 September 2015 at 14:15, Alex Shi alex.shi@linaro.org wrote:
Hi Milosz,
I have no specific requirements for details. But I guess the rt-tests' benchmarks are first thing we can start. alexs@alexs-des:/mmkernels/lsk$ apt-file list rt-tests rt-tests: /usr/bin/cyclictest rt-tests: /usr/bin/hackbench rt-tests: /usr/bin/pi_stress rt-tests: /usr/bin/pip_stress rt-tests: /usr/bin/pmqtest rt-tests: /usr/bin/ptsematest rt-tests: /usr/bin/rt-migrate-test rt-tests: /usr/bin/sendme rt-tests: /usr/bin/signaltest rt-tests: /usr/bin/sigwaittest rt-tests: /usr/bin/svsematest rt-tests: /usr/sbin/hwlatdetect
and the typical boards are appreciated, like tc2, juno, and others.
We had these running for LSK 3.14 RT some time ago so you can use the same gear to run the tests already now. There is no need to wait for anything.
For performance/power measure, the criteria may not the result value. It should be the change percentage, like the performance increase/decrease percentage. or the power(W)/energy(J) changed percentage. Guess Amit will have better suggestion on power testing.
I amn't a keen of LKP. I'd like any auto testing framework if it can give me the per/power changes of two branches. :)
I'm really not sure what are you expecting here? That can already be done with a little bit of scripting using LAVA. As Amit mentioned above, we don't have any reporting tools in place at this time.
milosz
Regards Alex
On 09/17/2015 06:22 PM, Milosz Wasilewski wrote:
Alex, I'm not sure if this is a good way of addressing your request. What are the benchmarks/measurements you're trying to run? Which boards would you like to be tested? What is the acceptance criteria for the benchmarks (no worse than last run or sth else)? LKP isn't as good as it looks at first. There are quite a few assumptions made by Intel that aren't true for ARM boards. So IMHO the best way forward is to define your use case and than try to find tools, not the other way around.
BTW, we also have workload automation (https://github.com/ARM-software/workload-automation/) for benchmarking and possibly power measurement.
milosz
On 17 September 2015 at 10:24, Alex Shi alex.shi@linaro.org wrote:
Good news!
Did the LKP regularly run in linaro? Could I give your a kernel branch and then you give the testing results?
Regards Alex
On 09/17/2015 05:02 PM, Chase Qi wrote:
On 09/17/2015 04:44 PM, Alex Shi wrote:
Hi All,
Is there some performance or power auto-testing system running in Linaro? Like intel's lkp porting to LAVA?
Riku/Chase, Do you have a plan to give a update or show you work in coming connection?
Alex, there is a session on Wed Sep 23rd to talk about LKP in LAVA and result comparison. If you don't want to wait ;), here is the slide decks https://docs.google.com/a/linaro.org/presentation/d/1Fj5AMu3z6DQMb4QokSBGXgB...
Thanks, Chase
If there is a system can measure the performance/power change on any SoC for each of patch, that would be perfect!
Regards Alex