Linaro-android

linaro-android@lists.linaro.org

1072 discussions

Benchmarking Nexus devices running AOSP master built with gcc 4.9 vs. clang 3.6

by pzheng＠codeaurora.org

I see a list of benchmark results (e.g., AndEMark Native, AndEMark Java, BenchmarkPi, AnTuTu 5.3 etc.) on the following webpage and have some questions on how the benchmarking was done. https://wiki.linaro.org/Platform/Android/GccClangBenchmark-2014-12 1) Were the benchmarks built from source with gcc/clang, or were the binaries (apks?) of the benchmarks used for the benchmarking? 2) If the benchmarks were not built from source for the benchmarking, can you explain the headings of the columns of the "Benchmark results"? I see for example "gcc Nexus 9", "clang Nexus 9". Does the heading mean, say for some benchmark "AnTuTu 5.3", the same AnTuTu apks were installed for benchmarking but one was ran on AOSP built with gcc and the other were ran on AOSP built with clang? Please correct me if I am wrong. 3) If the benchmarks were built from source, would you mind sharing the places where you get the source code of these benchmarks and instructions on how you built them with clang (I assume most benchmarks are built with gcc by default)? Besides, was the benchmarking done with AOSP built with gcc or with clang? I would greatly appreciate it if there is any additional detail that can be shared. Many thanks in advance.

10 years, 1 month

Update v1 : Jobs for build#335

by Mahanth Gouda

Hi all, Just wanted to let you know that I've picked up the build 335 and started manual testing this morning on Juno. I'm half the way running these tests so far, hoping to finish the rest in next few hours time. So, thought of giving you a quick results update: I'm testing only those benchmarks that've been marked by Yongqin as failed. Please let me know if I've missed something? Benchmark job 1: --------------- 1. antutu 5 - *HUNG/CRASH *(No log as the test didn't complete ) 2. caffeinemark - *CRASH *- (Every other time this test fails) - logcat & snapshot attached 3. cfbench - *PASS* Benchmark job 2: --------------- 4. smartbench2014 - *PASS* 5. gearsES1eclair - *CRASH* (There's no log for this because the script does not complete, it's hung in between) It took long time investigating this, but could not get to the root cause of this issue. So, I've left it open for now. Benchmark job 3: --------------- 6. vellamo - testing in progress (currently the benchmark sounds like it's paused on Networking Loader, since a while) Benchmark job 4: --------------- 7. andebench2014 - 8. javawhetstone - 9. jbench - 10. linpackjava - 11. scimark - Please note - I've repeated all these tests at least 5 times in order to check the consistency. Thanks & regards, Mahanth On 19 March 2015 at 10:59, Mahanth Gouda <mahanth.gouda(a)linaro.org> wrote: > Hi Jakub, > Thanks for the help offer, I've started with this, will surely seek your > help when required. > > > Thanks, > Mahanth > > On 19 March 2015 at 09:19, Jakub Pavelek <jakub.pavelek(a)linaro.org> wrote: > >> Hi Botao and Mananth, >> >> if you need anything from us ping me or YongQin. We would like to >> investigate the failing benchmark automation ASAP, otherwise we need QAS to >> run those benchmarks manually and we will lose trends tracking in >> ImageReports. >> >> >> >> On 18 March 2015 at 19:01, Milosz Wasilewski < >> milosz.wasilewski(a)linaro.org> wrote: >> >>> Botao and Mahanth can help. Mahanth has access to the hw. As far as I >>> remember: >>> - antutu 5 crashes (was crashing before) before it finishes >>> - caffeinemark crashes 4 out of 5 attempts >>> - nbench produces empty results for some reason (only zeros) >>> - GFXBench takes very long to run, we might have too short timeout >>> - GearsES1 crashes always and should be abandoned >>> >>> I don't know about the others. This is what was happening before >>> moving to 5.1. Mahanth, please take this as high priority to >>> investigate. Botao migh help you with Gears as he did the automation. >>> >>> milosz >>> >>> >>> On 18 March 2015 at 15:56, Jakub Pavelek <jakub.pavelek(a)linaro.org> >>> wrote: >>> > Milosz is out of office all this week. We need to find another way to >>> check >>> > things out :-/ >>> > >>> > On 18 March 2015 at 10:14, YongQin Liu <yongqin.liu(a)linaro.org> wrote: >>> >> >>> >> Hi, Misolz >>> >> >>> >> Could you please help to check if the benchmark tests mentioned below >>> >> can work on the Juno with the 5.1 build#335? >>> >> >>> >> Thanks, >>> >> Yongqin Liu >>> >> >>> >> On 18 March 2015 at 17:11, YongQin Liu <yongqin.liu(a)linaro.org> >>> wrote: >>> >>> >>> >>> Hi, All >>> >>> >>> >>> The job for the benchmarks failed again. >>> >>> Seems there is a problem to run the vellamo on Juno, the test timed >>> out >>> >>> and caused the sync problem. >>> >>> So I split the job into 3 small jobs: >>> >>> >>> >>> Benchmark Job#1 >>> >>> https://validation.linaro.org/scheduler/job/287238.0 finished. >>> >>> but there is no benchmark result for benchmarks application of >>> antutu5, >>> >>> Caffeinemark, and CF-Bench. >>> >>> And also all the benchmark result for nbench are zero. >>> >>> >>> >>> Benchmark Job#2 >>> >>> https://validation.linaro.org/scheduler/job/287240.0 >>> >>> Smartbench2012 seems not started correctly. >>> >>> And the gearses1eclair test was timed out, and caused the sync >>> problem. >>> >>> >>> >>> >>> >>> Benchmark Job#3: vellamo job, timed out again. >>> >>> https://validation.linaro.org/scheduler/job/287242.0 >>> >>> >>> >>> >>> >>> Benchmark Job#4: tests for andebench2014, Javawhetstone, JBench, >>> >>> LinpackJava, and Scimark >>> >>> https://validation.linaro.org/scheduler/job/287503.0 >>> >>> >>> >>> >>> >>> Thanks, >>> >>> Yongqin Liu >>> >>> On 17 March 2015 at 21:30, YongQin Liu <yongqin.liu(a)linaro.org> >>> wrote: >>> >>>> >>> >>>> Hi, Jakub >>> >>>> >>> >>>> The 2 cts jobs finished. >>> >>>> >>> >>>> Thanks, >>> >>>> Yongqin Liu >>> >>>> On 17 March 2015 at 15:47, YongQin Liu <yongqin.liu(a)linaro.org> >>> wrote: >>> >>>>> >>> >>>>> Hi, All >>> >>>>> >>> >>>>> Following are job status for Juno build #335 on LAVA: >>> >>>>> The 3 resubmitted jobs are running on LAVA now. >>> >>>>> >>> >>>>> Normal Job: >>> >>>>> https://validation.linaro.org/scheduler/job/282224 finished >>> >>>>> >>> >>>>> benchmark-lite: >>> >>>>> https://validation.linaro.org/scheduler/job/282229.0 finished >>> >>>>> >>> >>>>> >>> >>>>> linaro-android_armv8-android-juno-lsk-benchmark-application >>> >>>>> https://validation.linaro.org/scheduler/job/282231.0 finished >>> >>>>> >>> >>>>> >>> >>>>> linaro-android_armv8-android-juno-lsk_cts_32bit: >>> >>>>> https://validation.linaro.org/scheduler/job/282225.1 Canceled >>> >>>>> https://validation.linaro.org/scheduler/job/284313.0 Incomplete >>> >>>>> https://validation.linaro.org/scheduler/job/286312.0 resubmitted >>> >>>> >>> >>>> Finished >>> >>>>> >>> >>>>> >>> >>>>> linaro-android_armv8-android-juno-lsk_cts_64bit: >>> >>>>> https://validation.linaro.org/scheduler/job/282227.0 Canceled >>> >>>>> https://validation.linaro.org/scheduler/job/284315.0 Incomplete >>> >>>>> https://validation.linaro.org/scheduler/job/286310.0 resubmitted >>> >>>> >>> >>>> Finished. >>> >>>>> >>> >>>>> >>> >>>>> Benchmarks: >>> >>>>> https://validation.linaro.org/scheduler/job/282233.0 Canceled >>> >>>>> https://validation.linaro.org/scheduler/job/284317.0 Incomplete >>> >>>>> https://validation.linaro.org/scheduler/job/286314.0 resubmitted >>> >>>>> >>> >>>>> >>> >>>>> -- >>> >>>>> Best Regards, >>> >>>>> Yongqin Liu >>> >>>>> --------------------------------------------------------------- >>> >>>>> #mailing list >>> >>>>> linaro-android(a)lists.linaro.org >>> >>>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>> >>>> >>> >>>> >>> >>>> >>> >>>> >>> >>>> -- >>> >>>> Best Regards, >>> >>>> Yongqin Liu >>> >>>> --------------------------------------------------------------- >>> >>>> #mailing list >>> >>>> linaro-android(a)lists.linaro.org >>> >>>> http://lists.linaro.org/mailman/listinfo/linaro-android >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> -- >>> >>> Best Regards, >>> >>> Yongqin Liu >>> >>> --------------------------------------------------------------- >>> >>> #mailing list >>> >>> linaro-android(a)lists.linaro.org >>> >>> http://lists.linaro.org/mailman/listinfo/linaro-android >>> >> >>> >> >>> >> >>> >> >>> >> -- >>> >> Best Regards, >>> >> Yongqin Liu >>> >> --------------------------------------------------------------- >>> >> #mailing list >>> >> linaro-android(a)lists.linaro.org >>> >> http://lists.linaro.org/mailman/listinfo/linaro-android >>> > >>> > >>> > >>> > >>> > -- >>> > With best regards, >>> > >>> > Jakub Pavelek >>> > >>> > Linaro Mobile Group project manager >>> > Linaro.org│Open source software for ARM SoCs >>> > >>> >> >> >> >> -- >> With best regards, >> >> Jakub Pavelek >> >> Linaro Mobile Group project manager >> Linaro.org│Open source software for ARM SoCs >> >> >

10 years, 1 month

Jobs for build#335

by YongQin Liu

Hi, All Following are job status for Juno build #335 on LAVA: The 3 resubmitted jobs are running on LAVA now. Normal Job: https://validation.linaro.org/scheduler/job/282224 finished benchmark-lite: https://validation.linaro.org/scheduler/job/282229.0 finished linaro-android_armv8-android-juno-lsk-benchmark-application https://validation.linaro.org/scheduler/job/282231.0 finished linaro-android_armv8-android-juno-lsk_cts_32bit: https://validation.linaro.org/scheduler/job/282225.1 Canceled https://validation.linaro.org/scheduler/job/284313.0 Incomplete https://validation.linaro.org/scheduler/job/286312.0 resubmitted linaro-android_armv8-android-juno-lsk_cts_64bit: https://validation.linaro.org/scheduler/job/282227.0 Canceled https://validation.linaro.org/scheduler/job/284315.0 Incomplete *https://validation.linaro.org/scheduler/job/286310.0 <https://validation.linaro.org/scheduler/job/286310.0> *resubmitted Benchmarks: https://validation.linaro.org/scheduler/job/282233.0 Canceled https://validation.linaro.org/scheduler/job/284317.0 Incomplete https://validation.linaro.org/scheduler/job/286314.0 resubmitted -- Best Regards, Yongqin Liu --------------------------------------------------------------- #mailing list linaro-android(a)lists.linaro.org <linaro-dev(a)lists.linaro.org> http://lists.linaro.org/mailman/listinfo/linaro-android

10 years, 1 month

CTS job for clang build#36

by YongQin Liu

Hi, Jakub & Bero The clang build#36 finished successfully. Here are the cts job: https://validation.linaro.org/scheduler/job/287530.0 64bit https://validation.linaro.org/scheduler/job/287532.0 32bit -- Best Regards, Yongqin Liu --------------------------------------------------------------- #mailing list linaro-android(a)lists.linaro.org <linaro-dev(a)lists.linaro.org> http://lists.linaro.org/mailman/listinfo/linaro-android

10 years, 1 month

CTS updated to 5.0_r2

by YongQin Liu

Hi, All CTS packages has been updated to 5.0_r2. - Used for TC2, gles2 and jank package have been removed from the CTS paln: android-cts-5.0-armv7.zip <http://testdata.validation.linaro.org/cts/android-cts-5.0-armv7.zip> - Used for Juno, only jank package has been remove from the CTS plan: android-cts-5.0-armv8.zip <http://testdata.validation.linaro.org/cts/android-cts-5.0-armv8.zip> - Used for FVP, with timeout value increased: android-cts-5.0-timeout.zip <http://testdata.validation.linaro.org/cts/android-cts-5.0-timeout.zip> -- Best Regards, Yongqin Liu --------------------------------------------------------------- #mailing list linaro-android(a)lists.linaro.org <linaro-dev(a)lists.linaro.org> http://lists.linaro.org/mailman/listinfo/linaro-android

10 years, 1 month

About stringbench

by YongQin Liu

Hi, Bero About stringbench, when I tried to integrate it into our build, there are some compiling errors on harness and and dhry modules, Could you please help to fix that? And another point about this stringbench, do you think if it's possible to make it work like the bionic-benchmark command, or integrate it into the bionic-benchmark command? -- Best Regards, Yongqin Liu --------------------------------------------------------------- #mailing list linaro-android(a)lists.linaro.org <linaro-dev(a)lists.linaro.org> http://lists.linaro.org/mailman/listinfo/linaro-android

10 years, 1 month

Could you please help to try the AndEBenchPro on Juno?

by YongQin Liu

Hi, Milosz Could you please help to try the AndEBenchPro test here http://testdata.validation.linaro.org/apks/andebench-pro.apk with this following Juno Build? http://snapshots.linaro.org/android/~linaro-android/armv8-android-juno-lsk/… I tried the AndEBench apk with Nexus9, but only the google image works. it will crash during the 3D test with the AOSP nexus9 images. I want to check if there is any problem to run this apk on our Juno build, but there is some problem to run on juno jobs on LAVA, so could you please help to try it on you side? Thanks in advance! -- Best Regards, Yongqin Liu --------------------------------------------------------------- #mailing list linaro-android(a)lists.linaro.org <linaro-dev(a)lists.linaro.org> http://lists.linaro.org/mailman/listinfo/linaro-android

10 years, 1 month

Jia is away from desk now

by jia.jia＠zte.com.cn

我将从 2015-02-16 开始离开办公室，到 2015-02-25 时返回。 Hi, I will be on leave from Feb.16th to Feb.24th. Any message will be replied to you until I come back. Thanks! -------------------------------------------------------- ZTE Information Security Notice: The information contained in this mail (and any attachment transmitted herewith) is privileged and confidential and is intended for the exclusive use of the addressee(s). If you are not an intended recipient, any disclosure, reproduction, distribution or other dissemination or use of the information contained is strictly prohibited. If you have received this mail in error, please delete it and notify us immediately.

10 years, 2 months

Lava set up in ubuntu 14.10 utopic unicorn

by Narendra Kumar

Hi, Sorry for disturbing you. This question I might have several times in free-node channel, I got a suggestion to follow you-tube I will not comment on those videos but still those videos are not enough for new user like me to setup lava. any way I am able to install lava local host, Only help I need is how to start lava for running some tests on devices like panda board. I want to run ltp on panda using lava-test-shell, please consider my mail, its very important and I am critical condition now(stopped in middle to proceed further). As a new user of lava I am not getting any thing in lava documentation part, hope you understand the situation. Note:: Please don't share linaro documentation links as a reply. -- [image: tree pine]Please consider the environment before printing this e-mail Thanks & Regards Narendra Kumar Chepuri (+917353049544)

10 years, 2 months

inet vs unix socket when using adb

by Milosz Wasilewski

Hi, I'm suffering from a strange problem with adb. On the local laptop adb server uses inet socket to accept connections from the client. Netstat shows it as follows: tcp 0 0 localhost:5037 *:* LISTEN 23081/adb However I'm also using other machine, which is running debian. adb there uses unix sockets: unix 2 [ ACC ] STREAM LISTENING 61040 8722/adb /tmp/5037 For this reason I'm not able to use a third party python lib which expects inet socket. Does anyone has any clue why adb server opens unix socket? In both cases adb client works correctly. I'm asking only about host side. In both cases I'm connecting to target device over TCP/IP and it's the same physical device. So it doesn't make any difference. Any help is appreciated. Best Regards, milosz

10 years, 2 months

← Newer
1
...
6
7
8
9
10
11
12
...
108
Older →

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

Linaro-android