[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Oct 23 12:22:03 PDT 2013
http://llvm.org/perf/db_default/v4/nts/16610?compare_to=16607&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 16610, Order: 193248, Start Time: 2013-10-23 17:27:35, End Time: 2013-10-23 19:25:21
To: 16607, Order: 193240, Start Time: 2013-10-23 15:06:47, End Time: 2013-10-23 17:00:03
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 52 (61 on baseline)
Performance Improvements: 6 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1049 (1031 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Shootout/heapsort: 95.10% (0.0449 => 0.0876, std.dev.: 0.0036)
SingleSource/Benchmarks/Misc/mandel: 87.45% (0.0470 => 0.0881, std.dev.: 0.0047)
MultiSource/Benchmarks/McCat/04-bisect/bisect: 82.20% (0.1354 => 0.2467, std.dev.: 0.0111)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 77.60% (0.1027 => 0.1824, std.dev.: 0.0111)
SingleSource/UnitTests/AtomicOps: 75.69% (0.0144 => 0.0253, std.dev.: 0.0029)
SingleSource/UnitTests/byval-alignment: 67.03% (0.0182 => 0.0304, std.dev.: 0.0025)
SingleSource/Benchmarks/Misc/flops-5: 62.31% (0.0321 => 0.0521, std.dev.: 0.0043)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 60.57% (0.1088 => 0.1747, std.dev.: 0.0114)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 56.18% (0.0995 => 0.1554, std.dev.: 0.0045)
MultiSource/Benchmarks/MallocBench/gs/gs: 46.61% (4.6551 => 6.8247, std.dev.: 0.6430)
MultiSource/Benchmarks/Fhourstones/fhourstones: 45.32% (0.1880 => 0.2732, std.dev.: 0.0328)
SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 44.68% (0.0235 => 0.0340, std.dev.: 0.0035)
MultiSource/Benchmarks/McCat/18-imp/imp: 44.39% (0.3940 => 0.5689, std.dev.: 0.0532)
MultiSource/Applications/ALAC/encode/alacconvert-encode: 40.59% (1.1639 => 1.6363, std.dev.: 0.0146)
MultiSource/Applications/kimwitu++/kc: 23.89% (18.9597 => 23.4886, std.dev.: 0.8742)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 21.59% (4.9766 => 6.0511, std.dev.: 0.3141)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 19.29% (0.0762 => 0.0909, std.dev.: 0.0010)
MultiSource/Applications/minisat/minisat: 16.70% (0.7611 => 0.8882, std.dev.: 0.0489)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.87% (2.0037 => 2.3017, std.dev.: 0.0682)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 13.94% (0.8959 => 1.0208, std.dev.: 0.0290)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.72% (0.8373 => 0.9438, std.dev.: 0.0333)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.06% (0.6444 => 0.7221, std.dev.: 0.0217)
SingleSource/Benchmarks/Linpack/linpack-pc: 10.75% (0.3097 => 0.3430, std.dev.: 0.0096)
SingleSource/Regression/C++/ofstream_ctor: 10.42% (0.2045 => 0.2258, std.dev.: 0.0082)
SingleSource/UnitTests/SignlessTypes/rem: 10.13% (0.1204 => 0.1326, std.dev.: 0.0027)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout/heapsort: 79.88% (2.9706 => 5.3435, std.dev.: 0.0168)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 51.58% (0.0221 => 0.0335, std.dev.: 0.0003)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 51.53% (0.1370 => 0.2076, std.dev.: 0.0083)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 49.30% (0.0862 => 0.1287, std.dev.: 0.0016)
MultiSource/Applications/minisat/minisat: 48.69% (6.3797 => 9.4859, std.dev.: 0.3216)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.81% (1.2983 => 1.6334, std.dev.: 0.0499)
SingleSource/Benchmarks/Shootout/ary3: 21.92% (4.6853 => 5.7123, std.dev.: 0.0874)
SingleSource/Benchmarks/Linpack/linpack-pc: 19.91% (44.1250 => 52.9082, std.dev.: 0.5472)
MultiSource/Benchmarks/Fhourstones/fhourstones: 19.63% (1.5506 => 1.8550, std.dev.: 0.1019)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.04% (36.3155 => 43.2297, std.dev.: 0.9769)
SingleSource/Benchmarks/Shootout/hash: 17.86% (5.1825 => 6.1082, std.dev.: 0.0655)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.60% (6.7254 => 7.5057, std.dev.: 0.1913)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.45% (2.1176 => 2.3600, std.dev.: 0.0339)
SingleSource/Benchmarks/Shootout/strcat: 11.45% (0.1459 => 0.1626, std.dev.: 0.0061)
MultiSource/Applications/obsequi/Obsequi: 10.13% (2.3779 => 2.6189, std.dev.: 0.0533)
MultiSource/Benchmarks/mafft/pairlocalalign: 6.29% (40.8007 => 43.3665, std.dev.: 0.9694)
MultiSource/Benchmarks/sim/sim: 5.74% (3.8501 => 4.0710, std.dev.: 0.0054)
SingleSource/Benchmarks/Dhrystone/dry: 4.80% (0.4814 => 0.5045, std.dev.: 0.0006)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.46% (12.8567 => 13.4299, std.dev.: 0.0659)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.31% (5.0338 => 5.2508, std.dev.: 0.0042)
SingleSource/Benchmarks/Misc/flops: 3.95% (9.2655 => 9.6313, std.dev.: 0.0561)
SingleSource/Benchmarks/Misc/himenobmtxpa: 3.92% (4.0780 => 4.2378, std.dev.: 0.0077)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.86% (5.2035 => 5.4046, std.dev.: 0.0318)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.46% (1.0322 => 1.0679, std.dev.: 0.0109)
MultiSource/Benchmarks/BitBench/five11/five11: 3.39% (5.4550 => 5.6400, std.dev.: 0.0252)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.90% (1.0456 => 1.0655, std.dev.: 0.0006)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.81% (4.4029 => 4.4828, std.dev.: 0.0082)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Misc/pi: -17.53% (2.0731 => 1.7096, std.dev.: 0.0277)
MultiSource/Benchmarks/Ptrdist/bc/bc: -5.14% (1.1541 => 1.0948, std.dev.: 0.0088)
SingleSource/Benchmarks/Shootout/lists: -4.57% (7.5167 => 7.1734, std.dev.: 0.1320)
SingleSource/Benchmarks/CoyoteBench/huffbench: -1.75% (23.8150 => 23.3994, std.dev.: 0.0118)
SingleSource/Benchmarks/Misc/oourafft: -1.72% (3.6859 => 3.6224, std.dev.: 0.0071)
SingleSource/Benchmarks/Shootout/methcall: -1.16% (8.6406 => 8.5405, std.dev.: 0.0260)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.76% (0.1360 => 0.1384, std.dev.: 0.0388)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Misc/mandel: 94.05% (0.0454 => 0.0881, std.dev.: 0.0047)
MultiSource/Benchmarks/McCat/04-bisect/bisect: 85.07% (0.1333 => 0.2467, std.dev.: 0.0111)
SingleSource/Benchmarks/Shootout/heapsort: 84.81% (0.0474 => 0.0876, std.dev.: 0.0036)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 79.70% (0.1015 => 0.1824, std.dev.: 0.0111)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 70.61% (0.1024 => 0.1747, std.dev.: 0.0114)
SingleSource/UnitTests/byval-alignment: 67.03% (0.0182 => 0.0304, std.dev.: 0.0025)
MultiSource/Benchmarks/Fhourstones/fhourstones: 64.88% (0.1657 => 0.2732, std.dev.: 0.0328)
SingleSource/Benchmarks/Misc/flops-5: 63.84% (0.0318 => 0.0521, std.dev.: 0.0043)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 53.41% (0.1013 => 0.1554, std.dev.: 0.0045)
SingleSource/Benchmarks/Misc/whetstone: 52.40% (0.0874 => 0.1332, std.dev.: 0.0176)
MultiSource/Benchmarks/MallocBench/gs/gs: 48.74% (4.5883 => 6.8247, std.dev.: 0.6430)
MultiSource/Benchmarks/McCat/18-imp/imp: 46.44% (0.3885 => 0.5689, std.dev.: 0.0532)
MultiSource/Applications/ALAC/encode/alacconvert-encode: 41.30% (1.1580 => 1.6363, std.dev.: 0.0146)
SingleSource/UnitTests/Vector/constpool: 39.11% (8.8921 => 12.3694, std.dev.: 1.2941)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 36.88% (1.1393 => 1.5595, std.dev.: 0.1538)
MultiSource/Applications/lua/lua: 33.58% (4.2242 => 5.6425, std.dev.: 0.5260)
MultiSource/Applications/kimwitu++/kc: 27.93% (18.3608 => 23.4886, std.dev.: 0.8742)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 22.76% (4.9293 => 6.0511, std.dev.: 0.3141)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 21.85% (0.0746 => 0.0909, std.dev.: 0.0010)
MultiSource/Applications/minisat/minisat: 19.40% (0.7439 => 0.8882, std.dev.: 0.0489)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 18.18% (1.9476 => 2.3017, std.dev.: 0.0682)
SingleSource/Benchmarks/Linpack/linpack-pc: 16.31% (0.2949 => 0.3430, std.dev.: 0.0096)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 15.97% (0.8802 => 1.0208, std.dev.: 0.0290)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 14.67% (0.6297 => 0.7221, std.dev.: 0.0217)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.64% (0.8233 => 0.9438, std.dev.: 0.0333)
SingleSource/UnitTests/SignlessTypes/rem: 13.14% (0.1172 => 0.1326, std.dev.: 0.0027)
SingleSource/Regression/C++/ofstream_ctor: 11.07% (0.2033 => 0.2258, std.dev.: 0.0082)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.72% (0.2229 => 0.2401, std.dev.: 0.0066)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 5.04% (0.3096 => 0.3252, std.dev.: 0.0018)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.48% (14.4764 => 14.9795, std.dev.: 0.1745)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.53% (1.8775 => 1.9250, std.dev.: 0.0054)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/methcall: 63.38% (7.6426 => 12.4861, std.dev.: 0.0703)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 52.27% (0.0220 => 0.0335, std.dev.: 0.0003)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 52.09% (0.1365 => 0.2076, std.dev.: 0.0083)
MultiSource/Applications/minisat/minisat: 51.15% (6.2760 => 9.4859, std.dev.: 0.3216)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 49.13% (0.0863 => 0.1287, std.dev.: 0.0016)
SingleSource/Benchmarks/Shootout/heapsort: 48.84% (3.5900 => 5.3435, std.dev.: 0.0168)
MultiSource/Benchmarks/Fhourstones/fhourstones: 41.14% (1.3143 => 1.8550, std.dev.: 0.1019)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.57% (1.3008 => 1.6334, std.dev.: 0.0499)
MultiSource/Benchmarks/Ptrdist/ks/ks: 24.41% (1.1431 => 1.4221, std.dev.: 0.0606)
SingleSource/Benchmarks/Shootout/ary3: 21.61% (4.6972 => 5.7123, std.dev.: 0.0874)
MultiSource/Applications/obsequi/Obsequi: 19.67% (2.1884 => 2.6189, std.dev.: 0.0533)
SingleSource/Benchmarks/Shootout/hash: 17.45% (5.2009 => 6.1082, std.dev.: 0.0655)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.34% (36.8417 => 43.2297, std.dev.: 0.9769)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 16.50% (6.4425 => 7.5057, std.dev.: 0.1913)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.79% (2.1111 => 2.3600, std.dev.: 0.0339)
SingleSource/UnitTests/Vector/multiplies: 6.76% (0.5561 => 0.5937, std.dev.: 0.0072)
MultiSource/Benchmarks/sim/sim: 6.26% (3.8312 => 4.0710, std.dev.: 0.0054)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.56% (0.1871 => 0.1975, std.dev.: 0.0001)
MultiSource/Benchmarks/BitBench/five11/five11: 5.00% (5.3716 => 5.6400, std.dev.: 0.0252)
SingleSource/Benchmarks/Misc/himenobmtxpa: 4.39% (4.0596 => 4.2378, std.dev.: 0.0077)
SingleSource/Benchmarks/Dhrystone/dry: 3.53% (0.4873 => 0.5045, std.dev.: 0.0006)
MultiSource/Benchmarks/SciMark2-C/scimark2: 3.49% (89.7126 => 92.8415, std.dev.: 0.4115)
MultiSource/Applications/hexxagon/hexxagon: 2.93% (14.7810 => 15.2140, std.dev.: 0.0181)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.76% (1.7652 => 1.8140, std.dev.: 0.0112)
MultiSource/Benchmarks/Olden/power/power: 2.49% (1.2170 => 1.2473, std.dev.: 0.0032)
SingleSource/Benchmarks/Misc/flops: 1.99% (9.4433 => 9.6313, std.dev.: 0.0561)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4046, std.dev.: 0.0318)
SingleSource/Benchmarks/SmallPT/smallpt: 1.74% (16.7972 => 17.0891, std.dev.: 0.0642)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.70% (1.0477 => 1.0655, std.dev.: 0.0006)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.16% (5.8715 => 5.9396, std.dev.: 0.0062)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/Vector/Altivec/casts: -20.77% (0.1483 => 0.1175, std.dev.: 0.0047)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -53.81% (0.5226 => 0.2414, std.dev.: 0.0270)
MultiSource/Applications/sgefa/sgefa: -42.32% (1.5790 => 0.9107, std.dev.: 0.0063)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -34.00% (0.0400 => 0.0264, std.dev.: 0.0006)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.80% (15.9508 => 13.4299, std.dev.: 0.0659)
MultiSource/Benchmarks/mafft/pairlocalalign: -13.32% (50.0284 => 43.3665, std.dev.: 0.9694)
SingleSource/UnitTests/Vectorizer/gcc-loops: -11.10% (20.8247 => 18.5125, std.dev.: 0.0818)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.73% (3.4956 => 3.1204, std.dev.: 0.1041)
SingleSource/Benchmarks/Linpack/linpack-pc: -7.56% (57.2347 => 52.9082, std.dev.: 0.5472)
SingleSource/Benchmarks/Misc/oourafft: -3.36% (3.7484 => 3.6224, std.dev.: 0.0071)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.26% (2.5938 => 2.5093, std.dev.: 0.0109)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -2.92% (0.3462 => 0.3361, std.dev.: 0.0025)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.68% (3.7874 => 3.6858, std.dev.: 0.0021)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.14% (17.1431 => 16.7757, std.dev.: 0.0352)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.56% (4.3592 => 4.2911, std.dev.: 0.0051)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 2.67% (0.1348 => 0.1384, std.dev.: 0.0388)
Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131023/d1f841d4/attachment.html>
More information about the llvm-testresults
mailing list