[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Oct 2 12:49:25 PDT 2013
http://llvm.org/perf/db_default/v4/nts/15900?compare_to=15897&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 15900, Order: 191843, Start Time: 2013-10-02 17:58:27, End Time: 2013-10-02 19:52:18
To: 15897, Order: 191831, Start Time: 2013-10-02 15:40:41, End Time: 2013-10-02 17:32:55
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 51 (62 on baseline)
Performance Improvements: 16 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1040 (1027 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Misc/flops-7: 88.29% (0.0299 => 0.0563, std.dev.: 0.0013)
SingleSource/UnitTests/2002-10-09-ArrayResolution: 82.21% (0.0163 => 0.0297, std.dev.: 0.0011)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 81.42% (0.0775 => 0.1406, std.dev.: 0.0036)
SingleSource/Benchmarks/Stanford/Queens: 64.47% (0.0456 => 0.0750, std.dev.: 0.0015)
MultiSource/Benchmarks/Olden/bisort/bisort: 61.54% (0.0728 => 0.1176, std.dev.: 0.0080)
MultiSource/Benchmarks/FreeBench/distray/distray: 61.10% (0.1162 => 0.1872, std.dev.: 0.0078)
SingleSource/UnitTests/2003-05-31-CastToBool: 52.94% (0.0272 => 0.0416, std.dev.: 0.0036)
MultiSource/Benchmarks/Olden/tsp/tsp: 51.99% (0.1360 => 0.2067, std.dev.: 0.0227)
SingleSource/Benchmarks/Shootout-C++/lists: 42.35% (0.2614 => 0.3721, std.dev.: 0.0389)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 37.37% (1.1454 => 1.5734, std.dev.: 0.0850)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 34.80% (1.6179 => 2.1809, std.dev.: 0.0644)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 31.54% (0.9534 => 1.2541, std.dev.: 0.0597)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 21.86% (0.0837 => 0.1020, std.dev.: 0.0069)
MultiSource/Applications/lua/lua: 20.21% (4.2699 => 5.1328, std.dev.: 0.2543)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.53% (1.4774 => 1.7660, std.dev.: 0.0862)
SingleSource/Benchmarks/Linpack/linpack-pc: 17.44% (0.2958 => 0.3474, std.dev.: 0.0053)
MultiSource/Applications/lambda-0_1_3/lambda: 17.42% (0.8308 => 0.9755, std.dev.: 0.0217)
MultiSource/Applications/sqlite3/sqlite3: 12.94% (17.2266 => 19.4549, std.dev.: 0.3520)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 12.15% (0.1292 => 0.1449, std.dev.: 0.0017)
MultiSource/Applications/lemon/lemon: 11.87% (1.2161 => 1.3604, std.dev.: 0.0435)
SingleSource/Benchmarks/Shootout-C++/hello: 10.11% (0.1801 => 0.1983, std.dev.: 0.0059)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.34% (1.0920 => 1.1831, std.dev.: 0.0219)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/heapsort: 71.25% (2.8340 => 4.8533, std.dev.: 0.0669)
MultiSource/Benchmarks/Ptrdist/ft/ft: 61.65% (0.9132 => 1.4762, std.dev.: 0.0371)
MultiSource/Benchmarks/Olden/mst/mst: 61.42% (0.1786 => 0.2883, std.dev.: 0.0112)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 50.90% (0.0222 => 0.0335, std.dev.: 0.0003)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 50.13% (4.5320 => 6.8038, std.dev.: 0.1148)
SingleSource/Benchmarks/Shootout-C++/strcat: 47.23% (0.0955 => 0.1406, std.dev.: 0.0175)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 43.52% (0.0864 => 0.1240, std.dev.: 0.0025)
SingleSource/Benchmarks/Stanford/Quicksort: 40.07% (0.0277 => 0.0388, std.dev.: 0.0019)
MultiSource/Benchmarks/Olden/bisort/bisort: 36.82% (0.7032 => 0.9621, std.dev.: 0.0656)
MultiSource/Benchmarks/llubenchmark/llu: 20.94% (1.9939 => 2.4114, std.dev.: 0.0314)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.98% (2.1102 => 2.3842, std.dev.: 0.0169)
SingleSource/Benchmarks/McGill/chomp: 12.80% (1.0159 => 1.1459, std.dev.: 0.0150)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.62% (4.9535 => 5.4795, std.dev.: 0.0131)
SingleSource/Benchmarks/Shootout-C++/ackermann: 9.60% (3.9585 => 4.3386, std.dev.: 0.0212)
SingleSource/Benchmarks/BenchmarkGame/recursive: 9.56% (2.2609 => 2.4770, std.dev.: 0.0210)
MultiSource/Benchmarks/Olden/tsp/tsp: 9.40% (1.5874 => 1.7366, std.dev.: 0.0431)
SingleSource/Benchmarks/Misc/salsa20: 9.26% (7.5023 => 8.1973, std.dev.: 0.1346)
MultiSource/Benchmarks/BitBench/drop3/drop3: 6.22% (0.4617 => 0.4904, std.dev.: 0.0074)
MultiSource/Benchmarks/Olden/bh/bh: 5.59% (2.4022 => 2.5366, std.dev.: 0.0292)
MultiSource/Benchmarks/PAQ8p/paq8p: 3.84% (98.1932 => 101.9608, std.dev.: 0.7090)
SingleSource/Benchmarks/Misc/himenobmtxpa: 3.36% (4.0824 => 4.2195, std.dev.: 0.0217)
MultiSource/Benchmarks/Olden/em3d/em3d: 3.34% (5.0334 => 5.2015, std.dev.: 0.0222)
SingleSource/Benchmarks/Misc/fp-convert: 3.24% (7.3241 => 7.5616, std.dev.: 0.0747)
MultiSource/Applications/sqlite3/sqlite3: 2.99% (4.3664 => 4.4969, std.dev.: 0.0493)
SingleSource/Benchmarks/Misc/flops: 2.69% (9.3590 => 9.6111, std.dev.: 0.0477)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.99% (5.1149 => 5.2167, std.dev.: 0.0240)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.83% (5.9021 => 6.0102, std.dev.: 0.0146)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.70% (2.9561 => 3.0064, std.dev.: 0.0155)
MultiSource/Applications/lambda-0_1_3/lambda: 1.10% (8.6405 => 8.7356, std.dev.: 0.0107)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -41.74% (0.0678 => 0.0395, std.dev.: 0.0024)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -32.41% (0.4751 => 0.3211, std.dev.: 0.0238)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -26.63% (0.2343 => 0.1719, std.dev.: 0.0109)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.54% (0.0693 => 0.0516, std.dev.: 0.0017)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -16.66% (2.3098 => 1.9251, std.dev.: 0.1113)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -15.35% (0.2879 => 0.2437, std.dev.: 0.0035)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -15.06% (0.0697 => 0.0592, std.dev.: 0.0025)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -12.59% (1.9134 => 1.6725, std.dev.: 0.0059)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -10.64% (1.3811 => 1.2341, std.dev.: 0.0566)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.38% (1.5994 => 1.4494, std.dev.: 0.0101)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -8.77% (1.4443 => 1.3176, std.dev.: 0.0341)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -8.61% (1.5711 => 1.4358, std.dev.: 0.0259)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -7.72% (5.4157 => 4.9977, std.dev.: 0.0458)
MultiSource/Benchmarks/nbench/nbench: -4.60% (1.3307 => 1.2695, std.dev.: 0.0173)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -38.66% (0.0939 => 0.0576, std.dev.: 0.0076)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.69% (2.4490 => 2.3586, std.dev.: 0.0197)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 20.89% (0.1321 => 0.1597, std.dev.: 0.0214)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Misc/flops-7: 94.81% (0.0289 => 0.0563, std.dev.: 0.0013)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 81.89% (0.0773 => 0.1406, std.dev.: 0.0036)
SingleSource/UnitTests/2002-10-09-ArrayResolution: 71.68% (0.0173 => 0.0297, std.dev.: 0.0011)
SingleSource/Benchmarks/Stanford/Queens: 71.23% (0.0438 => 0.0750, std.dev.: 0.0015)
MultiSource/Benchmarks/Olden/bisort/bisort: 69.21% (0.0695 => 0.1176, std.dev.: 0.0080)
MultiSource/Benchmarks/Olden/tsp/tsp: 59.37% (0.1297 => 0.2067, std.dev.: 0.0227)
MultiSource/Benchmarks/FreeBench/distray/distray: 56.78% (0.1194 => 0.1872, std.dev.: 0.0078)
SingleSource/UnitTests/2003-05-31-CastToBool: 56.39% (0.0266 => 0.0416, std.dev.: 0.0036)
SingleSource/Benchmarks/Shootout-C++/lists: 44.39% (0.2577 => 0.3721, std.dev.: 0.0389)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 38.10% (1.1393 => 1.5734, std.dev.: 0.0850)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 36.14% (0.9212 => 1.2541, std.dev.: 0.0597)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: 35.91% (1.6047 => 2.1809, std.dev.: 0.0644)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 35.32% (0.0504 => 0.0682, std.dev.: 0.0063)
MultiSource/Benchmarks/Ptrdist/bc/bc: 31.49% (1.2728 => 1.6736, std.dev.: 0.1404)
MultiSource/Applications/lambda-0_1_3/lambda: 21.72% (0.8014 => 0.9755, std.dev.: 0.0217)
MultiSource/Applications/lua/lua: 21.51% (4.2242 => 5.1328, std.dev.: 0.2543)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 19.76% (1.4746 => 1.7660, std.dev.: 0.0862)
MultiSource/Applications/sqlite3/sqlite3: 19.44% (16.2888 => 19.4549, std.dev.: 0.3520)
SingleSource/Benchmarks/Linpack/linpack-pc: 17.80% (0.2949 => 0.3474, std.dev.: 0.0053)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 15.00% (0.0820 => 0.0943, std.dev.: 0.0037)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.73% (0.1263 => 0.1449, std.dev.: 0.0017)
MultiSource/Applications/lemon/lemon: 14.69% (1.1862 => 1.3604, std.dev.: 0.0435)
SingleSource/Benchmarks/Shootout-C++/hello: 10.97% (0.1787 => 0.1983, std.dev.: 0.0059)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 9.99% (1.0756 => 1.1831, std.dev.: 0.0219)
MultiSource/Benchmarks/sim/sim: 8.01% (0.3732 => 0.4031, std.dev.: 0.0109)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.83% (0.2956 => 0.3158, std.dev.: 0.0053)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.37% (0.2335 => 0.2437, std.dev.: 0.0035)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.58% (1.6465 => 1.6725, std.dev.: 0.0059)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 109.37% (0.1377 => 0.2883, std.dev.: 0.0112)
MultiSource/Benchmarks/Ptrdist/ft/ft: 99.22% (0.7410 => 1.4762, std.dev.: 0.0371)
SingleSource/Benchmarks/Shootout-C++/methcall: 63.33% (7.6426 => 12.4827, std.dev.: 0.0309)
SingleSource/Benchmarks/Shootout-C++/heapsort: 61.18% (3.0111 => 4.8533, std.dev.: 0.0669)
MultiSource/Applications/ALAC/decode/alacconvert-decode: 52.27% (0.0220 => 0.0335, std.dev.: 0.0003)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 49.60% (4.5479 => 6.8038, std.dev.: 0.1148)
MultiSource/Benchmarks/Olden/bisort/bisort: 44.74% (0.6647 => 0.9621, std.dev.: 0.0656)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 43.68% (0.0863 => 0.1240, std.dev.: 0.0025)
SingleSource/Benchmarks/Stanford/Quicksort: 43.17% (0.0271 => 0.0388, std.dev.: 0.0019)
MultiSource/Applications/ALAC/encode/alacconvert-encode: 30.99% (0.0497 => 0.0651, std.dev.: 0.0022)
MultiSource/Benchmarks/FreeBench/pifft/pifft: 24.02% (0.1374 => 0.1704, std.dev.: 0.0111)
MultiSource/Benchmarks/llubenchmark/llu: 21.24% (1.9889 => 2.4114, std.dev.: 0.0314)
SingleSource/Benchmarks/McGill/misr: 14.77% (0.3771 => 0.4328, std.dev.: 0.0154)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.94% (2.1111 => 2.3842, std.dev.: 0.0169)
SingleSource/Benchmarks/McGill/chomp: 12.77% (1.0161 => 1.1459, std.dev.: 0.0150)
MultiSource/Benchmarks/Olden/tsp/tsp: 11.66% (1.5553 => 1.7366, std.dev.: 0.0431)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.86% (4.9428 => 5.4795, std.dev.: 0.0131)
MultiSource/Benchmarks/nbench/nbench: 10.28% (22.1263 => 24.4014, std.dev.: 0.3602)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.74% (0.8273 => 0.9079, std.dev.: 0.0279)
SingleSource/Benchmarks/Shootout-C++/ackermann: 8.45% (4.0006 => 4.3386, std.dev.: 0.0212)
MultiSource/Applications/lambda-0_1_3/lambda: 7.39% (8.1346 => 8.7356, std.dev.: 0.0107)
SingleSource/Benchmarks/BenchmarkGame/recursive: 6.01% (2.3365 => 2.4770, std.dev.: 0.0210)
MultiSource/Benchmarks/Olden/bh/bh: 5.87% (2.3959 => 2.5366, std.dev.: 0.0292)
MultiSource/Benchmarks/PAQ8p/paq8p: 5.35% (96.7834 => 101.9608, std.dev.: 0.7090)
SingleSource/UnitTests/Vector/multiplies: 5.23% (0.5561 => 0.5852, std.dev.: 0.0054)
MultiSource/Applications/sqlite3/sqlite3: 5.23% (4.2733 => 4.4969, std.dev.: 0.0493)
SingleSource/Benchmarks/Misc/salsa20: 5.14% (7.7964 => 8.1973, std.dev.: 0.1346)
SingleSource/Benchmarks/Misc/himenobmtxpa: 3.94% (4.0596 => 4.2195, std.dev.: 0.0217)
MultiSource/Benchmarks/Olden/em3d/em3d: 3.43% (5.0288 => 5.2015, std.dev.: 0.0222)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.44% (5.7757 => 5.9164, std.dev.: 0.0468)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.33% (3.5683 => 3.6514, std.dev.: 0.0056)
SingleSource/Benchmarks/Misc/flops: 1.78% (9.4433 => 9.6111, std.dev.: 0.0477)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.60% (2.9592 => 3.0064, std.dev.: 0.0155)
SingleSource/Benchmarks/SmallPT/smallpt: 1.05% (16.7972 => 16.9736, std.dev.: 0.0342)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/Vector/Altivec/casts: -21.58% (0.1483 => 0.1163, std.dev.: 0.0095)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -51.09% (0.5226 => 0.2556, std.dev.: 0.0442)
MultiSource/Applications/sgefa/sgefa: -47.23% (1.5790 => 0.8333, std.dev.: 0.0455)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -25.75% (0.0400 => 0.0297, std.dev.: 0.0006)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.87% (15.9508 => 12.7811, std.dev.: 0.6552)
SingleSource/Benchmarks/Linpack/linpack-pc: -16.13% (57.2347 => 48.0016, std.dev.: 2.7734)
SingleSource/UnitTests/Vectorizer/gcc-loops: -11.08% (20.8247 => 18.5174, std.dev.: 0.1752)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.18% (3.4956 => 3.1396, std.dev.: 0.0364)
MultiSource/Applications/JM/lencod/lencod: -7.96% (8.1785 => 7.5277, std.dev.: 0.1240)
MultiSource/Benchmarks/mafft/pairlocalalign: -7.25% (50.0284 => 46.4030, std.dev.: 0.3358)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.68% (0.4549 => 0.4245, std.dev.: 0.0070)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -5.13% (1.0695 => 1.0146, std.dev.: 0.0197)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.05% (2.5938 => 2.4888, std.dev.: 0.0238)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.46% (4.3592 => 4.2085, std.dev.: 0.0385)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.12% (17.1431 => 16.6087, std.dev.: 0.0992)
MultiSource/Applications/SIBsim4/SIBsim4: -2.49% (3.7437 => 3.6504, std.dev.: 0.0124)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.34% (2.4471 => 2.4143, std.dev.: 0.0101)
MultiSource/Benchmarks/SciMark2-C/scimark2: -1.12% (89.7126 => 88.7068, std.dev.: 0.2731)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 18.47% (0.1348 => 0.1597, std.dev.: 0.0214)
Report Time: 1.22s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131002/79fc52f3/attachment.html>
More information about the llvm-testresults
mailing list