[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 10 07:05:00 PST 2013


http://llvm.org/perf/db_default/v4/nts/18249?compare_to=18246&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18249, Order: 196916, Start Time: 2013-12-10 13:23:53, End Time: 2013-12-10 15:09:12
      To: 18246, Order: 196903, Start Time: 2013-12-10 11:09:56, End Time: 2013-12-10 12:59:05
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 19 (22 on baseline)
Performance Improvements: 60 (16 on baseline)
Unchanged Tests: 1031 (1072 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 58.43% (1.6450 => 2.6062, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 31.62% (0.0427 => 0.0562, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/sieve: 20.66% (6.7396 => 8.1318, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/matrix: 15.71% (1.8194 => 2.1053, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/ReedSolomon: 9.05% (8.5029 => 9.2721, std.dev.: 0.2406)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.52% (0.1679 => 0.1822, std.dev.: 0.0014)
  SingleSource/Benchmarks/McGill/misr: 5.94% (0.3923 => 0.4156, std.dev.: 0.0001)
  SingleSource/Benchmarks/Misc/fp-convert: 5.58% (7.3178 => 7.7259, std.dev.: 0.0644)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.97% (0.6919 => 0.7263, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.27% (0.7141 => 0.7446, std.dev.: 0.0024)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.09% (3.7268 => 3.8420, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/lists1: 2.29% (0.5713 => 0.5844, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.27% (1.6727 => 1.7106, std.dev.: 0.0115)
  MultiSource/Applications/sqlite3/sqlite3: 2.00% (4.2204 => 4.3050, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.76% (11.9371 => 12.1475, std.dev.: 0.0095)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.28% (18.7438 => 18.9843, std.dev.: 0.0281)
  SingleSource/Benchmarks/Misc/mandel: 1.27% (1.0471 => 1.0604, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.7647 => 6.8431, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.08% (5.3170 => 5.3745, std.dev.: 0.0144)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: -41.22% (0.0507 => 0.0298, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/flops-1: -30.96% (0.0436 => 0.0301, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -30.75% (0.8292 => 0.5742, std.dev.: 0.0432)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -27.50% (0.9195 => 0.6666, std.dev.: 0.0169)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -27.31% (0.0681 => 0.0495, std.dev.: 0.0055)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -27.23% (0.0448 => 0.0326, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/mandel: -25.16% (0.0632 => 0.0473, std.dev.: 0.0054)
  MultiSource/Applications/sgefa/sgefa: -19.39% (0.4739 => 0.3820, std.dev.: 0.0238)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -18.22% (1.1416 => 0.9336, std.dev.: 0.0218)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -17.78% (0.1119 => 0.0920, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -15.99% (1.3233 => 1.1117, std.dev.: 0.0317)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -15.36% (0.0814 => 0.0689, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -14.65% (1.0887 => 0.9292, std.dev.: 0.0205)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -13.63% (0.0822 => 0.0710, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -12.68% (0.3700 => 0.3231, std.dev.: 0.0080)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -11.71% (49.9334 => 44.0886, std.dev.: 2.0589)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.87% (0.2312 => 0.2107, std.dev.: 0.0010)
  MultiSource/Applications/kimwitu++/kc: -8.24% (20.1780 => 18.5146, std.dev.: 0.4215)
  SingleSource/Benchmarks/Misc-C++/bigfib: -7.48% (0.6969 => 0.6448, std.dev.: 0.0057)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.23% (2.1066 => 1.9542, std.dev.: 0.0421)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.06% (0.1530 => 0.1422, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.94% (0.3098 => 0.2883, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -6.74% (4.5417 => 4.2358, std.dev.: 0.0759)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.66% (2.6890 => 2.5098, std.dev.: 0.0182)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -6.62% (0.3413 => 0.3187, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/ary: -5.97% (0.2648 => 0.2490, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.40% (0.9325 => 0.8821, std.dev.: 0.0184)
  SingleSource/Benchmarks/Misc/ReedSolomon: -5.13% (0.2299 => 0.2181, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.97% (1.1574 => 1.0999, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.77% (0.5345 => 0.5090, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/wc: -4.51% (0.2330 => 0.2225, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.50% (0.3134 => 0.2993, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.29% (1.2970 => 1.2413, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.90% (1.3220 => 1.2705, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.01% (1.2893 => 1.2505, std.dev.: 0.0088)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -31.81% (0.1317 => 0.0898, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -26.65% (3.7946 => 2.7833, std.dev.: 0.0317)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -25.24% (0.3589 => 0.2683, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -22.81% (0.0868 => 0.0670, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout/heapsort: -17.46% (3.4765 => 2.8694, std.dev.: 0.0394)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -16.45% (1.7431 => 1.4563, std.dev.: 0.0815)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -13.03% (10.7089 => 9.3137, std.dev.: 0.1726)
  SingleSource/Benchmarks/Shootout/ary3: -9.90% (5.2131 => 4.6969, std.dev.: 0.0330)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.00% (0.1233 => 0.1122, std.dev.: 0.0037)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -4.76% (2.4241 => 2.3087, std.dev.: 0.0291)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -4.72% (0.2246 => 0.2140, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.60% (3.9901 => 3.8064, std.dev.: 0.0577)
  SingleSource/Benchmarks/Misc/salsa20: -4.49% (7.8225 => 7.4714, std.dev.: 0.0056)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -3.71% (2.6201 => 2.5229, std.dev.: 0.0118)
  MultiSource/Benchmarks/Bullet/bullet: -3.18% (7.2680 => 7.0372, std.dev.: 0.0317)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.93% (29.2992 => 28.4399, std.dev.: 0.1128)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.76% (4.1668 => 4.0519, std.dev.: 0.0042)
  SingleSource/Benchmarks/McGill/chomp: -2.52% (1.0471 => 1.0207, std.dev.: 0.0039)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.21% (2.4250 => 2.3714, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.00% (1.6363 => 1.6036, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.83% (1.3820 => 1.3567, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/flops-4: -1.82% (1.7627 => 1.7307, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/tsp/tsp: -1.64% (1.5643 => 1.5387, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops-7: -1.20% (1.7339 => 1.7131, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout/hash: -1.12% (5.2135 => 5.1551, std.dev.: 0.0196)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.20% (1.6685 => 2.6062, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/sieve: 20.55% (6.7454 => 8.1318, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/matrix: 17.22% (1.7960 => 2.1053, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 15.74% (1.4795 => 1.7124, std.dev.: 0.0680)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.23% (0.1668 => 0.1822, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/ReedSolomon: 9.07% (8.5010 => 9.2721, std.dev.: 0.2406)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.33% (1.1019 => 1.1937, std.dev.: 0.0127)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.47% (1.2278 => 1.2950, std.dev.: 0.0177)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.67% (0.6939 => 0.7263, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/fp-convert: 4.56% (7.3892 => 7.7259, std.dev.: 0.0644)
  SingleSource/Benchmarks/McGill/misr: 3.15% (0.4029 => 0.4156, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.98% (5.9126 => 6.0889, std.dev.: 0.0173)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.96% (3.7315 => 3.8420, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.16% (11.8902 => 12.1475, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout/ary3: 2.16% (4.5977 => 4.6969, std.dev.: 0.0330)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.96% (18.6185 => 18.9843, std.dev.: 0.0281)
  SingleSource/Benchmarks/Shootout/fib2: 1.56% (3.5960 => 3.6520, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.51% (1.5797 => 1.6036, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.46% (6.8826 => 6.9829, std.dev.: 0.0294)
  SingleSource/Benchmarks/Misc/ffbench: 1.40% (1.4103 => 1.4301, std.dev.: 0.0026)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.32% (1.7409 => 1.7639, std.dev.: 0.0062)
  SingleSource/Benchmarks/McGill/chomp: 1.07% (1.0099 => 1.0207, std.dev.: 0.0039)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -11.21% (0.3247 => 0.2883, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.34% (1.3819 => 1.3081, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.12% (1.4277 => 1.3546, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.88% (1.3146 => 1.2505, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.28% (1.1409 => 1.0921, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.78% (1.2583 => 1.2107, std.dev.: 0.0165)
  SingleSource/UnitTests/Vector/constpool: -3.40% (9.2178 => 8.9042, std.dev.: 0.0843)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.33% (1.3918 => 1.3454, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.19% (1.3127 => 1.2708, std.dev.: 0.0153)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.20% (10.3096 => 10.0828, std.dev.: 0.0820)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -13.24% (0.1035 => 0.0898, std.dev.: 0.0020)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.06% (10.0217 => 9.3137, std.dev.: 0.1726)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -7.05% (2.9945 => 2.7833, std.dev.: 0.0317)
  MultiSource/Benchmarks/Bullet/bullet: -5.19% (7.4226 => 7.0372, std.dev.: 0.0317)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.20% (6.0535 => 5.9201, std.dev.: 0.0204)
  SingleSource/Benchmarks/Misc/salsa20: -1.62% (7.5947 => 7.4714, std.dev.: 0.0056)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131210/a609f11f/attachment.html>


More information about the llvm-testresults mailing list