[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Oct 30 09:44:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16839?compare_to=16835&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16839, Order: 193684, Start Time: 2013-10-30 14:49:23, End Time: 2013-10-30 16:48:25
      To: 16835, Order: 193679, Start Time: 2013-10-30 12:29:27, End Time: 2013-10-30 14:23:29
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 47 (55 on baseline)
Performance Improvements: 0 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1060 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 103.85% (0.0130 => 0.0265, std.dev.: 0.0007)
  SingleSource/UnitTests/2002-04-17-PrintfChar: 101.87% (0.0107 => 0.0216, std.dev.: 0.0004)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 99.34% (0.0151 => 0.0301, std.dev.: 0.0008)
  SingleSource/UnitTests/SignlessTypes/ccc: 88.00% (0.0250 => 0.0470, std.dev.: 0.0005)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 80.08% (0.0768 => 0.1383, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 69.66% (0.0501 => 0.0850, std.dev.: 0.0046)
  SingleSource/UnitTests/stmtexpr: 67.96% (0.0206 => 0.0346, std.dev.: 0.0022)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 48.44% (0.0514 => 0.0763, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc/mandel-2: 47.40% (0.0346 => 0.0510, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 40.65% (1.4264 => 2.0063, std.dev.: 0.1764)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 38.09% (5.0251 => 6.9390, std.dev.: 0.3000)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 28.84% (9.8839 => 12.7342, std.dev.: 0.8575)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 28.15% (7.3753 => 9.4516, std.dev.: 0.4200)
  MultiSource/Benchmarks/nbench/nbench: 20.41% (1.2385 => 1.4913, std.dev.: 0.0800)
  MultiSource/Applications/sgefa/sgefa: 20.34% (0.3919 => 0.4716, std.dev.: 0.0305)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 20.25% (2.0026 => 2.4082, std.dev.: 0.0297)
  MultiSource/Applications/kimwitu++/kc: 19.81% (19.1956 => 22.9979, std.dev.: 1.3550)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 17.01% (46.0747 => 53.9106, std.dev.: 1.5351)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 16.68% (1.2427 => 1.4500, std.dev.: 0.0455)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.48% (14.8393 => 17.2843, std.dev.: 0.5376)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 14.35% (1.2609 => 1.4418, std.dev.: 0.0414)
  MultiSource/Applications/ClamAV/clamscan: 14.23% (16.7580 => 19.1435, std.dev.: 0.6299)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 13.68% (1.3219 => 1.5028, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.29% (1.4541 => 1.6474, std.dev.: 0.0529)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.96% (1.2398 => 1.4005, std.dev.: 0.0491)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 12.02% (1.3000 => 1.4562, std.dev.: 0.0333)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.59% (0.8328 => 0.9293, std.dev.: 0.0098)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.44% (1.0950 => 1.1874, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 8.39% (1.3671 => 1.4818, std.dev.: 0.0424)
  MultiSource/Applications/JM/lencod/lencod: 1.81% (17.4655 => 17.7812, std.dev.: 0.1089)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 37.37% (0.0669 => 0.0919, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 29.96% (61.1009 => 79.4094, std.dev.: 3.4256)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 27.13% (35.2930 => 44.8697, std.dev.: 2.0446)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.18% (2.4697 => 3.0422, std.dev.: 0.1606)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 22.97% (40.7224 => 50.0757, std.dev.: 0.8339)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 12.81% (0.3311 => 0.3735, std.dev.: 0.0143)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 8.94% (2.7054 => 2.9473, std.dev.: 0.0368)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 8.26% (4.0094 => 4.3406, std.dev.: 0.0161)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 7.86% (1.4737 => 1.5896, std.dev.: 0.0424)
  MultiSource/Applications/SIBsim4/SIBsim4: 7.78% (3.3044 => 3.5614, std.dev.: 0.0285)
  SingleSource/Benchmarks/Shootout/strcat: 7.66% (0.1462 => 0.1574, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.57% (3.9895 => 4.2116, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.37% (4.5764 => 4.7766, std.dev.: 0.0380)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.91% (5.4326 => 5.6451, std.dev.: 0.0660)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.35% (0.7144 => 0.7383, std.dev.: 0.0063)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 3.14% (2.3127 => 2.3854, std.dev.: 0.0194)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 2.02% (2.3958 => 2.4441, std.dev.: 0.0025)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.77% (0.1364 => 0.1429, std.dev.: 0.0037)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 94.85% (0.0136 => 0.0265, std.dev.: 0.0007)
  SingleSource/UnitTests/SignlessTypes/ccc: 91.06% (0.0246 => 0.0470, std.dev.: 0.0005)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 89.31% (0.0159 => 0.0301, std.dev.: 0.0008)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 80.78% (0.0765 => 0.1383, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 80.08% (0.0472 => 0.0850, std.dev.: 0.0046)
  SingleSource/UnitTests/stmtexpr: 73.00% (0.0200 => 0.0346, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/mandel-2: 51.34% (0.0337 => 0.0510, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 42.89% (1.4041 => 2.0063, std.dev.: 0.1764)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 40.77% (4.9293 => 6.9390, std.dev.: 0.3000)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 35.77% (0.0562 => 0.0763, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 30.80% (9.7354 => 12.7342, std.dev.: 0.8575)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 30.08% (7.2661 => 9.4516, std.dev.: 0.4200)
  MultiSource/Applications/kimwitu++/kc: 25.26% (18.3608 => 22.9979, std.dev.: 1.3550)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 23.65% (1.9476 => 2.4082, std.dev.: 0.0297)
  MultiSource/Applications/sgefa/sgefa: 22.56% (0.3848 => 0.4716, std.dev.: 0.0305)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 21.75% (44.2807 => 53.9106, std.dev.: 1.5351)
  MultiSource/Benchmarks/nbench/nbench: 19.46% (1.2484 => 1.4913, std.dev.: 0.0800)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 19.40% (14.4764 => 17.2843, std.dev.: 0.5376)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 18.51% (1.2235 => 1.4500, std.dev.: 0.0455)
  MultiSource/Applications/ClamAV/clamscan: 15.74% (16.5398 => 19.1435, std.dev.: 0.6299)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.64% (1.2468 => 1.4418, std.dev.: 0.0414)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 15.28% (1.3036 => 1.5028, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 15.17% (1.4304 => 1.6474, std.dev.: 0.0529)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.85% (2.6492 => 3.0426, std.dev.: 0.1070)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.79% (1.2201 => 1.4005, std.dev.: 0.0491)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.01% (1.4599 => 1.6645, std.dev.: 0.0757)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.88% (0.8233 => 0.9293, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 11.43% (1.3068 => 1.4562, std.dev.: 0.0333)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.39% (1.0756 => 1.1874, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.78% (1.3498 => 1.4818, std.dev.: 0.0424)
  MultiSource/Applications/JM/lencod/lencod: 7.18% (16.5902 => 17.7812, std.dev.: 0.1089)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 59.67% (7.6426 => 12.2027, std.dev.: 0.0808)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.05% (2.8554 => 4.1702, std.dev.: 0.0599)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 40.95% (0.0652 => 0.0919, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 30.80% (60.7119 => 79.4094, std.dev.: 3.4256)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 23.46% (40.5588 => 50.0757, std.dev.: 0.8339)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.90% (2.4753 => 3.0422, std.dev.: 0.1606)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 21.79% (36.8417 => 44.8697, std.dev.: 2.0446)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.47% (1.1431 => 1.3771, std.dev.: 0.0590)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.99% (2.1111 => 2.3854, std.dev.: 0.0194)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 10.89% (2.6579 => 2.9473, std.dev.: 0.0368)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 8.91% (3.9856 => 4.3406, std.dev.: 0.0161)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.67% (96.7834 => 105.1783, std.dev.: 2.2236)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.82% (0.8273 => 0.8920, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.43% (3.1730 => 3.4086, std.dev.: 0.0756)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.34% (6.1088 => 6.4958, std.dev.: 0.0750)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.11% (3.9691 => 4.2116, std.dev.: 0.0076)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.88% (2.3084 => 2.4441, std.dev.: 0.0025)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.09% (5.3716 => 5.6451, std.dev.: 0.0660)
  SingleSource/Benchmarks/Misc/salsa20: 4.85% (7.7964 => 8.1748, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.42% (4.5744 => 4.7766, std.dev.: 0.0380)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.39% (89.7126 => 92.7567, std.dev.: 0.1875)
  SingleSource/Benchmarks/Misc/flops: 2.02% (9.4433 => 9.6340, std.dev.: 0.0660)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.26% (3.1569 => 3.1967, std.dev.: 0.0100)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -51.57% (0.5226 => 0.2531, std.dev.: 0.0337)
  MultiSource/Applications/sgefa/sgefa: -43.33% (1.5790 => 0.8948, std.dev.: 0.0207)
  SingleSource/Benchmarks/Linpack/linpack-pc: -21.15% (57.2347 => 45.1310, std.dev.: 3.6406)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.25% (15.9508 => 13.1985, std.dev.: 0.6083)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.73% (50.0284 => 44.6621, std.dev.: 0.7296)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.57% (20.8247 => 18.6225, std.dev.: 0.1241)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.57% (3.4956 => 3.1261, std.dev.: 0.0031)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.38% (8.1346 => 7.6966, std.dev.: 0.0618)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.87% (3.7437 => 3.5614, std.dev.: 0.0285)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.76% (5.2422 => 5.0452, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (5.4473 => 5.2684, std.dev.: 0.0487)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.11% (4.3592 => 4.2235, std.dev.: 0.0381)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.03% (3.7874 => 3.6728, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.54% (17.1431 => 16.7075, std.dev.: 0.0935)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.26% (3.6646 => 3.5817, std.dev.: 0.0201)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 6.01% (0.1348 => 0.1429, std.dev.: 0.0037)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131030/16a4d9c1/attachment.html>


More information about the llvm-testresults mailing list