[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 22 11:09:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14679?compare_to=14676&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14679, Order: 189024, Start Time: 2013-08-22 16:21:27, End Time: 2013-08-22 18:11:48
      To: 14676, Order: 189009, Start Time: 2013-08-22 14:02:54, End Time: 2013-08-22 15:54:16
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 29 (53 on baseline)
Performance Improvements: 6 (32 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1072 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: 69.35% (0.0248 => 0.0420, std.dev.: 0.0008)
  SingleSource/Regression/C++/BuiltinTypeInfo: 58.74% (0.0206 => 0.0327, std.dev.: 0.0010)
  SingleSource/Regression/C/matrixTranspose: 50.71% (0.0282 => 0.0425, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 12.82% (6.4969 => 7.3299, std.dev.: 0.0803)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 12.12% (0.8044 => 0.9019, std.dev.: 0.0170)
  SingleSource/Benchmarks/Shootout-C++/wc: 11.33% (0.2490 => 0.2772, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.18% (4.2604 => 4.7365, std.dev.: 0.1240)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 9.71% (0.4242 => 0.4654, std.dev.: 0.0133)
  SingleSource/Benchmarks/Shootout-C++/lists: 9.22% (0.2906 => 0.3174, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.41% (0.2104 => 0.2260, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/hello: 5.12% (0.2052 => 0.2157, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 61.72% (5.8143 => 9.4026, std.dev.: 1.0161)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.15% (4.4915 => 5.9354, std.dev.: 0.4426)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 29.42% (1.5910 => 2.0590, std.dev.: 0.1288)
  SingleSource/Benchmarks/Shootout-C++/moments: 17.22% (0.1022 => 0.1198, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.81% (4.1357 => 4.8308, std.dev.: 0.0059)
  SingleSource/Benchmarks/Linpack/linpack-pc: 13.78% (45.8945 => 52.2180, std.dev.: 0.2816)
  SingleSource/Benchmarks/Shootout/hash: 10.33% (5.1640 => 5.6976, std.dev.: 0.0971)
  SingleSource/Benchmarks/Misc/flops-7: 6.46% (1.7286 => 1.8402, std.dev.: 0.0110)
  SingleSource/Benchmarks/McGill/chomp: 6.44% (1.0810 => 1.1506, std.dev.: 0.0196)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.92% (2.4023 => 2.5446, std.dev.: 0.0187)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.88% (0.8564 => 0.8982, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.41% (4.9728 => 5.1424, std.dev.: 0.0653)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.00% (16.3181 => 16.8080, std.dev.: 0.1027)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.94% (5.0163 => 5.1636, std.dev.: 0.0252)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.02% (3.2452 => 3.3109, std.dev.: 0.0196)
  MultiSource/Applications/spiff/spiff: 2.00% (2.8719 => 2.9292, std.dev.: 0.0205)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 1.41% (1.3455 => 1.3645, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.34% (4.9394 => 5.0055, std.dev.: 0.0255)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -31.24% (0.1434 => 0.0986, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -30.84% (0.2205 => 0.1525, std.dev.: 0.0185)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -19.54% (2.4397 => 1.9631, std.dev.: 0.0705)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -30.99% (0.0797 => 0.0550, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -30.60% (0.2121 => 0.1472, std.dev.: 0.0053)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.97% (0.6902 => 0.6421, std.dev.: 0.0129)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.46% (0.1300 => 0.1306, std.dev.: 0.0274)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: 72.13% (0.0244 => 0.0420, std.dev.: 0.0008)
  SingleSource/Regression/C++/BuiltinTypeInfo: 66.84% (0.0196 => 0.0327, std.dev.: 0.0010)
  SingleSource/Regression/C/matrixTranspose: 56.25% (0.0272 => 0.0425, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 12.80% (6.4979 => 7.3299, std.dev.: 0.0803)
  SingleSource/Benchmarks/Shootout-C++/wc: 12.77% (0.2458 => 0.2772, std.dev.: 0.0015)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.59% (4.2444 => 4.7365, std.dev.: 0.1240)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 11.51% (0.8088 => 0.9019, std.dev.: 0.0170)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 11.29% (0.4182 => 0.4654, std.dev.: 0.0133)
  SingleSource/Benchmarks/Shootout-C++/lists: 11.10% (0.2857 => 0.3174, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.61% (0.2140 => 0.2260, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/hello: 5.43% (0.2046 => 0.2157, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 75.27% (3.7285 => 6.5349, std.dev.: 0.0287)
  SingleSource/Benchmarks/Shootout/ary3: 61.67% (5.8158 => 9.4026, std.dev.: 1.0161)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.33% (2.8867 => 4.3106, std.dev.: 0.0277)
  SingleSource/Benchmarks/Shootout/hash: 36.16% (4.1846 => 5.6976, std.dev.: 0.0971)
  MultiSource/Benchmarks/FreeBench/neural/neural: 33.02% (0.3171 => 0.4218, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.40% (4.5517 => 5.9354, std.dev.: 0.4426)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 27.72% (1.6121 => 2.0590, std.dev.: 0.1288)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.46% (1.5030 => 1.8857, std.dev.: 0.0118)
  SingleSource/Benchmarks/Misc/pi: 25.25% (1.9835 => 2.4843, std.dev.: 0.0315)
  SingleSource/Benchmarks/Shootout-C++/hash: 22.95% (0.6295 => 0.7740, std.dev.: 0.0363)
  SingleSource/Benchmarks/McGill/chomp: 14.48% (1.0051 => 1.1506, std.dev.: 0.0196)
  SingleSource/Benchmarks/Shootout-C++/moments: 13.23% (0.1058 => 0.1198, std.dev.: 0.0045)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.79% (7.0762 => 7.8400, std.dev.: 0.0185)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9473, std.dev.: 0.0953)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.05% (48.3256 => 52.2180, std.dev.: 0.2816)
  MultiSource/Applications/JM/lencod/lencod: 7.06% (7.1799 => 7.6869, std.dev.: 0.1831)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.82% (3.2027 => 3.4212, std.dev.: 0.0163)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.50% (2.3894 => 2.5446, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/flops-7: 6.19% (1.7330 => 1.8402, std.dev.: 0.0110)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.18% (0.2799 => 0.2972, std.dev.: 0.0009)
  MultiSource/Applications/spiff/spiff: 6.10% (2.7609 => 2.9292, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6224, std.dev.: 0.0471)
  MultiSource/Applications/siod/siod: 5.86% (3.3761 => 3.5740, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.59% (5.5008 => 5.8082, std.dev.: 0.0923)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.51% (3.4085 => 3.5964, std.dev.: 0.0297)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.52% (3.3877 => 3.5407, std.dev.: 0.0392)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.49% (6.1245 => 6.3995, std.dev.: 0.0408)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.3151 => 4.5021, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.29% (5.1471 => 5.3677, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/whetstone: 4.25% (3.4559 => 3.6029, std.dev.: 0.0296)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.13% (1.3104 => 1.3645, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.80% (3.3384 => 3.4651, std.dev.: 0.0455)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.28% (25.0200 => 25.8410, std.dev.: 0.0585)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.34% (12.8625 => 13.1636, std.dev.: 0.0629)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.10% (4.4624 => 4.5562, std.dev.: 0.0244)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 2.00% (3.2461 => 3.3109, std.dev.: 0.0196)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.78% (1.5957 => 1.6241, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.75% (1.5956 => 1.6236, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.69% (16.5294 => 16.8080, std.dev.: 0.1027)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.50% (4.9089 => 4.9827, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.14% (4.9040 => 4.9599, std.dev.: 0.0105)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.60% (0.1072 => 0.0744, std.dev.: 0.0033)
  MultiSource/Applications/hexxagon/hexxagon: -15.78% (1.3285 => 1.1189, std.dev.: 0.0447)
  MultiSource/Applications/sgefa/sgefa: -12.58% (0.4809 => 0.4204, std.dev.: 0.0030)
  MultiSource/Applications/Burg/burg: -5.89% (1.5733 => 1.4806, std.dev.: 0.0095)
  MultiSource/Applications/lemon/lemon: -4.51% (1.2976 => 1.2391, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.49% (1.4339 => 1.3695, std.dev.: 0.0139)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.27% (1.4194 => 0.8904, std.dev.: 0.0361)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.10% (2.1022 => 1.4485, std.dev.: 0.0251)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.44% (0.1189 => 0.0839, std.dev.: 0.0025)
  MultiSource/Applications/viterbi/viterbi: -27.35% (3.4923 => 2.5370, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.59% (6.9552 => 5.2449, std.dev.: 0.0168)
  SingleSource/Benchmarks/Misc/perlin: -21.47% (4.5989 => 3.6117, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/mandel: -13.97% (1.1996 => 1.0320, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.24% (6.2627 => 5.4334, std.dev.: 0.2807)
  MultiSource/Benchmarks/nbench/nbench: -12.70% (22.0083 => 19.2135, std.dev.: 0.9976)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.33% (0.0884 => 0.0775, std.dev.: 0.0009)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.98% (3.5791 => 3.2935, std.dev.: 0.0827)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.95% (47.2250 => 44.4160, std.dev.: 1.0451)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (3.8119 => 3.6283, std.dev.: 0.0599)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.60% (1.1024 => 1.0517, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc/fbench: -4.41% (4.9602 => 4.7413, std.dev.: 0.0228)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.32% (1.7207 => 1.6463, std.dev.: 0.0077)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.11% (1.1032 => 1.0579, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8380, std.dev.: 0.0293)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.21% (21.6864 => 20.9912, std.dev.: 0.1879)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.94% (5.2218 => 5.0683, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.88% (6.1482 => 5.9711, std.dev.: 0.0310)
  MultiSource/Applications/sgefa/sgefa: -2.42% (1.4030 => 1.3691, std.dev.: 0.0008)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1437, std.dev.: 0.1134)
  SingleSource/Benchmarks/Stanford/FloatMM: -1.73% (0.7806 => 0.7671, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.72% (21.5567 => 21.1861, std.dev.: 0.1393)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.41% (5.8810 => 5.7983, std.dev.: 0.0205)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.22% (0.1378 => 0.1306, std.dev.: 0.0274)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130822/02662dac/attachment.html>


More information about the llvm-testresults mailing list