[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 9 18:19:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13253?compare_to=13249&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13253, Order: 185982, Start Time: 2013-07-09 23:32:14, End Time: 2013-07-10 01:20:50
      To: 13249, Order: 185962, Start Time: 2013-07-09 20:28:29, End Time: 2013-07-09 22:18:18
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 14 (37 on baseline)
Performance Improvements: 20 (53 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1073 (1017 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.13% (47.0305 => 54.6162, std.dev.: 1.5438)
  MultiSource/Benchmarks/Bullet/bullet: 12.34% (35.6306 => 40.0258, std.dev.: 1.4151)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.00% (10.7620 => 11.7311, std.dev.: 0.1157)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.37% (1.6399 => 1.7279, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.21% (1.6741 => 1.7446, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.90% (1.7411 => 1.7916, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.87% (1.6008 => 1.6307, std.dev.: 0.0071)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.06% (0.8534 => 0.9051, std.dev.: 0.0170)
  MultiSource/Benchmarks/FreeBench/neural/neural: 5.49% (0.3172 => 0.3346, std.dev.: 0.0050)
  MultiSource/Benchmarks/Bullet/bullet: 4.84% (7.1462 => 7.4919, std.dev.: 0.0242)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.27% (2.9487 => 3.0746, std.dev.: 0.0295)
  SingleSource/Benchmarks/Misc/lowercase: 3.94% (0.7844 => 0.8153, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.68% (4.0979 => 4.2077, std.dev.: 0.0211)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.42% (11.3928 => 11.5548, std.dev.: 0.0540)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -19.16% (0.0929 => 0.0751, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/oourafft: -15.67% (0.2705 => 0.2281, std.dev.: 0.0046)
  MultiSource/Applications/siod/siod: -9.08% (2.7731 => 2.5212, std.dev.: 0.0287)
  MultiSource/Applications/treecc/treecc: -8.28% (2.5488 => 2.3378, std.dev.: 0.0019)
  MultiSource/Applications/sgefa/sgefa: -8.23% (0.4486 => 0.4117, std.dev.: 0.0021)
  MultiSource/Applications/d/make_dparser: -8.09% (4.0386 => 3.7118, std.dev.: 0.0267)
  SingleSource/Benchmarks/Misc-C++/bigfib: -7.02% (0.7696 => 0.7156, std.dev.: 0.0194)
  SingleSource/Benchmarks/Misc/ReedSolomon: -6.85% (0.2495 => 0.2324, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/hello: -6.71% (0.2117 => 0.1975, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.28% (0.5114 => 0.4793, std.dev.: 0.0089)
  MultiSource/Applications/SPASS/SPASS: -6.25% (18.1657 => 17.0296, std.dev.: 0.2450)
  MultiSource/Applications/spiff/spiff: -6.22% (0.9900 => 0.9284, std.dev.: 0.0105)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/bigfib: -5.60% (0.3520 => 0.3323, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -5.28% (0.2006 => 0.1900, std.dev.: 0.0010)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.39% (0.6657 => 0.6365, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -3.45% (4.1537 => 4.0105, std.dev.: 0.0464)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -3.42% (1.5525 => 1.4994, std.dev.: 0.0093)
  MultiSource/Applications/spiff/spiff: -2.37% (2.8064 => 2.7398, std.dev.: 0.0105)
  SingleSource/Benchmarks/Shootout-C++/sieve: -1.17% (3.4956 => 3.4546, std.dev.: 0.0139)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.04% (1.3611 => 1.3470, std.dev.: 0.0045)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.16% (0.1274 => 0.1276, std.dev.: 0.0062)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: 12.65% (35.5296 => 40.0258, std.dev.: 1.4151)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.37% (10.7257 => 11.7311, std.dev.: 0.1157)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.50% (1.6073 => 1.7279, std.dev.: 0.0127)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.20% (0.2721 => 0.2917, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.18% (1.7006 => 1.8227, std.dev.: 0.0446)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.04% (1.6299 => 1.7446, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.21% (1.4202 => 1.5084, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.43% (1.6993 => 1.7916, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.68% (1.5735 => 1.6471, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.45% (1.5612 => 1.6307, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.00% (1.5806 => 1.6439, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.69% (1.6070 => 1.6663, std.dev.: 0.0223)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.51% (2.5688 => 3.4811, std.dev.: 0.0103)
  MultiSource/Applications/sgefa/sgefa: 29.09% (1.1695 => 1.5097, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc/perlin: 26.57% (3.6271 => 4.5907, std.dev.: 0.0110)
  SingleSource/Benchmarks/Stanford/Puzzle: 21.79% (0.1455 => 0.1772, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.24% (6.1372 => 7.1955, std.dev.: 0.1204)
  SingleSource/Benchmarks/Misc/mandel: 16.89% (1.0293 => 1.2032, std.dev.: 0.0222)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.75% (0.9806 => 1.1350, std.dev.: 0.0139)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.36% (0.8276 => 0.9051, std.dev.: 0.0170)
  SingleSource/Benchmarks/Shootout/strcat: 8.52% (0.1456 => 0.1580, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.15% (5.2003 => 5.6241, std.dev.: 0.0105)
  MultiSource/Applications/lua/lua: 7.53% (28.2496 => 30.3773, std.dev.: 0.4694)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.46% (3.1853 => 3.3910, std.dev.: 0.0176)
  SingleSource/Benchmarks/Misc/lowercase: 5.25% (0.7746 => 0.8153, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.00% (3.2201 => 3.3810, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.88% (4.6639 => 4.8913, std.dev.: 0.0093)
  SingleSource/Benchmarks/Misc/fbench: 4.59% (4.7508 => 4.9687, std.dev.: 0.0191)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.39% (2.8994 => 3.0267, std.dev.: 0.0023)
  MultiSource/Benchmarks/Bullet/bullet: 4.14% (7.1938 => 7.4919, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.95% (5.9362 => 6.1705, std.dev.: 0.0279)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.58% (5.2788 => 5.4677, std.dev.: 0.0461)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.07% (5.5010 => 5.6698, std.dev.: 0.0531)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.53% (4.3727 => 4.4834, std.dev.: 0.0071)
  MultiSource/Benchmarks/sim/sim: 2.49% (3.8805 => 3.9772, std.dev.: 0.0149)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.36% (34.3107 => 35.1199, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.83% (5.6582 => 5.7618, std.dev.: 0.0206)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -24.39% (0.2431 => 0.1838, std.dev.: 0.0097)
  SingleSource/Benchmarks/Misc/whetstone: -16.50% (0.1097 => 0.0916, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.31% (0.0803 => 0.0672, std.dev.: 0.0029)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.37% (0.2006 => 0.1798, std.dev.: 0.0025)
  MultiSource/Applications/lemon/lemon: -6.40% (1.3155 => 1.2313, std.dev.: 0.0153)
  MultiSource/Applications/Burg/burg: -5.52% (1.5375 => 1.4526, std.dev.: 0.0142)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.13% (0.8649 => 0.8292, std.dev.: 0.0114)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.93% (1.2911 => 0.7239, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.74% (4.4050 => 2.7425, std.dev.: 0.0235)
  MultiSource/Applications/lemon/lemon: -32.95% (1.3499 => 0.9051, std.dev.: 0.0473)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.67% (1.6105 => 1.2132, std.dev.: 0.0034)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.77% (9.1099 => 7.0357, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/salsa20: -21.78% (10.3398 => 8.0876, std.dev.: 0.4282)
  SingleSource/Benchmarks/Shootout/hash: -21.78% (5.3656 => 4.1970, std.dev.: 0.2195)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.94% (4.8986 => 3.8727, std.dev.: 0.0496)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.95% (5.7264 => 4.5838, std.dev.: 0.2433)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.56% (6.2328 => 5.0763, std.dev.: 0.0109)
  SingleSource/Benchmarks/Shootout-C++/hash: -17.23% (0.7941 => 0.6573, std.dev.: 0.0416)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.17% (25.3677 => 21.2652, std.dev.: 0.0531)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.67% (1.6613 => 1.4342, std.dev.: 0.0599)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.33% (1.6679 => 1.4456, std.dev.: 0.0110)
  SingleSource/Regression/C/uint64_to_float: -10.29% (1.6851 => 1.5117, std.dev.: 0.0294)
  MultiSource/Applications/siod/siod: -9.77% (3.7240 => 3.3601, std.dev.: 0.0365)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.58% (3.5327 => 3.1942, std.dev.: 0.1265)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.74% (2.4808 => 2.2639, std.dev.: 0.0409)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.34% (9.8728 => 9.0493, std.dev.: 0.0604)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.65% (0.1542 => 0.1424, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.68% (5.5889 => 5.2158, std.dev.: 0.0159)
  MultiSource/Applications/sqlite3/sqlite3: -6.57% (4.6358 => 4.3313, std.dev.: 0.0199)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.13% (3.5939 => 3.3736, std.dev.: 0.0406)
  SingleSource/Benchmarks/Misc/flops: -5.73% (10.2170 => 9.6320, std.dev.: 0.0920)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.12% (6.3757 => 6.0491, std.dev.: 0.0903)
  MultiSource/Benchmarks/FreeBench/neural/neural: -4.75% (0.3513 => 0.3346, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.61% (5.3184 => 5.0732, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.47% (1.3084 => 1.2499, std.dev.: 0.0093)
  MultiSource/Applications/spiff/spiff: -3.99% (2.8536 => 2.7398, std.dev.: 0.0105)
  MultiSource/Applications/hexxagon/hexxagon: -3.96% (15.4979 => 14.8835, std.dev.: 0.0487)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.89% (1.6440 => 1.5800, std.dev.: 0.0148)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -3.86% (1.6535 => 1.5897, std.dev.: 0.0098)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.71% (4.5935 => 4.4229, std.dev.: 0.0240)
  SingleSource/Benchmarks/Misc/whetstone: -3.43% (3.5970 => 3.4738, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.40% (1.4783 => 1.4280, std.dev.: 0.0131)
  SingleSource/Benchmarks/Shootout/sieve: -2.87% (8.0178 => 7.7880, std.dev.: 0.0191)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.79% (0.6548 => 0.6365, std.dev.: 0.0024)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.66% (3.8665 => 3.7637, std.dev.: 0.0068)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.39% (48.3307 => 47.1738, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.96% (4.2167 => 4.1342, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.76% (4.7814 => 4.6973, std.dev.: 0.0313)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.73% (4.9946 => 4.9080, std.dev.: 0.0218)
  MultiSource/Benchmarks/Olden/power/power: -1.57% (1.2558 => 1.2361, std.dev.: 0.0061)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.47% (2.5408 => 2.5034, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.39% (2.8573 => 2.8175, std.dev.: 0.0109)
  MultiSource/Applications/aha/aha: -1.38% (3.6251 => 3.5751, std.dev.: 0.0176)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -11.45% (0.1441 => 0.1276, std.dev.: 0.0062)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130709/4cd91fb2/attachment.html>


More information about the llvm-testresults mailing list