[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 10 14:18:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13280?compare_to=13276&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13280, Order: 186027, Start Time: 2013-07-10 19:30:30, End Time: 2013-07-10 21:20:18
      To: 13276, Order: 186013, Start Time: 2013-07-10 17:13:16, End Time: 2013-07-10 19:05:52
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 8 (30 on baseline)
Performance Improvements: 32 (44 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1033 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 62.14% (0.0869 => 0.1409, std.dev.: 0.0039)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 35.73% (1.0178 => 1.3815, std.dev.: 0.0565)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 29.16% (0.2912 => 0.3761, std.dev.: 0.0232)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 28.93% (0.1777 => 0.2291, std.dev.: 0.0180)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 31.36% (0.9057 => 1.1897, std.dev.: 0.0181)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.63% (2.8431 => 3.1738, std.dev.: 0.0751)
  SingleSource/Regression/C/uint64_to_float: 2.51% (1.5086 => 1.5465, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.02% (5.0462 => 5.0977, std.dev.: 0.0189)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/TestLoop: -41.21% (0.0330 => 0.0194, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-08-20-FoldBug: -38.29% (0.0269 => 0.0166, std.dev.: 0.0012)
  SingleSource/UnitTests/printargs: -37.85% (0.0288 => 0.0179, std.dev.: 0.0016)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -35.78% (0.0830 => 0.0533, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -25.68% (0.1059 => 0.0787, std.dev.: 0.0019)
  SingleSource/Benchmarks/Stanford/IntMM: -19.03% (0.0536 => 0.0434, std.dev.: 0.0013)
  MultiSource/Applications/treecc/treecc: -10.64% (2.6375 => 2.3570, std.dev.: 0.0938)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.50% (0.1411 => 0.1291, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -8.34% (1.0725 => 0.9830, std.dev.: 0.0238)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -7.16% (0.2334 => 0.2167, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.97% (1.8783 => 1.7473, std.dev.: 0.0420)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -6.62% (1.7855 => 1.6673, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout-C++/hello: -6.31% (0.2172 => 0.2035, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.21% (1.8008 => 1.6889, std.dev.: 0.0400)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.89% (1.7529 => 1.6496, std.dev.: 0.0170)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.12% (0.2383 => 0.2261, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.83% (1.4657 => 1.4096, std.dev.: 0.0173)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -33.91% (0.0348 => 0.0230, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -31.77% (4.3233 => 2.9498, std.dev.: 0.5203)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -26.02% (1.7177 => 1.2707, std.dev.: 0.1524)
  SingleSource/Benchmarks/Stanford/Bubblesort: -25.61% (0.0449 => 0.0334, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -21.61% (0.2564 => 0.2010, std.dev.: 0.0199)
  MultiSource/Applications/JM/ldecod/ldecod: -14.25% (0.0737 => 0.0632, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -13.55% (4.6655 => 4.0333, std.dev.: 0.0534)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -10.88% (3.7141 => 3.3101, std.dev.: 0.0885)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -9.01% (0.5240 => 0.4768, std.dev.: 0.0156)
  MultiSource/Applications/spiff/spiff: -7.26% (2.9619 => 2.7468, std.dev.: 0.0249)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.28% (0.2877 => 0.2754, std.dev.: 0.0045)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.11% (0.5241 => 0.5078, std.dev.: 0.0061)
  SingleSource/Benchmarks/McGill/chomp: -3.06% (1.0469 => 1.0149, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.45% (4.6879 => 4.5731, std.dev.: 0.0289)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.04% (1.1748 => 1.1626, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.24% (0.1368 => 0.1310, std.dev.: 0.0252)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 67.34% (0.0842 => 0.1409, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 41.68% (0.1617 => 0.2291, std.dev.: 0.0180)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 38.65% (0.9964 => 1.3815, std.dev.: 0.0565)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 37.56% (0.2734 => 0.3761, std.dev.: 0.0232)
  SingleSource/Benchmarks/Shootout-C++/hello: 5.22% (0.1934 => 0.2035, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.92% (0.3113 => 0.3235, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.83% (2.5688 => 3.4893, std.dev.: 0.0378)
  MultiSource/Applications/sgefa/sgefa: 30.24% (1.1695 => 1.5232, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/perlin: 26.56% (3.6271 => 4.5905, std.dev.: 0.0183)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 25.12% (2.5366 => 3.1738, std.dev.: 0.0751)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.80% (6.1372 => 7.2295, std.dev.: 0.2209)
  SingleSource/Benchmarks/Misc/mandel: 16.59% (1.0293 => 1.2001, std.dev.: 0.0037)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.32% (0.9806 => 1.1406, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 16.06% (1.0251 => 1.1897, std.dev.: 0.0181)
  SingleSource/Benchmarks/Stanford/Puzzle: 15.74% (0.1455 => 0.1684, std.dev.: 0.0020)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.17% (2.5800 => 2.9713, std.dev.: 0.1242)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.99% (5.2003 => 5.6160, std.dev.: 0.0231)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 7.98% (0.4572 => 0.4937, std.dev.: 0.0125)
  MultiSource/Applications/lua/lua: 7.78% (28.2496 => 30.4486, std.dev.: 0.5438)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.97% (3.1853 => 3.3754, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.87% (3.2201 => 3.3768, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.71% (4.6639 => 4.8837, std.dev.: 0.0474)
  SingleSource/Benchmarks/Misc/fbench: 4.70% (4.7508 => 4.9742, std.dev.: 0.0212)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.38% (2.8994 => 3.0263, std.dev.: 0.0077)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.29% (1.2224 => 1.2748, std.dev.: 0.0056)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.42% (39.9248 => 41.2904, std.dev.: 0.0773)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.02% (5.5010 => 5.6670, std.dev.: 0.0033)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.23% (34.3107 => 35.0774, std.dev.: 0.0184)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.18% (1.7925 => 1.8315, std.dev.: 0.0087)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.09% (4.3727 => 4.4641, std.dev.: 0.0137)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -31.72% (0.1113 => 0.0760, std.dev.: 0.0096)
  MultiSource/Applications/viterbi/viterbi: -24.89% (0.2431 => 0.1826, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/whetstone: -14.49% (0.1097 => 0.0938, std.dev.: 0.0032)
  MultiSource/Applications/JM/lencod/lencod: -9.21% (18.9387 => 17.1948, std.dev.: 0.2442)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.78% (1.6793 => 1.5991, std.dev.: 0.0128)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.15% (1.2911 => 0.7340, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -38.05% (4.4050 => 2.7291, std.dev.: 0.0138)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.50% (1.6105 => 1.2159, std.dev.: 0.0181)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.77% (9.1099 => 7.0355, std.dev.: 0.0775)
  SingleSource/Benchmarks/Misc/salsa20: -21.66% (10.3398 => 8.1002, std.dev.: 0.4304)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.98% (4.8986 => 3.8709, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/hash: -20.77% (0.7941 => 0.6292, std.dev.: 0.0164)
  SingleSource/Benchmarks/Shootout/hash: -20.45% (5.3656 => 4.2686, std.dev.: 0.1312)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.14% (5.7264 => 4.5731, std.dev.: 0.0289)
  MultiSource/Benchmarks/Olden/bisort/bisort: -19.45% (0.8606 => 0.6932, std.dev.: 0.0643)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.21% (6.2328 => 5.0977, std.dev.: 0.0189)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.78% (25.3677 => 21.3647, std.dev.: 0.3167)
  MultiSource/Benchmarks/Olden/tsp/tsp: -12.80% (1.6613 => 1.4486, std.dev.: 0.0055)
  MultiSource/Applications/siod/siod: -9.79% (3.7240 => 3.3594, std.dev.: 0.0323)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.37% (3.5327 => 3.2369, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.34% (9.8728 => 9.0499, std.dev.: 0.0055)
  SingleSource/Regression/C/uint64_to_float: -8.23% (1.6851 => 1.5465, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.29% (4.5717 => 4.2382, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.78% (5.5889 => 5.2097, std.dev.: 0.0099)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -6.26% (2.8537 => 2.6752, std.dev.: 0.0585)
  MultiSource/Applications/sqlite3/sqlite3: -6.10% (4.6358 => 4.3528, std.dev.: 0.0574)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.91% (3.5939 => 3.3814, std.dev.: 0.0657)
  SingleSource/Benchmarks/Misc/flops: -5.76% (10.2170 => 9.6287, std.dev.: 0.0979)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.39% (6.3757 => 6.0319, std.dev.: 0.0241)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.80% (5.3184 => 5.0630, std.dev.: 0.0140)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -4.69% (2.5087 => 2.3911, std.dev.: 0.0287)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.52% (1.3084 => 1.2493, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.21% (5.3276 => 5.1034, std.dev.: 0.0057)
  MultiSource/Applications/spiff/spiff: -3.74% (2.8536 => 2.7468, std.dev.: 0.0249)
  SingleSource/Benchmarks/Misc/whetstone: -3.50% (3.5970 => 3.4711, std.dev.: 0.0093)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.44% (4.1768 => 4.0333, std.dev.: 0.0534)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -3.16% (1.6535 => 1.6012, std.dev.: 0.0072)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.55% (48.3307 => 47.0996, std.dev.: 0.3707)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.14% (4.5094 => 4.4129, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.80% (4.9946 => 4.9045, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.70% (4.2167 => 4.1450, std.dev.: 0.0057)
  MultiSource/Benchmarks/Olden/power/power: -1.47% (1.2558 => 1.2374, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.40% (1.1791 => 1.1626, std.dev.: 0.0031)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.04% (94.2966 => 93.3177, std.dev.: 0.2130)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.09% (0.1441 => 0.1310, std.dev.: 0.0252)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130710/9051c0c2/attachment.html>


More information about the llvm-testresults mailing list