[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Aug 3 20:14:55 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14065?compare_to=14060&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14065, Order: 187700, Start Time: 2013-08-04 01:13:46, End Time: 2013-08-04 03:16:43
      To: 14060, Order: 187699, Start Time: 2013-08-03 23:04:03, End Time: 2013-08-04 00:47:53
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 10 (28 on baseline)
Performance Improvements: 2 (85 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1093 (992 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 2.05% (0.7128 => 0.7274, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 12.15% (5.2210 => 5.8554, std.dev.: 0.1607)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.79% (2.3137 => 2.5402, std.dev.: 0.0075)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.56% (48.9511 => 52.1613, std.dev.: 0.0931)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.57% (3.9985 => 4.2212, std.dev.: 0.0288)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.51% (15.3838 => 16.2307, std.dev.: 0.3068)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.54% (43.3362 => 44.8698, std.dev.: 0.0773)
  SingleSource/Benchmarks/Misc/flops: 3.47% (9.5792 => 9.9115, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.61% (4.9849 => 5.0653, std.dev.: 0.0152)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 1.03% (1.4800 => 1.4953, std.dev.: 0.0035)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/spiff/spiff: -2.86% (0.9548 => 0.9275, std.dev.: 0.0099)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.17% (37.4164 => 36.9774, std.dev.: 0.1513)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -0.30% (0.1318 => 0.1314, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 0.11% (0.2735 => 0.2738, std.dev.: 0.0122)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: - (0.0279 => 0.0279, std.dev.: 0.0111)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.67% (0.2813 => 0.2738, std.dev.: 0.0122)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0111)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 4.22% (8.8630 => 9.2369, std.dev.: 0.1095)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.08% (3.7285 => 6.4532, std.dev.: 0.0603)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.58% (2.8867 => 4.2891, std.dev.: 0.0365)
  MultiSource/Benchmarks/FreeBench/neural/neural: 32.10% (0.3171 => 0.4189, std.dev.: 0.0078)
  SingleSource/Benchmarks/Shootout/hash: 24.55% (4.1846 => 5.2119, std.dev.: 0.1578)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.28% (0.6295 => 0.7320, std.dev.: 0.0151)
  MultiSource/Applications/siod/siod: 13.63% (3.3761 => 3.8363, std.dev.: 0.0223)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.53% (7.0762 => 7.9632, std.dev.: 0.0635)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.51% (14.9584 => 16.2307, std.dev.: 0.3068)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9470, std.dev.: 0.0333)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.94% (48.3256 => 52.1613, std.dev.: 0.0931)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.92% (1.2557 => 1.3552, std.dev.: 0.0317)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4237, std.dev.: 0.0378)
  SingleSource/Benchmarks/McGill/chomp: 6.42% (1.0051 => 1.0696, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.05% (3.3877 => 3.5927, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6219, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.70% (3.4085 => 3.6027, std.dev.: 0.0337)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.50% (5.5008 => 5.8036, std.dev.: 0.0986)
  SingleSource/Benchmarks/Misc/whetstone: 4.79% (3.4559 => 3.6214, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.36% (4.3151 => 4.5034, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3655, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.73% (3.3384 => 3.4630, std.dev.: 0.0467)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (4.8739 => 5.0220, std.dev.: 0.0132)
  MultiSource/Applications/spiff/spiff: 2.51% (2.7609 => 2.8303, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.41% (12.8625 => 13.1719, std.dev.: 0.0947)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.62% (1.4398 => 1.4631, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/flops: 1.49% (9.7664 => 9.9115, std.dev.: 0.0133)
  SingleSource/Benchmarks/Stanford/FloatMM: 1.38% (0.7806 => 0.7914, std.dev.: 0.0004)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.45% (0.2237 => 0.1444, std.dev.: 0.0183)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.21% (0.1072 => 0.0716, std.dev.: 0.0126)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.58% (0.1818 => 0.1353, std.dev.: 0.0172)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.59% (0.0675 => 0.0509, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -23.46% (0.0439 => 0.0336, std.dev.: 0.0005)
  MultiSource/Benchmarks/MallocBench/gs/gs: -23.11% (6.0938 => 4.6858, std.dev.: 0.3042)
  MultiSource/Benchmarks/Olden/health/health: -22.48% (0.1993 => 0.1545, std.dev.: 0.0121)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -21.34% (0.1518 => 0.1194, std.dev.: 0.0027)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.95% (1.5228 => 1.2038, std.dev.: 0.0418)
  MultiSource/Applications/obsequi/Obsequi: -19.71% (1.4685 => 1.1791, std.dev.: 0.0398)
  MultiSource/Applications/lua/lua: -17.87% (5.3200 => 4.3695, std.dev.: 0.2856)
  MultiSource/Applications/hexxagon/hexxagon: -16.76% (1.3285 => 1.1059, std.dev.: 0.0328)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.71% (1.3985 => 1.1928, std.dev.: 0.0115)
  MultiSource/Applications/sgefa/sgefa: -13.79% (0.4809 => 0.4146, std.dev.: 0.0041)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.58% (0.0773 => 0.0668, std.dev.: 0.0006)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.07% (0.7091 => 0.6164, std.dev.: 0.0097)
  MultiSource/Applications/lambda-0_1_3/lambda: -12.42% (0.9461 => 0.8286, std.dev.: 0.0094)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -11.22% (1.1012 => 0.9777, std.dev.: 0.0117)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -10.49% (0.1144 => 0.1024, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.01% (0.3655 => 0.3289, std.dev.: 0.0092)
  MultiSource/Applications/siod/siod: -7.78% (2.7150 => 2.5037, std.dev.: 0.0613)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.17% (0.2498 => 0.2319, std.dev.: 0.0050)
  MultiSource/Applications/Burg/burg: -6.88% (1.5733 => 1.4651, std.dev.: 0.0148)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.84% (2.6853 => 2.5017, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.37% (1.6226 => 1.5193, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.33% (1.4794 => 1.3858, std.dev.: 0.0173)
  MultiSource/Applications/minisat/minisat: -6.02% (0.8278 => 0.7780, std.dev.: 0.0110)
  MultiSource/Applications/oggenc/oggenc: -5.97% (6.1121 => 5.7473, std.dev.: 0.0458)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.55% (1.4853 => 1.4028, std.dev.: 0.0169)
  MultiSource/Applications/lemon/lemon: -5.09% (1.2976 => 1.2316, std.dev.: 0.0174)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.07% (0.2385 => 0.2264, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.79% (1.4721 => 1.4016, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.56% (1.4506 => 1.3844, std.dev.: 0.0089)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.05% (0.3309 => 0.3175, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.20% (1.5357 => 1.4865, std.dev.: 0.0112)
  MultiSource/Applications/spiff/spiff: -3.16% (0.9578 => 0.9275, std.dev.: 0.0099)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.40% (10.3031 => 10.0557, std.dev.: 0.0653)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.03% (1.6185 => 1.5856, std.dev.: 0.0084)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.81% (0.8088 => 0.7942, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -38.53% (1.4194 => 0.8725, std.dev.: 0.0241)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -37.66% (0.0316 => 0.0197, std.dev.: 0.0023)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.39% (2.1022 => 1.4212, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.02% (0.0816 => 0.0571, std.dev.: 0.0042)
  MultiSource/Applications/viterbi/viterbi: -27.44% (3.4923 => 2.5341, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.61% (6.9552 => 5.2436, std.dev.: 0.0082)
  MultiSource/Applications/JM/ldecod/ldecod: -24.21% (0.0859 => 0.0651, std.dev.: 0.0013)
  MultiSource/Applications/minisat/minisat: -21.98% (8.0162 => 6.2545, std.dev.: 0.6007)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6170, std.dev.: 0.0009)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -18.83% (0.0956 => 0.0776, std.dev.: 0.0050)
  MultiSource/Applications/obsequi/Obsequi: -15.47% (2.6081 => 2.2045, std.dev.: 0.0836)
  SingleSource/Benchmarks/Misc/mandel: -14.35% (1.1996 => 1.0274, std.dev.: 0.0159)
  MultiSource/Applications/sgefa/sgefa: -12.87% (1.4030 => 1.2224, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.57% (0.3557 => 0.3110, std.dev.: 0.0098)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.45% (2.6992 => 2.3902, std.dev.: 0.0220)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.72% (3.9978 => 3.6092, std.dev.: 0.0375)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.51% (0.5173 => 0.4681, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -6.94% (0.2047 => 0.1905, std.dev.: 0.0014)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.03% (0.7355 => 0.6985, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.01% (0.3773 => 0.3584, std.dev.: 0.0043)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.99% (47.2250 => 44.8698, std.dev.: 0.0773)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -4.83% (0.4783 => 0.4552, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.82% (3.8119 => 3.6281, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/fbench: -4.31% (4.9602 => 4.7464, std.dev.: 0.0024)
  MultiSource/Benchmarks/Bullet/bullet: -3.97% (7.2995 => 7.0096, std.dev.: 0.0411)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.60% (2.7049 => 2.6075, std.dev.: 0.0016)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.54% (21.6864 => 20.9181, std.dev.: 0.2458)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.51% (1.7207 => 1.6603, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.45% (6.0444 => 5.8361, std.dev.: 0.0557)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9621, std.dev.: 0.0306)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.90% (1.1024 => 1.0704, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.69% (5.2218 => 5.0814, std.dev.: 0.0347)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.65% (2.6094 => 2.5402, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.47% (8.6172 => 8.4044, std.dev.: 0.0210)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.27% (1.0964 => 1.0715, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/oourafft: -2.23% (3.7891 => 3.7046, std.dev.: 0.0155)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.16% (2.3894 => 2.3379, std.dev.: 0.0117)
  MultiSource/Applications/sqlite3/sqlite3: -2.14% (4.3833 => 4.2893, std.dev.: 0.0211)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.93% (34.8438 => 34.1701, std.dev.: 0.0100)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.51% (5.6678 => 5.5821, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.49% (4.9231 => 4.8499, std.dev.: 0.0141)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.44% (3.2461 => 3.1994, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.42% (5.8810 => 5.7977, std.dev.: 0.0187)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.32% (4.0075 => 3.9547, std.dev.: 0.0196)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.21% (1.3104 => 1.2946, std.dev.: 0.0022)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.05% (1.5112 => 1.4953, std.dev.: 0.0035)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.64% (0.1378 => 0.1314, std.dev.: 0.0031)

Report Time: 2.05s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130803/a7fe87e7/attachment.html>


More information about the llvm-testresults mailing list