[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 19 23:46:32 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14589?compare_to=14585&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14589, Order: 188742, Start Time: 2013-08-20 04:57:07, End Time: 2013-08-20 06:48:37
      To: 14585, Order: 188740, Start Time: 2013-08-20 02:34:37, End Time: 2013-08-20 04:16:02
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 26 (49 on baseline)
Performance Improvements: 0 (41 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1081 (1017 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-26-Shorts: 101.69% (0.0177 => 0.0357, std.dev.: 0.0018)
  SingleSource/Regression/C/compare: 82.94% (0.0170 => 0.0311, std.dev.: 0.0035)
  SingleSource/Regression/C/sumarray: 82.83% (0.0361 => 0.0660, std.dev.: 0.0010)
  SingleSource/Regression/C++/BuiltinTypeInfo: 71.14% (0.0201 => 0.0344, std.dev.: 0.0015)
  SingleSource/Regression/C/callargs: 69.79% (0.0192 => 0.0326, std.dev.: 0.0010)
  SingleSource/Regression/C/PR1386: 64.97% (0.0157 => 0.0259, std.dev.: 0.0017)
  SingleSource/Regression/C/casts: 59.12% (0.0411 => 0.0654, std.dev.: 0.0022)
  SingleSource/Regression/C/DuffsDevice: 56.52% (0.0276 => 0.0432, std.dev.: 0.0016)
  SingleSource/Benchmarks/Dhrystone/fldry: 35.42% (0.0528 => 0.0715, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.50% (0.9854 => 1.0987, std.dev.: 0.0358)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 10.34% (0.3598 => 0.3970, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.07% (6.5621 => 7.1570, std.dev.: 0.2207)
  SingleSource/Benchmarks/Misc-C++/bigfib: 8.17% (0.7286 => 0.7881, std.dev.: 0.0167)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 7.66% (0.1802 => 0.1940, std.dev.: 0.0007)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 7.54% (0.4206 => 0.4523, std.dev.: 0.0067)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 6.72% (0.1830 => 0.1953, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.59% (1.3960 => 1.4321, std.dev.: 0.0028)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 64.87% (1.4641 => 2.4138, std.dev.: 0.0755)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 37.22% (4.4777 => 6.1445, std.dev.: 0.3357)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.42% (29.1907 => 34.5673, std.dev.: 1.1914)
  MultiSource/Benchmarks/FreeBench/neural/neural: 12.91% (0.4175 => 0.4714, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.02% (4.9124 => 5.1101, std.dev.: 0.0207)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 2.76% (0.6944 => 0.7136, std.dev.: 0.0046)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.08% (21.0137 => 21.4513, std.dev.: 0.1649)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.00% (1.4667 => 1.4961, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.3347 => 6.4006, std.dev.: 0.0083)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.27% (0.1337 => 0.1320, std.dev.: 0.0139)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/sumarray: 77.42% (0.0372 => 0.0660, std.dev.: 0.0010)
  SingleSource/Regression/C++/BuiltinTypeInfo: 75.51% (0.0196 => 0.0344, std.dev.: 0.0015)
  SingleSource/Regression/C/PR1386: 64.97% (0.0157 => 0.0259, std.dev.: 0.0017)
  SingleSource/Regression/C/callargs: 60.59% (0.0203 => 0.0326, std.dev.: 0.0010)
  SingleSource/Regression/C/DuffsDevice: 59.41% (0.0271 => 0.0432, std.dev.: 0.0016)
  SingleSource/Regression/C/casts: 58.74% (0.0412 => 0.0654, std.dev.: 0.0022)
  SingleSource/UnitTests/2003-05-26-Shorts: 53.22% (0.0233 => 0.0357, std.dev.: 0.0018)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.62% (0.1033 => 0.1215, std.dev.: 0.0038)
  SingleSource/Benchmarks/Dhrystone/fldry: 17.60% (0.0608 => 0.0715, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 12.56% (0.9761 => 1.0987, std.dev.: 0.0358)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 11.96% (0.3546 => 0.3970, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.14% (6.4979 => 7.1570, std.dev.: 0.2207)
  SingleSource/Benchmarks/Misc-C++/bigfib: 8.20% (0.7284 => 0.7881, std.dev.: 0.0167)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 8.15% (0.4182 => 0.4523, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.34% (1.3993 => 1.4321, std.dev.: 0.0028)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 68.74% (3.7285 => 6.2916, std.dev.: 0.1866)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 49.73% (1.6121 => 2.4138, std.dev.: 0.0755)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.75% (2.8867 => 4.2939, std.dev.: 0.0046)
  MultiSource/Benchmarks/FreeBench/neural/neural: 48.66% (0.3171 => 0.4714, std.dev.: 0.0203)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 34.99% (4.5517 => 6.1445, std.dev.: 0.3357)
  SingleSource/Benchmarks/Misc/pi: 27.13% (1.9835 => 2.5216, std.dev.: 0.0085)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.16% (1.5030 => 1.8811, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout/hash: 24.27% (4.1846 => 5.2000, std.dev.: 0.2771)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 21.10% (0.0526 => 0.0637, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/hash: 19.09% (0.6295 => 0.7497, std.dev.: 0.0379)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.95% (29.8131 => 34.5673, std.dev.: 1.1914)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.80% (7.0762 => 7.8407, std.dev.: 0.0236)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.76% (0.1678 => 0.1825, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.43% (5.4910 => 5.9538, std.dev.: 0.0461)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.36% (48.3256 => 52.3670, std.dev.: 0.2339)
  SingleSource/Benchmarks/McGill/chomp: 7.49% (1.0051 => 1.0804, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.93% (3.2027 => 3.4245, std.dev.: 0.0623)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.47% (3.4085 => 3.6292, std.dev.: 0.0260)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.8002, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.51% (6.1245 => 6.4006, std.dev.: 0.0083)
  SingleSource/Benchmarks/Misc/whetstone: 4.46% (3.4559 => 3.6100, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.36% (5.1471 => 5.3713, std.dev.: 0.0735)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.15% (4.3151 => 4.4942, std.dev.: 0.0426)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.83% (25.0200 => 25.9789, std.dev.: 0.3213)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.67% (3.3384 => 3.4608, std.dev.: 0.0025)
  MultiSource/Applications/spiff/spiff: 3.48% (2.7609 => 2.8569, std.dev.: 0.0225)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 3.37% (1.3104 => 1.3545, std.dev.: 0.0119)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.29% (3.3877 => 3.4991, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.97% (4.8739 => 5.0186, std.dev.: 0.0314)
  SingleSource/Benchmarks/Shootout/matrix: 2.21% (1.7358 => 1.7741, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/ary3: 2.09% (2.0229 => 2.0651, std.dev.: 0.0147)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.65% (1.4398 => 1.4635, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.36% (5.0417 => 5.1101, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.25% (3.0680 => 3.1064, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -23.01% (0.0439 => 0.0338, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.55% (0.1870 => 0.1654, std.dev.: 0.0074)
  MultiSource/Applications/ClamAV/clamscan: -11.32% (19.4145 => 17.2162, std.dev.: 0.4958)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.86% (1.5426 => 1.4368, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.83% (1.5144 => 1.4109, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.30% (1.5815 => 1.4818, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.28% (1.4794 => 1.3865, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.17% (1.6226 => 1.5225, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.78% (1.4333 => 1.3505, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.43% (1.5437 => 1.4599, std.dev.: 0.0097)
  MultiSource/Applications/JM/lencod/lencod: -4.70% (18.5029 => 17.6331, std.dev.: 0.2670)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.56% (1.4506 => 1.3845, std.dev.: 0.0142)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.93% (0.3309 => 0.3179, std.dev.: 0.0009)
  MultiSource/Benchmarks/nbench/nbench: -3.40% (1.3677 => 1.3212, std.dev.: 0.0120)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -99.10% (0.0111 => 0.0001, std.dev.: 0.0034)
  MultiSource/Applications/lemon/lemon: -37.13% (1.4194 => 0.8924, std.dev.: 0.2045)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.35% (2.1022 => 1.4222, std.dev.: 0.0075)
  MultiSource/Applications/viterbi/viterbi: -27.25% (3.4923 => 2.5408, std.dev.: 0.0388)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.73% (6.9552 => 5.2351, std.dev.: 0.0285)
  MultiSource/Applications/JM/ldecod/ldecod: -24.21% (0.0859 => 0.0651, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/perlin: -21.34% (4.5989 => 3.6173, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/mandel: -13.69% (1.1996 => 1.0354, std.dev.: 0.0093)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.10% (0.0884 => 0.0777, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.38% (0.5173 => 0.4688, std.dev.: 0.0090)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.37% (47.2250 => 44.2158, std.dev.: 0.8638)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.43% (0.3773 => 0.3568, std.dev.: 0.0054)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.22% (1.7207 => 1.6309, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.91% (3.8119 => 3.6247, std.dev.: 0.0169)
  SingleSource/Benchmarks/Misc/fbench: -4.47% (4.9602 => 4.7384, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.14% (1.1024 => 1.0568, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.40% (6.0444 => 5.8389, std.dev.: 0.0537)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.34% (2.7049 => 2.6145, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.99% (6.1482 => 5.9641, std.dev.: 0.0372)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.98% (0.7355 => 0.7136, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/bh/bh: -2.88% (2.4879 => 2.4162, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.82% (5.2218 => 5.0748, std.dev.: 0.0035)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.54% (0.7806 => 0.7608, std.dev.: 0.0033)
  MultiSource/Applications/sgefa/sgefa: -2.28% (1.4030 => 1.3710, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.59% (5.0180 => 4.9384, std.dev.: 0.0043)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.43% (34.8438 => 34.3452, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.31% (4.9231 => 4.8586, std.dev.: 0.0045)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.21% (0.1378 => 0.1320, std.dev.: 0.0139)

Report Time: 1.07s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130820/cefc27d8/attachment.html>


More information about the llvm-testresults mailing list