[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Aug 1 01:38:57 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13985?compare_to=13981&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13985, Order: 187559, Start Time: 2013-08-01 06:49:55, End Time: 2013-08-01 08:40:41
      To: 13981, Order: 187555, Start Time: 2013-08-01 04:38:27, End Time: 2013-08-01 06:25:09
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 26 (43 on baseline)
Performance Improvements: 0 (40 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1081 (1024 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/hash: 66.35% (0.0624 => 0.1038, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout/random: 62.21% (0.0344 => 0.0558, std.dev.: 0.0040)
  SingleSource/UnitTests/Vector/constpool: 40.63% (8.7146 => 12.2550, std.dev.: 1.2572)
  SingleSource/Benchmarks/Shootout-C++/wc: 38.39% (0.2472 => 0.3421, std.dev.: 0.0359)
  SingleSource/Benchmarks/Shootout/ary3: 37.47% (0.0371 => 0.0510, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 24.58% (0.3902 => 0.4861, std.dev.: 0.0251)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 9.77% (0.2395 => 0.2629, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: 327.27% (0.0033 => 0.0141, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/ary3: 79.52% (6.4100 => 11.5071, std.dev.: 0.0882)
  SingleSource/Benchmarks/Shootout/heapsort: 55.80% (3.1859 => 4.9637, std.dev.: 0.3345)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 46.10% (3.2507 => 4.7493, std.dev.: 0.1828)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 38.21% (3.7201 => 5.1414, std.dev.: 0.2116)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.33% (4.1648 => 4.8450, std.dev.: 0.0197)
  SingleSource/Benchmarks/Shootout/hash: 13.52% (5.2041 => 5.9075, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 13.04% (3.3339 => 3.7688, std.dev.: 0.1666)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.96% (2.0386 => 2.2417, std.dev.: 0.0454)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.55% (0.3323 => 0.3574, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.02% (2.3105 => 2.4726, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.64% (5.0056 => 5.3379, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/em3d/em3d: 6.12% (4.8666 => 5.1643, std.dev.: 0.0136)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.63% (15.8815 => 16.6161, std.dev.: 0.1646)
  MultiSource/Benchmarks/FreeBench/distray/distray: 4.60% (0.2285 => 0.2390, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/flops: 4.38% (9.5076 => 9.9237, std.dev.: 0.0208)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.24% (3.4683 => 3.5461, std.dev.: 0.0036)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.72% (44.3013 => 45.0616, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.01% (3.2446 => 3.2774, std.dev.: 0.0119)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.96% (0.1314 => 0.1366, std.dev.: 0.0128)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/hash: 68.51% (0.0616 => 0.1038, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout/random: 63.16% (0.0342 => 0.0558, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout/ary3: 42.46% (0.0358 => 0.0510, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/wc: 39.18% (0.2458 => 0.3421, std.dev.: 0.0359)
  SingleSource/UnitTests/Vector/constpool: 38.27% (8.8630 => 12.2550, std.dev.: 1.2572)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 24.96% (0.3890 => 0.4861, std.dev.: 0.0251)
  SingleSource/Benchmarks/Shootout-C++/matrix: 10.58% (0.2609 => 0.2885, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 9.59% (0.2399 => 0.2629, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: 14000.00% (0.0001 => 0.0141, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/ary3: 97.86% (5.8158 => 11.5071, std.dev.: 0.0882)
  SingleSource/Benchmarks/Shootout/heapsort: 70.44% (2.9123 => 4.9637, std.dev.: 0.3345)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 63.58% (2.9033 => 4.7493, std.dev.: 0.1828)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.78% (2.8867 => 4.3238, std.dev.: 0.0284)
  MultiSource/Benchmarks/FreeBench/neural/neural: 42.45% (0.3171 => 0.4517, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout/hash: 41.17% (4.1846 => 5.9075, std.dev.: 0.0513)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 28.61% (3.9978 => 5.1414, std.dev.: 0.2116)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 28.07% (2.9428 => 3.7688, std.dev.: 0.1666)
  MultiSource/Applications/siod/siod: 13.48% (3.3761 => 3.8312, std.dev.: 0.1577)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.60% (7.0762 => 7.9681, std.dev.: 0.0403)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.08% (14.9584 => 16.6161, std.dev.: 0.1646)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.82% (2.0229 => 2.2417, std.dev.: 0.0454)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.06% (0.1678 => 0.1830, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.35% (1.2557 => 1.3606, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.29% (5.4910 => 5.9461, std.dev.: 0.0500)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4238, std.dev.: 0.0183)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.76% (48.3256 => 51.5946, std.dev.: 0.5397)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.40% (0.2799 => 0.2978, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.10% (2.3304 => 2.4726, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.85% (3.4085 => 3.6078, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.83% (5.3042 => 5.6135, std.dev.: 0.0722)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.83% (3.3877 => 3.5852, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.48% (5.5008 => 5.8023, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3652, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.08% (4.3151 => 4.4912, std.dev.: 0.0139)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.77% (3.5351 => 3.6683, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.10% (4.8739 => 5.0251, std.dev.: 0.0224)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.59% (3.4566 => 3.5461, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.32% (12.8625 => 13.1605, std.dev.: 0.0388)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.65% (1.4398 => 1.4635, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/flops: 1.61% (9.7664 => 9.9237, std.dev.: 0.0208)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.22% (3.0680 => 3.1053, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/fib2: 1.05% (4.9231 => 4.9747, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout/lists: 1.04% (7.2315 => 7.3069, std.dev.: 0.0165)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.94% (0.2237 => 0.1433, std.dev.: 0.0056)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.09% (0.1072 => 0.0728, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -25.48% (0.0675 => 0.0503, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.98% (0.1818 => 0.1382, std.dev.: 0.0116)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -17.98% (0.3576 => 0.2933, std.dev.: 0.0232)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.66% (0.1870 => 0.1652, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.12% (0.3655 => 0.3285, std.dev.: 0.0042)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.11% (1.1012 => 1.0009, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.56% (0.3073 => 0.2810, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.96% (0.7189 => 0.6904, std.dev.: 0.0075)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.43% (10.3031 => 10.0524, std.dev.: 0.0742)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.81% (2.1022 => 1.4334, std.dev.: 0.0057)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.39% (0.0816 => 0.0568, std.dev.: 0.0001)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.26% (0.1189 => 0.0853, std.dev.: 0.0004)
  MultiSource/Applications/viterbi/viterbi: -27.48% (3.4923 => 2.5327, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.03% (6.9552 => 5.3535, std.dev.: 0.2625)
  SingleSource/Benchmarks/Misc/perlin: -21.24% (4.5989 => 3.6222, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -16.68% (6.2627 => 5.2181, std.dev.: 0.1087)
  SingleSource/Benchmarks/Misc/mandel: -13.90% (1.1996 => 1.0328, std.dev.: 0.0194)
  MultiSource/Applications/sgefa/sgefa: -12.46% (1.4030 => 1.2282, std.dev.: 0.0095)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.34% (0.3557 => 0.3118, std.dev.: 0.0091)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.36% (2.6992 => 2.3927, std.dev.: 0.0151)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.27% (3.5791 => 3.2114, std.dev.: 0.0809)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.55% (0.5173 => 0.4679, std.dev.: 0.0019)
  MultiSource/Applications/lua/lua: -8.52% (31.0707 => 28.4239, std.dev.: 0.4875)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.98% (2.7049 => 2.5702, std.dev.: 0.0169)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.97% (1.7207 => 1.6351, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.69% (3.8119 => 3.6330, std.dev.: 0.0183)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.58% (47.2250 => 45.0616, std.dev.: 0.0365)
  SingleSource/Benchmarks/Misc/fbench: -4.50% (4.9602 => 4.7368, std.dev.: 0.0127)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.58% (0.7355 => 0.7092, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.35% (6.0444 => 5.8419, std.dev.: 0.0460)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.18% (0.4783 => 0.4631, std.dev.: 0.0011)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.85% (21.6864 => 21.0682, std.dev.: 0.2235)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.11% (5.2218 => 5.1116, std.dev.: 0.0416)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.04% (8.6172 => 8.4412, std.dev.: 0.0424)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.59% (1.2012 => 1.1821, std.dev.: 0.0058)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.52% (34.8438 => 34.3149, std.dev.: 0.0470)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.28% (1.6737 => 1.6523, std.dev.: 0.0020)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.24% (2.1343 => 2.1078, std.dev.: 0.0027)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.87% (0.1378 => 0.1366, std.dev.: 0.0128)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130801/c6245c4a/attachment.html>


More information about the llvm-testresults mailing list