[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 6 16:01:29 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14156?compare_to=14153&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14156, Order: 187813, Start Time: 2013-08-06 21:11:33, End Time: 2013-08-06 23:03:18
      To: 14153, Order: 187810, Start Time: 2013-08-06 19:02:20, End Time: 2013-08-06 20:50:23
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 26 (41 on baseline)
Performance Improvements: 3 (32 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1076 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: 21.53% (36.0682 => 43.8323, std.dev.: 0.1852)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.69% (47.4637 => 56.3366, std.dev.: 2.0453)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 15.14% (1.3741 => 1.5821, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 15.03% (1.5998 => 1.8403, std.dev.: 0.0147)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 14.21% (1.6524 => 1.8872, std.dev.: 0.0544)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 13.88% (0.0814 => 0.0927, std.dev.: 0.0037)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.60% (26.3145 => 29.8944, std.dev.: 0.1665)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.58% (1.3494 => 1.5326, std.dev.: 0.0591)
  MultiSource/Benchmarks/PAQ8p/paq8p: 11.02% (2.5161 => 2.7935, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.87% (1.3996 => 1.5517, std.dev.: 0.0197)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 8.37% (0.2556 => 0.2770, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 7.94% (0.3198 => 0.3452, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.69% (1.5292 => 1.5551, std.dev.: 0.0084)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 57.01% (0.0963 => 0.1512, std.dev.: 0.0027)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 21.85% (9.0435 => 11.0191, std.dev.: 0.1667)
  SingleSource/Benchmarks/Misc/fp-convert: 13.49% (7.0977 => 8.0553, std.dev.: 0.0108)
  MultiSource/Benchmarks/Bullet/bullet: 10.83% (6.9767 => 7.7320, std.dev.: 0.1046)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.93% (14.9933 => 16.3327, std.dev.: 0.3231)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.19% (90.6595 => 98.0848, std.dev.: 1.1121)
  SingleSource/Benchmarks/Misc/salsa20: 8.05% (8.3081 => 8.9765, std.dev.: 0.0573)
  SingleSource/Regression/C/uint64_to_float: 4.42% (1.4435 => 1.5073, std.dev.: 0.0247)
  SingleSource/Benchmarks/Misc/flops: 4.28% (9.4189 => 9.8223, std.dev.: 0.0232)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.77% (1.6291 => 1.6579, std.dev.: 0.0079)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.40% (4.4255 => 4.4876, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.38% (5.9298 => 6.0115, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.22% (3.6020 => 3.6461, std.dev.: 0.0092)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sgefa/sgefa: -6.04% (1.4598 => 1.3716, std.dev.: 0.0022)
  MultiSource/Applications/JM/lencod/lencod: -4.76% (8.0772 => 7.6927, std.dev.: 0.0555)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.08% (1.0681 => 1.0566, std.dev.: 0.0029)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -3.07% (0.1369 => 0.1327, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.15% (0.2718 => 0.2714, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 10.36% (0.0251 => 0.0277, std.dev.: 0.0033)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.52% (0.2813 => 0.2714, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.71% (0.0345 => 0.0277, std.dev.: 0.0033)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 43.56% (0.0466 => 0.0669, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.72% (0.1033 => 0.1216, std.dev.: 0.0043)
  MultiSource/Benchmarks/Bullet/bullet: 16.93% (37.4863 => 43.8323, std.dev.: 0.1852)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.68% (49.1253 => 56.3366, std.dev.: 2.0453)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 13.40% (1.3952 => 1.5821, std.dev.: 0.0283)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 13.39% (1.6643 => 1.8872, std.dev.: 0.0544)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.89% (1.3993 => 1.5517, std.dev.: 0.0197)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 9.62% (0.2527 => 0.2770, std.dev.: 0.0021)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.15% (27.6418 => 29.8944, std.dev.: 0.1665)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 4.32% (0.3309 => 0.3452, std.dev.: 0.0040)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.03% (2.6853 => 2.7935, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.41% (1.7797 => 1.8403, std.dev.: 0.0147)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.43% (3.7285 => 6.4662, std.dev.: 0.0595)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 57.17% (0.0962 => 0.1512, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.60% (2.8867 => 4.2896, std.dev.: 0.0370)
  MultiSource/Benchmarks/FreeBench/neural/neural: 39.14% (0.3171 => 0.4412, std.dev.: 0.0389)
  SingleSource/Benchmarks/Shootout/hash: 23.05% (4.1846 => 5.1493, std.dev.: 0.1103)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 20.62% (9.1355 => 11.0191, std.dev.: 0.1667)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.93% (7.0762 => 7.9913, std.dev.: 0.0333)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.19% (14.9584 => 16.3327, std.dev.: 0.3231)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.45% (1.2557 => 1.3618, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.38% (5.4910 => 5.9514, std.dev.: 0.0344)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.17% (48.3256 => 52.2729, std.dev.: 0.2915)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.16% (5.5008 => 5.8944, std.dev.: 0.0575)
  MultiSource/Applications/JM/lencod/lencod: 7.14% (7.1799 => 7.6927, std.dev.: 0.0555)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.97% (3.4085 => 3.6461, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.76% (5.3042 => 5.6628, std.dev.: 0.0706)
  MultiSource/Benchmarks/Bullet/bullet: 5.93% (7.2995 => 7.7320, std.dev.: 0.1046)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.99% (5.1471 => 5.4037, std.dev.: 0.0215)
  SingleSource/Benchmarks/Misc/whetstone: 4.74% (3.4559 => 3.6197, std.dev.: 0.0399)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.71% (93.6732 => 98.0848, std.dev.: 1.1121)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.3151 => 4.4969, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.75% (3.3384 => 3.4637, std.dev.: 0.0303)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.44% (25.0200 => 25.8819, std.dev.: 0.1234)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.11% (4.8739 => 5.0253, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.51% (12.8625 => 13.1853, std.dev.: 0.0472)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.89% (4.9040 => 4.9968, std.dev.: 0.0254)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.62% (1.4398 => 1.4631, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.36% (5.9307 => 6.0115, std.dev.: 0.0231)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.34% (1.1618 => 1.1774, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.14% (3.0680 => 3.1031, std.dev.: 0.0010)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.46% (0.3576 => 0.2916, std.dev.: 0.0242)
  MultiSource/Applications/JM/ldecod/ldecod: -11.84% (8.6720 => 7.6453, std.dev.: 0.3384)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.15% (1.7461 => 1.6213, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.73% (1.4940 => 1.4234, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.35% (1.4783 => 1.4140, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.16% (1.6226 => 1.5551, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.91% (1.5815 => 1.5197, std.dev.: 0.0164)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.06% (2.1022 => 1.4283, std.dev.: 0.0146)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.02% (0.0816 => 0.0571, std.dev.: 0.0004)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.69% (0.1189 => 0.0836, std.dev.: 0.0114)
  MultiSource/Applications/viterbi/viterbi: -27.37% (3.4923 => 2.5366, std.dev.: 0.0500)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.59% (6.9552 => 5.2448, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6169, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc/mandel: -13.43% (1.1996 => 1.0385, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.67% (6.2627 => 5.4691, std.dev.: 0.1126)
  MultiSource/Applications/lua/lua: -11.95% (31.0707 => 27.3584, std.dev.: 0.9852)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.72% (3.8119 => 3.6318, std.dev.: 0.0273)
  SingleSource/Benchmarks/Misc/fbench: -4.39% (4.9602 => 4.7423, std.dev.: 0.0153)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.39% (47.2250 => 45.1541, std.dev.: 0.4764)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.15% (1.1024 => 1.0566, std.dev.: 0.0029)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.00% (2.7049 => 2.5968, std.dev.: 0.0356)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.65% (1.7207 => 1.6579, std.dev.: 0.0079)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.46% (21.6864 => 20.9368, std.dev.: 0.2572)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.77% (5.2218 => 5.0771, std.dev.: 0.0517)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -2.76% (0.4969 => 0.4832, std.dev.: 0.0053)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.57% (0.7806 => 0.7605, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.47% (1.8144 => 1.7696, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.34% (8.6172 => 8.4155, std.dev.: 0.0656)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.33% (6.1482 => 6.0049, std.dev.: 0.0048)
  MultiSource/Applications/sgefa/sgefa: -2.24% (1.4030 => 1.3716, std.dev.: 0.0022)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.04% (34.8438 => 34.1316, std.dev.: 0.0580)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.47% (5.8810 => 5.7945, std.dev.: 0.0140)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.70% (0.1378 => 0.1327, std.dev.: 0.0021)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130806/d5c36520/attachment.html>


More information about the llvm-testresults mailing list