[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jul 4 11:55:21 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13074?compare_to=13071&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13074, Order: 185654, Start Time: 2013-07-04 17:06:04, End Time: 2013-07-04 18:56:33
      To: 13071, Order: 185629, Start Time: 2013-07-04 14:51:48, End Time: 2013-07-04 16:43:41
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 10 (40 on baseline)
Performance Improvements: 19 (48 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1078 (1019 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/NPB-serial/is/is: 63.64% (0.0869 => 0.1422, std.dev.: 0.0043)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 37.64% (0.9889 => 1.3611, std.dev.: 0.0742)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 36.59% (0.2706 => 0.3696, std.dev.: 0.0293)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 21.68% (4.8631 => 5.9172, std.dev.: 0.1070)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.71% (26.0958 => 27.3238, std.dev.: 0.3206)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 3.94% (1.7446 => 1.8134, std.dev.: 0.0065)
  MultiSource/Benchmarks/nbench/nbench: 3.08% (1.3067 => 1.3469, std.dev.: 0.0141)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 16.90% (2.0205 => 2.3619, std.dev.: 0.0734)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 14.60% (2.6081 => 2.9890, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.63% (5.1692 => 5.4087, std.dev.: 0.0311)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/random: -38.85% (0.0538 => 0.0329, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/hash: -33.94% (0.0934 => 0.0617, std.dev.: 0.0019)
  MultiSource/Applications/hbd/hbd: -23.03% (2.1235 => 1.6344, std.dev.: 0.0211)
  SingleSource/Benchmarks/Stanford/IntMM: -22.20% (0.0572 => 0.0445, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops: -13.93% (0.1249 => 0.1075, std.dev.: 0.0016)
  MultiSource/Applications/aha/aha: -11.59% (0.1484 => 0.1312, std.dev.: 0.0044)
  MultiSource/Applications/ClamAV/clamscan: -10.67% (18.8567 => 16.8454, std.dev.: 0.7439)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -10.10% (0.2377 => 0.2137, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/oourafft: -8.17% (0.2471 => 0.2269, std.dev.: 0.0054)
  MultiSource/Applications/hexxagon/hexxagon: -6.12% (1.1663 => 1.0949, std.dev.: 0.0195)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -5.10% (0.3350 => 0.3179, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -4.73% (0.3660 => 0.3487, std.dev.: 0.0004)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/richards_benchmark: -4.79% (1.4088 => 1.3413, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc/ffbench: -4.50% (1.4505 => 1.3852, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.69% (3.4409 => 3.3828, std.dev.: 0.0058)
  SingleSource/Benchmarks/Stanford/FloatMM: -1.66% (0.7890 => 0.7759, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/mandel-2: -1.36% (0.8434 => 0.8319, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/flops-1: -1.11% (2.3040 => 2.2785, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.07% (4.6564 => 4.6066, std.dev.: 0.0057)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.89% (0.1363 => 0.1310, std.dev.: 0.0051)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/NPB-serial/is/is: 62.51% (0.0875 => 0.1422, std.dev.: 0.0043)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 36.60% (0.9964 => 1.3611, std.dev.: 0.0742)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 33.53% (0.2768 => 0.3696, std.dev.: 0.0293)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 14.70% (5.1587 => 5.9172, std.dev.: 0.1070)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.65% (1.4131 => 1.6201, std.dev.: 0.0618)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.79% (1.5612 => 1.7141, std.dev.: 0.0524)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 9.26% (1.3833 => 1.5114, std.dev.: 0.0417)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 8.01% (1.5727 => 1.6986, std.dev.: 0.0443)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.42% (1.6881 => 1.8134, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.16% (1.6275 => 1.7441, std.dev.: 0.0390)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.83% (10.7257 => 11.4581, std.dev.: 0.2159)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.36% (1.5735 => 1.6578, std.dev.: 0.0234)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.36% (25.9348 => 27.3238, std.dev.: 0.3206)
  MultiSource/Benchmarks/nbench/nbench: 4.20% (1.2926 => 1.3469, std.dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 3.81% (0.2937 => 0.3049, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.61% (2.5688 => 3.4835, std.dev.: 0.0032)
  MultiSource/Applications/sgefa/sgefa: 30.33% (1.1695 => 1.5242, std.dev.: 0.0117)
  SingleSource/Benchmarks/Misc/pi: 28.94% (1.8318 => 2.3619, std.dev.: 0.0734)
  SingleSource/Benchmarks/Misc/perlin: 26.65% (3.6271 => 4.5938, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.54% (6.1372 => 7.2752, std.dev.: 0.2932)
  SingleSource/Benchmarks/Misc/mandel: 16.42% (1.0293 => 1.1983, std.dev.: 0.0218)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 15.85% (2.5800 => 2.9890, std.dev.: 0.0157)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.74% (0.9806 => 1.1349, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.29% (5.2003 => 5.6313, std.dev.: 0.0656)
  MultiSource/Applications/lua/lua: 8.22% (28.2496 => 30.5723, std.dev.: 0.7948)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.24% (3.1853 => 3.3841, std.dev.: 0.0107)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.40% (16.4665 => 17.3556, std.dev.: 0.2833)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.05% (3.2201 => 3.3828, std.dev.: 0.0058)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.04% (1.2224 => 1.2840, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.94% (4.6639 => 4.8941, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.45% (5.2788 => 5.5137, std.dev.: 0.0156)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.44% (1.0571 => 1.1040, std.dev.: 0.0041)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.37% (2.8994 => 3.0262, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc/fbench: 4.27% (4.7508 => 4.9536, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.37% (4.6379 => 4.7940, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.31% (5.5010 => 5.6830, std.dev.: 0.0605)
  SingleSource/Benchmarks/Shootout/methcall: 2.31% (8.3425 => 8.5348, std.dev.: 0.0744)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.22% (34.3107 => 35.0723, std.dev.: 0.0610)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.13% (4.3727 => 4.4660, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.85% (5.6582 => 5.7631, std.dev.: 0.0125)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.48% (0.1113 => 0.0707, std.dev.: 0.0119)
  MultiSource/Applications/viterbi/viterbi: -24.06% (0.2431 => 0.1846, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/whetstone: -14.68% (0.1097 => 0.0936, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.77% (0.2006 => 0.1810, std.dev.: 0.0042)
  MultiSource/Applications/lemon/lemon: -6.46% (1.3155 => 1.2305, std.dev.: 0.0248)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.37% (1.6793 => 1.5892, std.dev.: 0.0148)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.29% (1.2911 => 0.7322, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.66% (4.4050 => 2.7459, std.dev.: 0.0052)
  MultiSource/Applications/lemon/lemon: -29.28% (1.3499 => 0.9546, std.dev.: 0.0631)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.71% (1.6105 => 1.2126, std.dev.: 0.0021)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.78% (9.1099 => 7.0346, std.dev.: 0.0277)
  SingleSource/Benchmarks/Shootout/hash: -22.20% (5.3656 => 4.1744, std.dev.: 0.1713)
  SingleSource/Benchmarks/Misc/salsa20: -22.19% (10.3398 => 8.0458, std.dev.: 0.4494)
  SingleSource/Benchmarks/Shootout-C++/hash: -21.06% (0.7941 => 0.6269, std.dev.: 0.0437)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.76% (4.8986 => 3.8817, std.dev.: 0.0385)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.56% (5.7264 => 4.6066, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.38% (6.2328 => 5.0874, std.dev.: 0.0203)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.81% (25.3677 => 21.3576, std.dev.: 0.0354)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.24% (0.1945 => 0.1668, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.75% (1.6613 => 1.4329, std.dev.: 0.0717)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.04% (1.6679 => 1.4504, std.dev.: 0.0191)
  SingleSource/Regression/C/uint64_to_float: -11.82% (1.6851 => 1.4860, std.dev.: 0.0212)
  MultiSource/Applications/siod/siod: -9.45% (3.7240 => 3.3719, std.dev.: 0.0512)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.99% (3.2030 => 2.9150, std.dev.: 0.0916)
  MultiSource/Applications/sqlite3/sqlite3: -8.12% (4.6358 => 4.2593, std.dev.: 0.0145)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.07% (9.8728 => 9.0756, std.dev.: 0.0990)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.22% (4.5717 => 4.2416, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.48% (5.5889 => 5.2266, std.dev.: 0.1066)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.48% (0.4445 => 0.4157, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.67% (3.5939 => 3.3902, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.32% (6.3757 => 6.0364, std.dev.: 0.0146)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.83% (3.5327 => 3.3621, std.dev.: 0.0490)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.81% (2.8537 => 2.7164, std.dev.: 0.0400)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.57% (5.3184 => 5.0753, std.dev.: 0.0268)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.32% (1.6535 => 1.5820, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.12% (5.3276 => 5.1083, std.dev.: 0.0364)
  SingleSource/Benchmarks/Misc/flops: -4.10% (10.2170 => 9.7980, std.dev.: 0.0147)
  SingleSource/Benchmarks/Misc/whetstone: -3.63% (3.5970 => 3.4666, std.dev.: 0.0120)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.62% (1.6440 => 1.5845, std.dev.: 0.0048)
  MultiSource/Applications/hexxagon/hexxagon: -3.58% (15.4979 => 14.9424, std.dev.: 0.1702)
  SingleSource/Benchmarks/Shootout/sieve: -2.90% (8.0178 => 7.7855, std.dev.: 0.0206)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.61% (3.8665 => 3.7657, std.dev.: 0.0023)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.53% (48.3307 => 47.1096, std.dev.: 0.1259)
  MultiSource/Benchmarks/Olden/power/power: -2.05% (1.2558 => 1.2300, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.97% (4.2167 => 4.1338, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.79% (4.9946 => 4.9052, std.dev.: 0.0043)
  SingleSource/Benchmarks/Stanford/FloatMM: -1.59% (0.7884 => 0.7759, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/lists: -1.34% (7.2961 => 7.1980, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.09% (0.1441 => 0.1310, std.dev.: 0.0051)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130704/c4efeec7/attachment.html>


More information about the llvm-testresults mailing list