[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 20 20:26:29 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14621?compare_to=14617&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14621, Order: 188850, Start Time: 2013-08-21 01:34:30, End Time: 2013-08-21 03:28:35
      To: 14617, Order: 188837, Start Time: 2013-08-20 23:13:47, End Time: 2013-08-21 01:08:06
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 37 (60 on baseline)
Performance Improvements: 8 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1062 (1023 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 75.43% (0.0468 => 0.0821, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/methcall: 70.92% (0.0368 => 0.0629, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/strcat: 68.52% (0.0305 => 0.0514, std.dev.: 0.0060)
  MultiSource/Applications/Burg/burg: 34.50% (1.4814 => 1.9925, std.dev.: 0.1264)
  MultiSource/Applications/sgefa/sgefa: 32.47% (0.4235 => 0.5610, std.dev.: 0.0414)
  MultiSource/Applications/JM/lencod/lencod: 18.33% (17.5076 => 20.7163, std.dev.: 0.4789)
  MultiSource/Applications/d/make_dparser: 17.95% (3.7512 => 4.4245, std.dev.: 0.0647)
  MultiSource/Applications/SPASS/SPASS: 15.99% (17.4221 => 20.2072, std.dev.: 0.3063)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.80% (1.9731 => 2.2256, std.dev.: 0.0594)
  SingleSource/Benchmarks/Shootout-C++/ary: 11.92% (0.2868 => 0.3210, std.dev.: 0.0036)
  MultiSource/Applications/siod/siod: 11.59% (2.5794 => 2.8784, std.dev.: 0.0110)
  MultiSource/Applications/oggenc/oggenc: 10.79% (5.7925 => 6.4173, std.dev.: 0.0415)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 10.55% (0.4235 => 0.4682, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/wc: 10.54% (0.2466 => 0.2726, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 10.36% (0.2200 => 0.2428, std.dev.: 0.0043)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 10.34% (0.1711 => 0.1888, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.71% (0.8056 => 0.8677, std.dev.: 0.0231)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.81% (0.6933 => 0.7405, std.dev.: 0.0182)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 64.39% (3.0273 => 4.9765, std.dev.: 0.0904)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 57.31% (3.0919 => 4.8639, std.dev.: 0.3134)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 50.07% (1.6086 => 2.4140, std.dev.: 0.1463)
  MultiSource/Applications/SPASS/SPASS: 35.54% (8.1233 => 11.0102, std.dev.: 0.3272)
  SingleSource/Benchmarks/Shootout/ary3: 32.60% (8.1791 => 10.8453, std.dev.: 0.3752)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 31.12% (4.0215 => 5.2731, std.dev.: 0.3053)
  SingleSource/Benchmarks/Shootout-C++/moments: 20.17% (0.0967 => 0.1162, std.dev.: 0.0056)
  MultiSource/Benchmarks/nbench/nbench: 14.75% (19.4943 => 22.3691, std.dev.: 1.0625)
  SingleSource/Benchmarks/Shootout/hash: 14.65% (5.1920 => 5.9527, std.dev.: 0.1366)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.47% (2.9225 => 3.1994, std.dev.: 0.0630)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 8.42% (2.9986 => 3.2510, std.dev.: 0.0593)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.76% (4.0045 => 4.3153, std.dev.: 0.0819)
  MultiSource/Applications/JM/lencod/lencod: 4.71% (7.7029 => 8.0655, std.dev.: 0.0946)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.51% (61.1434 => 63.9025, std.dev.: 0.6576)
  MultiSource/Applications/lua/lua: 3.81% (29.7935 => 30.9287, std.dev.: 0.4151)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.79% (3.3351 => 3.4616, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.55% (4.9897 => 5.1167, std.dev.: 0.0139)
  MultiSource/Applications/sgefa/sgefa: 2.22% (1.3669 => 1.3973, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout-C++/matrix: 1.39% (4.3079 => 4.3676, std.dev.: 0.0190)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -23.15% (0.0717 => 0.0551, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -10.27% (1.5379 => 1.3799, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -9.73% (1.5315 => 1.3825, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -8.95% (1.5348 => 1.3974, std.dev.: 0.0175)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.89% (0.5172 => 0.4971, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.45% (3.7009 => 3.6101, std.dev.: 0.0071)
  SingleSource/Regression/C/uint64_to_float: -1.66% (1.4961 => 1.4713, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.54% (6.0571 => 5.9639, std.dev.: 0.0301)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 21.12% (0.1321 => 0.1600, std.dev.: 0.0076)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 77.71% (0.0462 => 0.0821, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/strcat: 76.03% (0.0292 => 0.0514, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/methcall: 73.76% (0.0362 => 0.0629, std.dev.: 0.0021)
  MultiSource/Applications/Burg/burg: 26.64% (1.5733 => 1.9925, std.dev.: 0.1264)
  MultiSource/Applications/d/make_dparser: 17.29% (3.7722 => 4.4245, std.dev.: 0.0647)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.21% (1.9317 => 2.2256, std.dev.: 0.0594)
  MultiSource/Applications/SPASS/SPASS: 12.82% (17.9111 => 20.2072, std.dev.: 0.3063)
  SingleSource/Benchmarks/Shootout-C++/ary: 12.12% (0.2863 => 0.3210, std.dev.: 0.0036)
  MultiSource/Applications/JM/lencod/lencod: 11.96% (18.5029 => 20.7163, std.dev.: 0.4789)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 11.96% (0.4182 => 0.4682, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/wc: 10.90% (0.2458 => 0.2726, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 9.07% (0.2226 => 0.2428, std.dev.: 0.0043)
  MultiSource/Benchmarks/FreeBench/neural/neural: 7.34% (0.2071 => 0.2223, std.dev.: 0.0024)
  MultiSource/Applications/siod/siod: 6.02% (2.7150 => 2.8784, std.dev.: 0.0110)
  MultiSource/Applications/oggenc/oggenc: 4.99% (6.1121 => 6.4173, std.dev.: 0.0415)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 86.48% (5.8158 => 10.8453, std.dev.: 0.3752)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 71.05% (3.7285 => 6.3775, std.dev.: 0.0775)
  SingleSource/Benchmarks/Shootout/heapsort: 70.88% (2.9123 => 4.9765, std.dev.: 0.0904)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 67.53% (2.9033 => 4.8639, std.dev.: 0.3134)
  SingleSource/Benchmarks/Shootout-C++/matrix: 51.30% (2.8867 => 4.3676, std.dev.: 0.0190)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 49.74% (1.6121 => 2.4140, std.dev.: 0.1463)
  SingleSource/Benchmarks/Shootout/hash: 42.25% (4.1846 => 5.9527, std.dev.: 0.1366)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 31.90% (3.9978 => 5.2731, std.dev.: 0.3053)
  MultiSource/Benchmarks/FreeBench/neural/neural: 31.54% (0.3171 => 0.4171, std.dev.: 0.0324)
  SingleSource/Benchmarks/Misc/pi: 26.96% (1.9835 => 2.5182, std.dev.: 0.0092)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.28% (1.5030 => 1.8830, std.dev.: 0.0240)
  SingleSource/Benchmarks/Shootout-C++/hash: 22.35% (0.6295 => 0.7702, std.dev.: 0.0135)
  MultiSource/Applications/SPASS/SPASS: 19.39% (9.2220 => 11.0102, std.dev.: 0.3272)
  MultiSource/Applications/JM/lencod/lencod: 12.33% (7.1799 => 8.0655, std.dev.: 0.0946)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.30% (7.0762 => 7.8758, std.dev.: 0.0244)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 8.50% (2.9962 => 3.2510, std.dev.: 0.0593)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.47% (1.2557 => 1.3621, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.45% (5.4910 => 5.9548, std.dev.: 0.0613)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.20% (2.9568 => 3.1994, std.dev.: 0.0630)
  MultiSource/Applications/siod/siod: 8.19% (3.3761 => 3.6526, std.dev.: 0.0393)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.68% (4.0075 => 4.3153, std.dev.: 0.0819)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.96% (3.2027 => 3.4255, std.dev.: 0.0358)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.70% (48.3256 => 51.5644, std.dev.: 0.3801)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.01% (5.3042 => 5.6228, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.91% (3.4085 => 3.6101, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.89% (60.3477 => 63.9025, std.dev.: 0.6576)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5008 => 5.8018, std.dev.: 0.0214)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.44% (2.3894 => 2.4954, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.35% (4.3151 => 4.5026, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3657, std.dev.: 0.0129)
  SingleSource/Benchmarks/Misc/whetstone: 4.20% (3.4559 => 3.6010, std.dev.: 0.0457)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.85% (6.1245 => 6.3600, std.dev.: 0.0657)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.80% (25.0200 => 25.9720, std.dev.: 0.1076)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.66% (3.3384 => 3.4607, std.dev.: 0.0446)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.05% (4.4624 => 4.5987, std.dev.: 0.0526)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.01% (4.8739 => 5.0205, std.dev.: 0.0389)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.63% (1.5957 => 1.6376, std.dev.: 0.0111)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.47% (1.2639 => 1.2951, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.35% (12.8625 => 13.1643, std.dev.: 0.1015)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.57% (4.7360 => 4.8103, std.dev.: 0.0287)
  SingleSource/Benchmarks/Misc/flops-4: 1.49% (1.6164 => 1.6405, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.49% (5.0417 => 5.1167, std.dev.: 0.0139)
  SingleSource/Benchmarks/Shootout/methcall: 1.36% (8.4614 => 8.5762, std.dev.: 0.0334)
  SingleSource/Benchmarks/Misc/flops: 1.14% (9.7664 => 9.8782, std.dev.: 0.0170)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.03% (4.9089 => 4.9595, std.dev.: 0.0109)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -20.74% (6.0938 => 4.8297, std.dev.: 0.3152)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.51% (1.4037 => 1.3825, std.dev.: 0.0055)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.62% (2.1022 => 1.4375, std.dev.: 0.0129)
  MultiSource/Applications/viterbi/viterbi: -26.59% (3.4923 => 2.5636, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.55% (6.9552 => 5.2478, std.dev.: 0.0198)
  SingleSource/Benchmarks/Misc/perlin: -21.17% (4.5989 => 3.6253, std.dev.: 0.0729)
  SingleSource/Benchmarks/Misc/mandel: -13.91% (1.1996 => 1.0327, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.19% (6.2627 => 5.4364, std.dev.: 0.2594)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.71% (0.5173 => 0.4619, std.dev.: 0.0049)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (47.2250 => 44.3452, std.dev.: 0.6945)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.71% (3.8119 => 3.6323, std.dev.: 0.0409)
  SingleSource/Benchmarks/Misc/fbench: -4.35% (4.9602 => 4.7446, std.dev.: 0.0090)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.91% (1.1032 => 1.0601, std.dev.: 0.0060)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.84% (2.7049 => 2.6011, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.42% (6.0444 => 5.8375, std.dev.: 0.0517)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.28% (3.5791 => 3.4616, std.dev.: 0.0185)
  SingleSource/Regression/C/uint64_to_float: -3.10% (1.5184 => 1.4713, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.00% (6.1482 => 5.9639, std.dev.: 0.0301)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.71% (1.8144 => 1.7652, std.dev.: 0.0105)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.47% (0.5097 => 0.4971, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.09% (8.6172 => 8.4367, std.dev.: 0.0432)
  SingleSource/Benchmarks/Misc/oourafft: -1.88% (3.7891 => 3.7177, std.dev.: 0.0219)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.35% (34.8438 => 34.3745, std.dev.: 0.0510)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.34% (4.9231 => 4.8573, std.dev.: 0.0106)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 16.11% (0.1378 => 0.1600, std.dev.: 0.0076)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130820/9308a2f3/attachment.html>


More information about the llvm-testresults mailing list