[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 5 09:42:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12082?compare_to=12078&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12082, Order: 183312, Start Time: 2013-06-05 14:53:36, End Time: 2013-06-05 16:43:31
      To: 12078, Order: 183304, Start Time: 2013-06-05 12:40:50, End Time: 2013-06-05 14:26:28
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

New Passes: 9 (0 on baseline)
Performance Regressions: 29 (28 on baseline)
Performance Improvements: 1 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1068 (1053 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/lambda-0_1_3/lambda
  MultiSource/Benchmarks/Bullet/bullet
  SingleSource/Benchmarks/Shootout-C++/hello
  SingleSource/Benchmarks/Shootout-C++/methcall
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/spellcheck
  SingleSource/Benchmarks/Shootout-C++/sumcol
  SingleSource/Benchmarks/Shootout-C++/wc
  MultiSource/Applications/kimwitu++/kc: 5350.00% (0.0010 => 0.0545, std.dev.: 0.0071)
  MultiSource/Applications/lambda-0_1_3/lambda: 973500.00% (0.0009 => 8.7624, std.dev.: 0.0094)
  MultiSource/Benchmarks/Bullet/bullet: 805655.56% (0.0009 => 7.2518, std.dev.: 0.0151)
  SingleSource/Benchmarks/Shootout-C++/hello: -90.00% (0.0010 => 0.0001, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/methcall: 144.22% (4.7604 => 11.6259, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 900.00% (0.0001 => 0.0010, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 300.00% (0.0001 => 0.0004, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 800.00% (0.0001 => 0.0009, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/wc: 900.00% (0.0001 => 0.0010, std.dev.: 0.0002)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/simple: 47.49% (0.0219 => 0.0323, std.dev.: 0.0021)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 30.41% (0.0434 => 0.0566, std.dev.: 0.0051)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 28.22% (1.5008 => 1.9244, std.dev.: 0.0138)
  SingleSource/UnitTests/Vector/constpool: 22.70% (8.6315 => 10.5907, std.dev.: 0.2523)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.61% (1.4980 => 1.6120, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.87% (1.4740 => 1.5753, std.dev.: 0.0332)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.31% (1.7031 => 1.8106, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.94% (1.5810 => 1.6749, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.76% (1.6349 => 1.7291, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.90% (0.2223 => 0.2332, std.dev.: 0.0015)
  MultiSource/Benchmarks/mafft/pairlocalalign: 4.69% (10.4172 => 10.9055, std.dev.: 0.1851)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.66% (1.3853 => 1.4498, std.dev.: 0.0122)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.45% (25.7718 => 26.9183, std.dev.: 0.3763)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.47% (1.3768 => 1.4246, std.dev.: 0.0179)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 69.11% (5.7979 => 9.8049, std.dev.: 0.4959)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.59% (1.4755 => 1.8678, std.dev.: 0.0221)
  MultiSource/Applications/SPASS/SPASS: 14.81% (8.1366 => 9.3420, std.dev.: 0.3266)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.41% (2.1064 => 2.4100, std.dev.: 0.0197)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.81% (16.1698 => 16.9468, std.dev.: 0.0443)
  MultiSource/Applications/lua/lua: 3.89% (28.2378 => 29.3374, std.dev.: 0.1762)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.76% (39.6343 => 41.1240, std.dev.: 0.2954)
  MultiSource/Applications/sqlite3/sqlite3: 2.20% (4.3385 => 4.4339, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.53% (3.2015 => 3.2506, std.dev.: 0.0034)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 1.32% (1.4902 => 1.5099, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.31% (3.3776 => 3.4220, std.dev.: 0.0035)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.25% (51.2135 => 51.8552, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.23% (5.6593 => 5.7291, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.10% (5.2586 => 5.3163, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.05% (4.6365 => 4.6853, std.dev.: 0.0131)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.57% (21.5437 => 21.2052, std.dev.: 0.0868)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.62% (0.1443 => 0.1434, std.dev.: 0.0093)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 28.17% (1.5014 => 1.9244, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.47% (1.4999 => 1.6120, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.75% (1.4757 => 1.5753, std.dev.: 0.0332)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.55% (1.6993 => 1.8106, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.09% (1.6299 => 1.7291, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.97% (1.5806 => 1.6749, std.dev.: 0.0104)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.71% (0.2206 => 0.2332, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.77% (1.3838 => 1.4498, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.24% (1.3667 => 1.4246, std.dev.: 0.0179)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.79% (25.9348 => 26.9183, std.dev.: 0.3763)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 63.08% (6.0122 => 9.8049, std.dev.: 0.4959)
  MultiSource/Applications/sgefa/sgefa: 18.16% (1.1695 => 1.3819, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.15% (5.2003 => 5.6240, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.27% (3.2201 => 3.4220, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.77% (4.6639 => 4.8863, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.45% (1.0571 => 1.1041, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.15% (5.5010 => 5.7291, std.dev.: 0.0036)
  MultiSource/Applications/lua/lua: 3.85% (28.2496 => 29.3374, std.dev.: 0.1762)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.60% (5.2788 => 5.4686, std.dev.: 0.0577)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.00% (39.9248 => 41.1240, std.dev.: 0.2954)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.92% (16.4665 => 16.9468, std.dev.: 0.0443)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.00% (4.3727 => 4.4600, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.55% (3.2009 => 3.2506, std.dev.: 0.0034)
  MultiSource/Applications/siod/siod: 1.43% (3.7240 => 3.7774, std.dev.: 0.0198)
  SingleSource/Benchmarks/Misc/oourafft: 1.20% (3.7315 => 3.7764, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.15% (5.2561 => 5.3163, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.10% (11.4990 => 11.6259, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.02% (4.6379 => 4.6853, std.dev.: 0.0131)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.57% (0.1113 => 0.0706, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.43% (0.0803 => 0.0663, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -5.72% (0.2151 => 0.2028, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/strcat: -5.67% (0.2309 => 0.2178, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.27% (1.2911 => 0.7325, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.40% (4.4050 => 3.2420, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -20.22% (6.2328 => 4.9727, std.dev.: 0.0509)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.41% (25.3677 => 21.2052, std.dev.: 0.0868)
  SingleSource/Benchmarks/Misc/salsa20: -13.10% (10.3398 => 8.9849, std.dev.: 0.0260)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.23% (48.3307 => 43.3867, std.dev.: 0.0549)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.43% (1.6679 => 1.5107, std.dev.: 0.0416)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.32% (0.7941 => 0.7280, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.54% (9.8728 => 9.2271, std.dev.: 0.0430)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.78% (5.5889 => 5.2656, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.41% (5.3184 => 5.0841, std.dev.: 0.0075)
  MultiSource/Applications/sqlite3/sqlite3: -4.36% (4.6358 => 4.4339, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.18% (5.3276 => 5.1048, std.dev.: 0.0237)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.81% (9.1099 => 8.7624, std.dev.: 0.0094)
  MultiSource/Applications/hexxagon/hexxagon: -3.75% (15.4979 => 14.9166, std.dev.: 0.0303)
  SingleSource/Benchmarks/Misc/flops: -3.43% (10.2170 => 9.8665, std.dev.: 0.0269)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.02% (3.8665 => 3.7498, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout/sieve: -2.91% (8.0178 => 7.7848, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.15% (4.5094 => 4.4124, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.95% (2.8537 => 2.7980, std.dev.: 0.0115)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.78% (8.5243 => 8.3729, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.72% (4.2167 => 4.1440, std.dev.: 0.0118)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.49% (0.1441 => 0.1434, std.dev.: 0.0093)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130605/c4303f85/attachment.html>


More information about the llvm-testresults mailing list