[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jun 6 07:50:00 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12115?compare_to=12112&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12115, Order: 183398, Start Time: 2013-06-06 13:02:05, End Time: 2013-06-06 14:50:42
      To: 12112, Order: 183394, Start Time: 2013-06-06 10:55:37, End Time: 2013-06-06 12:40:53
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 35 (29 on baseline)
Performance Improvements: 1 (35 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1071 (1043 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 49.75% (0.1212 => 0.1815, std.dev.: 0.0067)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 30.21% (0.5948 => 0.7745, std.dev.: 0.0444)
  MultiSource/Benchmarks/McCat/05-eks/eks: 26.00% (0.5361 => 0.6755, std.dev.: 0.0513)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.62% (9.8568 => 12.3822, std.dev.: 0.7179)
  MultiSource/Applications/lua/lua: 18.48% (4.3229 => 5.1217, std.dev.: 0.2575)
  MultiSource/Benchmarks/nbench/nbench: 16.30% (1.2885 => 1.4985, std.dev.: 0.0380)
  MultiSource/Applications/SIBsim4/SIBsim4: 14.28% (1.5722 => 1.7967, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.54% (1.4175 => 1.5386, std.dev.: 0.0099)
  MultiSource/Applications/sqlite3/sqlite3: 7.81% (16.6126 => 17.9100, std.dev.: 0.3661)
  MultiSource/Applications/lemon/lemon: 6.92% (1.2199 => 1.3043, std.dev.: 0.0310)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.46% (25.5240 => 27.1719, std.dev.: 0.2648)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.41% (1.8240 => 1.9410, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.38% (1.6203 => 1.7237, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.26% (1.5093 => 1.6038, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.24% (1.6432 => 1.7458, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.97% (1.4579 => 1.5450, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.83% (1.3766 => 1.4569, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.75% (1.6901 => 1.7873, std.dev.: 0.0179)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 4.85% (0.3218 => 0.3374, std.dev.: 0.0015)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.75% (0.2633 => 0.2758, std.dev.: 0.0007)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.51% (1.4760 => 1.8820, std.dev.: 0.0047)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.18% (0.1682 => 0.1870, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hash: 8.14% (0.7174 => 0.7758, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.34% (4.6843 => 5.0283, std.dev.: 0.0037)
  MultiSource/Benchmarks/Bullet/bullet: 5.39% (6.8859 => 7.2568, std.dev.: 0.0472)
  SingleSource/Benchmarks/Misc/fp-convert: 5.19% (7.6703 => 8.0687, std.dev.: 0.0034)
  MultiSource/Applications/sqlite3/sqlite3: 4.34% (4.3386 => 4.5268, std.dev.: 0.0219)
  MultiSource/Benchmarks/Olden/em3d/em3d: 4.33% (4.9564 => 5.1711, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.96% (8.9295 => 9.2830, std.dev.: 0.0388)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.33% (0.7786 => 0.8045, std.dev.: 0.0040)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.33% (16.1037 => 16.6392, std.dev.: 0.1820)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.09% (4.5709 => 4.6664, std.dev.: 0.0174)
  MultiSource/Applications/siod/siod: 2.09% (3.7397 => 3.8177, std.dev.: 0.0176)
  MultiSource/Applications/JM/lencod/lencod: 1.60% (6.8522 => 6.9621, std.dev.: 0.0402)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.39% (5.5774 => 5.6548, std.dev.: 0.0092)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.36% (2.5443 => 2.3316, std.dev.: 0.0648)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 25.59% (0.1442 => 0.1811, std.dev.: 0.0030)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 46.14% (0.1242 => 0.1815, std.dev.: 0.0067)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 29.47% (0.5982 => 0.7745, std.dev.: 0.0444)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 21.87% (10.1602 => 12.3822, std.dev.: 0.7179)
  MultiSource/Applications/lua/lua: 18.12% (4.3359 => 5.1217, std.dev.: 0.2575)
  MultiSource/Benchmarks/nbench/nbench: 15.93% (1.2926 => 1.4985, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.27% (1.4081 => 1.5386, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.01% (1.5959 => 1.7237, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.11% (1.6299 => 1.7458, std.dev.: 0.0047)
  MultiSource/Applications/SIBsim4/SIBsim4: 6.99% (1.6793 => 1.7967, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.98% (1.4991 => 1.6038, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.66% (1.4485 => 1.5450, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.60% (1.3667 => 1.4569, std.dev.: 0.0146)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.88% (1.6881 => 1.7873, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 5.29% (1.8435 => 1.9410, std.dev.: 0.0194)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.77% (25.9348 => 27.1719, std.dev.: 0.2648)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: 28.52% (0.1455 => 0.1870, std.dev.: 0.0001)
  MultiSource/Applications/sgefa/sgefa: 17.62% (1.1695 => 1.3756, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.86% (6.1372 => 7.1104, std.dev.: 0.0557)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.55% (5.2003 => 5.6447, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.61% (3.1853 => 3.3959, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.14% (5.2788 => 5.4976, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.45% (5.5010 => 5.6906, std.dev.: 0.0114)
  MultiSource/Applications/siod/siod: 2.52% (3.7240 => 3.8177, std.dev.: 0.0176)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.29% (4.3727 => 4.4727, std.dev.: 0.0039)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.09% (39.9248 => 40.7612, std.dev.: 0.2881)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.04% (0.7884 => 0.8045, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.82% (5.6582 => 5.7612, std.dev.: 0.0254)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.59% (4.5935 => 4.6664, std.dev.: 0.0174)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.04% (1.6980 => 1.7156, std.dev.: 0.0021)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -37.20% (0.1113 => 0.0699, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/whetstone: -15.22% (0.1097 => 0.0930, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.12% (0.1151 => 0.1000, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.21% (0.1646 => 0.1445, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.46% (0.7381 => 0.6904, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/strcat: -6.28% (0.2309 => 0.2164, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/ary2: -5.29% (0.2951 => 0.2795, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.83% (0.2151 => 0.2047, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/objinst: -4.67% (0.2397 => 0.2285, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.68% (0.4293 => 0.4135, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.77% (0.4554 => 0.4428, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.43% (1.2911 => 0.7304, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.46% (4.4050 => 3.2395, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.33% (6.2328 => 5.0283, std.dev.: 0.0037)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.08% (25.3677 => 21.2883, std.dev.: 0.2702)
  SingleSource/Benchmarks/Misc/salsa20: -13.03% (10.3398 => 8.9926, std.dev.: 0.0251)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.69% (48.3307 => 43.1659, std.dev.: 0.1750)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.17% (1.6679 => 1.5149, std.dev.: 0.0581)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.72% (5.5889 => 5.2134, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.58% (4.5717 => 4.2709, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.97% (9.8728 => 9.2830, std.dev.: 0.0388)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.35% (3.5327 => 3.3438, std.dev.: 0.0592)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.66% (5.3184 => 5.0705, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.19% (5.3276 => 5.1042, std.dev.: 0.0344)
  MultiSource/Applications/hexxagon/hexxagon: -3.90% (15.4979 => 14.8942, std.dev.: 0.0461)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.89% (9.1099 => 8.7554, std.dev.: 0.0439)
  SingleSource/Benchmarks/Misc/flops: -3.57% (10.2170 => 9.8527, std.dev.: 0.0328)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.85% (3.8665 => 3.7564, std.dev.: 0.0091)
  SingleSource/Benchmarks/Misc/flops-7: -2.59% (1.7987 => 1.7522, std.dev.: 0.0164)
  MultiSource/Applications/sqlite3/sqlite3: -2.35% (4.6358 => 4.5268, std.dev.: 0.0219)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.30% (0.7941 => 0.7758, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/hash: -1.79% (5.3656 => 5.2694, std.dev.: 0.0098)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.38% (5.7342 => 5.6548, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.16% (9.6556 => 9.5432, std.dev.: 0.0274)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.00% (2.8573 => 2.8286, std.dev.: 0.0067)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 25.68% (0.1441 => 0.1811, std.dev.: 0.0030)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130606/55d07a8d/attachment.html>


More information about the llvm-testresults mailing list