[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 2 04:20:34 PST 2013


http://llvm.org/perf/db_default/v4/nts/17809?compare_to=17802&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17809, Order: 196081, Start Time: 2013-12-02 10:35:38, End Time: 2013-12-02 12:24:37
      To: 17802, Order: 196069, Start Time: 2013-12-02 08:27:48, End Time: 2013-12-02 10:12:10
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 55 (55 on baseline)
Performance Improvements: 1 (10 on baseline)
Unchanged Tests: 1054 (1045 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/recursive-throw: 90.98% (0.0255 => 0.0487, std.dev.: 0.0014)
  SingleSource/UnitTests/2003-05-14-AtExit: 85.71% (0.0203 => 0.0377, std.dev.: 0.0015)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 82.44% (0.0205 => 0.0374, std.dev.: 0.0006)
  SingleSource/Regression/C/ConstructorDestructorAttributes: 82.17% (0.0157 => 0.0286, std.dev.: 0.0013)
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 81.25% (0.0160 => 0.0290, std.dev.: 0.0018)
  SingleSource/Regression/C++/pointer_member: 80.72% (0.0166 => 0.0300, std.dev.: 0.0009)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 79.90% (0.0194 => 0.0349, std.dev.: 0.0012)
  SingleSource/Regression/C/2008-01-07-LongDouble: 76.87% (0.0147 => 0.0260, std.dev.: 0.0005)
  SingleSource/Regression/C++/pointer_method: 75.50% (0.0200 => 0.0351, std.dev.: 0.0011)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 68.70% (0.0262 => 0.0442, std.dev.: 0.0025)
  SingleSource/Regression/C++/2011-03-28-Bitfield: 67.91% (0.0187 => 0.0314, std.dev.: 0.0020)
  SingleSource/Regression/C/2003-05-21-UnionTest: 67.52% (0.0157 => 0.0263, std.dev.: 0.0017)
  SingleSource/Regression/C/casts: 65.56% (0.0392 => 0.0649, std.dev.: 0.0024)
  SingleSource/Regression/C++/EH/simple_rethrow: 64.85% (0.0239 => 0.0394, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 61.31% (0.1667 => 0.2689, std.dev.: 0.0027)
  MultiSource/Applications/aha/aha: 61.28% (0.1268 => 0.2045, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 60.44% (0.0771 => 0.1237, std.dev.: 0.0042)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 60.26% (0.0234 => 0.0375, std.dev.: 0.0035)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 60.00% (0.0235 => 0.0376, std.dev.: 0.0038)
  SingleSource/UnitTests/2002-05-02-CastTest2: 59.51% (0.0205 => 0.0327, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-05-26-Shorts: 56.54% (0.0237 => 0.0371, std.dev.: 0.0019)
  SingleSource/Regression/C/bigstack: 52.70% (0.0630 => 0.0962, std.dev.: 0.0071)
  SingleSource/UnitTests/2003-05-31-CastToBool: 41.70% (0.0259 => 0.0367, std.dev.: 0.0032)
  MultiSource/Applications/Burg/burg: 32.20% (1.4064 => 1.8593, std.dev.: 0.1295)
  MultiSource/Applications/treecc/treecc: 24.43% (2.2424 => 2.7903, std.dev.: 0.0700)
  MultiSource/Applications/spiff/spiff: 24.27% (0.9004 => 1.1189, std.dev.: 0.0436)
  SingleSource/Benchmarks/Linpack/linpack-pc: 22.76% (0.3089 => 0.3792, std.dev.: 0.0263)
  SingleSource/UnitTests/Vector/constpool: 19.59% (9.1319 => 10.9209, std.dev.: 0.5619)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 18.06% (0.0897 => 0.1059, std.dev.: 0.0040)
  MultiSource/Applications/lua/lua: 17.39% (4.2205 => 4.9545, std.dev.: 0.2700)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 15.08% (9.7805 => 11.2557, std.dev.: 0.1073)
  MultiSource/Applications/ClamAV/clamscan: 13.24% (16.7291 => 18.9439, std.dev.: 0.6391)
  MultiSource/Applications/SPASS/SPASS: 8.03% (16.3573 => 17.6713, std.dev.: 0.1645)
  MultiSource/Applications/oggenc/oggenc: 6.94% (5.4160 => 5.7921, std.dev.: 0.0980)
  SingleSource/Benchmarks/Shootout-C++/matrix: 6.43% (0.2378 => 0.2531, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.39% (0.6813 => 0.7044, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/moments: 2.63% (0.3801 => 0.3901, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 59.24% (0.0238 => 0.0379, std.dev.: 0.0008)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 45.53% (1.4664 => 2.1340, std.dev.: 0.1022)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 44.72% (2.9016 => 4.1993, std.dev.: 0.0321)
  MultiSource/Applications/minisat/minisat: 26.87% (6.4216 => 8.1474, std.dev.: 0.1186)
  SingleSource/Benchmarks/Shootout/heapsort: 24.72% (3.6913 => 4.6039, std.dev.: 0.2160)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.68% (28.5452 => 33.3067, std.dev.: 0.5855)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.30% (14.1973 => 15.6594, std.dev.: 0.3073)
  SingleSource/Benchmarks/Misc/salsa20: 8.96% (7.4797 => 8.1497, std.dev.: 0.0525)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.41% (1.1102 => 1.1925, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.09% (5.0321 => 5.3891, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.00% (3.4762 => 3.7194, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.18% (2.9445 => 3.1264, std.dev.: 0.0579)
  MultiSource/Benchmarks/sim/sim: 4.41% (3.8100 => 3.9779, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.33% (4.5743 => 4.7725, std.dev.: 0.0127)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.22% (2.3389 => 2.4377, std.dev.: 0.0149)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.36% (2.4917 => 2.5505, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.01% (3.7954 => 3.8716, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.69% (5.5000 => 5.5932, std.dev.: 0.0178)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.49% (2.5332 => 2.4700, std.dev.: 0.0143)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/recursive-throw: 88.76% (0.0258 => 0.0487, std.dev.: 0.0014)
  SingleSource/UnitTests/2003-05-14-AtExit: 84.80% (0.0204 => 0.0377, std.dev.: 0.0015)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 83.33% (0.0204 => 0.0374, std.dev.: 0.0006)
  SingleSource/Regression/C/ConstructorDestructorAttributes: 78.75% (0.0160 => 0.0286, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 78.06% (0.0196 => 0.0349, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 77.91% (0.0163 => 0.0290, std.dev.: 0.0018)
  SingleSource/Regression/C++/pointer_member: 77.51% (0.0169 => 0.0300, std.dev.: 0.0009)
  SingleSource/Regression/C++/EH/simple_rethrow: 75.11% (0.0225 => 0.0394, std.dev.: 0.0020)
  SingleSource/Regression/C/2003-05-21-UnionTest: 66.46% (0.0158 => 0.0263, std.dev.: 0.0017)
  SingleSource/Regression/C/casts: 66.41% (0.0390 => 0.0649, std.dev.: 0.0024)
  SingleSource/Regression/C++/pointer_method: 65.57% (0.0212 => 0.0351, std.dev.: 0.0011)
  SingleSource/Regression/C/2008-01-07-LongDouble: 64.56% (0.0158 => 0.0260, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 64.06% (0.1639 => 0.2689, std.dev.: 0.0027)
  MultiSource/Applications/aha/aha: 62.56% (0.1258 => 0.2045, std.dev.: 0.0079)
  SingleSource/Regression/C++/2011-03-28-Bitfield: 61.86% (0.0194 => 0.0314, std.dev.: 0.0020)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 60.26% (0.0234 => 0.0375, std.dev.: 0.0035)
  SingleSource/UnitTests/2002-05-02-CastTest2: 59.51% (0.0205 => 0.0327, std.dev.: 0.0012)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 58.65% (0.0237 => 0.0376, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 57.38% (0.0786 => 0.1237, std.dev.: 0.0042)
  SingleSource/UnitTests/2003-04-22-Switch: 57.06% (0.0177 => 0.0278, std.dev.: 0.0027)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 55.09% (0.0285 => 0.0442, std.dev.: 0.0025)
  SingleSource/UnitTests/2003-05-26-Shorts: 54.58% (0.0240 => 0.0371, std.dev.: 0.0019)
  SingleSource/Regression/C/bigstack: 51.97% (0.0633 => 0.0962, std.dev.: 0.0071)
  SingleSource/UnitTests/2003-05-31-CastToBool: 40.08% (0.0262 => 0.0367, std.dev.: 0.0032)
  MultiSource/Applications/Burg/burg: 30.34% (1.4265 => 1.8593, std.dev.: 0.1295)
  MultiSource/Applications/spiff/spiff: 24.07% (0.9018 => 1.1189, std.dev.: 0.0436)
  MultiSource/Applications/treecc/treecc: 22.48% (2.2781 => 2.7903, std.dev.: 0.0700)
  SingleSource/Benchmarks/Linpack/linpack-pc: 21.97% (0.3109 => 0.3792, std.dev.: 0.0263)
  SingleSource/UnitTests/Vector/constpool: 18.48% (9.2178 => 10.9209, std.dev.: 0.5619)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 14.36% (9.8425 => 11.2557, std.dev.: 0.1073)
  MultiSource/Applications/ClamAV/clamscan: 11.66% (16.9661 => 18.9439, std.dev.: 0.6391)
  MultiSource/Applications/SPASS/SPASS: 5.70% (16.7177 => 17.6713, std.dev.: 0.1645)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.46% (0.2400 => 0.2531, std.dev.: 0.0048)
  MultiSource/Applications/oggenc/oggenc: 5.37% (5.4968 => 5.7921, std.dev.: 0.0980)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 56.11% (2.9492 => 4.6039, std.dev.: 0.2160)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 45.01% (1.4716 => 2.1340, std.dev.: 0.1022)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 40.23% (2.9945 => 4.1993, std.dev.: 0.0321)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 37.32% (0.0276 => 0.0379, std.dev.: 0.0008)
  MultiSource/Applications/minisat/minisat: 27.54% (6.3881 => 8.1474, std.dev.: 0.1186)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.20% (28.6638 => 33.3067, std.dev.: 0.5855)
  SingleSource/Benchmarks/Shootout/strcat: 8.96% (0.1417 => 0.1544, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.22% (1.1019 => 1.1925, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.03% (2.8940 => 3.1264, std.dev.: 0.0579)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.58% (0.3534 => 0.3802, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/salsa20: 7.31% (7.5947 => 8.1497, std.dev.: 0.0525)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.10% (5.0320 => 5.3891, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.19% (3.5027 => 3.7194, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.38% (2.3355 => 2.4377, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.01% (4.5883 => 4.7725, std.dev.: 0.0127)
  SingleSource/Benchmarks/Shootout/lists: 3.09% (6.9930 => 7.2090, std.dev.: 0.0473)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.08% (5.9126 => 6.0355, std.dev.: 0.0335)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.92% (2.5025 => 2.5505, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.72% (3.8062 => 3.8716, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.64% (5.5032 => 5.5932, std.dev.: 0.0178)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.53% (2.3882 => 2.4248, std.dev.: 0.0110)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.82% (0.3247 => 0.2928, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.81% (1.3676 => 1.2745, std.dev.: 0.0237)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.87% (0.3714 => 0.3533, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.69% (1.3146 => 1.2529, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.53% (1.2670 => 1.2349, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.25% (1.2952 => 1.2660, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.21% (1.3551 => 1.3251, std.dev.: 0.0061)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.14% (2.5384 => 2.5095, std.dev.: 0.0099)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -5.28% (7.4226 => 7.0309, std.dev.: 0.0562)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.95% (6.0535 => 5.8747, std.dev.: 0.0146)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131202/9d7937f3/attachment.html>


More information about the llvm-testresults mailing list