[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 13 11:28:55 PST 2013


http://llvm.org/perf/db_default/v4/nts/18382?compare_to=18375&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18382, Order: 197245, Start Time: 2013-12-13 17:43:33, End Time: 2013-12-13 19:33:11
      To: 18375, Order: 197229, Start Time: 2013-12-13 15:29:00, End Time: 2013-12-13 17:17:58
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 38 (54 on baseline)
Performance Improvements: 21 (10 on baseline)
Unchanged Tests: 1051 (1046 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 73.39% (0.0327 => 0.0567, std.dev.: 0.0023)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 72.20% (0.0223 => 0.0384, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 68.51% (0.1356 => 0.2285, std.dev.: 0.0072)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 63.10% (0.0168 => 0.0274, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 59.85% (0.0274 => 0.0438, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout/hash: 58.74% (0.0572 => 0.0908, std.dev.: 0.0063)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 58.56% (0.0432 => 0.0685, std.dev.: 0.0022)
  SingleSource/UnitTests/2005-05-13-SDivTwo: 57.80% (0.0173 => 0.0273, std.dev.: 0.0011)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 51.59% (0.0252 => 0.0382, std.dev.: 0.0026)
  MultiSource/Applications/treecc/treecc: 18.76% (2.2941 => 2.7245, std.dev.: 0.0864)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.65% (1.7311 => 2.0194, std.dev.: 0.0415)
  MultiSource/Applications/Burg/burg: 13.94% (1.4603 => 1.6639, std.dev.: 0.0428)
  MultiSource/Applications/d/make_dparser: 13.04% (3.5679 => 4.0333, std.dev.: 0.0168)
  MultiSource/Applications/JM/ldecod/ldecod: 8.87% (8.0454 => 8.7592, std.dev.: 0.2335)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 8.27% (1.2365 => 1.3388, std.dev.: 0.0349)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.08% (1.3475 => 1.4025, std.dev.: 0.0080)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 3.89% (0.3572 => 0.3711, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 39.67% (1.5604 => 2.1794, std.dev.: 0.0445)
  SingleSource/Benchmarks/Shootout/heapsort: 31.46% (3.6328 => 4.7758, std.dev.: 0.0935)
  SingleSource/Benchmarks/Misc/flops: 19.89% (8.0280 => 9.6248, std.dev.: 0.0258)
  MultiSource/Benchmarks/FreeBench/neural/neural: 19.54% (0.4416 => 0.5279, std.dev.: 0.0295)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 15.66% (4.1338 => 4.7810, std.dev.: 0.1179)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.74% (1.1034 => 1.1998, std.dev.: 0.0031)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.59% (9.7608 => 10.5994, std.dev.: 0.0856)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.26% (1.3930 => 1.5080, std.dev.: 0.0007)
  SingleSource/Benchmarks/McGill/misr: 8.22% (0.3808 => 0.4121, std.dev.: 0.0085)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.21% (29.6196 => 32.0518, std.dev.: 0.8309)
  MultiSource/Applications/lua/lua: 7.08% (30.0326 => 32.1596, std.dev.: 0.6298)
  SingleSource/Benchmarks/Shootout/strcat: 6.72% (0.1487 => 0.1587, std.dev.: 0.0038)
  MultiSource/Benchmarks/sim/sim: 5.59% (3.8083 => 4.0213, std.dev.: 0.0547)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.92% (4.1012 => 4.3028, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.89% (4.5733 => 4.7968, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout/hash: 3.81% (5.2173 => 5.4163, std.dev.: 0.0406)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.79% (3.5909 => 3.6550, std.dev.: 0.0065)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.62% (0.6411 => 0.6515, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.62% (3.7364 => 3.7970, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.32% (6.5443 => 6.6304, std.dev.: 0.0267)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.16% (1.7121 => 1.7320, std.dev.: 0.0013)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: -42.95% (0.0596 => 0.0340, std.dev.: 0.0030)
  SingleSource/Benchmarks/Stanford/IntMM: -34.62% (0.0673 => 0.0440, std.dev.: 0.0015)
  SingleSource/Benchmarks/Stanford/Queens: -32.14% (0.0641 => 0.0435, std.dev.: 0.0020)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -23.61% (0.0699 => 0.0534, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -22.95% (0.0928 => 0.0715, std.dev.: 0.0040)
  MultiSource/Applications/hbd/hbd: -19.40% (1.9492 => 1.5711, std.dev.: 0.1284)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.56% (1.3548 => 1.1576, std.dev.: 0.0527)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -11.84% (0.3859 => 0.3402, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/strcat: -8.74% (0.2255 => 0.2058, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/ary2: -5.11% (0.2718 => 0.2579, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -4.16% (0.3988 => 0.3822, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.57% (0.4116 => 0.3969, std.dev.: 0.0023)
  MultiSource/Benchmarks/sim/sim: -2.81% (0.3776 => 0.3670, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -30.99% (0.0355 => 0.0245, std.dev.: 0.0015)
  MultiSource/Benchmarks/nbench/nbench: -11.88% (21.3312 => 18.7977, std.dev.: 0.9401)
  MultiSource/Applications/ClamAV/clamscan: -11.74% (0.1550 => 0.1368, std.dev.: 0.0026)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -4.06% (1.9007 => 1.8235, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.09% (0.7679 => 0.7442, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -1.72% (5.3141 => 5.2227, std.dev.: 0.0331)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.61% (3.6380 => 3.5795, std.dev.: 0.0212)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.25% (1.2691 => 1.2532, std.dev.: 0.0028)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-13-SwitchTest: 83.89% (0.0149 => 0.0274, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 72.97% (0.0222 => 0.0384, std.dev.: 0.0030)
  SingleSource/UnitTests/2005-05-13-SDivTwo: 68.52% (0.0162 => 0.0273, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 64.35% (0.0345 => 0.0567, std.dev.: 0.0023)
  SingleSource/Regression/C++/EH/ctor_dtor_count-2: 63.25% (0.0234 => 0.0382, std.dev.: 0.0026)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 62.83% (0.0269 => 0.0438, std.dev.: 0.0023)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 60.80% (0.0426 => 0.0685, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 59.12% (0.1436 => 0.2285, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/hash: 55.75% (0.0583 => 0.0908, std.dev.: 0.0063)
  SingleSource/UnitTests/AtomicOps: 55.39% (0.0204 => 0.0317, std.dev.: 0.0025)
  SingleSource/UnitTests/2003-05-31-CastToBool: 43.51% (0.0262 => 0.0376, std.dev.: 0.0033)
  MultiSource/Applications/sqlite3/sqlite3: 41.33% (15.7419 => 22.2481, std.dev.: 0.8509)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 30.40% (0.3859 => 0.5032, std.dev.: 0.0302)
  MultiSource/Applications/treecc/treecc: 19.60% (2.2781 => 2.7245, std.dev.: 0.0864)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 18.41% (1.7054 => 2.0194, std.dev.: 0.0415)
  MultiSource/Applications/Burg/burg: 16.64% (1.4265 => 1.6639, std.dev.: 0.0428)
  MultiSource/Applications/JM/ldecod/ldecod: 14.41% (7.6560 => 8.7592, std.dev.: 0.2335)
  MultiSource/Applications/lemon/lemon: 12.98% (1.2200 => 1.3783, std.dev.: 0.0225)
  MultiSource/Applications/d/make_dparser: 10.72% (3.6428 => 4.0333, std.dev.: 0.0168)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.46% (25.9661 => 28.1638, std.dev.: 0.3952)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 5.19% (0.2137 => 0.2248, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 3.60% (0.3582 => 0.3711, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 61.94% (2.9492 => 4.7758, std.dev.: 0.0935)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 48.10% (1.4716 => 2.1794, std.dev.: 0.0445)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.49% (4.5769 => 5.8810, std.dev.: 0.1442)
  MultiSource/Benchmarks/FreeBench/neural/neural: 25.09% (0.4220 => 0.5279, std.dev.: 0.0295)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 17.85% (4.0567 => 4.7810, std.dev.: 0.1179)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.60% (5.9583 => 7.0068, std.dev.: 0.0627)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.73% (35.9684 => 40.5467, std.dev.: 1.0161)
  SingleSource/Benchmarks/Shootout/strcat: 12.00% (0.1417 => 0.1587, std.dev.: 0.0038)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.82% (28.6638 => 32.0518, std.dev.: 0.8309)
  MultiSource/Applications/lua/lua: 10.38% (29.1357 => 32.1596, std.dev.: 0.6298)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.98% (1.3838 => 1.5080, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.88% (1.1019 => 1.1998, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.54% (3.3810 => 3.6699, std.dev.: 0.0575)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.22% (5.0320 => 5.3953, std.dev.: 0.0025)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.76% (10.0217 => 10.5994, std.dev.: 0.0856)
  MultiSource/Applications/siod/siod: 5.64% (3.4258 => 3.6191, std.dev.: 0.0737)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.79% (3.4043 => 3.5675, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.54% (4.5883 => 4.7968, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout/hash: 4.37% (5.1896 => 5.4163, std.dev.: 0.0406)
  SingleSource/Benchmarks/Misc/flops: 3.86% (9.2673 => 9.6248, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.78% (4.1462 => 4.3028, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.94% (4.8243 => 4.9659, std.dev.: 0.0241)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.50% (3.8062 => 3.9014, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.99% (0.6388 => 0.6515, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.84% (11.7894 => 12.0069, std.dev.: 0.0194)
  SingleSource/UnitTests/Vector/multiplies: 1.82% (0.5878 => 0.5985, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.76% (3.7315 => 3.7970, std.dev.: 0.0209)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.60% (4.4509 => 4.5220, std.dev.: 0.0168)
  MultiSource/Applications/sgefa/sgefa: 1.59% (0.8745 => 0.8884, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.55% (6.5291 => 6.6304, std.dev.: 0.0267)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.36% (1.7088 => 1.7320, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.28% (5.8933 => 5.9686, std.dev.: 0.0231)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.48% (0.2824 => 0.2641, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.89% (1.4277 => 1.3579, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.95% (1.3505 => 1.2971, std.dev.: 0.0178)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.85% (0.3714 => 0.3608, std.dev.: 0.0037)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -19.91% (23.4696 => 18.7977, std.dev.: 0.9401)
  MultiSource/Benchmarks/Bullet/bullet: -2.89% (7.4226 => 7.2083, std.dev.: 0.0811)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.63% (6.0535 => 5.8942, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.31% (5.3463 => 5.2227, std.dev.: 0.0331)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.15% (3.6583 => 3.5795, std.dev.: 0.0212)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.28% (7.9597 => 7.8577, std.dev.: 0.0122)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131213/f17d60c6/attachment.html>


More information about the llvm-testresults mailing list