[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 24 08:20:42 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11710?compare_to=11707&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11710, Order: 182640, Start Time: 2013-05-24 13:32:36, End Time: 2013-05-24 15:21:11
      To: 11707, Order: 182636, Start Time: 2013-05-24 11:26:06, End Time: 2013-05-24 13:11:33
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 56 (48 on baseline)
Performance Improvements: 1 (22 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1050 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 67.33% (0.0502 => 0.0840, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 46.80% (0.0859 => 0.1261, std.dev.: 0.0062)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 44.78% (0.2213 => 0.3204, std.dev.: 0.0259)
  MultiSource/Benchmarks/McCat/08-main/main: 43.80% (0.2975 => 0.4278, std.dev.: 0.0241)
  MultiSource/Benchmarks/Olden/bisort/bisort: 41.63% (0.0723 => 0.1024, std.dev.: 0.0099)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 38.62% (0.1028 => 0.1425, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/18-imp/imp: 37.62% (0.3982 => 0.5480, std.dev.: 0.0234)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 36.11% (0.1055 => 0.1436, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/tsp/tsp: 34.66% (0.1304 => 0.1756, std.dev.: 0.0099)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 33.08% (0.0526 => 0.0700, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 32.06% (0.2829 => 0.3736, std.dev.: 0.0142)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 31.85% (0.2810 => 0.3705, std.dev.: 0.0223)
  MultiSource/Benchmarks/Olden/health/health: 29.39% (0.1545 => 0.1999, std.dev.: 0.0170)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 29.01% (1.4215 => 1.8339, std.dev.: 0.0571)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 20.44% (1.3136 => 1.5821, std.dev.: 0.0551)
  MultiSource/Benchmarks/Bullet/bullet: 15.53% (35.2594 => 40.7351, std.dev.: 1.8590)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.27% (0.9725 => 1.0724, std.dev.: 0.0038)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.56% (25.6676 => 28.1205, std.dev.: 0.4274)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.59% (1.6868 => 1.7980, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.11% (1.6143 => 1.7129, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.04% (1.6257 => 1.7239, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 5.99% (1.6887 => 1.7898, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.99% (1.7125 => 1.8150, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.84% (1.6135 => 1.7077, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.62% (1.6464 => 1.7389, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.41% (1.5851 => 1.6708, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.38% (1.6665 => 1.7561, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.14% (1.5882 => 1.6699, std.dev.: 0.0244)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.98% (0.2432 => 0.2553, std.dev.: 0.0041)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.40% (2.5143 => 2.5997, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.15% (1.4320 => 1.4771, std.dev.: 0.0115)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 97.66% (0.1322 => 0.2613, std.dev.: 0.0093)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 81.57% (0.7503 => 1.3623, std.dev.: 0.0560)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 59.31% (0.0553 => 0.0881, std.dev.: 0.0016)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 41.13% (0.0248 => 0.0350, std.dev.: 0.0035)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 33.23% (0.3106 => 0.4138, std.dev.: 0.0159)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 32.11% (0.0819 => 0.1082, std.dev.: 0.0010)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 31.09% (1.2546 => 1.6446, std.dev.: 0.0511)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 29.62% (0.3649 => 0.4730, std.dev.: 0.0286)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.22% (1.4785 => 1.8809, std.dev.: 0.0040)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 26.49% (1.2320 => 1.5583, std.dev.: 0.0121)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.58% (2.4102 => 2.8580, std.dev.: 0.0510)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.59% (4.1384 => 4.8248, std.dev.: 0.0049)
  MultiSource/Applications/obsequi/Obsequi: 13.78% (2.2163 => 2.5218, std.dev.: 0.0340)
  MultiSource/Benchmarks/llubenchmark/llu: 10.93% (1.9994 => 2.2179, std.dev.: 0.0682)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.13% (1.6031 => 1.7014, std.dev.: 0.0169)
  MultiSource/Applications/lua/lua: 4.01% (27.7534 => 28.8664, std.dev.: 0.1071)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.33% (4.4205 => 4.5676, std.dev.: 0.0224)
  MultiSource/Benchmarks/Olden/bh/bh: 2.68% (2.4239 => 2.4888, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.64% (5.1875 => 5.3242, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.51% (4.7986 => 4.9191, std.dev.: 0.0170)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.78% (2.9560 => 3.0086, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.31% (3.9770 => 4.0292, std.dev.: 0.0165)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.23% (1.2857 => 1.3015, std.dev.: 0.0010)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.20% (95.2390 => 96.3830, std.dev.: 0.0940)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.14% (51.2525 => 51.8383, std.dev.: 0.0159)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/FloatMM: -2.70% (0.7964 => 0.7749, std.dev.: 0.0076)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.71% (0.1401 => 0.1481, std.dev.: 0.0022)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 55.27% (0.0541 => 0.0840, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/bisort/bisort: 46.29% (0.0700 => 0.1024, std.dev.: 0.0099)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 42.65% (0.0884 => 0.1261, std.dev.: 0.0062)
  MultiSource/Benchmarks/McCat/08-main/main: 40.72% (0.3040 => 0.4278, std.dev.: 0.0241)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 39.73% (0.2293 => 0.3204, std.dev.: 0.0259)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 34.10% (0.0522 => 0.0700, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.55% (0.1067 => 0.1425, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 32.84% (0.1081 => 0.1436, std.dev.: 0.0110)
  MultiSource/Benchmarks/McCat/18-imp/imp: 30.51% (0.4199 => 0.5480, std.dev.: 0.0234)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 29.68% (0.2881 => 0.3736, std.dev.: 0.0142)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 28.67% (1.4253 => 1.8339, std.dev.: 0.0571)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 25.13% (0.2961 => 0.3705, std.dev.: 0.0223)
  MultiSource/Benchmarks/Olden/tsp/tsp: 23.23% (0.1425 => 0.1756, std.dev.: 0.0099)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 15.60% (1.3686 => 1.5821, std.dev.: 0.0551)
  MultiSource/Benchmarks/Bullet/bullet: 14.65% (35.5296 => 40.7351, std.dev.: 1.8590)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.43% (25.9348 => 28.1205, std.dev.: 0.4274)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.70% (0.9957 => 1.0724, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.81% (1.6993 => 1.8150, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.69% (1.6299 => 1.7389, std.dev.: 0.0181)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 6.69% (0.2393 => 0.2553, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.25% (1.6073 => 1.7077, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6.18% (1.5735 => 1.6708, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.18% (1.5727 => 1.6699, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.03% (1.6563 => 1.7561, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.02% (1.6881 => 1.7898, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.81% (1.6292 => 1.7239, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.73% (1.7006 => 1.7980, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.25% (1.6275 => 1.7129, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.74% (1.4238 => 1.4771, std.dev.: 0.0115)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.66% (2.5078 => 2.5997, std.dev.: 0.0262)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.71% (1.3838 => 1.4213, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.20% (1.4202 => 1.4514, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.12% (1.4081 => 1.4379, std.dev.: 0.0092)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 41.19% (0.0624 => 0.0881, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 32.89% (1.0251 => 1.3623, std.dev.: 0.0560)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 29.20% (0.3661 => 0.4730, std.dev.: 0.0286)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.12% (0.0838 => 0.1082, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 28.99% (0.3208 => 0.4138, std.dev.: 0.0159)
  MultiSource/Benchmarks/Olden/mst/mst: 24.49% (0.2099 => 0.2613, std.dev.: 0.0093)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.88% (1.2579 => 1.5583, std.dev.: 0.0121)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 21.55% (1.3530 => 1.6446, std.dev.: 0.0511)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.67% (2.5366 => 2.8580, std.dev.: 0.0510)
  MultiSource/Applications/obsequi/Obsequi: 12.59% (2.2398 => 2.5218, std.dev.: 0.0340)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.50% (1.0571 => 1.1047, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.53% (6.1372 => 6.2923, std.dev.: 0.0503)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.21% (94.2966 => 96.3830, std.dev.: 0.0940)
  MultiSource/Applications/lua/lua: 2.18% (28.2496 => 28.8664, std.dev.: 0.1071)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.26% (5.2003 => 5.2660, std.dev.: 0.0065)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.19% (0.0803 => 0.0665, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/whetstone: -15.04% (0.1097 => 0.0932, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.21% (0.1151 => 0.0999, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.00% (0.1646 => 0.1432, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.00% (0.1075 => 0.0946, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.81% (1.5932 => 1.4051, std.dev.: 0.0126)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.27% (0.1322 => 0.1173, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -8.70% (0.1886 => 0.1722, std.dev.: 0.0012)
  MultiSource/Applications/aha/aha: -8.03% (0.1407 => 0.1294, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.57% (0.7381 => 0.6822, std.dev.: 0.0034)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.13% (0.1828 => 0.1716, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.81% (2.0439 => 1.9252, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -5.29% (0.3853 => 0.3649, std.dev.: 0.0011)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.87% (0.2738 => 0.2632, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.79% (0.3378 => 0.3250, std.dev.: 0.0022)
  MultiSource/Applications/d/make_dparser: -1.55% (3.7330 => 3.6751, std.dev.: 0.0209)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -22.74% (1.3499 => 1.0429, std.dev.: 0.0652)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.75% (0.3702 => 0.3304, std.dev.: 0.0142)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.07% (0.7941 => 0.7221, std.dev.: 0.0270)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.07% (3.2030 => 3.0086, std.dev.: 0.0084)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.99% (5.7342 => 5.5629, std.dev.: 0.0590)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.32% (2.8573 => 2.8195, std.dev.: 0.0099)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.78% (0.1441 => 0.1481, std.dev.: 0.0022)

Report Time: 0.58s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130524/57fb2241/attachment.html>


More information about the llvm-testresults mailing list