[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Sep 11 12:01:16 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15196?compare_to=15193&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15196, Order: 190528, Start Time: 2013-09-11 17:10:35, End Time: 2013-09-11 19:03:48
      To: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 72 (72 on baseline)
Performance Improvements: 1 (1 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1034 (1034 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 60.53% (0.6617 => 1.0622, std.dev.: 0.0179)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 49.06% (0.1015 => 0.1513, std.dev.: 0.0165)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 47.22% (0.0504 => 0.0742, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 44.52% (0.0849 => 0.1227, std.dev.: 0.0135)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 42.81% (1.1393 => 1.6270, std.dev.: 0.0336)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 42.48% (1.0935 => 1.5580, std.dev.: 0.0521)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 41.08% (0.5609 => 0.7913, std.dev.: 0.0614)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 40.73% (0.7037 => 0.9903, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/tsp/tsp: 39.55% (0.1297 => 0.1810, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 39.16% (0.8667 => 1.2061, std.dev.: 0.0668)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 36.84% (0.9212 => 1.2606, std.dev.: 0.0689)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 33.79% (0.3374 => 0.4514, std.dev.: 0.0084)
  MultiSource/Benchmarks/MallocBench/gs/gs: 32.83% (4.5883 => 6.0945, std.dev.: 0.2919)
  MultiSource/Benchmarks/Olden/health/health: 32.38% (0.1507 => 0.1995, std.dev.: 0.0076)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 30.56% (0.6868 => 0.8967, std.dev.: 0.0403)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 28.03% (9.7354 => 12.4640, std.dev.: 0.3887)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 26.59% (1.4746 => 1.8667, std.dev.: 0.1000)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.07% (0.1024 => 0.1291, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 24.40% (1.4792 => 1.8401, std.dev.: 0.1117)
  MultiSource/Benchmarks/nbench/nbench: 23.30% (1.2484 => 1.5393, std.dev.: 0.0247)
  MultiSource/Applications/lua/lua: 22.86% (4.2242 => 5.1899, std.dev.: 0.2603)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.66% (1.2007 => 1.3887, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.89% (6.0284 => 6.9260, std.dev.: 0.0370)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.63% (24.6139 => 28.2148, std.dev.: 0.1288)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.31% (2.6492 => 3.0019, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.09% (1.3235 => 1.4967, std.dev.: 0.0352)
  MultiSource/Benchmarks/Prolangs-C/football/football: 12.90% (0.9828 => 1.1096, std.dev.: 0.0281)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.65% (1.9476 => 2.1940, std.dev.: 0.0158)
  MultiSource/Applications/sqlite3/sqlite3: 12.57% (16.2888 => 18.3368, std.dev.: 0.4347)
  MultiSource/Applications/kimwitu++/kc: 12.53% (18.3608 => 20.6608, std.dev.: 0.2670)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.66% (1.2086 => 1.3495, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 11.28% (1.3514 => 1.5038, std.dev.: 0.0495)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.03% (0.8802 => 0.9773, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.97% (1.2152 => 1.3485, std.dev.: 0.0414)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.61% (1.6047 => 1.7750, std.dev.: 0.0539)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.55% (1.2695 => 1.4034, std.dev.: 0.0137)
  MultiSource/Applications/lemon/lemon: 10.28% (1.1862 => 1.3081, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.27% (1.2550 => 1.3839, std.dev.: 0.0475)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.45% (1.4304 => 1.5370, std.dev.: 0.0209)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.04% (0.2956 => 0.3164, std.dev.: 0.0068)
  SingleSource/UnitTests/Vector/constpool: 2.87% (8.8921 => 9.1470, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.27% (1.3498 => 1.3805, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 111.11% (0.1377 => 0.2907, std.dev.: 0.0136)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 75.44% (0.7410 => 1.3000, std.dev.: 0.0907)
  MultiSource/Benchmarks/Olden/bisort/bisort: 53.41% (0.6647 => 1.0197, std.dev.: 0.0197)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 48.85% (4.5479 => 6.7697, std.dev.: 0.0595)
  MultiSource/Applications/minisat/minisat: 38.91% (6.2760 => 8.7180, std.dev.: 0.3941)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 32.97% (1.3143 => 1.7476, std.dev.: 0.0293)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.12% (1.4830 => 1.8852, std.dev.: 0.0379)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.85% (0.3401 => 0.4144, std.dev.: 0.0150)
  MultiSource/Benchmarks/McCat/08-main/main: 19.66% (0.0763 => 0.0913, std.dev.: 0.0035)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.07% (1.3008 => 1.5228, std.dev.: 0.0526)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.10% (2.1111 => 2.4088, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.00% (21.5217 => 24.1045, std.dev.: 0.8170)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.93% (1.1075 => 1.2396, std.dev.: 0.0069)
  MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (1.5553 => 1.7399, std.dev.: 0.0383)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.66% (4.9428 => 5.4696, std.dev.: 0.0233)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.18% (6.1088 => 6.6697, std.dev.: 0.1032)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.88% (2.3365 => 2.4972, std.dev.: 0.0223)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.29% (3.9691 => 4.2189, std.dev.: 0.0490)
  MultiSource/Applications/sqlite3/sqlite3: 5.99% (4.2733 => 4.5291, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.95% (5.9061 => 6.1985, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.54% (4.5744 => 4.7822, std.dev.: 0.0105)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.03% (5.3716 => 5.5883, std.dev.: 0.0435)
  MultiSource/Applications/lua/lua: 3.75% (29.5202 => 30.6267, std.dev.: 0.1128)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (96.7834 => 100.3819, std.dev.: 1.1607)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.29% (5.6951 => 5.8826, std.dev.: 0.0121)
  SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3703 => 7.5514, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.25% (5.0196 => 5.1326, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.56% (3.9552 => 4.0170, std.dev.: 0.0104)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.1013 => 1.1152, std.dev.: 0.0039)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.12% (1.1923 => 1.2056, std.dev.: 0.0024)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.90% (0.1483 => 0.1173, std.dev.: 0.0026)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.63% (0.1348 => 0.1370, std.dev.: 0.0159)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 60.53% (0.6617 => 1.0622, std.dev.: 0.0179)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 49.06% (0.1015 => 0.1513, std.dev.: 0.0165)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 47.22% (0.0504 => 0.0742, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 44.52% (0.0849 => 0.1227, std.dev.: 0.0135)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 42.81% (1.1393 => 1.6270, std.dev.: 0.0336)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 42.48% (1.0935 => 1.5580, std.dev.: 0.0521)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 41.08% (0.5609 => 0.7913, std.dev.: 0.0614)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 40.73% (0.7037 => 0.9903, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/tsp/tsp: 39.55% (0.1297 => 0.1810, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 39.16% (0.8667 => 1.2061, std.dev.: 0.0668)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 36.84% (0.9212 => 1.2606, std.dev.: 0.0689)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 33.79% (0.3374 => 0.4514, std.dev.: 0.0084)
  MultiSource/Benchmarks/MallocBench/gs/gs: 32.83% (4.5883 => 6.0945, std.dev.: 0.2919)
  MultiSource/Benchmarks/Olden/health/health: 32.38% (0.1507 => 0.1995, std.dev.: 0.0076)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 30.56% (0.6868 => 0.8967, std.dev.: 0.0403)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 28.03% (9.7354 => 12.4640, std.dev.: 0.3887)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 26.59% (1.4746 => 1.8667, std.dev.: 0.1000)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 26.07% (0.1024 => 0.1291, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 24.40% (1.4792 => 1.8401, std.dev.: 0.1117)
  MultiSource/Benchmarks/nbench/nbench: 23.30% (1.2484 => 1.5393, std.dev.: 0.0247)
  MultiSource/Applications/lua/lua: 22.86% (4.2242 => 5.1899, std.dev.: 0.2603)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.66% (1.2007 => 1.3887, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.89% (6.0284 => 6.9260, std.dev.: 0.0370)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.63% (24.6139 => 28.2148, std.dev.: 0.1288)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 13.31% (2.6492 => 3.0019, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.09% (1.3235 => 1.4967, std.dev.: 0.0352)
  MultiSource/Benchmarks/Prolangs-C/football/football: 12.90% (0.9828 => 1.1096, std.dev.: 0.0281)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 12.65% (1.9476 => 2.1940, std.dev.: 0.0158)
  MultiSource/Applications/sqlite3/sqlite3: 12.57% (16.2888 => 18.3368, std.dev.: 0.4347)
  MultiSource/Applications/kimwitu++/kc: 12.53% (18.3608 => 20.6608, std.dev.: 0.2670)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.66% (1.2086 => 1.3495, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 11.28% (1.3514 => 1.5038, std.dev.: 0.0495)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.03% (0.8802 => 0.9773, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.97% (1.2152 => 1.3485, std.dev.: 0.0414)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.61% (1.6047 => 1.7750, std.dev.: 0.0539)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 10.55% (1.2695 => 1.4034, std.dev.: 0.0137)
  MultiSource/Applications/lemon/lemon: 10.28% (1.1862 => 1.3081, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.27% (1.2550 => 1.3839, std.dev.: 0.0475)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.45% (1.4304 => 1.5370, std.dev.: 0.0209)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.04% (0.2956 => 0.3164, std.dev.: 0.0068)
  SingleSource/UnitTests/Vector/constpool: 2.87% (8.8921 => 9.1470, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.27% (1.3498 => 1.3805, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 111.11% (0.1377 => 0.2907, std.dev.: 0.0136)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 75.44% (0.7410 => 1.3000, std.dev.: 0.0907)
  MultiSource/Benchmarks/Olden/bisort/bisort: 53.41% (0.6647 => 1.0197, std.dev.: 0.0197)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 48.85% (4.5479 => 6.7697, std.dev.: 0.0595)
  MultiSource/Applications/minisat/minisat: 38.91% (6.2760 => 8.7180, std.dev.: 0.3941)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 32.97% (1.3143 => 1.7476, std.dev.: 0.0293)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.12% (1.4830 => 1.8852, std.dev.: 0.0379)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.85% (0.3401 => 0.4144, std.dev.: 0.0150)
  MultiSource/Benchmarks/McCat/08-main/main: 19.66% (0.0763 => 0.0913, std.dev.: 0.0035)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.07% (1.3008 => 1.5228, std.dev.: 0.0526)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.10% (2.1111 => 2.4088, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.00% (21.5217 => 24.1045, std.dev.: 0.8170)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.93% (1.1075 => 1.2396, std.dev.: 0.0069)
  MultiSource/Benchmarks/Olden/tsp/tsp: 11.87% (1.5553 => 1.7399, std.dev.: 0.0383)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.66% (4.9428 => 5.4696, std.dev.: 0.0233)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.18% (6.1088 => 6.6697, std.dev.: 0.1032)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.88% (2.3365 => 2.4972, std.dev.: 0.0223)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.29% (3.9691 => 4.2189, std.dev.: 0.0490)
  MultiSource/Applications/sqlite3/sqlite3: 5.99% (4.2733 => 4.5291, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.95% (5.9061 => 6.1985, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.54% (4.5744 => 4.7822, std.dev.: 0.0105)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.03% (5.3716 => 5.5883, std.dev.: 0.0435)
  MultiSource/Applications/lua/lua: 3.75% (29.5202 => 30.6267, std.dev.: 0.1128)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.72% (96.7834 => 100.3819, std.dev.: 1.1607)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.29% (5.6951 => 5.8826, std.dev.: 0.0121)
  SingleSource/Benchmarks/Shootout/lists: 2.46% (7.3703 => 7.5514, std.dev.: 0.0371)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.25% (5.0196 => 5.1326, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.56% (3.9552 => 4.0170, std.dev.: 0.0104)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.26% (1.1013 => 1.1152, std.dev.: 0.0039)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.12% (1.1923 => 1.2056, std.dev.: 0.0024)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.90% (0.1483 => 0.1173, std.dev.: 0.0026)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.63% (0.1348 => 0.1370, std.dev.: 0.0159)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130911/717de2da/attachment.html>


More information about the llvm-testresults mailing list