[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 24 16:58:32 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11723?compare_to=11721&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11723, Order: 182674, Start Time: 2013-05-24 22:06:46, End Time: 2013-05-24 23:59:00
      To: 11721, Order: 182660, Start Time: 2013-05-24 19:54:52, End Time: 2013-05-24 21:44:17
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 72 (58 on baseline)
Performance Improvements: 0 (6 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1035 (1043 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 66.01% (0.0153 => 0.0254, std.dev.: 0.0008)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 62.19% (0.0201 => 0.0326, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 61.65% (0.0266 => 0.0430, std.dev.: 0.0008)
  SingleSource/UnitTests/initp1: 59.80% (0.0500 => 0.0799, std.dev.: 0.0032)
  MultiSource/Benchmarks/NPB-serial/is/is: 55.34% (0.0862 => 0.1339, std.dev.: 0.0050)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.62% (0.0736 => 0.1138, std.dev.: 0.0072)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 53.57% (0.0196 => 0.0301, std.dev.: 0.0011)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 52.91% (0.0499 => 0.0763, std.dev.: 0.0040)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 34.87% (0.2277 => 0.3071, std.dev.: 0.0163)
  MultiSource/Applications/treecc/treecc: 34.07% (2.3049 => 3.0902, std.dev.: 0.0411)
  MultiSource/Applications/Burg/burg: 31.33% (1.4381 => 1.8886, std.dev.: 0.0308)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 28.99% (1.4294 => 1.8438, std.dev.: 0.1099)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 25.15% (4.9689 => 6.2186, std.dev.: 0.3164)
  MultiSource/Applications/spiff/spiff: 23.88% (0.9228 => 1.1432, std.dev.: 0.0662)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.67% (0.1006 => 0.1224, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.33% (4.6561 => 5.5563, std.dev.: 0.2714)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 16.53% (0.3461 => 0.4033, std.dev.: 0.0162)
  MultiSource/Applications/JM/lencod/lencod: 15.20% (16.8370 => 19.3960, std.dev.: 0.6611)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.74% (0.7010 => 0.7973, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/methcall: 12.40% (0.2210 => 0.2484, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.42% (1.3865 => 1.5449, std.dev.: 0.0297)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.70% (1.6358 => 1.8108, std.dev.: 0.0414)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 10.01% (9.9015 => 10.8924, std.dev.: 0.2131)
  SingleSource/Benchmarks/Shootout-C++/hello: 9.75% (0.1959 => 0.2150, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.74% (1.5060 => 1.6376, std.dev.: 0.0305)
  MultiSource/Applications/sqlite3/sqlite3: 8.72% (16.7874 => 18.2516, std.dev.: 0.1067)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.94% (1.5207 => 1.6414, std.dev.: 0.0082)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.14% (4.1856 => 4.4844, std.dev.: 0.0130)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.03% (1.1262 => 1.2054, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.43% (1.6074 => 1.7107, std.dev.: 0.0163)
  MultiSource/Applications/kimwitu++/kc: 5.97% (19.1760 => 20.3210, std.dev.: 0.0916)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.95% (1.4240 => 1.5087, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.73% (1.4795 => 1.5643, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.73% (1.4262 => 1.5079, std.dev.: 0.0156)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 5.63% (1.6401 => 1.7324, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.21% (0.2113 => 0.2223, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.00% (1.4627 => 1.5358, std.dev.: 0.0212)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.24% (0.3492 => 0.3640, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.15% (1.6959 => 1.7662, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.29% (0.7023 => 0.7254, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 81.31% (0.0214 => 0.0388, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 71.53% (0.0439 => 0.0753, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 58.64% (2.8954 => 4.5932, std.dev.: 0.2988)
  SingleSource/Benchmarks/Shootout/ary3: 49.97% (5.7870 => 8.6790, std.dev.: 1.0341)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 46.40% (0.7465 => 1.0929, std.dev.: 0.1045)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 37.61% (1.4983 => 2.0618, std.dev.: 0.0495)
  MultiSource/Applications/JM/ldecod/ldecod: 36.07% (0.0707 => 0.0962, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/ary: 27.10% (0.0631 => 0.0802, std.dev.: 0.0015)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 21.26% (4.0332 => 4.8908, std.dev.: 0.1140)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 18.73% (2.5602 => 3.0398, std.dev.: 0.1848)
  MultiSource/Applications/SPASS/SPASS: 15.38% (8.6021 => 9.9255, std.dev.: 0.4210)
  SingleSource/Benchmarks/Shootout-C++/lists1: 12.23% (0.6052 => 0.6792, std.dev.: 0.0142)
  SingleSource/Benchmarks/Shootout-C++/moments: 12.20% (0.1008 => 0.1131, std.dev.: 0.0041)
  MultiSource/Benchmarks/nbench/nbench: 9.50% (19.6374 => 21.5023, std.dev.: 0.3209)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.56% (2.9901 => 3.2462, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.47% (2.0188 => 2.1494, std.dev.: 0.0414)
  MultiSource/Benchmarks/Bullet/bullet: 5.60% (7.0495 => 7.4446, std.dev.: 0.0474)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.03% (60.9370 => 64.0027, std.dev.: 0.2166)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.31% (3.0027 => 3.1322, std.dev.: 0.0445)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.80% (40.6681 => 42.2153, std.dev.: 0.5749)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.20% (5.1837 => 5.3497, std.dev.: 0.0151)
  MultiSource/Applications/lua/lua: 3.11% (27.8636 => 28.7308, std.dev.: 0.0843)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.97% (4.5886 => 4.7249, std.dev.: 0.0320)
  SingleSource/Benchmarks/Shootout/methcall: 2.16% (8.2918 => 8.4711, std.dev.: 0.0232)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.10% (5.5153 => 5.6310, std.dev.: 0.0172)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 2.06% (1.8687 => 1.9072, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.47% (1.6353 => 1.6593, std.dev.: 0.0089)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.30% (1.0983 => 1.1126, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/tsp/tsp: 1.17% (1.6029 => 1.6217, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.15% (16.4352 => 16.6244, std.dev.: 0.0696)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.09% (4.0333 => 4.0773, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout/fib2: 1.05% (4.9055 => 4.9569, std.dev.: 0.0137)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.83% (0.1420 => 0.1446, std.dev.: 0.0288)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-08-19-CodegenBug: 59.02% (0.0205 => 0.0326, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 57.51% (0.0273 => 0.0430, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 56.75% (0.0726 => 0.1138, std.dev.: 0.0072)
  SingleSource/UnitTests/initp1: 53.95% (0.0519 => 0.0799, std.dev.: 0.0032)
  MultiSource/Benchmarks/NPB-serial/is/is: 53.03% (0.0875 => 0.1339, std.dev.: 0.0050)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 52.02% (0.0198 => 0.0301, std.dev.: 0.0011)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 48.16% (0.0515 => 0.0763, std.dev.: 0.0040)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 37.59% (0.2232 => 0.3071, std.dev.: 0.0163)
  MultiSource/Applications/treecc/treecc: 32.99% (2.3237 => 3.0902, std.dev.: 0.0411)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 29.94% (0.0942 => 0.1224, std.dev.: 0.0036)
  MultiSource/Applications/Burg/burg: 22.84% (1.5375 => 1.8886, std.dev.: 0.0308)
  MultiSource/Applications/spiff/spiff: 22.07% (0.9365 => 1.1432, std.dev.: 0.0662)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 18.27% (0.3410 => 0.4033, std.dev.: 0.0162)
  SingleSource/Benchmarks/Shootout-C++/methcall: 13.17% (0.2195 => 0.2484, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.64% (1.3838 => 1.5449, std.dev.: 0.0297)
  SingleSource/Benchmarks/Shootout-C++/hello: 11.17% (0.1934 => 0.2150, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 9.32% (1.5014 => 1.6414, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.24% (1.4991 => 1.6376, std.dev.: 0.0305)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 9.22% (1.5862 => 1.7324, std.dev.: 0.0187)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 7.69% (1.1193 => 1.2054, std.dev.: 0.0256)
  MultiSource/Applications/sqlite3/sqlite3: 7.54% (16.9719 => 18.2516, std.dev.: 0.1067)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.45% (4.1734 => 4.4844, std.dev.: 0.0130)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 7.21% (10.1602 => 10.8924, std.dev.: 0.2131)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.19% (1.5959 => 1.7107, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.71% (1.4131 => 1.5079, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.51% (1.4165 => 1.5087, std.dev.: 0.0294)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.15% (0.3429 => 0.3640, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.00% (1.4757 => 1.5643, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.62% (1.3833 => 1.4472, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.97% (1.4771 => 1.5358, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.86% (1.7006 => 1.7662, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.86% (1.6563 => 1.7037, std.dev.: 0.0155)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.76% (0.7059 => 0.7254, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.46% (1.6993 => 1.7411, std.dev.: 0.0114)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 106.38% (0.0188 => 0.0388, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 61.94% (0.0465 => 0.0753, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/ary3: 44.36% (6.0122 => 8.6790, std.dev.: 1.0341)
  MultiSource/Applications/JM/ldecod/ldecod: 43.80% (0.0669 => 0.0962, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 31.23% (3.5000 => 4.5932, std.dev.: 0.2988)
  SingleSource/Benchmarks/Shootout-C++/ary: 26.70% (0.0633 => 0.0802, std.dev.: 0.0015)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 17.09% (4.1768 => 4.8908, std.dev.: 0.1140)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 12.72% (1.8291 => 2.0618, std.dev.: 0.0495)
  SingleSource/Benchmarks/Shootout-C++/moments: 11.65% (0.1013 => 0.1131, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/lists1: 11.40% (0.6097 => 0.6792, std.dev.: 0.0142)
  SingleSource/Benchmarks/Misc/pi: 8.05% (1.8318 => 1.9793, std.dev.: 0.0478)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.22% (2.0236 => 2.1494, std.dev.: 0.0414)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.25% (1.0571 => 1.1126, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.93% (40.6198 => 42.2153, std.dev.: 0.5749)
  MultiSource/Benchmarks/Bullet/bullet: 3.49% (7.1938 => 7.4446, std.dev.: 0.0474)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.88% (16.4665 => 16.9412, std.dev.: 0.1537)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.86% (4.5935 => 4.7249, std.dev.: 0.0320)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.67% (3.9713 => 4.0773, std.dev.: 0.0093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.51% (62.4345 => 64.0027, std.dev.: 0.2166)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 2.07% (6.1372 => 6.2643, std.dev.: 0.0278)
  MultiSource/Applications/siod/siod: 1.87% (3.7240 => 3.7936, std.dev.: 0.0230)
  MultiSource/Applications/lua/lua: 1.70% (28.2496 => 28.7308, std.dev.: 0.0843)
  SingleSource/Benchmarks/Shootout/methcall: 1.54% (8.3425 => 8.4711, std.dev.: 0.0232)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.26% (11.4990 => 11.6440, std.dev.: 0.0031)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: -13.13% (0.1097 => 0.0953, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.87% (0.2006 => 0.1828, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: -2.60% (4.6358 => 4.5155, std.dev.: 0.0341)
  MultiSource/Benchmarks/Olden/tsp/tsp: -2.38% (1.6613 => 1.6217, std.dev.: 0.0060)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.80% (5.7342 => 5.6310, std.dev.: 0.0172)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.35% (2.5408 => 2.5064, std.dev.: 0.0080)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.35% (0.1441 => 0.1446, std.dev.: 0.0288)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130524/59b8201a/attachment.html>


More information about the llvm-testresults mailing list