[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jul 26 10:53:12 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13792?compare_to=13788&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13792, Order: 187207, Start Time: 2013-07-26 16:04:09, End Time: 2013-07-26 17:54:51
      To: 13788, Order: 187199, Start Time: 2013-07-26 13:29:54, End Time: 2013-07-26 15:39:53
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 29 (39 on baseline)
Performance Improvements: 34 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1044 (1042 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/life/life: 66.70% (0.0958 => 0.1597, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 27.57% (1.6817 => 2.1454, std.dev.: 0.1023)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.61% (1.4462 => 1.8165, std.dev.: 0.1214)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.82% (0.3589 => 0.4408, std.dev.: 0.0217)
  MultiSource/Benchmarks/Bullet/bullet: 21.59% (35.9252 => 43.6825, std.dev.: 1.0726)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 20.99% (48.1992 => 58.3167, std.dev.: 0.6974)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.43% (26.0089 => 30.0227, std.dev.: 0.1560)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.17% (1.5965 => 1.8227, std.dev.: 0.0678)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.76% (1.3820 => 1.5721, std.dev.: 0.0444)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.29% (1.4211 => 1.6100, std.dev.: 0.0489)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.09% (1.3474 => 1.5238, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.58% (1.4726 => 1.6578, std.dev.: 0.0652)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.48% (1.3479 => 1.5161, std.dev.: 0.0417)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 12.08% (1.3639 => 1.5287, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 11.30% (1.4218 => 1.5824, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.14% (1.4062 => 1.5629, std.dev.: 0.0271)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.10% (1.4740 => 1.6376, std.dev.: 0.0343)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.96% (1.3975 => 1.5507, std.dev.: 0.0446)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.11% (1.3611 => 1.4987, std.dev.: 0.0389)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.81% (1.5435 => 1.6486, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.71% (1.4936 => 1.5192, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 116.48% (0.0091 => 0.0197, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 50.00% (0.0978 => 0.1467, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc/flops: 20.08% (8.2607 => 9.9197, std.dev.: 0.0265)
  MultiSource/Benchmarks/Bullet/bullet: 13.89% (7.0058 => 7.9789, std.dev.: 0.0285)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 13.72% (0.8312 => 0.9452, std.dev.: 0.0016)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.64% (91.6394 => 97.7238, std.dev.: 1.4587)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.04% (5.7624 => 5.8802, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.50% (5.0202 => 5.0955, std.dev.: 0.0114)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -44.33% (0.1358 => 0.0756, std.dev.: 0.0193)
  SingleSource/UnitTests/2002-05-02-ManyArguments: -38.83% (0.0291 => 0.0178, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -32.78% (0.4125 => 0.2773, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -30.63% (0.2328 => 0.1615, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/oourafft: -30.41% (0.3285 => 0.2286, std.dev.: 0.0140)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -26.77% (0.5410 => 0.3962, std.dev.: 0.0433)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -26.64% (0.1265 => 0.0928, std.dev.: 0.0114)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -24.81% (1.9590 => 1.4729, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -24.45% (0.6384 => 0.4823, std.dev.: 0.0281)
  SingleSource/Benchmarks/Misc/ffbench: -21.66% (0.1071 => 0.0839, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -21.44% (0.0984 => 0.0773, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -15.37% (1.1560 => 0.9783, std.dev.: 0.0421)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -15.27% (0.0871 => 0.0738, std.dev.: 0.0050)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.37% (8.9377 => 7.6532, std.dev.: 0.1235)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -13.91% (1.8008 => 1.5503, std.dev.: 0.0802)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -10.92% (0.1026 => 0.0914, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -8.88% (0.4098 => 0.3734, std.dev.: 0.0033)
  MultiSource/Applications/JM/lencod/lencod: -7.32% (18.6505 => 17.2860, std.dev.: 0.3891)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -7.13% (1.2713 => 1.1807, std.dev.: 0.0074)
  MultiSource/Applications/sgefa/sgefa: -2.80% (0.4293 => 0.4173, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: -42.64% (0.2005 => 0.1150, std.dev.: 0.0083)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -26.75% (0.0800 => 0.0586, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -26.07% (0.0675 => 0.0499, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -22.21% (3.0945 => 2.4073, std.dev.: 0.0996)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -17.63% (73.7560 => 60.7554, std.dev.: 4.2427)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -17.16% (4.8017 => 3.9779, std.dev.: 0.2440)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -15.95% (44.8665 => 37.7100, std.dev.: 2.2201)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -12.01% (0.3846 => 0.3384, std.dev.: 0.0079)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -11.90% (0.1387 => 0.1222, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.63% (0.3076 => 0.2749, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -6.61% (1.5270 => 1.4261, std.dev.: 0.0249)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -6.03% (3.4522 => 3.2441, std.dev.: 0.0456)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -3.33% (0.5078 => 0.4909, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.26% (5.0120 => 4.9490, std.dev.: 0.0102)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.63% (0.1257 => 0.1290, std.dev.: 0.0128)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/life/life: 67.23% (0.0955 => 0.1597, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 28.91% (1.6643 => 2.1454, std.dev.: 0.1023)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 22.31% (0.3604 => 0.4408, std.dev.: 0.0217)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.71% (49.1253 => 58.3167, std.dev.: 0.6974)
  MultiSource/Benchmarks/Bullet/bullet: 16.53% (37.4863 => 43.6825, std.dev.: 1.0726)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.69% (1.3993 => 1.5629, std.dev.: 0.0271)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 11.64% (1.3649 => 1.5238, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.57% (1.3952 => 1.5287, std.dev.: 0.0308)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.61% (27.6418 => 30.0227, std.dev.: 0.1560)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.38% (1.4506 => 1.5721, std.dev.: 0.0444)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.35% (1.5357 => 1.6486, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.08% (1.5437 => 1.6376, std.dev.: 0.0343)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.49% (1.5144 => 1.5824, std.dev.: 0.0127)
  SingleSource/UnitTests/Vector/constpool: 3.90% (8.8630 => 9.2087, std.dev.: 0.0768)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 109.57% (0.0094 => 0.0197, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 52.49% (0.0962 => 0.1467, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2881, std.dev.: 0.0358)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.95% (0.0341 => 0.0467, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/neural/neural: 24.94% (0.3171 => 0.3962, std.dev.: 0.0103)
  MultiSource/Applications/siod/siod: 13.55% (3.3761 => 3.8335, std.dev.: 0.0777)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.42% (14.9584 => 16.6668, std.dev.: 0.3604)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 10.01% (0.1348 => 0.1483, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.75% (5.4910 => 6.0265, std.dev.: 0.0271)
  MultiSource/Benchmarks/Bullet/bullet: 9.31% (7.2995 => 7.9789, std.dev.: 0.0285)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.07% (3.4085 => 3.6496, std.dev.: 0.0567)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.01% (3.2027 => 3.4272, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.96% (5.5008 => 5.8835, std.dev.: 0.0978)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.41% (5.3042 => 5.6440, std.dev.: 0.1242)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.87% (0.8928 => 0.9452, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.12% (5.1471 => 5.4108, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.33% (4.3151 => 4.5020, std.dev.: 0.0092)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.32% (93.6732 => 97.7238, std.dev.: 1.4587)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.26% (4.8739 => 5.0813, std.dev.: 0.0622)
  SingleSource/Benchmarks/Shootout/matrix: 2.61% (1.7358 => 1.7811, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.92% (4.9995 => 5.0955, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.89% (3.3464 => 3.4097, std.dev.: 0.0209)
  SingleSource/Benchmarks/Misc/flops: 1.57% (9.7664 => 9.9197, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.08% (4.9040 => 4.9569, std.dev.: 0.0138)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.21% (0.1072 => 0.0716, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -13.64% (0.1870 => 0.1615, std.dev.: 0.0024)
  MultiSource/Applications/sgefa/sgefa: -13.23% (0.4809 => 0.4173, std.dev.: 0.0040)
  MultiSource/Applications/JM/ldecod/ldecod: -12.06% (8.6720 => 7.6265, std.dev.: 0.1367)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.42% (1.1012 => 0.9864, std.dev.: 0.0266)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.76% (0.3073 => 0.2773, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.30% (0.3655 => 0.3315, std.dev.: 0.0008)
  MultiSource/Applications/Burg/burg: -7.09% (1.5733 => 1.4617, std.dev.: 0.0230)
  MultiSource/Applications/JM/lencod/lencod: -6.58% (18.5029 => 17.2860, std.dev.: 0.3891)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.67% (0.7189 => 0.6925, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.85% (1.5479 => 1.5192, std.dev.: 0.0030)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.36% (1.4932 => 1.4729, std.dev.: 0.0068)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.18% (2.1022 => 1.4257, std.dev.: 0.0310)
  MultiSource/Applications/JM/ldecod/ldecod: -24.56% (0.0859 => 0.0648, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.45% (6.9552 => 5.2548, std.dev.: 0.3412)
  MultiSource/Applications/sgefa/sgefa: -13.39% (1.4030 => 1.2152, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.95% (6.2627 => 5.4517, std.dev.: 0.1054)
  MultiSource/Applications/SPASS/SPASS: -12.02% (9.2220 => 8.1134, std.dev.: 0.3921)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -10.81% (2.6992 => 2.4073, std.dev.: 0.0996)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.13% (1.7207 => 1.6324, std.dev.: 0.0219)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.10% (0.5173 => 0.4909, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.75% (3.8119 => 3.6309, std.dev.: 0.0217)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.44% (47.2250 => 45.1303, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.13% (6.1482 => 6.0170, std.dev.: 0.0467)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.28% (5.8810 => 5.8055, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/oourafft: -1.18% (3.7891 => 3.7442, std.dev.: 0.0039)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.39% (0.1378 => 0.1290, std.dev.: 0.0128)

Report Time: 1.54s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130726/d471cb9e/attachment.html>


More information about the llvm-testresults mailing list