[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 30 11:35:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13928?compare_to=13924&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13928, Order: 187424, Start Time: 2013-07-30 16:53:14, End Time: 2013-07-30 18:37:25
      To: 13924, Order: 187419, Start Time: 2013-07-30 14:42:47, End Time: 2013-07-30 16:27:09
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 14 (30 on baseline)
Performance Improvements: 2 (88 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1091 (989 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 17.72% (4.6471 => 5.4707, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.14% (5.2400 => 5.9809, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.72% (0.3332 => 0.3556, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 6.67% (0.1888 => 0.2014, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 5.98% (4.8561 => 5.1467, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.80% (5.0090 => 5.2994, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.56% (0.8385 => 0.8851, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.24% (3.1000 => 3.2623, std.dev.: 0.0029)
  SingleSource/Benchmarks/McGill/misr: 4.94% (0.3641 => 0.3821, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.06% (4.0313 => 4.1949, std.dev.: 0.0507)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 2.50% (3.9503 => 4.0491, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.05% (2.9332 => 2.9932, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.82% (1.6297 => 1.6593, std.dev.: 0.0053)
  SingleSource/Benchmarks/McGill/queens: 1.26% (1.6646 => 1.6856, std.dev.: 0.0006)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.88% (5.0815 => 4.9859, std.dev.: 0.0327)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.00% (2.4755 => 2.4013, std.dev.: 0.0260)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1346 => 0.1345, std.dev.: 0.0024)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.63% (2.8867 => 4.2904, std.dev.: 0.0371)
  MultiSource/Benchmarks/FreeBench/neural/neural: 30.46% (0.3171 => 0.4137, std.dev.: 0.0175)
  SingleSource/Benchmarks/Shootout/hash: 25.45% (4.1846 => 5.2494, std.dev.: 0.0467)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 17.46% (4.6576 => 5.4707, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.52% (0.6295 => 0.7272, std.dev.: 0.0192)
  MultiSource/Applications/siod/siod: 13.94% (3.3761 => 3.8468, std.dev.: 0.0287)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.65% (7.0762 => 7.9716, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.22% (5.4910 => 5.9974, std.dev.: 0.0188)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (1.2557 => 1.3550, std.dev.: 0.0178)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.88% (48.3256 => 52.1315, std.dev.: 0.0588)
  SingleSource/Benchmarks/McGill/chomp: 7.48% (1.0051 => 1.0803, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4243, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.33% (3.0680 => 3.2623, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.00% (4.9995 => 5.2994, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.80% (5.3042 => 5.6119, std.dev.: 0.0147)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.75% (3.3877 => 3.5825, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.66% (3.4085 => 3.6014, std.dev.: 0.0513)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.51% (5.5008 => 5.8038, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.54% (4.9231 => 5.1467, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.28% (4.3151 => 4.4997, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3653, std.dev.: 0.0241)
  SingleSource/Benchmarks/McGill/misr: 4.00% (0.3674 => 0.3821, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.99% (3.3384 => 3.4717, std.dev.: 0.0357)
  SingleSource/Benchmarks/Misc/whetstone: 3.87% (3.4559 => 3.5896, std.dev.: 0.0150)
  SingleSource/Benchmarks/McGill/queens: 1.94% (1.6536 => 1.6856, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.73% (3.3464 => 3.4043, std.dev.: 0.0018)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.65% (1.4398 => 1.4635, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.58% (2.9467 => 2.9932, std.dev.: 0.0005)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.13% (1.1618 => 1.1749, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.03% (1.4813 => 1.4966, std.dev.: 0.0003)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -37.82% (0.2237 => 0.1391, std.dev.: 0.0064)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -30.61% (0.1114 => 0.0773, std.dev.: 0.0115)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -27.11% (0.0675 => 0.0492, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/health/health: -21.68% (0.1993 => 0.1561, std.dev.: 0.0161)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.26% (1.5228 => 1.1990, std.dev.: 0.0564)
  MultiSource/Applications/obsequi/Obsequi: -19.76% (1.4685 => 1.1783, std.dev.: 0.1013)
  MultiSource/Benchmarks/Olden/em3d/em3d: -16.65% (0.2367 => 0.1973, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.10% (0.0773 => 0.0664, std.dev.: 0.0022)
  MultiSource/Applications/hexxagon/hexxagon: -14.05% (1.3285 => 1.1418, std.dev.: 0.0663)
  MultiSource/Applications/sgefa/sgefa: -13.70% (0.4809 => 0.4150, std.dev.: 0.0153)
  MultiSource/Applications/ClamAV/clamscan: -12.96% (19.4145 => 16.8975, std.dev.: 0.7373)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.85% (0.7091 => 0.6180, std.dev.: 0.0307)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -12.78% (0.1870 => 0.1631, std.dev.: 0.0018)
  MultiSource/Applications/JM/ldecod/ldecod: -12.57% (8.6720 => 7.5822, std.dev.: 0.0356)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -12.09% (0.1141 => 0.1003, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -11.33% (1.1012 => 0.9764, std.dev.: 0.0105)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -11.19% (0.3073 => 0.2729, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -11.03% (0.3655 => 0.3252, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -8.55% (0.2432 => 0.2224, std.dev.: 0.0060)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -8.53% (0.2498 => 0.2285, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/bh/bh: -7.91% (0.3603 => 0.3318, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.85% (1.4853 => 1.3835, std.dev.: 0.0278)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.83% (2.6853 => 2.5020, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.65% (1.5361 => 1.4340, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -6.28% (1.4721 => 1.3796, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.25% (1.5815 => 1.4826, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.12% (1.6226 => 1.5233, std.dev.: 0.0271)
  MultiSource/Applications/oggenc/oggenc: -5.72% (6.1121 => 5.7624, std.dev.: 0.0326)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -5.66% (5.2851 => 4.9859, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.10% (1.4940 => 1.4178, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.90% (1.5479 => 1.4721, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.74% (1.4339 => 1.3659, std.dev.: 0.0245)
  MultiSource/Benchmarks/nbench/nbench: -4.57% (1.3677 => 1.3052, std.dev.: 0.0078)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -4.53% (0.3309 => 0.3159, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.53% (1.4783 => 1.4113, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.53% (1.5357 => 1.4661, std.dev.: 0.0112)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.36% (0.4153 => 0.3972, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.01% (0.7189 => 0.6901, std.dev.: 0.0077)
  MultiSource/Benchmarks/McCat/08-main/main: -3.95% (0.3039 => 0.2919, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/05-eks/eks: -3.51% (0.5634 => 0.5436, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -3.50% (1.6185 => 1.5619, std.dev.: 0.0153)
  MultiSource/Benchmarks/McCat/09-vor/vor: -3.49% (0.3670 => 0.3542, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.42% (1.3780 => 1.3309, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.37% (1.3946 => 1.3476, std.dev.: 0.0117)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.12% (1.6686 => 1.6166, std.dev.: 0.0181)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.79% (1.4932 => 1.4516, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.83% (1.9671 => 1.9311, std.dev.: 0.0134)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.68% (10.8541 => 10.6722, std.dev.: 0.0642)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.61% (7.7035 => 7.5792, std.dev.: 0.0436)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.71% (0.0816 => 0.0492, std.dev.: 0.0041)
  MultiSource/Applications/lemon/lemon: -38.69% (1.4194 => 0.8702, std.dev.: 0.2004)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.39% (2.1022 => 1.4213, std.dev.: 0.0078)
  MultiSource/Applications/viterbi/viterbi: -27.35% (3.4923 => 2.5373, std.dev.: 0.0140)
  MultiSource/Applications/JM/ldecod/ldecod: -24.80% (0.0859 => 0.0646, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6129, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/mandel: -14.18% (1.1996 => 1.0295, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -14.01% (6.9552 => 5.9809, std.dev.: 0.0000)
  MultiSource/Applications/sgefa/sgefa: -13.49% (1.4030 => 1.2138, std.dev.: 0.0109)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.74% (0.3557 => 0.3104, std.dev.: 0.0111)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.04% (2.6992 => 2.4013, std.dev.: 0.0260)
  MultiSource/Applications/SPASS/SPASS: -10.82% (9.2220 => 8.2238, std.dev.: 0.0730)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -9.53% (0.1542 => 0.1395, std.dev.: 0.0037)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.51% (3.9978 => 3.6177, std.dev.: 0.0105)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.50% (47.2250 => 42.7372, std.dev.: 1.0197)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.38% (3.5791 => 3.2435, std.dev.: 0.0520)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.32% (0.5173 => 0.4691, std.dev.: 0.0018)
  MultiSource/Applications/lua/lua: -8.17% (31.0707 => 28.5312, std.dev.: 0.7837)
  SingleSource/Regression/C/uint64_to_float: -5.85% (1.5184 => 1.4295, std.dev.: 0.0066)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.09% (0.3773 => 0.3581, std.dev.: 0.0047)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.95% (0.7355 => 0.6991, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.70% (3.8119 => 3.6327, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.28% (0.3479 => 0.3330, std.dev.: 0.0046)
  MultiSource/Benchmarks/Bullet/bullet: -4.24% (7.2995 => 6.9898, std.dev.: 0.0268)
  SingleSource/Benchmarks/Misc/fbench: -4.15% (4.9602 => 4.7545, std.dev.: 0.0131)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.89% (0.2854 => 0.2743, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.57% (1.7207 => 1.6593, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.55% (0.2813 => 0.2713, std.dev.: 0.0022)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.32% (21.6864 => 20.9654, std.dev.: 0.0762)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9626, std.dev.: 0.0485)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.91% (1.1024 => 1.0703, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.65% (5.2218 => 5.0832, std.dev.: 0.0272)
  MultiSource/Benchmarks/Olden/bh/bh: -2.45% (2.4879 => 2.4270, std.dev.: 0.0231)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.96% (29.8131 => 29.2288, std.dev.: 0.0226)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.92% (34.8438 => 34.1731, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.56% (5.8810 => 5.7891, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.56% (5.0180 => 4.9397, std.dev.: 0.0286)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.29% (1.6737 => 1.6521, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.19% (2.1343 => 2.1088, std.dev.: 0.0005)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.39% (0.1378 => 0.1345, std.dev.: 0.0024)

Report Time: 1.10s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130730/9a4e6617/attachment.html>


More information about the llvm-testresults mailing list