[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 13 08:01:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14367?compare_to=14363&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14367, Order: 188260, Start Time: 2013-08-13 13:09:17, End Time: 2013-08-13 15:03:25
      To: 14363, Order: 188259, Start Time: 2013-08-13 11:04:06, End Time: 2013-08-13 12:48:08
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 45 (59 on baseline)
Performance Improvements: 2 (25 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1060 (1023 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 59.72% (0.0787 => 0.1257, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 44.53% (1.0030 => 1.4496, std.dev.: 0.1041)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 44.31% (0.3275 => 0.4726, std.dev.: 0.0261)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 42.41% (0.1719 => 0.2448, std.dev.: 0.0274)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 34.95% (0.6212 => 0.8383, std.dev.: 0.0510)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 31.17% (1.4982 => 1.9652, std.dev.: 0.0610)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 28.62% (0.7349 => 0.9452, std.dev.: 0.0260)
  SingleSource/Benchmarks/SmallPT/smallpt: 27.91% (0.1437 => 0.1838, std.dev.: 0.0124)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 20.02% (0.0984 => 0.1181, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 18.71% (4.7940 => 5.6908, std.dev.: 0.3020)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.59% (15.2563 => 18.0928, std.dev.: 0.3328)
  MultiSource/Applications/SPASS/SPASS: 15.09% (17.0927 => 19.6721, std.dev.: 0.5276)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 13.32% (1.5816 => 1.7922, std.dev.: 0.0396)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 13.00% (0.0908 => 0.1026, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 12.52% (1.4854 => 1.6714, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 12.48% (1.4996 => 1.6867, std.dev.: 0.0416)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 11.80% (1.4425 => 1.6127, std.dev.: 0.0545)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 11.79% (1.4015 => 1.5667, std.dev.: 0.0522)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 11.58% (1.4312 => 1.5970, std.dev.: 0.0201)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 11.10% (0.6985 => 0.7760, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.07% (1.4531 => 1.6139, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 10.92% (1.4917 => 1.6546, std.dev.: 0.0483)
  MultiSource/Applications/minisat/minisat: 10.86% (0.7858 => 0.8711, std.dev.: 0.0108)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.47% (0.5311 => 0.5814, std.dev.: 0.0078)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.73% (2.5133 => 2.7328, std.dev.: 0.0770)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 1050.00% (0.0010 => 0.0115, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/pi: 51.96% (1.6466 => 2.5021, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.82% (1.4868 => 1.8856, std.dev.: 0.0068)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.41% (2.5593 => 3.2352, std.dev.: 0.1163)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 24.86% (0.3145 => 0.3927, std.dev.: 0.0116)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 15.93% (60.9060 => 70.6071, std.dev.: 3.1166)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 11.20% (2.9746 => 3.3078, std.dev.: 0.0684)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.16% (4.1242 => 4.5431, std.dev.: 0.1417)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.32% (4.7661 => 5.1625, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.74% (4.9991 => 5.3361, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc/salsa20: 6.35% (8.2316 => 8.7543, std.dev.: 0.1158)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.93% (39.9624 => 42.3309, std.dev.: 0.2447)
  SingleSource/Benchmarks/Misc/flops: 4.54% (9.4103 => 9.8376, std.dev.: 0.0198)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.37% (4.0289 => 4.2048, std.dev.: 0.0477)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.58% (1.5900 => 1.6470, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.55% (12.8089 => 13.2637, std.dev.: 0.0129)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.10% (2.8189 => 2.9062, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.47% (3.7378 => 3.8302, std.dev.: 0.0149)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.15% (5.5638 => 5.6832, std.dev.: 0.0356)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.12% (12.2117 => 12.3485, std.dev.: 0.0384)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.81% (46.4478 => 44.6784, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.66% (3.5576 => 3.4629, std.dev.: 0.0296)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.05% (0.1318 => 0.1345, std.dev.: 0.0232)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 62.40% (0.0774 => 0.1257, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.64% (1.1012 => 1.4496, std.dev.: 0.1041)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 31.61% (1.4932 => 1.9652, std.dev.: 0.0610)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 31.39% (0.7194 => 0.9452, std.dev.: 0.0260)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 29.30% (0.3655 => 0.4726, std.dev.: 0.0261)
  SingleSource/Benchmarks/SmallPT/smallpt: 24.27% (0.1479 => 0.1838, std.dev.: 0.0124)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.28% (4.7710 => 5.6908, std.dev.: 0.3020)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.33% (0.1033 => 0.1212, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 16.35% (15.5498 => 18.0928, std.dev.: 0.3328)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 10.89% (0.3546 => 0.3932, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 10.73% (1.6185 => 1.7922, std.dev.: 0.0396)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.86% (0.5292 => 0.5814, std.dev.: 0.0078)
  MultiSource/Applications/SPASS/SPASS: 9.83% (17.9111 => 19.6721, std.dev.: 0.5276)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 9.41% (1.5416 => 1.6867, std.dev.: 0.0416)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 6.94% (1.5629 => 1.6714, std.dev.: 0.0153)
  MultiSource/Applications/minisat/minisat: 5.23% (0.8278 => 0.8711, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.80% (1.5239 => 1.5970, std.dev.: 0.0201)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.16% (3.7285 => 6.4562, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.84% (2.8867 => 4.3255, std.dev.: 0.1267)
  MultiSource/Benchmarks/FreeBench/neural/neural: 30.43% (0.3171 => 0.4136, std.dev.: 0.0287)
  SingleSource/Benchmarks/Shootout/hash: 27.24% (4.1846 => 5.3243, std.dev.: 0.2849)
  SingleSource/Benchmarks/Misc/pi: 26.15% (1.9835 => 2.5021, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.46% (1.5030 => 1.8856, std.dev.: 0.0068)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 23.98% (2.6094 => 3.2352, std.dev.: 0.1163)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 23.76% (0.0526 => 0.0651, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 23.76% (0.3173 => 0.3927, std.dev.: 0.0116)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 17.00% (60.3477 => 70.6071, std.dev.: 3.1166)
  SingleSource/Benchmarks/Shootout/nestedloop: 16.86% (0.1364 => 0.1594, std.dev.: 0.0075)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.00% (7.0762 => 7.8549, std.dev.: 0.0382)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 10.40% (2.9962 => 3.3078, std.dev.: 0.0684)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.62% (5.4910 => 6.0191, std.dev.: 0.1590)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.1678 => 0.1838, std.dev.: 0.0013)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.19% (14.9584 => 16.3332, std.dev.: 0.4241)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 8.94% (3.2027 => 3.4890, std.dev.: 0.0443)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3611, std.dev.: 0.0012)
  MultiSource/Applications/JM/lencod/lencod: 8.03% (7.1799 => 7.7562, std.dev.: 0.1710)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.02% (48.3256 => 51.7190, std.dev.: 0.3079)
  MultiSource/Applications/siod/siod: 6.50% (3.3761 => 3.5956, std.dev.: 0.0202)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.25% (0.2799 => 0.2974, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.07% (5.3042 => 5.6259, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.54% (5.5008 => 5.8058, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.32% (4.3151 => 4.5014, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3651, std.dev.: 0.0695)
  SingleSource/Benchmarks/Misc/whetstone: 4.12% (3.4559 => 3.5983, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.73% (3.3384 => 3.4629, std.dev.: 0.0296)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.22% (25.0200 => 25.8268, std.dev.: 0.0625)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 3.22% (1.5956 => 1.6470, std.dev.: 0.0163)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 3.22% (2.8156 => 2.9062, std.dev.: 0.0062)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.19% (41.0210 => 42.3309, std.dev.: 0.2447)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.16% (3.3877 => 3.4949, std.dev.: 0.0282)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.12% (12.8625 => 13.2637, std.dev.: 0.0129)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.78% (3.5351 => 3.6335, std.dev.: 0.0376)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.72% (1.3104 => 1.3460, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.29% (3.3464 => 3.4231, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.89% (3.7593 => 3.8302, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.66% (4.9040 => 4.9855, std.dev.: 0.0087)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.45% (1.1618 => 1.1786, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.16% (4.9089 => 4.9659, std.dev.: 0.0190)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.09% (1.4813 => 1.4975, std.dev.: 0.0023)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.14% (0.1947 => 0.1808, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.55% (1.4514 => 1.3564, std.dev.: 0.0102)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.16% (6.1631 => 5.7837, std.dev.: 0.1335)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -34.47% (1.4194 => 0.9302, std.dev.: 0.1137)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.05% (2.1022 => 1.4284, std.dev.: 0.0183)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.10% (0.1189 => 0.0843, std.dev.: 0.0026)
  MultiSource/Applications/viterbi/viterbi: -26.42% (3.4923 => 2.5695, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.62% (6.9552 => 5.2428, std.dev.: 0.1519)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6169, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/mandel: -13.95% (1.1996 => 1.0323, std.dev.: 0.0121)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.56% (0.0884 => 0.0773, std.dev.: 0.0041)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.39% (47.2250 => 44.6784, std.dev.: 0.0383)
  SingleSource/Benchmarks/Misc/fbench: -4.54% (4.9602 => 4.7348, std.dev.: 0.0096)
  SingleSource/Regression/C/uint64_to_float: -4.45% (1.5184 => 1.4509, std.dev.: 0.0245)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.06% (1.1032 => 1.0584, std.dev.: 0.0018)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.01% (0.7355 => 0.7060, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.47% (3.8119 => 3.6797, std.dev.: 0.0228)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -3.37% (1.1024 => 1.0653, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.01% (6.1482 => 5.9630, std.dev.: 0.0195)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.81% (0.5097 => 0.4954, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.79% (6.0444 => 5.8759, std.dev.: 0.0092)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.71% (2.7049 => 2.6316, std.dev.: 0.0209)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.57% (0.7806 => 0.7605, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.20% (8.6172 => 8.4275, std.dev.: 0.0629)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1399, std.dev.: 0.0957)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.39% (0.1378 => 0.1345, std.dev.: 0.0232)

Report Time: 1.01s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130813/0f870aed/attachment.html>


More information about the llvm-testresults mailing list