[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 13 12:38:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14374?compare_to=14371&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14374, Order: 188293, Start Time: 2013-08-13 17:47:26, End Time: 2013-08-13 19:40:29
      To: 14371, Order: 188271, Start Time: 2013-08-13 15:28:18, End Time: 2013-08-13 17:23:36
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 27 (56 on baseline)
Performance Improvements: 16 (22 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1064 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 48.90% (0.2638 => 0.3928, std.dev.: 0.0406)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 47.88% (0.0850 => 0.1257, std.dev.: 0.0060)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 36.95% (0.9579 => 1.3118, std.dev.: 0.1166)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 35.88% (0.0549 => 0.0746, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 35.85% (0.8044 => 1.0928, std.dev.: 0.0660)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.84% (0.1790 => 0.2342, std.dev.: 0.0201)
  MultiSource/Benchmarks/McCat/08-main/main: 30.49% (0.3050 => 0.3980, std.dev.: 0.0263)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.88% (5.8091 => 7.5449, std.dev.: 0.1850)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 27.37% (0.1695 => 0.2159, std.dev.: 0.0132)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 22.94% (0.1046 => 0.1286, std.dev.: 0.0066)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 16.23% (0.4424 => 0.5142, std.dev.: 0.0087)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 14.92% (0.1119 => 0.1286, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 12.64% (1.6901 => 1.9037, std.dev.: 0.0367)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.31% (29.3131 => 29.9898, std.dev.: 0.1365)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 76.31% (0.7652 => 1.3491, std.dev.: 0.0646)
  MultiSource/Benchmarks/McCat/09-vor/vor: 58.12% (0.1225 => 0.1937, std.dev.: 0.0056)
  MultiSource/Benchmarks/Olden/bisort/bisort: 48.35% (0.7161 => 1.0623, std.dev.: 0.0834)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.28% (0.1832 => 0.2460, std.dev.: 0.0065)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 28.70% (0.0777 => 0.1000, std.dev.: 0.0037)
  MultiSource/Benchmarks/FreeBench/distray/distray: 21.01% (0.2347 => 0.2840, std.dev.: 0.0058)
  MultiSource/Benchmarks/llubenchmark/llu: 20.56% (2.0038 => 2.4157, std.dev.: 0.0299)
  MultiSource/Applications/obsequi/Obsequi: 20.35% (2.1268 => 2.5596, std.dev.: 0.0078)
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.92% (1.6209 => 1.7655, std.dev.: 0.0170)
  MultiSource/Benchmarks/Bullet/bullet: 8.47% (7.2000 => 7.8095, std.dev.: 0.0681)
  MultiSource/Benchmarks/Olden/bh/bh: 5.85% (2.4342 => 2.5765, std.dev.: 0.0350)
  MultiSource/Applications/lua/lua: 5.32% (29.8316 => 31.4191, std.dev.: 0.6155)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.21% (4.4198 => 4.4732, std.dev.: 0.0084)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: -36.41% (0.0390 => 0.0248, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/moments: -22.08% (0.5411 => 0.4216, std.dev.: 0.0243)
  SingleSource/Benchmarks/Stanford/RealMM: -19.06% (0.0577 => 0.0467, std.dev.: 0.0041)
  SingleSource/Benchmarks/Stanford/FloatMM: -18.01% (0.0572 => 0.0469, std.dev.: 0.0021)
  MultiSource/Applications/Burg/burg: -17.57% (1.7771 => 1.4648, std.dev.: 0.0801)
  SingleSource/Benchmarks/Shootout-C++/ary2: -12.33% (0.3391 => 0.2973, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout-C++/hash: -12.00% (0.5168 => 0.4548, std.dev.: 0.0189)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -45.81% (0.0334 => 0.0181, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/strcat: -31.55% (0.1176 => 0.0805, std.dev.: 0.0088)
  MultiSource/Applications/lemon/lemon: -30.99% (1.4135 => 0.9754, std.dev.: 0.1406)
  SingleSource/Benchmarks/Stanford/Puzzle: -21.11% (0.2354 => 0.1857, std.dev.: 0.0103)
  SingleSource/Benchmarks/Shootout-C++/ary: -15.29% (0.0713 => 0.0604, std.dev.: 0.0034)
  SingleSource/Benchmarks/Stanford/FloatMM: -4.50% (0.7934 => 0.7577, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/mandel-2: -4.37% (0.8784 => 0.8400, std.dev.: 0.0040)
  MultiSource/Benchmarks/sim/sim: -2.86% (4.0054 => 3.8910, std.dev.: 0.0168)
  SingleSource/Benchmarks/Misc/flops-5: -1.28% (2.8523 => 2.8157, std.dev.: 0.0064)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.45% (0.1412 => 0.1335, std.dev.: 0.0238)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 63.46% (0.0769 => 0.1257, std.dev.: 0.0060)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 51.90% (0.7194 => 1.0928, std.dev.: 0.0660)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 46.68% (0.2678 => 0.3928, std.dev.: 0.0406)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 42.39% (0.3508 => 0.4995, std.dev.: 0.0388)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 39.45% (0.9407 => 1.3118, std.dev.: 0.1166)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 32.89% (0.3934 => 0.5228, std.dev.: 0.0495)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 32.77% (0.3873 => 0.5142, std.dev.: 0.0087)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 32.05% (0.1635 => 0.2159, std.dev.: 0.0132)
  MultiSource/Benchmarks/McCat/08-main/main: 30.96% (0.3039 => 0.3980, std.dev.: 0.0263)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 28.54% (10.3031 => 13.2438, std.dev.: 0.6970)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 26.70% (0.1015 => 0.1286, std.dev.: 0.0066)
  MultiSource/Benchmarks/FreeBench/distray/distray: 24.39% (0.1033 => 0.1285, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.47% (1.5544 => 1.9037, std.dev.: 0.0367)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.42% (6.1631 => 7.5449, std.dev.: 0.1850)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 21.55% (0.1058 => 0.1286, std.dev.: 0.0036)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.49% (27.6418 => 29.9898, std.dev.: 0.1365)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.06% (1.3649 => 1.4476, std.dev.: 0.0301)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 108.51% (0.0094 => 0.0196, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.58% (3.7285 => 6.4721, std.dev.: 0.0261)
  MultiSource/Benchmarks/McCat/09-vor/vor: 64.01% (0.1181 => 0.1937, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.54% (2.8867 => 4.2878, std.dev.: 0.0312)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 46.60% (0.1678 => 0.2460, std.dev.: 0.0065)
  MultiSource/Benchmarks/FreeBench/neural/neural: 43.68% (0.3171 => 0.4556, std.dev.: 0.0317)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 39.27% (0.0578 => 0.0805, std.dev.: 0.0052)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 37.97% (1.2558 => 1.7326, std.dev.: 0.0573)
  SingleSource/Benchmarks/Shootout/hash: 27.44% (4.1846 => 5.3328, std.dev.: 0.2590)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 23.07% (1.0962 => 1.3491, std.dev.: 0.0646)
  MultiSource/Benchmarks/FreeBench/distray/distray: 22.52% (0.2318 => 0.2840, std.dev.: 0.0058)
  MultiSource/Benchmarks/llubenchmark/llu: 19.67% (2.0187 => 2.4157, std.dev.: 0.0299)
  MultiSource/Benchmarks/Olden/tsp/tsp: 15.10% (1.5339 => 1.7655, std.dev.: 0.0170)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 13.12% (0.0884 => 0.1000, std.dev.: 0.0037)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.43% (14.9584 => 16.8175, std.dev.: 0.0849)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.86% (7.0762 => 7.8450, std.dev.: 0.0050)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.76% (0.4313 => 0.4777, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.51% (5.4910 => 6.0130, std.dev.: 0.0084)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.33% (1.2557 => 1.3729, std.dev.: 0.0173)
  MultiSource/Applications/JM/lencod/lencod: 8.06% (7.1799 => 7.7587, std.dev.: 0.2086)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.89% (48.3256 => 52.1368, std.dev.: 0.4039)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.37% (3.2027 => 3.4388, std.dev.: 0.0626)
  MultiSource/Benchmarks/Bullet/bullet: 6.99% (7.2995 => 7.8095, std.dev.: 0.0681)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.35% (93.6732 => 99.6253, std.dev.: 0.0916)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.14% (5.3042 => 5.6299, std.dev.: 0.0920)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.12% (3.4085 => 3.6171, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.65% (5.5008 => 5.8116, std.dev.: 0.0523)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.37% (5.1471 => 5.3722, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.25% (4.3151 => 4.4986, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.68% (4.8739 => 5.0532, std.dev.: 0.0175)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.50% (0.6480 => 0.6707, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/whetstone: 3.44% (3.4559 => 3.5749, std.dev.: 0.0192)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.44% (6.1245 => 6.3353, std.dev.: 0.0681)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.28% (25.0200 => 25.8419, std.dev.: 0.0614)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.83% (4.9995 => 5.0912, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.72% (3.3464 => 3.4041, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.33% (4.9040 => 4.9694, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.13% (1.4813 => 1.4981, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/em3d/em3d: 1.04% (5.1555 => 5.2093, std.dev.: 0.0202)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.54% (0.3655 => 0.3343, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.24% (1.4721 => 1.4244, std.dev.: 0.0126)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.16% (0.7189 => 0.7034, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.12% (2.1022 => 1.4270, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.62% (0.0816 => 0.0558, std.dev.: 0.0012)
  MultiSource/Applications/lemon/lemon: -31.28% (1.4194 => 0.9754, std.dev.: 0.1406)
  MultiSource/Applications/viterbi/viterbi: -27.10% (3.4923 => 2.5459, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.60% (6.9552 => 5.2439, std.dev.: 0.0321)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6131, std.dev.: 0.0451)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.21% (6.2627 => 5.4353, std.dev.: 0.0445)
  SingleSource/Benchmarks/Misc/mandel: -11.31% (1.1996 => 1.0639, std.dev.: 0.0452)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.93% (47.2250 => 44.4241, std.dev.: 0.8277)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -5.37% (0.2849 => 0.2696, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.50% (3.8119 => 3.6403, std.dev.: 0.0026)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.20% (1.1024 => 1.0561, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/fbench: -4.02% (4.9602 => 4.7608, std.dev.: 0.0120)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.02% (1.1032 => 1.0699, std.dev.: 0.0034)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.93% (0.7806 => 0.7577, std.dev.: 0.0078)
  MultiSource/Applications/sgefa/sgefa: -2.36% (1.4030 => 1.3699, std.dev.: 0.0086)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.04% (34.8438 => 34.1342, std.dev.: 0.0928)
  MultiSource/Applications/obsequi/Obsequi: -1.86% (2.6081 => 2.5596, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.25% (5.8810 => 5.8077, std.dev.: 0.0028)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.12% (0.1378 => 0.1335, std.dev.: 0.0238)

Report Time: 1.10s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130813/e7d25955/attachment.html>


More information about the llvm-testresults mailing list