[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 6 23:10:57 PST 2013


http://llvm.org/perf/db_default/v4/nts/18093?compare_to=18088&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18093, Order: 196641, Start Time: 2013-12-07 05:30:18, End Time: 2013-12-07 07:15:07
      To: 18088, Order: 196635, Start Time: 2013-12-07 03:19:24, End Time: 2013-12-07 05:06:52
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 13 (22 on baseline)
Performance Improvements: 44 (26 on baseline)
Unchanged Tests: 1053 (1062 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.20% (2.8681 => 4.0210, std.dev.: 0.0819)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.09% (6.3174 => 6.8285, std.dev.: 0.1075)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.03% (3.6017 => 3.8550, std.dev.: 0.0079)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.34% (1.9711 => 2.0960, std.dev.: 0.0020)
  MultiSource/Applications/lua/lua: 4.94% (28.4990 => 29.9061, std.dev.: 0.1694)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.39% (5.0802 => 5.2524, std.dev.: 0.0113)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.41% (7.7011 => 7.8867, std.dev.: 0.0603)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.32% (5.8933 => 6.0303, std.dev.: 0.0385)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.14% (2.4958 => 2.5491, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.79% (3.1640 => 3.2205, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.68% (11.8038 => 12.0023, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.53% (5.5393 => 5.6239, std.dev.: 0.0020)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.08% (1.3568 => 1.3715, std.dev.: 0.0054)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -37.86% (0.1199 => 0.0745, std.dev.: 0.0049)
  MultiSource/Benchmarks/llubenchmark/llu: -37.63% (0.0845 => 0.0527, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -36.19% (0.1177 => 0.0751, std.dev.: 0.0016)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -28.63% (0.0723 => 0.0516, std.dev.: 0.0050)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -24.51% (1.1630 => 0.8780, std.dev.: 0.0693)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -23.09% (1.4167 => 1.0896, std.dev.: 0.1123)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.77% (0.3344 => 0.2683, std.dev.: 0.0235)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.01% (0.0684 => 0.0554, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -17.05% (0.2692 => 0.2233, std.dev.: 0.0073)
  MultiSource/Benchmarks/MallocBench/gs/gs: -15.69% (5.4666 => 4.6087, std.dev.: 0.1137)
  SingleSource/Benchmarks/Shootout-C++/random: -14.95% (0.2388 => 0.2031, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -14.79% (0.0879 => 0.0749, std.dev.: 0.0016)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.12% (8.4911 => 7.2923, std.dev.: 0.1144)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -13.62% (11.3312 => 9.7878, std.dev.: 0.3926)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -12.49% (0.0849 => 0.0743, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -12.04% (5.3106 => 4.6711, std.dev.: 0.2368)
  MultiSource/Applications/lambda-0_1_3/lambda: -9.74% (0.9014 => 0.8136, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -7.83% (1.3718 => 1.2644, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -7.81% (1.4580 => 1.3441, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.79% (1.4109 => 1.3010, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -6.94% (0.2232 => 0.2077, std.dev.: 0.0038)
  MultiSource/Benchmarks/nbench/nbench: -6.76% (1.3282 => 1.2384, std.dev.: 0.0230)
  MultiSource/Benchmarks/sim/sim: -6.18% (0.3851 => 0.3613, std.dev.: 0.0059)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.77% (0.1751 => 0.1650, std.dev.: 0.0028)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -5.76% (1.3816 => 1.3020, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.19% (1.4108 => 1.3376, std.dev.: 0.0098)
  SingleSource/Benchmarks/Shootout-C++/matrix: -5.14% (0.2492 => 0.2364, std.dev.: 0.0036)
  MultiSource/Applications/lemon/lemon: -4.08% (1.2662 => 1.2145, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.00% (1.3231 => 1.2702, std.dev.: 0.0066)
  MultiSource/Applications/JM/ldecod/ldecod: -3.53% (7.8863 => 7.6078, std.dev.: 0.0249)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.96% (1.2718 => 1.2341, std.dev.: 0.0050)
  MultiSource/Applications/oggenc/oggenc: -2.54% (5.6125 => 5.4697, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.11% (1.3774 => 1.3621, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -36.82% (1.2291 => 0.7766, std.dev.: 0.1114)
  MultiSource/Benchmarks/FreeBench/neural/neural: -11.07% (0.4924 => 0.4379, std.dev.: 0.0139)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.14% (0.3156 => 0.2836, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -8.60% (0.1383 => 0.1264, std.dev.: 0.0020)
  MultiSource/Benchmarks/llubenchmark/llu: -8.40% (2.1878 => 2.0041, std.dev.: 0.0538)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.46% (0.6836 => 0.6463, std.dev.: 0.0013)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -3.55% (1.3194 => 1.2726, std.dev.: 0.0154)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.16% (2.4865 => 2.4080, std.dev.: 0.0251)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.81% (3.0084 => 2.9239, std.dev.: 0.0058)
  MultiSource/Applications/hexxagon/hexxagon: -1.27% (15.1932 => 14.9999, std.dev.: 0.0653)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.21% (7.9243 => 7.8281, std.dev.: 0.0115)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.21% (2.7572 => 2.9559, std.dev.: 0.0727)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.59% (1.9834 => 2.1141, std.dev.: 0.0039)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.56% (2.8607 => 4.0210, std.dev.: 0.0819)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.64% (35.9684 => 40.5158, std.dev.: 1.6052)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.77% (3.5771 => 3.8550, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/salsa20: 7.28% (7.5947 => 8.1475, std.dev.: 0.0329)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.65% (2.3043 => 2.4575, std.dev.: 0.0350)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.24% (1.9729 => 2.0960, std.dev.: 0.0020)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.38% (0.3534 => 0.3724, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.80% (5.0601 => 5.2524, std.dev.: 0.0113)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.23% (0.6261 => 0.6463, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.10% (2.3355 => 2.4080, std.dev.: 0.0251)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.97% (0.5112 => 0.5264, std.dev.: 0.0028)
  MultiSource/Applications/siod/siod: 2.77% (3.4258 => 3.5208, std.dev.: 0.0359)
  MultiSource/Applications/lua/lua: 2.64% (29.1357 => 29.9061, std.dev.: 0.1694)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.52% (7.6931 => 7.8867, std.dev.: 0.0603)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.19% (5.5032 => 5.6239, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.09% (3.1547 => 3.2205, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.99% (5.9126 => 6.0303, std.dev.: 0.0385)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.86% (2.5025 => 2.5491, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.81% (11.7894 => 12.0023, std.dev.: 0.0295)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.44% (1.5797 => 1.6024, std.dev.: 0.0077)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.56% (0.3247 => 0.2904, std.dev.: 0.0027)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -8.47% (25.9661 => 23.7675, std.dev.: 0.8087)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.99% (0.1774 => 0.1650, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.43% (1.3676 => 1.2796, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.38% (1.3505 => 1.2644, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.93% (1.3819 => 1.3000, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.90% (1.2914 => 1.2152, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.22% (1.4113 => 1.3376, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.98% (1.3146 => 1.2491, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.84% (1.4125 => 1.3441, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.49% (1.3660 => 1.3046, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.24% (1.3264 => 1.2702, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.06% (1.2724 => 1.2208, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.69% (1.3918 => 1.3404, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.47% (1.2785 => 1.2341, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.34% (1.3460 => 1.3010, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.35% (1.2952 => 1.2647, std.dev.: 0.0080)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.15% (2.5384 => 2.5091, std.dev.: 0.0096)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -15.42% (23.4696 => 19.8515, std.dev.: 1.1375)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -11.22% (1.4335 => 1.2726, std.dev.: 0.0154)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.73% (99.3511 => 95.6420, std.dev.: 1.0598)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.61% (6.0535 => 5.8958, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.46% (3.6583 => 3.5682, std.dev.: 0.0242)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.73% (3.6605 => 3.5972, std.dev.: 0.0130)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.65% (7.9597 => 7.8281, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.26% (4.1462 => 4.0941, std.dev.: 0.0108)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131207/25e2fa5b/attachment.html>


More information about the llvm-testresults mailing list