[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 5 16:43:43 PST 2013


http://llvm.org/perf/db_default/v4/nts/18032?compare_to=18026&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18032, Order: 196542, Start Time: 2013-12-05 23:01:44, End Time: 2013-12-06 00:47:49
      To: 18026, Order: 196528, Start Time: 2013-12-05 20:45:10, End Time: 2013-12-05 22:36:35
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 15 (15 on baseline)
Performance Improvements: 40 (20 on baseline)
Unchanged Tests: 1055 (1075 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.77% (0.3106 => 0.3223, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 21.38% (7.9197 => 9.6133, std.dev.: 0.0731)
  SingleSource/Benchmarks/Shootout/matrix: 17.12% (1.8056 => 2.1147, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.72% (29.9566 => 33.1685, std.dev.: 0.3489)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 8.97% (0.1839 => 0.2004, std.dev.: 0.0019)
  MultiSource/Benchmarks/nbench/nbench: 8.08% (20.9273 => 22.6192, std.dev.: 0.5565)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.96% (0.3768 => 0.3955, std.dev.: 0.0038)
  MultiSource/Applications/JM/lencod/lencod: 4.18% (7.8788 => 8.2081, std.dev.: 0.0529)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.80% (0.4794 => 0.4976, std.dev.: 0.0023)
  MultiSource/Benchmarks/sim/sim: 3.74% (3.8168 => 3.9597, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.54% (5.7920 => 5.9972, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.93% (5.2591 => 5.4131, std.dev.: 0.0245)
  SingleSource/Benchmarks/Shootout/methcall: 1.93% (8.4988 => 8.6631, std.dev.: 0.0071)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.26% (1.8581 => 1.8815, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.17% (6.0058 => 6.0760, std.dev.: 0.0160)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/DuffsDevice: -43.89% (0.0458 => 0.0257, std.dev.: 0.0060)
  SingleSource/Regression/C++/global_ctor: -41.62% (0.0370 => 0.0216, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -38.61% (0.0777 => 0.0477, std.dev.: 0.0081)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -36.23% (0.1242 => 0.0792, std.dev.: 0.0162)
  MultiSource/Benchmarks/Olden/tsp/tsp: -35.90% (0.2173 => 0.1393, std.dev.: 0.0169)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -35.67% (0.1427 => 0.0918, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/mst/mst: -34.93% (0.2021 => 0.1315, std.dev.: 0.0058)
  SingleSource/Regression/C/sumarray2d: -32.49% (0.0474 => 0.0320, std.dev.: 0.0006)
  MultiSource/Benchmarks/McCat/05-eks/eks: -24.12% (0.6912 => 0.5245, std.dev.: 0.0375)
  SingleSource/Benchmarks/Shootout/heapsort: -22.67% (0.0600 => 0.0464, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -20.44% (0.0954 => 0.0759, std.dev.: 0.0015)
  MultiSource/Applications/viterbi/viterbi: -19.29% (0.2488 => 0.2008, std.dev.: 0.0022)
  MultiSource/Applications/ClamAV/clamscan: -15.90% (20.0907 => 16.8972, std.dev.: 0.5491)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -14.89% (2.2396 => 1.9062, std.dev.: 0.0252)
  SingleSource/Benchmarks/Dhrystone/fldry: -14.66% (0.0689 => 0.0588, std.dev.: 0.0024)
  MultiSource/Applications/minisat/minisat: -13.70% (0.8634 => 0.7451, std.dev.: 0.0192)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -13.23% (0.0869 => 0.0754, std.dev.: 0.0041)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -11.56% (0.3529 => 0.3121, std.dev.: 0.0039)
  MultiSource/Applications/JM/lencod/lencod: -10.95% (19.3851 => 17.2630, std.dev.: 0.5510)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -6.57% (0.1765 => 0.1649, std.dev.: 0.0015)
  MultiSource/Applications/JM/ldecod/ldecod: -6.48% (8.1811 => 7.6512, std.dev.: 0.0519)
  SingleSource/Benchmarks/Misc/ReedSolomon: -6.44% (0.2313 => 0.2164, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.45% (1.4751 => 1.3947, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -5.27% (1.3253 => 1.2555, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.95% (1.3454 => 1.2788, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.93% (1.3013 => 1.2372, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.48% (1.3635 => 1.3024, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.35% (1.2584 => 1.2037, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.05% (1.3230 => 1.2694, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.79% (1.3320 => 1.2815, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.96% (1.3009 => 1.2624, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.75% (1.3732 => 1.3355, std.dev.: 0.0066)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -48.14% (0.2601 => 0.1349, std.dev.: 0.0355)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -31.99% (0.0347 => 0.0236, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -25.50% (0.0647 => 0.0482, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/heapsort: -24.55% (4.6427 => 3.5028, std.dev.: 0.1518)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -20.61% (0.1082 => 0.0859, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -18.75% (0.1893 => 0.1538, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.74% (1.2970 => 1.2614, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout/hash: -1.83% (5.3105 => 5.2135, std.dev.: 0.0089)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.02% (0.3069 => 0.3223, std.dev.: 0.0036)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.71% (1.5198 => 1.5762, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 2.42% (5.8749 => 6.0170, std.dev.: 0.0355)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 18.77% (2.9492 => 3.5028, std.dev.: 0.1518)
  SingleSource/Benchmarks/Shootout/matrix: 17.74% (1.7960 => 2.1147, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 15.72% (28.6638 => 33.1685, std.dev.: 0.3489)
  SingleSource/Benchmarks/Shootout-C++/lists1: 13.56% (0.5871 => 0.6667, std.dev.: 0.0284)
  SingleSource/Benchmarks/Misc/flops: 3.73% (9.2673 => 9.6133, std.dev.: 0.0731)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.49% (5.7952 => 5.9972, std.dev.: 0.0048)
  MultiSource/Applications/JM/lencod/lencod: 3.31% (7.9450 => 8.2081, std.dev.: 0.0529)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.13% (5.2486 => 5.4131, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.76% (5.9126 => 6.0760, std.dev.: 0.0160)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.21% (1.8409 => 1.8815, std.dev.: 0.0084)
  MultiSource/Applications/viterbi/viterbi: 1.82% (2.6366 => 2.6847, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout/fib2: 1.12% (3.5960 => 3.6363, std.dev.: 0.0104)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.91% (0.1938 => 0.1649, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -8.26% (0.3402 => 0.3121, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.94% (0.1523 => 0.1402, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.23% (1.5034 => 1.3947, std.dev.: 0.0173)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.67% (2.0207 => 1.9062, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.42% (1.4277 => 1.3503, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.37% (1.4113 => 1.3355, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.31% (1.3505 => 1.2788, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.66% (1.3660 => 1.3024, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.52% (1.4125 => 1.3487, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.30% (1.3264 => 1.2694, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.20% (1.2914 => 1.2372, std.dev.: 0.0130)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.04% (1.1409 => 1.0948, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.04% (1.3157 => 1.2626, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.92% (1.3460 => 1.2932, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.60% (1.3024 => 1.2555, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.89% (1.3702 => 1.3306, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.53% (1.2952 => 1.2624, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -4.08% (6.0535 => 5.8065, std.dev.: 0.0554)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.6605 => 3.5944, std.dev.: 0.0060)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131205/a4c56d46/attachment.html>


More information about the llvm-testresults mailing list