[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 18 15:26:05 PST 2013


http://llvm.org/perf/db_default/v4/nts/18596?compare_to=18592&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18596, Order: 197605, Start Time: 2013-12-18 21:40:46, End Time: 2013-12-18 23:30:26
      To: 18592, Order: 197595, Start Time: 2013-12-18 19:26:43, End Time: 2013-12-18 21:14:17
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 43 (61 on baseline)
Performance Improvements: 4 (11 on baseline)
Unchanged Tests: 1063 (1038 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 55.78% (0.2377 => 0.3703, std.dev.: 0.0189)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 54.56% (0.0493 => 0.0762, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 49.55% (0.0779 => 0.1165, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 46.81% (0.0502 => 0.0737, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 38.06% (0.7028 => 0.9703, std.dev.: 0.0390)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 30.01% (0.3682 => 0.4787, std.dev.: 0.0292)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 30.00% (0.5733 => 0.7453, std.dev.: 0.0166)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 29.67% (0.7384 => 0.9575, std.dev.: 0.0816)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.67% (5.0808 => 6.5373, std.dev.: 0.3021)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 24.51% (0.2656 => 0.3307, std.dev.: 0.0248)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 23.25% (1.4192 => 1.7492, std.dev.: 0.0622)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 17.75% (2.0074 => 2.3637, std.dev.: 0.0240)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 17.42% (0.4970 => 0.5836, std.dev.: 0.0111)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 17.21% (9.9462 => 11.6575, std.dev.: 0.5377)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.64% (7.2730 => 8.4833, std.dev.: 0.1989)
  SingleSource/Benchmarks/Shootout-C++/objinst: 14.14% (0.2129 => 0.2430, std.dev.: 0.0092)
  MultiSource/Benchmarks/mafft/pairlocalalign: 8.23% (10.0991 => 10.9306, std.dev.: 0.1983)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.20% (27.3742 => 29.3453, std.dev.: 0.2951)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.61% (2.7969 => 2.9818, std.dev.: 0.0154)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.29% (5.5802 => 5.9313, std.dev.: 0.0170)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.98% (0.3446 => 0.3652, std.dev.: 0.0055)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 48.08% (0.0495 => 0.0733, std.dev.: 0.0072)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 28.19% (0.0667 => 0.0855, std.dev.: 0.0062)
  MultiSource/Applications/minisat/minisat: 27.10% (6.4317 => 8.1746, std.dev.: 0.3314)
  MultiSource/Benchmarks/Olden/bisort/bisort: 21.12% (0.7491 => 0.9073, std.dev.: 0.0430)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 20.53% (1.4810 => 1.7850, std.dev.: 0.0375)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.46% (0.3580 => 0.4205, std.dev.: 0.0217)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.00% (0.1600 => 0.1856, std.dev.: 0.0050)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.20% (2.4546 => 2.8031, std.dev.: 0.1004)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.12% (9.3643 => 10.6866, std.dev.: 0.1917)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 8.26% (2.1055 => 2.2794, std.dev.: 0.0481)
  SingleSource/Benchmarks/Misc/salsa20: 8.01% (7.4993 => 8.0997, std.dev.: 0.0505)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.17% (2.6955 => 2.8619, std.dev.: 0.0248)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.10% (5.0062 => 5.3117, std.dev.: 0.0434)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.58% (2.2801 => 2.4073, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.28% (5.8996 => 6.1519, std.dev.: 0.0899)
  SingleSource/Benchmarks/Misc/flops: 3.77% (9.2735 => 9.6235, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.59% (6.5321 => 6.7011, std.dev.: 0.0282)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.58% (21.4291 => 21.9809, std.dev.: 0.1800)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.11% (5.7030 => 5.8233, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/methcall: 2.01% (8.4958 => 8.6669, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/fib2: 1.24% (3.6166 => 3.6615, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.07% (4.9369 => 4.9897, std.dev.: 0.0165)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -5.66% (0.4205 => 0.3967, std.dev.: 0.0023)
  MultiSource/Applications/lemon/lemon: -1.58% (1.3577 => 1.3362, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -16.04% (4.6390 => 3.8948, std.dev.: 0.2152)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.84% (5.5219 => 5.4203, std.dev.: 0.0284)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 56.38% (0.0745 => 0.1165, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 51.23% (0.3859 => 0.5836, std.dev.: 0.0111)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 51.19% (0.0504 => 0.0762, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 45.79% (0.2540 => 0.3703, std.dev.: 0.0189)
  MultiSource/Applications/sqlite3/sqlite3: 45.20% (15.7419 => 22.8573, std.dev.: 0.5274)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 40.65% (0.0524 => 0.0737, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 40.06% (0.3355 => 0.4699, std.dev.: 0.0512)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 39.77% (0.6942 => 0.9703, std.dev.: 0.0390)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 31.61% (0.5663 => 0.7453, std.dev.: 0.0166)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 29.83% (0.7375 => 0.9575, std.dev.: 0.0816)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 28.63% (5.0823 => 6.5373, std.dev.: 0.3021)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 28.17% (0.3735 => 0.4787, std.dev.: 0.0292)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 18.44% (9.8425 => 11.6575, std.dev.: 0.5377)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.67% (1.7054 => 2.0067, std.dev.: 0.1164)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.97% (2.0207 => 2.3637, std.dev.: 0.0240)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 16.35% (1.5034 => 1.7492, std.dev.: 0.0622)
  SingleSource/Benchmarks/Shootout-C++/objinst: 14.79% (0.2117 => 0.2430, std.dev.: 0.0092)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.01% (25.9661 => 29.3453, std.dev.: 0.2951)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.92% (7.5124 => 8.4833, std.dev.: 0.1989)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.00% (0.1080 => 0.1188, std.dev.: 0.0020)
  MultiSource/Applications/lemon/lemon: 9.52% (1.2200 => 1.3362, std.dev.: 0.0078)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 8.50% (0.3366 => 0.3652, std.dev.: 0.0055)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.15% (2.7572 => 2.9818, std.dev.: 0.0154)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 6.76% (1.9834 => 2.1174, std.dev.: 0.0412)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 6.34% (0.2083 => 0.2215, std.dev.: 0.0013)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (10.3096 => 10.9306, std.dev.: 0.1983)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.25% (4.2717 => 4.4960, std.dev.: 0.0376)
  SingleSource/Benchmarks/Shootout-C++/sieve: 4.66% (0.2856 => 0.2989, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.12% (0.3209 => 0.3309, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 61.26% (0.7670 => 1.2369, std.dev.: 0.0568)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 50.82% (0.0486 => 0.0733, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 40.53% (2.9945 => 4.2083, std.dev.: 0.3772)
  MultiSource/Benchmarks/Olden/bisort/bisort: 34.77% (0.6732 => 0.9073, std.dev.: 0.0430)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 28.19% (0.0667 => 0.0855, std.dev.: 0.0062)
  MultiSource/Applications/minisat/minisat: 27.97% (6.3881 => 8.1746, std.dev.: 0.3314)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 25.22% (0.3358 => 0.4205, std.dev.: 0.0217)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 23.47% (0.1359 => 0.1678, std.dev.: 0.0120)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 20.65% (1.4795 => 1.7850, std.dev.: 0.0375)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.60% (5.9583 => 6.9471, std.dev.: 0.1292)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.27% (0.1668 => 0.1856, std.dev.: 0.0050)
  MultiSource/Benchmarks/llubenchmark/llu: 11.05% (1.9763 => 2.1947, std.dev.: 0.0347)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 8.44% (2.1020 => 2.2794, std.dev.: 0.0481)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.38% (3.3810 => 3.6643, std.dev.: 0.0444)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.36% (2.6658 => 2.8619, std.dev.: 0.0248)
  SingleSource/Benchmarks/Misc/salsa20: 6.65% (7.5947 => 8.0997, std.dev.: 0.0505)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.63% (10.0217 => 10.6866, std.dev.: 0.1917)
  MultiSource/Applications/siod/siod: 5.69% (3.4258 => 3.6206, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.56% (5.0320 => 5.3117, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.03% (5.9133 => 6.1519, std.dev.: 0.0899)
  SingleSource/Benchmarks/Misc/flops: 3.84% (9.2673 => 9.6235, std.dev.: 0.0040)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.72% (3.4043 => 3.5309, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.17% (5.9126 => 6.1003, std.dev.: 0.0343)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.07% (2.3355 => 2.4073, std.dev.: 0.0199)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.68% (3.9755 => 4.0821, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.63% (6.5291 => 6.7011, std.dev.: 0.0282)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 2.29% (0.6388 => 0.6534, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.06% (5.7060 => 5.8233, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/fib2: 1.82% (3.5960 => 3.6615, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.70% (11.7894 => 11.9893, std.dev.: 0.0521)
  SingleSource/Benchmarks/Misc/ffbench: 1.52% (1.4103 => 1.4317, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.08% (4.9365 => 4.9897, std.dev.: 0.0165)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.43% (1.3676 => 1.2796, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.96% (1.4113 => 1.3413, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.09% (1.4125 => 1.3688, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.53% (1.3460 => 1.3120, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -6.28% (5.9456 => 5.5724, std.dev.: 0.1385)
  MultiSource/Benchmarks/sim/sim: -5.22% (4.0134 => 3.8039, std.dev.: 0.0427)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.45% (0.4526 => 0.4370, std.dev.: 0.0013)
  MultiSource/Applications/sqlite3/sqlite3: -3.31% (4.2978 => 4.1555, std.dev.: 0.0390)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.82% (6.0535 => 5.8825, std.dev.: 0.0583)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.54% (7.9597 => 7.8375, std.dev.: 0.0392)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.44% (5.4994 => 5.4203, std.dev.: 0.0284)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131218/ccb4b418/attachment.html>


More information about the llvm-testresults mailing list