[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Dec 18 08:40:41 PST 2013


http://llvm.org/perf/db_default/v4/nts/18579?compare_to=18566&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18579, Order: 197570, Start Time: 2013-12-18 14:55:36, End Time: 2013-12-18 16:45:03
      To: 18566, Order: 197559, Start Time: 2013-12-18 12:20:08, End Time: 2013-12-18 14:00:02
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 62 (58 on baseline)
Performance Improvements: 13 (8 on baseline)
Unchanged Tests: 1035 (1044 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 62.09% (0.2622 => 0.4250, std.dev.: 0.0200)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 55.86% (0.0512 => 0.0798, std.dev.: 0.0046)
  SingleSource/Benchmarks/Stanford/Perm: 43.20% (0.0331 => 0.0474, std.dev.: 0.0033)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 41.51% (0.9328 => 1.3200, std.dev.: 0.0794)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 34.23% (0.2626 => 0.3525, std.dev.: 0.0318)
  MultiSource/Benchmarks/MallocBench/gs/gs: 24.34% (4.6486 => 5.7799, std.dev.: 0.1315)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 22.76% (9.7525 => 11.9719, std.dev.: 0.0329)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 21.35% (0.3611 => 0.4382, std.dev.: 0.0108)
  MultiSource/Benchmarks/Prolangs-C/football/football: 21.35% (1.0147 => 1.2313, std.dev.: 0.0352)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 19.92% (5.0972 => 6.1126, std.dev.: 0.1611)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 19.82% (4.6542 => 5.5767, std.dev.: 0.2581)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 18.63% (1.3841 => 1.6419, std.dev.: 0.0684)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 15.77% (0.8782 => 1.0167, std.dev.: 0.0394)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 15.52% (0.7249 => 0.8374, std.dev.: 0.0279)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 14.70% (1.0915 => 1.2520, std.dev.: 0.0350)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.07% (44.5206 => 50.7852, std.dev.: 1.3521)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 13.62% (0.6676 => 0.7585, std.dev.: 0.0236)
  MultiSource/Benchmarks/Bullet/bullet: 13.02% (33.0411 => 37.3417, std.dev.: 1.2839)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.50% (7.2889 => 8.2002, std.dev.: 0.3011)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.23% (14.7765 => 16.4353, std.dev.: 0.2340)
  MultiSource/Benchmarks/nbench/nbench: 8.94% (1.2376 => 1.3482, std.dev.: 0.0294)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 8.31% (1.0815 => 1.1714, std.dev.: 0.0328)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.82% (1.9786 => 2.1333, std.dev.: 0.0324)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.78% (10.0951 => 10.8810, std.dev.: 0.2059)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.68% (2.7655 => 2.9778, std.dev.: 0.0258)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.50% (0.8271 => 0.8891, std.dev.: 0.0167)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.36% (0.8863 => 0.9515, std.dev.: 0.0013)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.48% (4.2133 => 4.4864, std.dev.: 0.0680)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.81% (0.4841 => 0.5074, std.dev.: 0.0087)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.62% (1.0918 => 1.1422, std.dev.: 0.0089)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.20% (0.6421 => 0.6691, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 3.92% (1.3281 => 1.3802, std.dev.: 0.0082)
  MultiSource/Applications/obsequi/Obsequi: 3.55% (1.1591 => 1.2003, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 3.30% (0.3178 => 0.3283, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.98% (1.2230 => 1.2595, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.32% (1.2680 => 1.2974, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.73% (1.3266 => 1.3496, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.66% (1.3137 => 1.3355, std.dev.: 0.0059)
  MultiSource/Applications/siod/siod: 1.34% (2.5955 => 2.6304, std.dev.: 0.0072)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 32.64% (2.8219 => 3.7431, std.dev.: 0.3030)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.88% (4.5449 => 5.9485, std.dev.: 0.1075)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.42% (1.4823 => 1.8591, std.dev.: 0.0980)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 22.73% (2.3769 => 2.9171, std.dev.: 0.0552)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.43% (2.3994 => 2.9137, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 17.69% (35.1716 => 41.3947, std.dev.: 0.4688)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.50% (2.1019 => 2.3857, std.dev.: 0.0456)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.33% (9.3378 => 10.5824, std.dev.: 0.0932)
  SingleSource/Benchmarks/Shootout-C++/matrix: 12.19% (3.3218 => 3.7267, std.dev.: 0.1332)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.45% (6.2419 => 6.7695, std.dev.: 0.1349)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.28% (2.6725 => 2.8670, std.dev.: 0.0379)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 6.84% (59.0407 => 63.0804, std.dev.: 0.5699)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.26% (2.2567 => 2.3979, std.dev.: 0.0192)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 6.03% (2.3024 => 2.4412, std.dev.: 0.0455)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.33% (2.9148 => 3.0703, std.dev.: 0.0452)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.49% (4.1016 => 4.2856, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.31% (5.0853 => 5.2029, std.dev.: 0.0394)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.97% (7.7141 => 7.8659, std.dev.: 0.0559)
  MultiSource/Benchmarks/Olden/tsp/tsp: 1.91% (1.5374 => 1.5667, std.dev.: 0.0100)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.67% (8.7880 => 8.9348, std.dev.: 0.0099)
  MultiSource/Benchmarks/Olden/bh/bh: 1.66% (2.3856 => 2.4251, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.52% (16.5470 => 16.7989, std.dev.: 0.0358)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.23% (39.5775 => 40.0627, std.dev.: 0.1807)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -10.56% (3.5363 => 3.1627, std.dev.: 0.0762)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.14% (0.4636 => 0.4305, std.dev.: 0.0031)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.90% (3.0539 => 2.8431, std.dev.: 0.0120)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.88% (16.4565 => 15.4886, std.dev.: 0.2278)
  SingleSource/Benchmarks/Misc/fp-convert: -5.16% (7.8635 => 7.4576, std.dev.: 0.0782)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.18% (4.4093 => 4.2251, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.55% (5.2496 => 5.0631, std.dev.: 0.0465)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.45% (0.7216 => 0.6967, std.dev.: 0.0080)
  MultiSource/Applications/hexxagon/hexxagon: -3.38% (15.6067 => 15.0793, std.dev.: 0.1954)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.93% (1.2948 => 1.2568, std.dev.: 0.0085)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.52% (3.8329 => 3.7365, std.dev.: 0.0031)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.77% (23.8227 => 23.4005, std.dev.: 0.0782)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -1.26% (6.8433 => 6.7574, std.dev.: 0.0251)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 57.93% (0.2691 => 0.4250, std.dev.: 0.0200)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 52.29% (0.0524 => 0.0798, std.dev.: 0.0046)
  MultiSource/Applications/sqlite3/sqlite3: 48.32% (15.7419 => 23.3476, std.dev.: 1.0974)
  SingleSource/Benchmarks/Stanford/Perm: 35.43% (0.0350 => 0.0474, std.dev.: 0.0033)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 29.45% (1.0197 => 1.3200, std.dev.: 0.0794)
  MultiSource/Benchmarks/Prolangs-C/football/football: 24.19% (0.9915 => 1.2313, std.dev.: 0.0352)
  MultiSource/Benchmarks/MallocBench/gs/gs: 23.34% (4.6860 => 5.7799, std.dev.: 0.1315)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 21.63% (9.8425 => 11.9719, std.dev.: 0.0329)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 20.27% (5.0823 => 6.1126, std.dev.: 0.1611)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 17.32% (0.3735 => 0.4382, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 16.65% (4.7807 => 5.5767, std.dev.: 0.2581)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 15.60% (1.0830 => 1.2520, std.dev.: 0.0350)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 14.98% (0.6597 => 0.7585, std.dev.: 0.0236)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 14.49% (0.8880 => 1.0167, std.dev.: 0.0394)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 13.63% (1.4449 => 1.6419, std.dev.: 0.0684)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 13.55% (0.7375 => 0.8374, std.dev.: 0.0279)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.06% (44.9186 => 50.7852, std.dev.: 1.3521)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.24% (25.9661 => 28.8836, std.dev.: 0.6280)
  MultiSource/Applications/lemon/lemon: 10.11% (1.2200 => 1.3433, std.dev.: 0.0422)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.28% (0.8787 => 0.9515, std.dev.: 0.0013)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.11% (0.8224 => 0.8891, std.dev.: 0.0167)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.00% (2.7572 => 2.9778, std.dev.: 0.0258)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.56% (1.9834 => 2.1333, std.dev.: 0.0324)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.69% (15.4053 => 16.4353, std.dev.: 0.2340)
  MultiSource/Benchmarks/nbench/nbench: 6.60% (1.2647 => 1.3482, std.dev.: 0.0294)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.86% (0.4793 => 0.5074, std.dev.: 0.0087)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.84% (0.6322 => 0.6691, std.dev.: 0.0051)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.54% (10.3096 => 10.8810, std.dev.: 0.2059)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.03% (4.2717 => 4.4864, std.dev.: 0.0680)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.86% (1.5198 => 1.5937, std.dev.: 0.0167)
  MultiSource/Applications/oggenc/oggenc: 4.62% (5.4968 => 5.7505, std.dev.: 0.0496)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.69% (1.1016 => 1.1422, std.dev.: 0.0089)
  MultiSource/Applications/siod/siod: 3.19% (2.5491 => 2.6304, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.85% (1.3551 => 1.3802, std.dev.: 0.0082)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 30.27% (2.8607 => 3.7267, std.dev.: 0.1332)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.97% (4.5769 => 5.9485, std.dev.: 0.1075)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.66% (1.4795 => 1.8591, std.dev.: 0.0980)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.06% (5.9583 => 6.9748, std.dev.: 0.0654)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 15.09% (35.9684 => 41.3947, std.dev.: 0.4688)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.00% (2.5559 => 2.9137, std.dev.: 0.0057)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.50% (2.1020 => 2.3857, std.dev.: 0.0456)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.55% (2.6658 => 2.8670, std.dev.: 0.0379)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.09% (2.8940 => 3.0703, std.dev.: 0.0452)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.59% (10.0217 => 10.5824, std.dev.: 0.0932)
  MultiSource/Applications/lua/lua: 5.46% (29.1357 => 30.7258, std.dev.: 0.3643)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.44% (3.4043 => 3.5896, std.dev.: 0.0200)
  MultiSource/Applications/siod/siod: 4.90% (3.4258 => 3.5938, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 4.06% (2.3043 => 2.3979, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.36% (4.1462 => 4.2856, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.28% (61.0792 => 63.0804, std.dev.: 0.5699)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.25% (7.6931 => 7.8659, std.dev.: 0.0559)
  MultiSource/Applications/obsequi/Obsequi: 1.96% (2.3061 => 2.3512, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.95% (5.9126 => 6.0280, std.dev.: 0.0434)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.85% (11.7894 => 12.0080, std.dev.: 0.0615)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.48% (2.5025 => 2.5395, std.dev.: 0.0071)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.45% (8.8073 => 8.9348, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.07% (16.6205 => 16.7989, std.dev.: 0.0358)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.03% (4.0593 => 4.1011, std.dev.: 0.0074)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.31% (0.0688 => 0.0507, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.78% (0.3247 => 0.3027, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.61% (1.4277 => 1.3762, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.86% (1.2785 => 1.2419, std.dev.: 0.0083)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -7.81% (0.3970 => 0.3660, std.dev.: 0.0113)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.88% (0.4526 => 0.4305, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.71% (6.0535 => 5.8892, std.dev.: 0.0432)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.84% (3.6583 => 3.5909, std.dev.: 0.0049)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131218/80cbff17/attachment.html>


More information about the llvm-testresults mailing list