[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 17 14:39:28 PST 2013


http://llvm.org/perf/db_default/v4/nts/18537?compare_to=18533&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18537, Order: 197518, Start Time: 2013-12-17 20:54:02, End Time: 2013-12-17 22:43:46
      To: 18533, Order: 197507, Start Time: 2013-12-17 18:43:59, End Time: 2013-12-17 20:28:39
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 70 (61 on baseline)
Performance Improvements: 8 (11 on baseline)
Unchanged Tests: 1032 (1038 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 79.66% (0.0772 => 0.1387, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 66.81% (0.0937 => 0.1563, std.dev.: 0.0061)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 63.90% (0.0878 => 0.1439, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 63.42% (0.0853 => 0.1394, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 62.95% (0.0664 => 0.1082, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/flops-2: 60.84% (0.0309 => 0.0497, std.dev.: 0.0030)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 45.64% (0.1674 => 0.2438, std.dev.: 0.0272)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 43.15% (0.6700 => 0.9591, std.dev.: 0.0655)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 42.39% (0.1019 => 0.1451, std.dev.: 0.0076)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 39.74% (0.8606 => 1.2026, std.dev.: 0.0199)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 31.97% (0.4714 => 0.6221, std.dev.: 0.0133)
  MultiSource/Benchmarks/MallocBench/gs/gs: 31.10% (4.5771 => 6.0006, std.dev.: 0.2301)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 30.76% (0.0868 => 0.1135, std.dev.: 0.0071)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 28.41% (9.6724 => 12.4206, std.dev.: 0.4573)
  SingleSource/UnitTests/vla: 24.43% (0.0442 => 0.0550, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 22.98% (0.6772 => 0.8328, std.dev.: 0.0567)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.36% (0.1570 => 0.1921, std.dev.: 0.0029)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 21.80% (1.1489 => 1.3994, std.dev.: 0.0406)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 21.25% (1.0612 => 1.2867, std.dev.: 0.0807)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 15.11% (5.4581 => 6.2830, std.dev.: 0.1058)
  MultiSource/Applications/sqlite3/sqlite3: 9.29% (21.9123 => 23.9474, std.dev.: 0.5534)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.59% (5.4298 => 5.8960, std.dev.: 0.0443)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.53% (4.1989 => 4.5569, std.dev.: 0.0144)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.33% (1.9703 => 2.1344, std.dev.: 0.0101)
  MultiSource/Applications/kimwitu++/kc: 7.99% (18.5289 => 20.0099, std.dev.: 0.5184)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.58% (2.7485 => 2.9568, std.dev.: 0.0567)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.10% (27.2824 => 29.2204, std.dev.: 0.5743)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 6.43% (0.3530 => 0.3757, std.dev.: 0.0040)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.82% (1.5586 => 1.6493, std.dev.: 0.0294)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.74% (0.2560 => 0.2707, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.21% (1.3025 => 1.3703, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/ary: 4.87% (0.2485 => 0.2606, std.dev.: 0.0029)
  MultiSource/Applications/lemon/lemon: 4.68% (1.3267 => 1.3888, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.59% (1.2342 => 1.2908, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.33% (1.2580 => 1.3125, std.dev.: 0.0190)
  MultiSource/Applications/SPASS/SPASS: 3.90% (16.5180 => 17.1617, std.dev.: 0.1937)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.63% (0.3416 => 0.3540, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 3.41% (1.3360 => 1.3815, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.33% (0.6666 => 0.6888, std.dev.: 0.0054)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.13% (4.6647 => 4.8106, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.93% (1.2673 => 1.3044, std.dev.: 0.0087)
  MultiSource/Benchmarks/nbench/nbench: 2.30% (1.2279 => 1.2562, std.dev.: 0.0092)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 89.19% (0.1351 => 0.2556, std.dev.: 0.0383)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 53.30% (2.8180 => 4.3201, std.dev.: 0.0424)
  SingleSource/Benchmarks/Stanford/Queens: 49.06% (0.0267 => 0.0398, std.dev.: 0.0030)
  SingleSource/Benchmarks/Stanford/Towers: 43.80% (0.0258 => 0.0371, std.dev.: 0.0040)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 42.23% (0.7617 => 1.0834, std.dev.: 0.1023)
  SingleSource/Benchmarks/Shootout/heapsort: 36.16% (2.9312 => 3.9912, std.dev.: 0.2777)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.04% (4.6030 => 5.9396, std.dev.: 0.0344)
  MultiSource/Applications/lemon/lemon: 27.33% (0.8334 => 1.0612, std.dev.: 0.0349)
  SingleSource/Benchmarks/Shootout/ary3: 25.12% (4.2935 => 5.3720, std.dev.: 0.2209)
  MultiSource/Applications/minisat/minisat: 24.35% (6.3068 => 7.8422, std.dev.: 0.2208)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 24.01% (2.3801 => 2.9515, std.dev.: 0.0862)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 16.39% (1.3243 => 1.5413, std.dev.: 0.0702)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 13.01% (3.7759 => 4.2670, std.dev.: 0.0908)
  SingleSource/Benchmarks/Shootout-C++/moments: 12.72% (0.1085 => 0.1223, std.dev.: 0.0007)
  MultiSource/Applications/obsequi/Obsequi: 12.14% (2.1787 => 2.4432, std.dev.: 0.0924)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.39% (2.1039 => 2.3436, std.dev.: 0.0647)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.77% (46.4461 => 50.9859, std.dev.: 0.2837)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.59% (1.3030 => 1.4279, std.dev.: 0.0464)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.38% (1.5432 => 1.6416, std.dev.: 0.0189)
  SingleSource/Benchmarks/Misc/salsa20: 5.23% (7.5151 => 7.9079, std.dev.: 0.1363)
  SingleSource/Benchmarks/Shootout-C++/fibo: 4.39% (5.1711 => 5.3981, std.dev.: 0.0816)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.78% (3.6502 => 3.7880, std.dev.: 0.0268)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.69% (3.9871 => 4.1341, std.dev.: 0.0355)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.28% (97.2062 => 100.3905, std.dev.: 0.7352)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.70% (39.4340 => 40.5004, std.dev.: 0.3809)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.61% (7.6776 => 7.8780, std.dev.: 0.0693)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.99% (5.7039 => 5.8173, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.47% (3.5351 => 3.5871, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/McGill/misr: -10.37% (0.4157 => 0.3726, std.dev.: 0.0056)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.80% (1.5077 => 1.3750, std.dev.: 0.0304)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.86% (0.4639 => 0.4367, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.75% (0.3981 => 0.3752, std.dev.: 0.0088)
  MultiSource/Applications/aha/aha: -5.40% (3.7768 => 3.5729, std.dev.: 0.0475)
  MultiSource/Benchmarks/sim/sim: -5.04% (4.0089 => 3.8068, std.dev.: 0.0565)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.21% (1.3811 => 1.3644, std.dev.: 0.0034)
  MultiSource/Applications/lua/lua: -1.16% (30.8966 => 30.5394, std.dev.: 0.1323)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 71.45% (0.0809 => 0.1387, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: 62.98% (0.0959 => 0.1563, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 61.90% (0.0861 => 0.1394, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 61.50% (0.0891 => 0.1439, std.dev.: 0.0122)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 61.21% (0.3859 => 0.6221, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 54.57% (0.0700 => 0.1082, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/flops-2: 53.87% (0.0323 => 0.0497, std.dev.: 0.0030)
  MultiSource/Applications/sqlite3/sqlite3: 52.13% (15.7419 => 23.9474, std.dev.: 0.5534)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 41.91% (0.1718 => 0.2438, std.dev.: 0.0272)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 38.16% (0.6942 => 0.9591, std.dev.: 0.0655)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 37.67% (0.1054 => 0.1451, std.dev.: 0.0076)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 35.43% (0.8880 => 1.2026, std.dev.: 0.0199)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 29.12% (0.0879 => 0.1135, std.dev.: 0.0071)
  MultiSource/Benchmarks/MallocBench/gs/gs: 28.05% (4.6860 => 6.0006, std.dev.: 0.2301)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 26.19% (9.8425 => 12.4206, std.dev.: 0.4573)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 18.93% (1.1767 => 1.3994, std.dev.: 0.0406)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.82% (0.1673 => 0.1921, std.dev.: 0.0029)
  MultiSource/Applications/lemon/lemon: 13.84% (1.2200 => 1.3888, std.dev.: 0.0137)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 13.34% (5.5433 => 6.2830, std.dev.: 0.1058)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.53% (25.9661 => 29.2204, std.dev.: 0.5743)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.83% (0.1080 => 0.1197, std.dev.: 0.0014)
  MultiSource/Applications/SIBsim4/SIBsim4: 8.52% (1.5198 => 1.6493, std.dev.: 0.0294)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 7.61% (1.9834 => 2.1344, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc-C++/bigfib: 7.42% (0.6412 => 0.6888, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.24% (2.7572 => 2.9568, std.dev.: 0.0567)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.68% (4.2717 => 4.5569, std.dev.: 0.0144)
  SingleSource/Benchmarks/Shootout-C++/ary3: 6.28% (0.2547 => 0.2707, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.17% (0.3366 => 0.3540, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.00% (0.2482 => 0.2606, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 4.89% (0.3582 => 0.3757, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 90.04% (0.1345 => 0.2556, std.dev.: 0.0383)
  SingleSource/Benchmarks/Stanford/Queens: 51.91% (0.0262 => 0.0398, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 44.27% (2.9945 => 4.3201, std.dev.: 0.0424)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 41.25% (0.7670 => 1.0834, std.dev.: 0.1023)
  SingleSource/Benchmarks/Shootout/heapsort: 35.33% (2.9492 => 3.9912, std.dev.: 0.2777)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.77% (4.5769 => 5.9396, std.dev.: 0.0344)
  MultiSource/Benchmarks/FreeBench/neural/neural: 25.85% (0.4220 => 0.5311, std.dev.: 0.0379)
  MultiSource/Applications/lemon/lemon: 22.94% (0.8632 => 1.0612, std.dev.: 0.0349)
  MultiSource/Applications/minisat/minisat: 22.76% (6.3881 => 7.8422, std.dev.: 0.2208)
  SingleSource/Benchmarks/Shootout/ary3: 16.84% (4.5977 => 5.3720, std.dev.: 0.2209)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.82% (5.9583 => 6.9603, std.dev.: 0.1326)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.30% (1.2278 => 1.4279, std.dev.: 0.0464)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.49% (2.1020 => 2.3436, std.dev.: 0.0647)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.74% (3.8883 => 4.2670, std.dev.: 0.0908)
  SingleSource/Benchmarks/Shootout-C++/moments: 9.59% (0.1116 => 0.1223, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.28% (5.0320 => 5.3981, std.dev.: 0.0816)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.42% (1.5425 => 1.6416, std.dev.: 0.0189)
  MultiSource/Applications/siod/siod: 5.68% (3.4258 => 3.6203, std.dev.: 0.0629)
  MultiSource/Applications/lua/lua: 4.82% (29.1357 => 30.5394, std.dev.: 0.1323)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 4.81% (3.6142 => 3.7880, std.dev.: 0.0268)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.59% (3.4043 => 3.5604, std.dev.: 0.0417)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.99% (3.9755 => 4.1341, std.dev.: 0.0355)
  SingleSource/Benchmarks/Misc/fp-convert: 2.64% (7.3892 => 7.5843, std.dev.: 0.0078)
  SingleSource/Benchmarks/McGill/chomp: 2.53% (1.0099 => 1.0355, std.dev.: 0.0099)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.40% (7.6931 => 7.8780, std.dev.: 0.0693)
  SingleSource/Benchmarks/Shootout/lists: 2.19% (6.9930 => 7.1464, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.17% (11.7894 => 12.0454, std.dev.: 0.0426)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.97% (6.5291 => 6.6574, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.95% (5.7060 => 5.8173, std.dev.: 0.0240)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.82% (2.4894 => 2.5346, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.18% (3.5451 => 3.5871, std.dev.: 0.0020)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.16% (0.6882 => 0.6458, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.87% (1.3505 => 1.2983, std.dev.: 0.0081)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.80% (15.4053 => 14.9733, std.dev.: 0.0799)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -2.11% (1.4113 => 1.3815, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -20.28% (0.0572 => 0.0456, std.dev.: 0.0041)
  SingleSource/Benchmarks/McGill/misr: -7.52% (0.4029 => 0.3726, std.dev.: 0.0056)
  MultiSource/Benchmarks/sim/sim: -5.15% (4.0134 => 3.8068, std.dev.: 0.0565)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -3.51% (0.4526 => 0.4367, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -2.54% (1.8409 => 1.7942, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.47% (6.0535 => 5.9041, std.dev.: 0.0125)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.81% (3.6605 => 3.5942, std.dev.: 0.0257)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131217/ad29371f/attachment.html>


More information about the llvm-testresults mailing list