[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 26 09:03:13 PST 2013


http://llvm.org/perf/db_default/v4/nts/19060?compare_to=19049&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19060, Order: 198045, Start Time: 2013-12-26 15:21:10, End Time: 2013-12-26 17:07:41
      To: 19049, Order: 198043, Start Time: 2013-12-26 12:30:16, End Time: 2013-12-26 14:10:39
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 53 (53 on baseline)
Performance Improvements: 12 (18 on baseline)
Unchanged Tests: 1045 (1039 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 61.96% (0.0439 => 0.0711, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 51.89% (0.0925 => 0.1405, std.dev.: 0.0082)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 46.28% (0.5614 => 0.8212, std.dev.: 0.0637)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 32.21% (0.6681 => 0.8833, std.dev.: 0.0823)
  MultiSource/Applications/hbd/hbd: 31.50% (1.5350 => 2.0186, std.dev.: 0.1347)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 25.44% (0.3408 => 0.4275, std.dev.: 0.0321)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.16% (0.6772 => 0.8476, std.dev.: 0.0433)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 24.13% (1.1410 => 1.4163, std.dev.: 0.0452)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.37% (1.0870 => 1.3302, std.dev.: 0.0536)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.82% (0.5679 => 0.6691, std.dev.: 0.0389)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 17.53% (1.6942 => 1.9912, std.dev.: 0.0650)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 16.30% (1.1420 => 1.3281, std.dev.: 0.0655)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 15.61% (0.2601 => 0.3007, std.dev.: 0.0137)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.09% (5.4834 => 6.2562, std.dev.: 0.0424)
  MultiSource/Applications/obsequi/Obsequi: 13.62% (1.1439 => 1.2997, std.dev.: 0.0260)
  MultiSource/Benchmarks/Olden/tsp/tsp: 10.37% (0.1312 => 0.1448, std.dev.: 0.0022)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.86% (2.7563 => 2.9729, std.dev.: 0.0363)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.63% (4.2329 => 4.5558, std.dev.: 0.0528)
  MultiSource/Applications/sqlite3/sqlite3: 7.12% (22.0344 => 23.6035, std.dev.: 0.2362)
  MultiSource/Applications/kimwitu++/kc: 6.55% (18.5341 => 19.7490, std.dev.: 0.4337)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 6.04% (0.2101 => 0.2228, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.82% (0.2835 => 0.3000, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.78% (0.8892 => 0.9406, std.dev.: 0.0151)
  MultiSource/Applications/lemon/lemon: 5.39% (1.3201 => 1.3913, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 5.33% (0.1971 => 0.2076, std.dev.: 0.0004)
  SingleSource/Benchmarks/McGill/chomp: 5.24% (0.2176 => 0.2290, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 5.00% (0.5195 => 0.5455, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/hash: 4.83% (0.3935 => 0.4125, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.20% (0.3760 => 0.3918, std.dev.: 0.0053)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.51% (0.9345 => 0.9673, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.94% (0.4253 => 0.4378, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 68.63% (0.7747 => 1.3064, std.dev.: 0.0403)
  MultiSource/Benchmarks/Olden/mst/mst: 66.72% (0.1340 => 0.2234, std.dev.: 0.0300)
  SingleSource/Benchmarks/Stanford/Queens: 59.02% (0.0244 => 0.0388, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/ary3: 33.71% (4.3599 => 5.8297, std.dev.: 0.4151)
  MultiSource/Benchmarks/Olden/bisort/bisort: 32.17% (0.6706 => 0.8863, std.dev.: 0.0130)
  MultiSource/Applications/minisat/minisat: 26.91% (6.3684 => 8.0823, std.dev.: 0.0584)
  MultiSource/Applications/lemon/lemon: 22.39% (0.8319 => 1.0182, std.dev.: 0.0407)
  MultiSource/Applications/obsequi/Obsequi: 13.58% (2.1830 => 2.4794, std.dev.: 0.0655)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.56% (2.1018 => 2.3868, std.dev.: 0.0140)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 11.27% (3.6660 => 4.0791, std.dev.: 0.1598)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 9.55% (3.6624 => 4.0120, std.dev.: 0.1041)
  MultiSource/Benchmarks/llubenchmark/llu: 8.27% (1.9579 => 2.1198, std.dev.: 0.0176)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.65% (14.3487 => 15.4464, std.dev.: 0.3526)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.84% (5.5609 => 5.9410, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.94% (40.4741 => 42.4736, std.dev.: 0.3547)
  SingleSource/Benchmarks/Misc/flops: 3.78% (9.2689 => 9.6195, std.dev.: 0.0276)
  SingleSource/Benchmarks/Misc/pi: 3.05% (1.5962 => 1.6449, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.87% (4.0482 => 4.1643, std.dev.: 0.0129)
  SingleSource/Benchmarks/Misc/ffbench: 1.83% (1.3968 => 1.4223, std.dev.: 0.0077)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.66% (1.4336 => 1.4574, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.19% (7.1365 => 7.2212, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.06% (16.5678 => 16.7442, std.dev.: 0.0131)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -17.30% (8.1289 => 6.7226, std.dev.: 0.3565)
  SingleSource/Benchmarks/Misc/ReedSolomon: -13.35% (9.7720 => 8.4674, std.dev.: 0.1207)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -6.10% (1.1949 => 1.1220, std.dev.: 0.0030)
  SingleSource/Benchmarks/McGill/misr: -5.85% (0.4082 => 0.3843, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/lists: -5.52% (7.4987 => 7.0850, std.dev.: 0.0444)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -3.82% (85.4715 => 82.2096, std.dev.: 0.2462)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.38% (0.6593 => 0.6370, std.dev.: 0.0011)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.80% (101.7837 => 98.9370, std.dev.: 0.9416)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.31% (2.5371 => 2.4784, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.83% (12.1477 => 11.9253, std.dev.: 0.0199)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.62% (3.1957 => 3.1440, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.03% (1.3815 => 1.3673, std.dev.: 0.0019)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 60.14% (0.0444 => 0.0711, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 51.73% (0.0926 => 0.1405, std.dev.: 0.0082)
  MultiSource/Applications/sqlite3/sqlite3: 49.94% (15.7419 => 23.6035, std.dev.: 0.2362)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 45.01% (0.5663 => 0.8212, std.dev.: 0.0637)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 34.62% (0.3859 => 0.5195, std.dev.: 0.0387)
  MultiSource/Applications/hbd/hbd: 29.02% (1.5646 => 2.0186, std.dev.: 0.1347)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 27.42% (0.3355 => 0.4275, std.dev.: 0.0321)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 25.22% (0.6769 => 0.8476, std.dev.: 0.0433)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.83% (1.0830 => 1.3302, std.dev.: 0.0536)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 20.36% (1.1767 => 1.4163, std.dev.: 0.0452)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 16.76% (1.7054 => 1.9912, std.dev.: 0.0650)
  MultiSource/Applications/lemon/lemon: 14.04% (1.2200 => 1.3913, std.dev.: 0.0060)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 12.86% (5.5433 => 6.2562, std.dev.: 0.0424)
  MultiSource/Applications/obsequi/Obsequi: 9.17% (1.1905 => 1.2997, std.dev.: 0.0260)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.82% (2.7572 => 2.9729, std.dev.: 0.0363)
  SingleSource/Benchmarks/Misc-C++/bigfib: 7.50% (0.6412 => 0.6893, std.dev.: 0.0138)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 7.04% (0.8787 => 0.9406, std.dev.: 0.0151)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.65% (4.2717 => 4.5558, std.dev.: 0.0528)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.25% (0.5134 => 0.5455, std.dev.: 0.0017)
  MultiSource/Applications/oggenc/oggenc: 6.21% (5.4968 => 5.8379, std.dev.: 0.0920)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.44% (0.2113 => 0.2228, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.04% (0.2856 => 0.3000, std.dev.: 0.0012)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.37% (0.6322 => 0.6598, std.dev.: 0.0094)
  SingleSource/UnitTests/Vector/constpool: 4.32% (9.2178 => 9.6163, std.dev.: 0.1482)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 4.26% (0.3758 => 0.3918, std.dev.: 0.0053)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.05% (1.5198 => 1.5814, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/hash: 3.88% (0.3971 => 0.4125, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.63% (0.4266 => 0.4378, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: 70.33% (0.7670 => 1.3064, std.dev.: 0.0403)
  MultiSource/Benchmarks/Olden/mst/mst: 66.10% (0.1345 => 0.2234, std.dev.: 0.0300)
  SingleSource/Benchmarks/Stanford/Queens: 48.09% (0.0262 => 0.0388, std.dev.: 0.0037)
  MultiSource/Benchmarks/Olden/bisort/bisort: 31.65% (0.6732 => 0.8863, std.dev.: 0.0130)
  SingleSource/Benchmarks/Shootout/ary3: 26.80% (4.5977 => 5.8297, std.dev.: 0.4151)
  MultiSource/Applications/minisat/minisat: 26.52% (6.3881 => 8.0823, std.dev.: 0.0584)
  MultiSource/Applications/lemon/lemon: 17.96% (0.8632 => 1.0182, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.85% (5.9583 => 7.0219, std.dev.: 0.1112)
  SingleSource/Benchmarks/Shootout/matrix: 17.68% (1.7960 => 2.1136, std.dev.: 0.0006)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.55% (2.1020 => 2.3868, std.dev.: 0.0140)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.24% (3.3810 => 3.6596, std.dev.: 0.0177)
  MultiSource/Applications/obsequi/Obsequi: 7.51% (2.3061 => 2.4794, std.dev.: 0.0655)
  MultiSource/Benchmarks/llubenchmark/llu: 7.26% (1.9763 => 2.1198, std.dev.: 0.0176)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.95% (1.9729 => 2.0902, std.dev.: 0.0032)
  MultiSource/Applications/siod/siod: 5.29% (3.4258 => 3.6071, std.dev.: 0.0285)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.79% (3.4043 => 3.5674, std.dev.: 0.0344)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.74% (40.5530 => 42.4736, std.dev.: 0.3547)
  SingleSource/Benchmarks/Misc/flops: 3.80% (9.2673 => 9.6195, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.19% (5.9126 => 6.1012, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.63% (1.2463 => 1.2791, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.59% (4.0593 => 4.1643, std.dev.: 0.0129)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.82% (1.1019 => 1.1220, std.dev.: 0.0030)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.74% (0.6261 => 0.6370, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.45% (1.4366 => 1.4574, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.43% (11.7894 => 11.9584, std.dev.: 0.0560)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.74% (0.0688 => 0.0504, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.68% (0.3247 => 0.2965, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.27% (1.3676 => 1.2818, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.45% (1.3819 => 1.3066, std.dev.: 0.0239)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.14% (1.0197 => 0.9673, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.12% (1.4113 => 1.3390, std.dev.: 0.0260)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.76% (0.2540 => 0.2419, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.23% (1.3182 => 1.2624, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.13% (1.3157 => 1.2613, std.dev.: 0.0180)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.08% (1.1409 => 1.0943, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.06% (1.2724 => 1.2208, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.61% (1.3918 => 1.3416, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.56% (1.3608 => 1.3260, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.37% (1.3510 => 1.3190, std.dev.: 0.0104)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.03% (7.5124 => 7.3602, std.dev.: 0.0245)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.99% (2.8850 => 2.4237, std.dev.: 0.0338)
  MultiSource/Benchmarks/sim/sim: -5.30% (4.0134 => 3.8005, std.dev.: 0.0421)
  SingleSource/Benchmarks/McGill/misr: -4.62% (0.4029 => 0.3843, std.dev.: 0.0012)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131226/eaa9a6b5/attachment.html>


More information about the llvm-testresults mailing list