[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jan 8 23:29:31 PST 2014


http://llvm.org/perf/db_default/v4/nts/20086?compare_to=20082&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20086, Order: 198849, Start Time: 2014-01-09 05:47:37, End Time: 2014-01-09 07:34:16
      To: 20082, Order: 198833, Start Time: 2014-01-09 03:06:33, End Time: 2014-01-09 05:12:59
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 23 (30 on baseline)
Performance Improvements: 17 (58 on baseline)
Unchanged Tests: 1070 (1022 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.98% (1.2022 => 1.2260, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.79% (1.2875 => 1.3106, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.78% (1.2888 => 1.3117, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.68% (1.3089 => 1.3309, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city: 29.38% (0.0388 => 0.0502, std.dev.: 0.0007)
  SingleSource/Benchmarks/Stanford/Puzzle: 13.35% (0.1596 => 0.1809, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 12.01% (3.1557 => 3.5346, std.dev.: 0.0080)
  SingleSource/Benchmarks/McGill/misr: 6.22% (0.3825 => 0.4063, std.dev.: 0.0047)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.65% (0.8411 => 0.8886, std.dev.: 0.0069)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.34% (0.3555 => 0.3745, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.61% (3.6882 => 3.8583, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.30% (5.6939 => 5.9390, std.dev.: 0.0010)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.81% (4.1998 => 4.3597, std.dev.: 0.0158)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 3.32% (0.4938 => 0.5102, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.19% (2.0265 => 2.0912, std.dev.: 0.0026)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.55% (1.6490 => 1.6910, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.37% (3.6343 => 3.7203, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.13% (5.5075 => 5.6249, std.dev.: 0.0002)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.57% (2.3873 => 2.4247, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.53% (5.9183 => 6.0090, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.28% (6.6040 => 6.6885, std.dev.: 0.0112)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.05% (8.8127 => 8.9052, std.dev.: 0.0169)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.02% (3.8285 => 3.8674, std.dev.: 0.0025)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/sgefa/sgefa: -21.67% (0.4932 => 0.3863, std.dev.: 0.0049)
  MultiSource/Applications/siod/siod: -6.47% (2.7663 => 2.5873, std.dev.: 0.0217)
  MultiSource/Applications/spiff/spiff: -5.90% (0.9711 => 0.9138, std.dev.: 0.0208)
  MultiSource/Applications/JM/lencod/lencod: -4.92% (18.3084 => 17.4072, std.dev.: 0.3459)
  MultiSource/Applications/oggenc/oggenc: -4.82% (5.9695 => 5.6819, std.dev.: 0.1041)
  MultiSource/Applications/d/make_dparser: -4.54% (3.7406 => 3.5707, std.dev.: 0.0214)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -3.57% (0.3365 => 0.3245, std.dev.: 0.0010)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.65% (1.6905 => 1.6457, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.95% (0.6565 => 0.6437, std.dev.: 0.0027)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.52% (10.2922 => 10.1362, std.dev.: 0.0147)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -14.42% (25.3255 => 21.6735, std.dev.: 0.2956)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.74% (38.5829 => 35.9807, std.dev.: 0.8394)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -5.14% (3.7933 => 3.5985, std.dev.: 0.0300)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -5.09% (3.8045 => 3.6110, std.dev.: 0.0098)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.42% (2.4930 => 2.3827, std.dev.: 0.0104)
  MultiSource/Applications/siod/siod: -3.47% (3.7106 => 3.5820, std.dev.: 0.0146)
  MultiSource/Applications/spiff/spiff: -1.14% (2.9034 => 2.8703, std.dev.: 0.0009)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 39.71% (15.7419 => 21.9931, std.dev.: 1.0639)
  MultiSource/Applications/lemon/lemon: 9.72% (1.2200 => 1.3386, std.dev.: 0.0419)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.57% (25.9661 => 27.4113, std.dev.: 0.1373)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.14% (1.2845 => 1.2992, std.dev.: 0.0016)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.06% (2.5384 => 2.5654, std.dev.: 0.0011)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 19.19% (5.9583 => 7.1018, std.dev.: 0.0685)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.11% (82.2592 => 92.2245, std.dev.: 0.1086)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.91% (3.1585 => 3.5346, std.dev.: 0.0080)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.45% (0.1668 => 0.1809, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.86% (3.5771 => 3.8583, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.21% (3.5027 => 3.7203, std.dev.: 0.0012)
  MultiSource/Applications/lua/lua: 6.08% (29.1357 => 30.9061, std.dev.: 0.4242)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.00% (1.9729 => 2.0912, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.97% (0.3534 => 0.3745, std.dev.: 0.0034)
  MultiSource/Applications/siod/siod: 4.56% (3.4258 => 3.5820, std.dev.: 0.0146)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.20% (4.1840 => 4.3597, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.41% (5.2486 => 5.4278, std.dev.: 0.0044)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.29% (0.5112 => 0.5280, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.13% (5.9126 => 6.0975, std.dev.: 0.0086)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 2.89% (0.8636 => 0.8886, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.46% (11.7894 => 12.0796, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.44% (6.5291 => 6.6885, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.21% (5.5032 => 5.6249, std.dev.: 0.0002)
  MultiSource/Applications/spiff/spiff: 2.04% (2.8130 => 2.8703, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.96% (5.8933 => 6.0090, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.84% (2.5025 => 2.5485, std.dev.: 0.0011)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.53% (2.3882 => 2.4247, std.dev.: 0.0004)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.26% (1.6699 => 1.6910, std.dev.: 0.0012)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.26% (23.3972 => 23.6912, std.dev.: 0.0651)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.11% (8.8073 => 8.9052, std.dev.: 0.0169)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.60% (0.0688 => 0.0505, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.71% (0.1938 => 0.1653, std.dev.: 0.0010)
  MultiSource/Benchmarks/Bullet/bullet: -9.23% (36.6274 => 33.2450, std.dev.: 0.3408)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.22% (0.3247 => 0.2980, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.35% (0.1523 => 0.1411, std.dev.: 0.0026)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.03% (0.3402 => 0.3163, std.dev.: 0.0018)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.61% (0.2540 => 0.2372, std.dev.: 0.0021)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.60% (0.1774 => 0.1657, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.47% (0.6882 => 0.6437, std.dev.: 0.0027)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.38% (1.0197 => 0.9546, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.32% (1.4277 => 1.3375, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.30% (1.3676 => 1.2814, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.20% (1.5034 => 1.4102, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.75% (1.3146 => 1.2390, std.dev.: 0.0085)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.69% (0.2758 => 0.2601, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.08% (1.3819 => 1.3117, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.04% (2.0207 => 1.9188, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.70% (1.3505 => 1.2870, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.70% (1.4113 => 1.3450, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.27% (1.2824 => 1.2276, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.08% (1.1409 => 1.0943, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.06% (1.3660 => 1.3106, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.02% (1.2914 => 1.2395, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.93% (1.5305 => 1.4703, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.92% (1.3127 => 1.2613, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.84% (1.4125 => 1.3582, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.82% (1.3157 => 1.2655, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.76% (15.4053 => 14.8262, std.dev.: 0.0588)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.66% (0.3714 => 0.3578, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.65% (1.2724 => 1.2260, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.60% (1.3918 => 1.3417, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.44% (1.2544 => 1.2112, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.31% (1.3264 => 1.2825, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.26% (1.2785 => 1.2368, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.14% (1.3460 => 1.3038, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.86% (1.3024 => 1.2651, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.63% (1.3182 => 1.2835, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.57% (1.2583 => 1.2260, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.32% (1.3457 => 1.3145, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.16% (1.3608 => 1.3314, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.00% (1.4074 => 1.3792, std.dev.: 0.0018)
  MultiSource/Applications/d/make_dparser: -1.98% (3.6428 => 3.5707, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.85% (1.3510 => 1.3260, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.82% (1.2952 => 1.2716, std.dev.: 0.0008)
  MultiSource/Applications/obsequi/Obsequi: -1.81% (1.1905 => 1.1689, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.81% (1.2670 => 1.2441, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.79% (1.3551 => 1.3309, std.dev.: 0.0021)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.68% (10.3096 => 10.1362, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.61% (1.3068 => 1.2858, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -1.27% (1.2356 => 1.2199, std.dev.: 0.0044)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.19% (1.6656 => 1.6457, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.41% (2.8850 => 2.3827, std.dev.: 0.0104)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.90% (15.5356 => 12.9101, std.dev.: 0.8793)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.27% (50.9650 => 45.2224, std.dev.: 1.5833)
  MultiSource/Benchmarks/nbench/nbench: -10.16% (23.4696 => 21.0845, std.dev.: 0.7164)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.84% (10.0217 => 9.4362, std.dev.: 0.0242)
  MultiSource/Benchmarks/Bullet/bullet: -4.86% (7.4226 => 7.0622, std.dev.: 0.0357)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.72% (99.3511 => 96.6532, std.dev.: 1.0420)

Report Time: 0.75s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140109/be9f5b4e/attachment.html>


More information about the llvm-testresults mailing list