[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 23 17:31:03 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13687?compare_to=13684&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13687, Order: 186989, Start Time: 2013-07-23 22:40:35, End Time: 2013-07-24 00:32:40
      To: 13684, Order: 186982, Start Time: 2013-07-23 20:25:38, End Time: 2013-07-23 22:16:58
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 68 (48 on baseline)
Performance Improvements: 14 (10 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1025 (1049 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: 56.99% (0.2039 => 0.3201, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/mandel-2: 56.68% (0.0367 => 0.0575, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/Oscar: 54.44% (0.0720 => 0.1112, std.dev.: 0.0069)
  SingleSource/Benchmarks/McGill/exptree: 54.00% (0.1000 => 0.1540, std.dev.: 0.0083)
  SingleSource/Benchmarks/Misc/flops: 53.84% (0.1120 => 0.1723, std.dev.: 0.0031)
  SingleSource/Benchmarks/Misc/salsa20: 50.92% (0.0595 => 0.0898, std.dev.: 0.0007)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 43.09% (0.1743 => 0.2494, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc/flops-8: 41.10% (0.0326 => 0.0460, std.dev.: 0.0033)
  SingleSource/Benchmarks/McGill/misr: 40.48% (0.0704 => 0.0989, std.dev.: 0.0064)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 40.06% (0.1238 => 0.1734, std.dev.: 0.0174)
  MultiSource/Applications/obsequi/Obsequi: 35.50% (1.1905 => 1.6131, std.dev.: 0.1247)
  MultiSource/Benchmarks/McCat/09-vor/vor: 31.04% (0.3583 => 0.4695, std.dev.: 0.0217)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 27.93% (0.0870 => 0.1113, std.dev.: 0.0087)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 24.63% (1.2339 => 1.5378, std.dev.: 0.0831)
  MultiSource/Applications/hexxagon/hexxagon: 24.21% (1.1384 => 1.4140, std.dev.: 0.0370)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 22.07% (5.8683 => 7.1634, std.dev.: 0.0406)
  MultiSource/Applications/minisat/minisat: 17.72% (0.8215 => 0.9671, std.dev.: 0.0341)
  MultiSource/Applications/treecc/treecc: 17.28% (2.5465 => 2.9865, std.dev.: 0.1486)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.94% (5.0893 => 5.7477, std.dev.: 0.0573)
  MultiSource/Applications/JM/lencod/lencod: 10.42% (17.6578 => 19.4972, std.dev.: 0.6144)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.20% (1.4522 => 1.6003, std.dev.: 0.0213)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.49% (10.8761 => 11.6906, std.dev.: 0.2931)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 6.75% (1.6020 => 1.7101, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.41% (1.4607 => 1.5544, std.dev.: 0.0087)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.33% (47.2750 => 50.2652, std.dev.: 1.1030)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.94% (1.3750 => 1.4567, std.dev.: 0.0123)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.82% (2.4991 => 2.6446, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 5.69% (1.3644 => 1.4420, std.dev.: 0.0267)
  MultiSource/Applications/kimwitu++/kc: 5.29% (19.5797 => 20.6163, std.dev.: 0.2205)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.96% (1.3548 => 1.4220, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.67% (1.4867 => 1.5562, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.42% (0.2511 => 0.2622, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.86% (1.5311 => 1.5902, std.dev.: 0.0063)
  MultiSource/Applications/siod/siod: 2.91% (2.7789 => 2.8597, std.dev.: 0.0125)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 52.49% (0.0261 => 0.0398, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 38.27% (0.8029 => 1.1102, std.dev.: 0.1014)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 35.92% (0.0554 => 0.0753, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 33.58% (3.4250 => 4.5750, std.dev.: 0.0683)
  MultiSource/Benchmarks/Olden/bisort/bisort: 31.89% (0.6808 => 0.8979, std.dev.: 0.0174)
  MultiSource/Applications/JM/ldecod/ldecod: 29.12% (0.0752 => 0.0971, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/moments: 23.67% (0.1014 => 0.1254, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc/flops: 21.38% (8.0633 => 9.7870, std.dev.: 0.0638)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 19.98% (1.3879 => 1.6652, std.dev.: 0.0310)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.62% (1.2477 => 1.4925, std.dev.: 0.0206)
  SingleSource/Benchmarks/Misc/fp-convert: 16.58% (6.9361 => 8.0858, std.dev.: 0.0095)
  MultiSource/Applications/obsequi/Obsequi: 14.72% (2.2904 => 2.6275, std.dev.: 0.0665)
  SingleSource/Benchmarks/Shootout/ary3: 12.86% (9.4110 => 10.6209, std.dev.: 0.2479)
  MultiSource/Applications/minisat/minisat: 9.16% (7.2861 => 7.9532, std.dev.: 0.2182)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.92% (3.3539 => 3.6531, std.dev.: 0.0928)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.15% (9.7155 => 10.4102, std.dev.: 0.1084)
  SingleSource/Benchmarks/Misc/flops-4: 7.09% (1.5331 => 1.6418, std.dev.: 0.0273)
  MultiSource/Benchmarks/Olden/tsp/tsp: 6.08% (1.4447 => 1.5326, std.dev.: 0.0181)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.58% (91.5592 => 95.7522, std.dev.: 0.4393)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.24% (14.5807 => 15.1992, std.dev.: 0.1853)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.19% (2.5899 => 2.6984, std.dev.: 0.0191)
  MultiSource/Applications/lua/lua: 3.95% (30.0645 => 31.2511, std.dev.: 0.1027)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.37% (0.4891 => 0.5056, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 3.35% (6.6845 => 6.9083, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.14% (4.8995 => 5.0531, std.dev.: 0.0058)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.75% (46.2317 => 47.5048, std.dev.: 0.1098)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.56% (39.9931 => 41.0174, std.dev.: 0.2324)
  MultiSource/Applications/aha/aha: 2.19% (3.6044 => 3.6834, std.dev.: 0.0077)
  MultiSource/Applications/sqlite3/sqlite3: 1.64% (4.3581 => 4.4294, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.52% (5.8819 => 5.9712, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/flops-7: 1.45% (1.8197 => 1.8460, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.36% (2.7579 => 2.7955, std.dev.: 0.0085)
  MultiSource/Benchmarks/Bullet/bullet: 1.28% (7.1453 => 7.2370, std.dev.: 0.0171)
  SingleSource/Benchmarks/Shootout-C++/fibo: 1.06% (4.8165 => 4.8677, std.dev.: 0.0098)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -40.07% (0.0307 => 0.0184, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/methcall: -39.64% (0.0608 => 0.0367, std.dev.: 0.0027)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: -37.09% (0.0275 => 0.0173, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/sumarray-dbl: -36.75% (0.0351 => 0.0222, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout/strcat: -32.57% (0.0479 => 0.0323, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/lists: -28.14% (0.1148 => 0.0825, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -23.08% (0.0979 => 0.0753, std.dev.: 0.0013)
  MultiSource/Applications/spiff/spiff: -20.15% (1.3505 => 1.0784, std.dev.: 0.1000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.50% (0.2454 => 0.2270, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -2.57% (0.4048 => 0.3944, std.dev.: 0.0010)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -15.96% (2.2075 => 1.8551, std.dev.: 0.1309)
  SingleSource/Benchmarks/Shootout/strcat: -10.84% (0.1762 => 0.1571, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.01% (6.5705 => 6.3726, std.dev.: 0.0168)
  MultiSource/Applications/spiff/spiff: -2.31% (2.8325 => 2.7670, std.dev.: 0.0176)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 24.16% (0.1333 => 0.1655, std.dev.: 0.0021)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/mandel-2: 73.72% (0.0331 => 0.0575, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/Oscar: 56.18% (0.0712 => 0.1112, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/flops: 55.37% (0.1109 => 0.1723, std.dev.: 0.0031)
  SingleSource/Benchmarks/McGill/exptree: 55.24% (0.0992 => 0.1540, std.dev.: 0.0083)
  SingleSource/Benchmarks/Misc/salsa20: 52.46% (0.0589 => 0.0898, std.dev.: 0.0007)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 50.65% (0.1151 => 0.1734, std.dev.: 0.0174)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 44.08% (0.1731 => 0.2494, std.dev.: 0.0136)
  SingleSource/Benchmarks/McGill/misr: 41.69% (0.0698 => 0.0989, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc/flops-8: 35.69% (0.0339 => 0.0460, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/em3d/em3d: 35.23% (0.2367 => 0.3201, std.dev.: 0.0187)
  MultiSource/Benchmarks/McCat/09-vor/vor: 27.93% (0.3670 => 0.4695, std.dev.: 0.0217)
  MultiSource/Applications/treecc/treecc: 26.27% (2.3651 => 2.9865, std.dev.: 0.1486)
  MultiSource/Applications/minisat/minisat: 16.83% (0.8278 => 0.9671, std.dev.: 0.0341)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.23% (6.1631 => 7.1634, std.dev.: 0.0406)
  SingleSource/Benchmarks/Shootout-C++/sieve: 8.70% (0.3148 => 0.3422, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 8.63% (1.4732 => 1.6003, std.dev.: 0.0213)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.71% (10.8541 => 11.6906, std.dev.: 0.2931)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 7.48% (5.3476 => 5.7477, std.dev.: 0.0573)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.60% (0.2609 => 0.2755, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.37% (4.2444 => 4.4722, std.dev.: 0.0752)
  MultiSource/Applications/siod/siod: 5.33% (2.7150 => 2.8597, std.dev.: 0.0125)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 4.83% (0.4182 => 0.4384, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.45% (1.3946 => 1.4567, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.15% (1.5416 => 1.5902, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.31% (1.5361 => 1.5562, std.dev.: 0.0074)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.21% (1.0359 => 1.0484, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 82.62% (5.8158 => 10.6209, std.dev.: 0.2479)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 57.58% (2.9033 => 4.5750, std.dev.: 0.0683)
  SingleSource/Benchmarks/Shootout/heapsort: 51.15% (2.9123 => 4.4019, std.dev.: 0.1678)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 47.94% (0.0509 => 0.0753, std.dev.: 0.0006)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 32.60% (1.2558 => 1.6652, std.dev.: 0.0310)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 24.14% (2.9428 => 3.6531, std.dev.: 0.0928)
  SingleSource/Benchmarks/Shootout-C++/moments: 18.53% (0.1058 => 0.1254, std.dev.: 0.0064)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.40% (3.9978 => 4.6533, std.dev.: 0.1701)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.95% (9.1355 => 10.4102, std.dev.: 0.1084)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 13.52% (1.3148 => 1.4925, std.dev.: 0.0206)
  SingleSource/Benchmarks/Shootout-C++/lists1: 12.46% (0.6034 => 0.6786, std.dev.: 0.0291)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.11% (2.0229 => 2.1870, std.dev.: 0.0270)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.00% (36.8900 => 39.4737, std.dev.: 0.9775)
  SingleSource/Benchmarks/Misc/flops-7: 6.52% (1.7330 => 1.8460, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.77% (60.3477 => 63.2237, std.dev.: 0.6507)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.77% (21.5567 => 22.3699, std.dev.: 0.1091)
  MultiSource/Applications/aha/aha: 2.41% (3.5968 => 3.6834, std.dev.: 0.0077)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.22% (93.6732 => 95.7522, std.dev.: 0.4393)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.75% (6.2627 => 6.3726, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.53% (5.8810 => 5.9712, std.dev.: 0.0073)
  SingleSource/Regression/C/uint64_to_float: 1.38% (1.5184 => 1.5394, std.dev.: 0.0031)
  MultiSource/Applications/sqlite3/sqlite3: 1.05% (4.3833 => 4.4294, std.dev.: 0.0093)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: -17.27% (0.1818 => 0.1504, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.64% (1.5144 => 1.4441, std.dev.: 0.0266)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.34% (1.7461 => 1.6703, std.dev.: 0.0292)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -34.65% (0.1189 => 0.0777, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.19% (0.0816 => 0.0586, std.dev.: 0.0081)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.73% (0.3557 => 0.3211, std.dev.: 0.0125)
  MultiSource/Benchmarks/Olden/bisort/bisort: -5.93% (0.9545 => 0.8979, std.dev.: 0.0174)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -4.79% (0.5173 => 0.4925, std.dev.: 0.0019)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.42% (3.5791 => 3.4566, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.77% (4.9231 => 4.8358, std.dev.: 0.0224)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 20.10% (0.1378 => 0.1655, std.dev.: 0.0021)

Report Time: 0.31s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130723/f64c882c/attachment.html>


More information about the llvm-testresults mailing list