[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jul 25 15:13:19 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13762?compare_to=13759&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13762, Order: 187152, Start Time: 2013-07-25 20:23:40, End Time: 2013-07-25 22:14:56
      To: 13759, Order: 187133, Start Time: 2013-07-25 18:09:56, End Time: 2013-07-25 20:00:26
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 33 (32 on baseline)
Performance Improvements: 22 (30 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1052 (1045 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/factor: 53.60% (0.0375 => 0.0576, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 44.33% (0.0706 => 0.1019, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.79% (1.3986 => 1.4935, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.47% (1.4430 => 1.5219, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.80% (1.4613 => 1.5315, std.dev.: 0.0101)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.52% (0.3076 => 0.3215, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.57% (2.8893 => 4.2925, std.dev.: 0.0181)
  SingleSource/Benchmarks/Shootout/heapsort: 45.80% (3.1466 => 4.5877, std.dev.: 0.0113)
  MultiSource/Applications/siod/siod: 15.83% (3.3483 => 3.8782, std.dev.: 0.1214)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.26% (37.6265 => 42.2380, std.dev.: 1.1257)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 12.11% (1.2140 => 1.3610, std.dev.: 0.0064)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.61% (0.1344 => 0.1500, std.dev.: 0.0053)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.54% (14.2336 => 15.8758, std.dev.: 0.3424)
  SingleSource/Benchmarks/Misc/fp-convert: 10.72% (7.2949 => 8.0767, std.dev.: 0.0898)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.44% (5.4507 => 5.9653, std.dev.: 0.0216)
  SingleSource/Benchmarks/Misc/salsa20: 8.85% (8.2668 => 8.9983, std.dev.: 0.0946)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.50% (3.4061 => 3.6615, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.28% (5.3038 => 5.6370, std.dev.: 0.0478)
  SingleSource/Benchmarks/Misc/flops-4: 6.02% (1.5385 => 1.6311, std.dev.: 0.0153)
  SingleSource/Benchmarks/McGill/chomp: 5.65% (1.0258 => 1.0838, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.47% (5.5033 => 5.8043, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.51% (3.3179 => 3.4675, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.46% (3.3152 => 3.4629, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.28% (4.3151 => 4.5000, std.dev.: 0.0191)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.97% (0.6366 => 0.6619, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.63% (4.8909 => 5.0686, std.dev.: 0.0527)
  SingleSource/Benchmarks/Misc/ffbench: 2.32% (1.3923 => 1.4246, std.dev.: 0.0108)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.10% (1.4303 => 1.4603, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.86% (3.0557 => 3.1125, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/flops: 1.73% (9.7689 => 9.9379, std.dev.: 0.0229)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.54% (5.8220 => 5.9119, std.dev.: 0.0258)
  SingleSource/Benchmarks/Shootout-C++/random: 1.35% (2.4427 => 2.4756, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.05% (12.8426 => 12.9777, std.dev.: 0.0225)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/lowercase: -26.64% (0.0428 => 0.0314, std.dev.: 0.0026)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -20.12% (0.1521 => 0.1215, std.dev.: 0.0074)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -13.56% (0.3141 => 0.2715, std.dev.: 0.0147)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.92% (0.2502 => 0.2354, std.dev.: 0.0048)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -40.56% (2.4196 => 1.4382, std.dev.: 0.0928)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -40.41% (0.1554 => 0.0926, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.37% (6.9453 => 5.2525, std.dev.: 0.0108)
  SingleSource/Benchmarks/Shootout-C++/ary: -17.80% (0.0753 => 0.0619, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -17.73% (0.5960 => 0.4903, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.54% (6.3627 => 5.5009, std.dev.: 0.1786)
  MultiSource/Applications/sgefa/sgefa: -12.92% (1.4017 => 1.2206, std.dev.: 0.0101)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -5.79% (0.4925 => 0.4640, std.dev.: 0.0006)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.28% (2.7254 => 2.5814, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -5.22% (3.8264 => 3.6266, std.dev.: 0.0213)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.05% (1.7163 => 1.6297, std.dev.: 0.0254)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.03% (47.2662 => 44.8870, std.dev.: 0.0937)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.60% (0.2859 => 0.2756, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.36% (17.2338 => 16.6556, std.dev.: 0.1041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.87% (1.1030 => 1.0713, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.24% (6.1049 => 5.9680, std.dev.: 0.0324)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.91% (21.7183 => 21.3045, std.dev.: 0.1086)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.06% (5.8755 => 5.8133, std.dev.: 0.0216)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.60% (0.1332 => 0.1284, std.dev.: 0.0045)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/factor: 65.04% (0.0349 => 0.0576, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 43.72% (0.0709 => 0.1019, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.43% (4.2444 => 4.6024, std.dev.: 0.1047)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.73% (1.3993 => 1.4935, std.dev.: 0.0240)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.08% (0.3089 => 0.3215, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 78.49% (5.8158 => 10.3808, std.dev.: 0.2159)
  SingleSource/Benchmarks/Shootout/heapsort: 57.53% (2.9123 => 4.5877, std.dev.: 0.0113)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.70% (2.8867 => 4.2925, std.dev.: 0.0181)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 36.36% (0.0341 => 0.0465, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.85% (4.5517 => 5.6371, std.dev.: 0.3893)
  MultiSource/Applications/siod/siod: 14.87% (3.3761 => 3.8782, std.dev.: 0.1214)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.50% (36.8900 => 42.2380, std.dev.: 1.1257)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 14.24% (9.1355 => 10.4367, std.dev.: 0.1309)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.28% (0.1348 => 0.1500, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/hash: 9.59% (4.1846 => 4.5859, std.dev.: 0.1265)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.64% (5.4910 => 5.9653, std.dev.: 0.0216)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3610, std.dev.: 0.0064)
  SingleSource/Benchmarks/McGill/chomp: 7.83% (1.0051 => 1.0838, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.42% (3.4085 => 3.6615, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.27% (5.3042 => 5.6370, std.dev.: 0.0478)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.13% (14.9584 => 15.8758, std.dev.: 0.3424)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.52% (5.5008 => 5.8043, std.dev.: 0.0165)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.05% (2.0229 => 2.1250, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.28% (4.3151 => 4.5000, std.dev.: 0.0191)
  SingleSource/Benchmarks/Misc/ffbench: 4.15% (1.3679 => 1.4246, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.73% (3.3384 => 3.4629, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.62% (3.3464 => 3.4675, std.dev.: 0.0194)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.15% (0.6480 => 0.6619, std.dev.: 0.0003)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.93% (1.4327 => 1.4603, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc/flops: 1.76% (9.7664 => 9.9379, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.45% (3.0680 => 3.1125, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.25% (5.8390 => 5.9119, std.dev.: 0.0258)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.07% (1.5228 => 1.2020, std.dev.: 0.0232)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.96% (0.1518 => 0.1215, std.dev.: 0.0074)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.10% (0.3576 => 0.2893, std.dev.: 0.0190)
  MultiSource/Applications/lua/lua: -17.98% (5.3200 => 4.3633, std.dev.: 0.3063)
  MultiSource/Applications/hexxagon/hexxagon: -14.44% (1.3285 => 1.1366, std.dev.: 0.0397)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.42% (1.3985 => 1.1968, std.dev.: 0.0138)
  MultiSource/Applications/sqlite3/sqlite3: -9.45% (19.1635 => 17.3517, std.dev.: 0.6804)
  MultiSource/Applications/minisat/minisat: -5.91% (0.8278 => 0.7789, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.14% (1.5144 => 1.4365, std.dev.: 0.0203)
  MultiSource/Applications/lemon/lemon: -4.99% (1.2976 => 1.2329, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.55% (1.4783 => 1.4111, std.dev.: 0.0253)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -35.75% (1.4194 => 0.9119, std.dev.: 0.1246)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.59% (2.1022 => 1.4382, std.dev.: 0.0928)
  MultiSource/Benchmarks/MallocBench/gs/gs: -27.75% (0.1189 => 0.0859, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.48% (6.9552 => 5.2525, std.dev.: 0.0108)
  MultiSource/Applications/minisat/minisat: -20.32% (8.0162 => 6.3876, std.dev.: 0.3067)
  MultiSource/Applications/sgefa/sgefa: -13.00% (1.4030 => 1.2206, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.16% (6.2627 => 5.5009, std.dev.: 0.1786)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.29% (1.7207 => 1.6297, std.dev.: 0.0254)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.95% (47.2250 => 44.8870, std.dev.: 0.0937)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.86% (3.8119 => 3.6266, std.dev.: 0.0213)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.57% (2.7049 => 2.5814, std.dev.: 0.0362)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.99% (0.4783 => 0.4640, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.93% (6.1482 => 5.9680, std.dev.: 0.0324)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.82% (1.1024 => 1.0713, std.dev.: 0.0117)
  SingleSource/Regression/C/uint64_to_float: -2.75% (1.5184 => 1.4766, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.49% (5.2218 => 5.0917, std.dev.: 0.0363)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.76% (21.6864 => 21.3045, std.dev.: 0.1086)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.37% (5.0180 => 4.9495, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.15% (5.8810 => 5.8133, std.dev.: 0.0216)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.82% (0.1378 => 0.1284, std.dev.: 0.0045)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130725/5c26e6de/attachment.html>


More information about the llvm-testresults mailing list