[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 22 08:33:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16573?compare_to=16569&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16573, Order: 193160, Start Time: 2013-10-22 13:47:10, End Time: 2013-10-22 15:36:44
      To: 16569, Order: 193157, Start Time: 2013-10-22 11:41:59, End Time: 2013-10-22 13:26:05
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 41 (64 on baseline)
Performance Improvements: 9 (21 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1057 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: 56.42% (0.5363 => 0.8389, std.dev.: 0.0830)
  MultiSource/Applications/Burg/burg: 39.76% (1.4338 => 2.0039, std.dev.: 0.0276)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 38.80% (1.1636 => 1.6151, std.dev.: 0.0758)
  MultiSource/Applications/treecc/treecc: 34.93% (2.3060 => 3.1116, std.dev.: 0.1183)
  MultiSource/Applications/spiff/spiff: 32.16% (0.9198 => 1.2156, std.dev.: 0.1001)
  MultiSource/Applications/lambda-0_1_3/lambda: 24.98% (0.8307 => 1.0382, std.dev.: 0.0188)
  MultiSource/Applications/SPASS/SPASS: 18.09% (16.5221 => 19.5109, std.dev.: 0.7846)
  MultiSource/Applications/siod/siod: 16.83% (2.5382 => 2.9655, std.dev.: 0.1073)
  MultiSource/Applications/d/make_dparser: 15.51% (3.6439 => 4.2092, std.dev.: 0.1206)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 13.88% (1.2625 => 1.4377, std.dev.: 0.0115)
  MultiSource/Applications/sqlite3/sqlite3: 13.81% (16.6394 => 18.9372, std.dev.: 0.1779)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 13.79% (4.9933 => 5.6817, std.dev.: 0.0583)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 10.72% (1.4753 => 1.6335, std.dev.: 0.0551)
  MultiSource/Applications/oggenc/oggenc: 10.60% (5.4871 => 6.0687, std.dev.: 0.0805)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.77% (1.2687 => 1.3927, std.dev.: 0.0186)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.75% (7.4756 => 8.0550, std.dev.: 0.0862)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 7.03% (1.4885 => 1.5931, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.00% (1.2624 => 1.3508, std.dev.: 0.0227)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 5.09% (0.2827 => 0.2971, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/d/make_dparser: 58.79% (0.0381 => 0.0605, std.dev.: 0.0031)
  MultiSource/Applications/lemon/lemon: 45.24% (0.8651 => 1.2565, std.dev.: 0.1199)
  MultiSource/Applications/JM/ldecod/ldecod: 43.01% (0.0658 => 0.0941, std.dev.: 0.0082)
  MultiSource/Applications/minisat/minisat: 39.43% (6.3184 => 8.8098, std.dev.: 0.1326)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 38.83% (0.0497 => 0.0690, std.dev.: 0.0058)
  MultiSource/Applications/SPASS/SPASS: 38.59% (7.9538 => 11.0234, std.dev.: 0.5777)
  MultiSource/Applications/obsequi/Obsequi: 16.10% (2.2571 => 2.6205, std.dev.: 0.0514)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.39% (2.6779 => 3.0366, std.dev.: 0.1142)
  MultiSource/Applications/lua/lua: 6.27% (28.1655 => 29.9312, std.dev.: 0.0585)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.94% (0.3737 => 0.3959, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.28% (4.0109 => 4.2226, std.dev.: 0.0328)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.06% (0.6898 => 0.7247, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.62% (4.5740 => 4.7852, std.dev.: 0.0364)
  MultiSource/Benchmarks/sim/sim: 2.92% (3.9631 => 4.0790, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.43% (5.7035 => 5.8419, std.dev.: 0.0494)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.22% (1.0422 => 1.0653, std.dev.: 0.0065)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.97% (6.7131 => 6.8454, std.dev.: 0.0042)
  MultiSource/Applications/sqlite3/sqlite3: 1.97% (4.3238 => 4.4088, std.dev.: 0.0120)
  MultiSource/Applications/siod/siod: 1.94% (3.5933 => 3.6631, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.66% (5.0300 => 5.1134, std.dev.: 0.0160)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.60% (2.4896 => 2.5295, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.49% (5.7892 => 5.8753, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -13.08% (0.1254 => 0.1090, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -9.51% (2.5578 => 2.3145, std.dev.: 0.0868)
  MultiSource/Applications/JM/lencod/lencod: -9.06% (8.3442 => 7.5880, std.dev.: 0.1395)
  MultiSource/Applications/spiff/spiff: -5.04% (2.9845 => 2.8340, std.dev.: 0.0404)
  MultiSource/Applications/aha/aha: -5.04% (3.7756 => 3.5853, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.25% (3.6711 => 3.5149, std.dev.: 0.0307)
  MultiSource/Applications/hexxagon/hexxagon: -4.04% (15.7676 => 15.1307, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -1.84% (6.6862 => 6.5634, std.dev.: 0.0185)
  MultiSource/Applications/sgefa/sgefa: -1.24% (0.9146 => 0.9033, std.dev.: 0.0038)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.47% (0.1365 => 0.1304, std.dev.: 0.0076)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: 61.79% (0.5185 => 0.8389, std.dev.: 0.0830)
  MultiSource/Applications/Burg/burg: 43.20% (1.3994 => 2.0039, std.dev.: 0.0276)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 41.76% (1.1393 => 1.6151, std.dev.: 0.0758)
  MultiSource/Applications/treecc/treecc: 38.20% (2.2516 => 3.1116, std.dev.: 0.1183)
  MultiSource/Applications/spiff/spiff: 36.42% (0.8911 => 1.2156, std.dev.: 0.1001)
  MultiSource/Applications/lambda-0_1_3/lambda: 29.55% (0.8014 => 1.0382, std.dev.: 0.0188)
  MultiSource/Applications/lua/lua: 22.01% (4.2242 => 5.1538, std.dev.: 0.3325)
  MultiSource/Applications/siod/siod: 21.14% (2.4480 => 2.9655, std.dev.: 0.1073)
  MultiSource/Applications/JM/ldecod/ldecod: 21.02% (7.4026 => 8.9583, std.dev.: 0.5437)
  MultiSource/Applications/SPASS/SPASS: 20.70% (16.1646 => 19.5109, std.dev.: 0.7846)
  MultiSource/Applications/d/make_dparser: 20.39% (3.4962 => 4.2092, std.dev.: 0.1206)
  MultiSource/Applications/sqlite3/sqlite3: 16.26% (16.2888 => 18.9372, std.dev.: 0.1779)
  MultiSource/Applications/JM/lencod/lencod: 16.15% (16.5902 => 19.2694, std.dev.: 0.7335)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 15.26% (4.9293 => 5.6817, std.dev.: 0.0583)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 14.80% (1.2523 => 1.4377, std.dev.: 0.0115)
  MultiSource/Applications/oggenc/oggenc: 13.78% (5.3339 => 6.0687, std.dev.: 0.0805)
  MultiSource/Applications/minisat/minisat: 13.68% (0.7439 => 0.8457, std.dev.: 0.0350)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 11.89% (1.4599 => 1.6335, std.dev.: 0.0551)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 10.97% (1.2550 => 1.3927, std.dev.: 0.0186)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.86% (7.2661 => 8.0550, std.dev.: 0.0862)
  SingleSource/Benchmarks/Misc/flops: 9.96% (0.1034 => 0.1137, std.dev.: 0.0021)
  MultiSource/Benchmarks/nbench/nbench: 9.33% (1.2484 => 1.3649, std.dev.: 0.0451)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.12% (1.2494 => 1.3508, std.dev.: 0.0227)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.70% (2.6492 => 2.8533, std.dev.: 0.0776)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 7.70% (1.4792 => 1.5931, std.dev.: 0.0111)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 4.36% (0.2847 => 0.2971, std.dev.: 0.0044)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.88% (4.5883 => 4.7205, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.70% (1.8775 => 1.9282, std.dev.: 0.0096)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.38% (0.6297 => 0.6447, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.10% (0.5046 => 0.5152, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.63% (5.5014 => 5.5913, std.dev.: 0.0235)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.71% (7.6426 => 12.5116, std.dev.: 0.0752)
  MultiSource/Applications/d/make_dparser: 57.55% (0.0384 => 0.0605, std.dev.: 0.0031)
  MultiSource/Applications/lemon/lemon: 47.37% (0.8526 => 1.2565, std.dev.: 0.1199)
  MultiSource/Applications/JM/ldecod/ldecod: 44.55% (0.0651 => 0.0941, std.dev.: 0.0082)
  MultiSource/Applications/minisat/minisat: 40.37% (6.2760 => 8.8098, std.dev.: 0.1326)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 38.83% (0.0497 => 0.0690, std.dev.: 0.0058)
  MultiSource/Applications/SPASS/SPASS: 33.92% (8.2311 => 11.0234, std.dev.: 0.5777)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 22.68% (2.4753 => 3.0366, std.dev.: 0.1142)
  MultiSource/Applications/obsequi/Obsequi: 19.75% (2.1884 => 2.6205, std.dev.: 0.0514)
  MultiSource/Benchmarks/sim/sim: 6.47% (3.8312 => 4.0790, std.dev.: 0.0242)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.95% (3.9856 => 4.2226, std.dev.: 0.0328)
  SingleSource/Benchmarks/McGill/misr: 5.83% (0.3771 => 0.3991, std.dev.: 0.0076)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.67% (0.1871 => 0.1977, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.54% (3.1730 => 3.3488, std.dev.: 0.0130)
  SingleSource/UnitTests/Vector/multiplies: 5.45% (0.5561 => 0.5864, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.02% (6.5990 => 6.9301, std.dev.: 0.1006)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.61% (4.5744 => 4.7852, std.dev.: 0.0364)
  MultiSource/Applications/siod/siod: 3.74% (3.5310 => 3.6631, std.dev.: 0.0105)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.30% (89.7126 => 92.6689, std.dev.: 0.1091)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.21% (0.3836 => 0.3959, std.dev.: 0.0014)
  MultiSource/Applications/sqlite3/sqlite3: 3.17% (4.2733 => 4.4088, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.58% (5.6951 => 5.8419, std.dev.: 0.0494)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.53% (1.7652 => 1.8099, std.dev.: 0.0044)
  MultiSource/Applications/hexxagon/hexxagon: 2.37% (14.7810 => 15.1307, std.dev.: 0.0185)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.34% (3.5683 => 3.6519, std.dev.: 0.0221)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.74% (16.7972 => 17.0887, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0065)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.61% (2.4920 => 2.5322, std.dev.: 0.0025)
  SingleSource/Regression/C/uint64_to_float: 1.61% (1.4528 => 1.4762, std.dev.: 0.0048)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.52% (6.7429 => 6.8454, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.50% (5.7884 => 5.8753, std.dev.: 0.0046)
  MultiSource/Applications/lua/lua: 1.39% (29.5202 => 29.9312, std.dev.: 0.0585)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.23% (1.6707 => 1.6912, std.dev.: 0.0020)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.70% (0.1483 => 0.1176, std.dev.: 0.0089)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.29% (0.1195 => 0.1084, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.64% (0.5226 => 0.2423, std.dev.: 0.0308)
  MultiSource/Applications/sgefa/sgefa: -42.79% (1.5790 => 0.9033, std.dev.: 0.0038)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0003)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.38% (57.2347 => 43.2801, std.dev.: 1.0188)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.18% (15.9508 => 12.8907, std.dev.: 0.4031)
  MultiSource/Benchmarks/mafft/pairlocalalign: -12.81% (50.0284 => 43.6210, std.dev.: 1.4828)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.68% (0.3304 => 0.2885, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -11.95% (0.1238 => 0.1090, std.dev.: 0.0057)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.49% (20.8247 => 18.4315, std.dev.: 0.1167)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.85% (3.4956 => 3.1862, std.dev.: 0.0032)
  MultiSource/Applications/JM/lencod/lencod: -7.22% (8.1785 => 7.5880, std.dev.: 0.1395)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.53% (3.7437 => 3.6117, std.dev.: 0.0226)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.40% (0.7474 => 0.7220, std.dev.: 0.0064)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.97% (3.7874 => 3.6748, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.51% (17.1431 => 16.7127, std.dev.: 0.0538)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.48% (2.5938 => 2.5295, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.46% (5.2422 => 5.1134, std.dev.: 0.0160)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.65% (4.9459 => 4.8644, std.dev.: 0.0094)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.20% (4.3592 => 4.3069, std.dev.: 0.0162)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.26% (0.1348 => 0.1304, std.dev.: 0.0076)

Report Time: 1.29s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131022/aff52c9f/attachment.html>


More information about the llvm-testresults mailing list