[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 1 12:21:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15864?compare_to=15860&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15864, Order: 191781, Start Time: 2013-10-01 17:33:49, End Time: 2013-10-01 19:24:24
      To: 15860, Order: 191770, Start Time: 2013-10-01 15:14:22, End Time: 2013-10-01 17:06:59
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 16 (31 on baseline)
Performance Improvements: 33 (12 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1058 (1064 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/objinst: 8.08% (0.2116 => 0.2287, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 6.09% (0.1906 => 0.2022, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/lists1: 4.01% (0.3118 => 0.3243, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.77% (1.2673 => 1.3024, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 39.31% (2.9971 => 4.1754, std.dev.: 0.3620)
  SingleSource/Benchmarks/Linpack/linpack-pc: 35.75% (34.7040 => 47.1096, std.dev.: 1.8986)
  SingleSource/Benchmarks/Shootout/ary3: 29.07% (4.6827 => 6.0441, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 20.63% (0.1614 => 0.1947, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.25% (6.5245 => 7.3888, std.dev.: 0.3083)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.77% (4.9444 => 5.4768, std.dev.: 0.0073)
  MultiSource/Benchmarks/nbench/nbench: 5.62% (22.2543 => 23.5061, std.dev.: 0.3274)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.29% (1.1558 => 1.2169, std.dev.: 0.0120)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.46% (18.1399 => 18.7681, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.40% (3.5996 => 3.7221, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.32% (5.2073 => 5.3804, std.dev.: 0.0132)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.37% (1.0478 => 1.0622, std.dev.: 0.0015)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -43.31% (0.1637 => 0.0928, std.dev.: 0.0234)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: -42.15% (0.0892 => 0.0516, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C++/family/family: -42.15% (0.0790 => 0.0457, std.dev.: 0.0013)
  MultiSource/Applications/spiff/spiff: -32.03% (1.3692 => 0.9306, std.dev.: 0.0301)
  MultiSource/Applications/Burg/burg: -28.16% (2.0343 => 1.4614, std.dev.: 0.2148)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -26.87% (0.7988 => 0.5842, std.dev.: 0.0313)
  MultiSource/Applications/treecc/treecc: -22.93% (3.0295 => 2.3347, std.dev.: 0.1421)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -22.19% (0.2929 => 0.2279, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -20.82% (0.0951 => 0.0753, std.dev.: 0.0050)
  MultiSource/Applications/SPASS/SPASS: -16.61% (20.0374 => 16.7101, std.dev.: 1.0945)
  MultiSource/Applications/d/make_dparser: -13.98% (4.1571 => 3.5760, std.dev.: 0.0553)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -10.63% (1.6270 => 1.4541, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -9.99% (1.5244 => 1.3721, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -9.63% (1.4784 => 1.3360, std.dev.: 0.0189)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -9.57% (1.4320 => 1.2950, std.dev.: 0.0219)
  MultiSource/Benchmarks/FreeBench/distray/distray: -9.46% (0.1279 => 0.1158, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -9.35% (1.4389 => 1.3043, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -8.93% (1.4057 => 1.2802, std.dev.: 0.0420)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -7.91% (1.3851 => 1.2755, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.78% (1.4300 => 1.3188, std.dev.: 0.0115)
  SingleSource/Benchmarks/SmallPT/smallpt: -7.67% (0.1512 => 0.1396, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -6.89% (1.4444 => 1.3449, std.dev.: 0.0148)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -28.38% (3.9481 => 2.8277, std.dev.: 0.0539)
  MultiSource/Applications/SPASS/SPASS: -26.99% (11.3509 => 8.2878, std.dev.: 0.9371)
  MultiSource/Applications/JM/ldecod/ldecod: -23.60% (0.0822 => 0.0628, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -19.72% (0.3271 => 0.2626, std.dev.: 0.0182)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.53% (0.5437 => 0.4647, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -12.40% (1.7053 => 1.4939, std.dev.: 0.0365)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.96% (41.4537 => 39.3978, std.dev.: 0.6853)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.95% (5.0002 => 4.8529, std.dev.: 0.0545)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.71% (23.7591 => 23.3532, std.dev.: 0.0610)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -1.44% (0.7271 => 0.7166, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.28% (9.0202 => 8.9044, std.dev.: 0.0070)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.57% (0.1362 => 0.1397, std.dev.: 0.0031)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/viterbi/viterbi: 12.65% (0.1976 => 0.2226, std.dev.: 0.0077)
  SingleSource/Benchmarks/Shootout-C++/objinst: 7.93% (0.2119 => 0.2287, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 6.14% (0.1905 => 0.2022, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.05% (0.3087 => 0.3243, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.04% (1.2086 => 1.2574, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.88% (1.2695 => 1.3188, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.17% (1.3036 => 1.3449, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.88% (1.2660 => 1.3024, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.85% (1.2468 => 1.2823, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.66% (1.3365 => 1.3721, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.66% (1.4304 => 1.4541, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.61% (1.2553 => 1.2755, std.dev.: 0.0044)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.51% (7.6426 => 12.4967, std.dev.: 0.0730)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 38.67% (3.0111 => 4.1754, std.dev.: 0.3620)
  SingleSource/Benchmarks/Shootout/ary3: 28.67% (4.6972 => 6.0441, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.69% (6.4425 => 7.3888, std.dev.: 0.3083)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.80% (4.9428 => 5.4768, std.dev.: 0.0073)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.50% (1.1013 => 1.2169, std.dev.: 0.0120)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.78% (0.8273 => 0.8999, std.dev.: 0.0244)
  SingleSource/UnitTests/Vector/multiplies: 6.73% (0.5561 => 0.5935, std.dev.: 0.0002)
  MultiSource/Benchmarks/nbench/nbench: 6.24% (22.1263 => 23.5061, std.dev.: 0.3274)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.23% (8.1346 => 8.6413, std.dev.: 0.0877)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.43% (3.5642 => 3.7221, std.dev.: 0.0012)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.67% (1.7652 => 1.8124, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.18% (3.5683 => 3.6462, std.dev.: 0.0261)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.89% (3.8582 => 3.9310, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.49% (6.6028 => 6.7015, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.47% (5.3022 => 5.3804, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout/methcall: 1.43% (8.5434 => 8.6658, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.38% (1.0477 => 1.0622, std.dev.: 0.0015)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.37% (16.7972 => 17.0273, std.dev.: 0.0153)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -16.32% (0.1483 => 0.1241, std.dev.: 0.0062)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.90% (0.5226 => 0.2409, std.dev.: 0.0564)
  MultiSource/Applications/sgefa/sgefa: -46.70% (1.5790 => 0.8416, std.dev.: 0.0350)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -20.89% (15.9508 => 12.6190, std.dev.: 0.4618)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.69% (57.2347 => 47.1096, std.dev.: 1.8986)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.05% (0.3304 => 0.2906, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.27% (3.4956 => 3.1365, std.dev.: 0.0328)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.88% (20.8247 => 18.7681, std.dev.: 0.0310)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.22% (50.0284 => 45.9168, std.dev.: 0.2849)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.49% (2.5938 => 2.5033, std.dev.: 0.0205)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.59% (3.7437 => 3.6468, std.dev.: 0.0234)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.07% (89.7126 => 88.7503, std.dev.: 0.0725)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.64% (0.1348 => 0.1397, std.dev.: 0.0031)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131001/3ad0baba/attachment.html>


More information about the llvm-testresults mailing list