[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Aug 25 06:50:45 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14766?compare_to=14764&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14766, Order: 189188, Start Time: 2013-08-25 12:05:54, End Time: 2013-08-25 13:52:57
      To: 14764, Order: 189187, Start Time: 2013-08-25 09:59:33, End Time: 2013-08-25 11:44:00
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 11 (32 on baseline)
Performance Improvements: 3 (61 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1093 (1014 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.88% (1.4396 => 1.4666, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.58% (1.3688 => 1.3904, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 50.12% (1.6597 => 2.4915, std.dev.: 0.0242)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.32% (4.7219 => 5.1618, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.93% (6.2057 => 6.5119, std.dev.: 0.0419)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.23% (0.6409 => 0.6680, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc/flops: 3.79% (9.4576 => 9.8158, std.dev.: 0.0064)
  SingleSource/Benchmarks/Shootout/hash: 3.24% (5.1600 => 5.3273, std.dev.: 0.0160)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 2.74% (2.9081 => 2.9877, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.72% (4.9427 => 5.0769, std.dev.: 0.0335)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.20% (1.5989 => 1.6181, std.dev.: 0.0047)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -6.72% (2.4719 => 2.3057, std.dev.: 0.0510)
  SingleSource/Benchmarks/McGill/queens: -2.21% (1.6855 => 1.6483, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.94% (5.4707 => 5.3648, std.dev.: 0.0325)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.85% (0.1297 => 0.1334, std.dev.: 0.0015)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 44.21% (0.0466 => 0.0672, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/oourafft: 7.40% (0.2284 => 0.2453, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.79% (1.4932 => 1.5199, std.dev.: 0.0060)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.65% (3.7285 => 6.5119, std.dev.: 0.0419)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.67% (2.8867 => 4.3494, std.dev.: 0.0711)
  SingleSource/Benchmarks/Shootout/hash: 27.31% (4.1846 => 5.3273, std.dev.: 0.0160)
  SingleSource/Benchmarks/Misc/pi: 25.61% (1.9835 => 2.4915, std.dev.: 0.0242)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.89% (0.6295 => 0.7295, std.dev.: 0.0298)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.07% (7.0762 => 7.8597, std.dev.: 0.0691)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.52% (5.4910 => 5.9590, std.dev.: 0.0728)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.40% (1.2557 => 1.3612, std.dev.: 0.0090)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.06% (48.3256 => 52.2230, std.dev.: 0.3358)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 7.94% (0.1348 => 0.1455, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.87% (3.2027 => 3.4228, std.dev.: 0.0051)
  SingleSource/Benchmarks/McGill/chomp: 6.54% (1.0051 => 1.0708, std.dev.: 0.0213)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.05% (5.3042 => 5.6251, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.74% (3.4085 => 3.6041, std.dev.: 0.0644)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.8000, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.34% (4.3151 => 4.5022, std.dev.: 0.0022)
  MultiSource/Applications/siod/siod: 4.26% (3.3761 => 3.5198, std.dev.: 0.0430)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.24% (3.3384 => 3.4799, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.23% (5.1471 => 5.3648, std.dev.: 0.0325)
  SingleSource/Benchmarks/Misc/whetstone: 4.09% (3.4559 => 3.5973, std.dev.: 0.0047)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.44% (25.0200 => 25.8803, std.dev.: 0.1321)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.86% (1.3104 => 1.3479, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/ffbench: 2.47% (1.3679 => 1.4017, std.dev.: 0.0100)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.68% (1.4398 => 1.4640, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.42% (4.9089 => 4.9788, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.40% (1.5957 => 1.6181, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.27% (1.2639 => 1.2799, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.26% (3.0680 => 3.1066, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.05% (2.9568 => 2.9877, std.dev.: 0.0027)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.65% (0.1072 => 0.0722, std.dev.: 0.0101)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.30% (1.5228 => 1.2136, std.dev.: 0.0421)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -18.45% (0.1518 => 0.1238, std.dev.: 0.0021)
  MultiSource/Applications/obsequi/Obsequi: -18.42% (1.4685 => 1.1980, std.dev.: 0.0449)
  MultiSource/Applications/lua/lua: -17.28% (5.3200 => 4.4009, std.dev.: 0.0822)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.86% (1.3985 => 1.2186, std.dev.: 0.0133)
  MultiSource/Applications/sgefa/sgefa: -12.52% (0.4809 => 0.4207, std.dev.: 0.0020)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.24% (0.7091 => 0.6223, std.dev.: 0.0047)
  MultiSource/Applications/ClamAV/clamscan: -11.39% (19.4145 => 17.2024, std.dev.: 0.8569)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.85% (0.3655 => 0.3295, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.00% (1.7797 => 1.6195, std.dev.: 0.0431)
  MultiSource/Applications/sqlite3/sqlite3: -8.92% (19.1635 => 17.4540, std.dev.: 0.2993)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.87% (1.5144 => 1.4103, std.dev.: 0.0206)
  MultiSource/Applications/siod/siod: -6.69% (2.7150 => 2.5335, std.dev.: 0.0355)
  MultiSource/Applications/Burg/burg: -6.05% (1.5733 => 1.4781, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (1.4853 => 1.4107, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.93% (1.5426 => 1.4666, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.85% (1.5361 => 1.4616, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.84% (1.5815 => 1.5050, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.82% (1.4721 => 1.4011, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.78% (1.4339 => 1.3654, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.47% (1.4333 => 1.3693, std.dev.: 0.0116)
  MultiSource/Applications/lemon/lemon: -4.27% (1.2976 => 1.2422, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.59% (1.5479 => 1.4924, std.dev.: 0.0149)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.44% (0.7189 => 0.6942, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -39.02% (1.4194 => 0.8655, std.dev.: 0.0214)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.39% (2.1022 => 1.4214, std.dev.: 0.0093)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -31.74% (0.0816 => 0.0557, std.dev.: 0.0009)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.94% (0.1189 => 0.0833, std.dev.: 0.0114)
  MultiSource/Applications/JM/ldecod/ldecod: -27.71% (0.0859 => 0.0621, std.dev.: 0.0077)
  MultiSource/Applications/viterbi/viterbi: -27.24% (3.4923 => 2.5411, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -23.99% (6.9552 => 5.2869, std.dev.: 0.3031)
  MultiSource/Applications/minisat/minisat: -22.08% (8.0162 => 6.2463, std.dev.: 0.2424)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.0007)
  MultiSource/Applications/obsequi/Obsequi: -18.61% (2.6081 => 2.1227, std.dev.: 0.1105)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.38% (6.2627 => 5.4250, std.dev.: 0.0283)
  SingleSource/Benchmarks/Misc/mandel: -13.23% (1.1996 => 1.0409, std.dev.: 0.0109)
  MultiSource/Applications/SPASS/SPASS: -12.01% (9.2220 => 8.1143, std.dev.: 0.1625)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.61% (0.5173 => 0.4676, std.dev.: 0.0073)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.83% (3.5791 => 3.2990, std.dev.: 0.0596)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.44% (47.2250 => 44.6577, std.dev.: 0.7379)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.31% (1.7207 => 1.6293, std.dev.: 0.0144)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.17% (0.7355 => 0.6975, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.88% (4.2062 => 4.0010, std.dev.: 0.0661)
  MultiSource/Applications/lua/lua: -4.80% (31.0707 => 29.5783, std.dev.: 0.5370)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.71% (3.8119 => 3.6322, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.61% (1.1024 => 1.0516, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/fbench: -4.57% (4.9602 => 4.7336, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.63% (21.6864 => 20.8993, std.dev.: 0.1755)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.07% (5.2218 => 5.0617, std.dev.: 0.0112)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.01% (0.4783 => 0.4639, std.dev.: 0.0008)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.68% (0.7806 => 0.7597, std.dev.: 0.0034)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.66% (41.0210 => 39.9304, std.dev.: 0.3043)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.57% (2.7049 => 2.6354, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.46% (8.6172 => 8.4049, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/oourafft: -2.11% (3.7891 => 3.7093, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc/lowercase: -2.10% (0.7849 => 0.7684, std.dev.: 0.0044)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1407, std.dev.: 0.1136)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.87% (5.6678 => 5.5618, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.58% (5.0180 => 4.9389, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.50% (5.8810 => 5.7929, std.dev.: 0.0203)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.19% (0.1378 => 0.1334, std.dev.: 0.0015)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130825/81ef7109/attachment.html>


More information about the llvm-testresults mailing list