[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 27 08:56:39 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15730?compare_to=15726&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15730, Order: 191521, Start Time: 2013-09-27 14:11:32, End Time: 2013-09-27 15:59:28
      To: 15726, Order: 191507, Start Time: 2013-09-27 11:48:21, End Time: 2013-09-27 13:44:34
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (25 on baseline)
Performance Improvements: 68 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1017 (1067 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 59.01% (1.6419 => 2.6108, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 28.93% (0.1545 => 0.1992, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.94% (0.3734 => 0.3993, std.dev.: 0.0063)
  SingleSource/Benchmarks/Stanford/FloatMM: 6.44% (0.6851 => 0.7292, std.dev.: 0.0004)
  SingleSource/Regression/C/uint64_to_float: 6.21% (1.3969 => 1.4836, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.00% (0.1766 => 0.1872, std.dev.: 0.0001)
  MultiSource/Applications/aha/aha: 5.52% (3.5851 => 3.7830, std.dev.: 0.0033)
  MultiSource/Applications/spiff/spiff: 5.29% (2.8325 => 2.9823, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.70% (0.4617 => 0.4834, std.dev.: 0.0006)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.50% (0.4976 => 0.5200, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout/lists: 4.08% (7.2160 => 7.5105, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/fp-convert: 3.84% (7.3373 => 7.6189, std.dev.: 0.1021)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.37% (4.1845 => 4.3255, std.dev.: 0.0052)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.08% (1.0376 => 1.0696, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.99% (1.2640 => 1.2892, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.85% (15.8614 => 16.1544, std.dev.: 0.0360)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.70% (46.1929 => 46.9768, std.dev.: 0.1181)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.66% (6.5431 => 6.6516, std.dev.: 0.0335)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.39% (3.5564 => 3.6057, std.dev.: 0.0180)
  MultiSource/Applications/viterbi/viterbi: 1.37% (2.6514 => 2.6877, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.18% (3.8853 => 3.9312, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/random: 1.01% (2.4547 => 2.4794, std.dev.: 0.0066)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-05-31-LongShifts: -51.63% (0.0306 => 0.0148, std.dev.: 0.0005)
  SingleSource/UnitTests/2002-08-02-CastTest2: -49.77% (0.0221 => 0.0111, std.dev.: 0.0004)
  SingleSource/UnitTests/member-function-pointers: -45.06% (0.0395 => 0.0217, std.dev.: 0.0006)
  SingleSource/UnitTests/2005-11-29-LongSwitch: -44.98% (0.0289 => 0.0159, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -44.66% (0.0309 => 0.0171, std.dev.: 0.0002)
  SingleSource/UnitTests/2007-01-04-KNR-Args: -43.93% (0.0346 => 0.0194, std.dev.: 0.0003)
  SingleSource/Regression/C++/EH/inlined_cleanup: -43.62% (0.0337 => 0.0190, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-02-04-DivRem: -42.95% (0.0305 => 0.0174, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: -42.73% (0.0461 => 0.0264, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-10-12-StructureArgsSimple: -42.34% (0.0274 => 0.0158, std.dev.: 0.0006)
  SingleSource/UnitTests/2002-05-02-CastTest: -42.05% (0.0459 => 0.0266, std.dev.: 0.0024)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -41.68% (0.0751 => 0.0438, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: -41.64% (0.0281 => 0.0164, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -40.53% (0.1325 => 0.0788, std.dev.: 0.0028)
  SingleSource/UnitTests/2003-07-09-LoadShorts: -40.00% (0.0440 => 0.0264, std.dev.: 0.0000)
  MultiSource/Applications/aha/aha: -38.45% (0.2083 => 0.1282, std.dev.: 0.0128)
  SingleSource/UnitTests/2003-05-02-DependentPHI: -38.40% (0.0263 => 0.0162, std.dev.: 0.0006)
  SingleSource/UnitTests/2003-07-10-SignConversions: -38.28% (0.0290 => 0.0179, std.dev.: 0.0001)
  SingleSource/Benchmarks/McGill/queens: -35.85% (0.0834 => 0.0535, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-07-09-SignedArgs: -32.62% (0.0423 => 0.0285, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/flops-1: -31.07% (0.0354 => 0.0244, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/flops-7: -30.07% (0.0419 => 0.0293, std.dev.: 0.0009)
  MultiSource/Applications/sgefa/sgefa: -29.57% (0.5630 => 0.3965, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/methcall: -29.34% (0.0501 => 0.0354, std.dev.: 0.0027)
  MultiSource/Applications/Burg/burg: -28.38% (2.0082 => 1.4382, std.dev.: 0.0227)
  SingleSource/Benchmarks/Stanford/Towers: -27.87% (0.0714 => 0.0515, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/fbench: -26.15% (0.0975 => 0.0720, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/flops-5: -25.06% (0.0419 => 0.0314, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/flops-3: -24.27% (0.0412 => 0.0312, std.dev.: 0.0008)
  SingleSource/Benchmarks/Stanford/Queens: -19.69% (0.0574 => 0.0461, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -19.53% (0.3041 => 0.2447, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/perlin: -19.30% (0.0741 => 0.0598, std.dev.: 0.0008)
  SingleSource/UnitTests/SignlessTypes/rem: -18.30% (0.1514 => 0.1237, std.dev.: 0.0000)
  SingleSource/Benchmarks/CoyoteBench/almabench: -16.83% (0.0927 => 0.0771, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.49% (1.7190 => 1.4356, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/ReedSolomon: -15.99% (0.2645 => 0.2222, std.dev.: 0.0056)
  MultiSource/Applications/JM/lencod/lencod: -13.15% (19.7573 => 17.1598, std.dev.: 0.3253)
  MultiSource/Applications/siod/siod: -12.12% (2.9299 => 2.5749, std.dev.: 0.0097)
  MultiSource/Applications/JM/ldecod/ldecod: -10.94% (8.4470 => 7.5229, std.dev.: 0.1971)
  SingleSource/Benchmarks/Misc/flops: -10.15% (0.1231 => 0.1106, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/objinst: -9.84% (0.2357 => 0.2125, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/methcall: -8.73% (0.2267 => 0.2069, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -8.33% (1.4966 => 1.3719, std.dev.: 0.0454)
  SingleSource/Benchmarks/Stanford/Puzzle: -7.68% (0.1394 => 0.1287, std.dev.: 0.0015)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -7.23% (0.4300 => 0.3989, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/fibo: -6.70% (0.2001 => 0.1867, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -6.38% (0.2180 => 0.2041, std.dev.: 0.0001)
  MultiSource/Applications/oggenc/oggenc: -5.35% (5.7687 => 5.4601, std.dev.: 0.0851)
  MultiSource/Benchmarks/nbench/nbench: -4.36% (1.3314 => 1.2733, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.14% (1.3304 => 1.2753, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.09% (1.4042 => 1.3467, std.dev.: 0.0144)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -40.65% (2.4973 => 1.4822, std.dev.: 0.1230)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.96% (0.0389 => 0.0288, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -15.03% (33.7077 => 28.6430, std.dev.: 1.8904)
  SingleSource/Benchmarks/Misc/ffbench: -6.42% (1.4598 => 1.3661, std.dev.: 0.0176)
  SingleSource/Benchmarks/McGill/misr: -6.17% (0.4136 => 0.3881, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -5.24% (2.6302 => 2.4924, std.dev.: 0.0371)
  MultiSource/Applications/sgefa/sgefa: -5.02% (0.8852 => 0.8408, std.dev.: 0.0004)
  SingleSource/Benchmarks/Dhrystone/dry: -4.88% (0.5042 => 0.4796, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.23% (4.7743 => 4.5723, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.91% (1.5571 => 1.5118, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.90% (4.1934 => 4.0716, std.dev.: 0.0304)
  SingleSource/Benchmarks/Misc/flops: -2.72% (9.6121 => 9.3504, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.28% (3.6428 => 3.5598, std.dev.: 0.0237)
  SingleSource/Benchmarks/Misc/flops-6: -1.97% (2.4602 => 2.4117, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/fbench: -1.87% (4.9979 => 4.9046, std.dev.: 0.0231)
  SingleSource/Benchmarks/Misc/flops-7: -1.65% (1.7447 => 1.7159, std.dev.: 0.0054)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.30% (35.5633 => 35.0996, std.dev.: 0.0906)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.03% (0.1415 => 0.1358, std.dev.: 0.0173)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-11-LoadConstants: 8.44% (0.1470 => 0.1594, std.dev.: 0.0003)
  MultiSource/Applications/siod/siod: 5.18% (2.4480 => 2.5749, std.dev.: 0.0097)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.80% (0.2335 => 0.2447, std.dev.: 0.0043)
  MultiSource/Applications/d/make_dparser: 3.19% (3.4962 => 3.6077, std.dev.: 0.0429)
  MultiSource/Applications/sgefa/sgefa: 3.04% (0.3848 => 0.3965, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.24% (1.4041 => 1.4356, std.dev.: 0.0061)
  MultiSource/Benchmarks/nbench/nbench: 1.99% (1.2484 => 1.2733, std.dev.: 0.0075)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 62.89% (7.6426 => 12.4491, std.dev.: 0.1070)
  SingleSource/Benchmarks/Misc/pi: 57.52% (1.6574 => 2.6108, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout/matrix: 18.57% (1.7809 => 2.1116, std.dev.: 0.0505)
  MultiSource/Applications/obsequi/Obsequi: 7.38% (2.1884 => 2.3498, std.dev.: 0.0494)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0048)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.52% (8.1346 => 8.6652, std.dev.: 0.0626)
  MultiSource/Applications/aha/aha: 5.87% (3.5731 => 3.7830, std.dev.: 0.0033)
  MultiSource/Applications/spiff/spiff: 5.78% (2.8194 => 2.9823, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.12% (4.0181 => 4.1433, std.dev.: 0.0142)
  SingleSource/Benchmarks/McGill/misr: 2.92% (0.3771 => 0.3881, std.dev.: 0.0039)
  MultiSource/Applications/siod/siod: 2.83% (3.5310 => 3.6311, std.dev.: 0.0329)
  MultiSource/Benchmarks/Olden/power/power: 2.41% (1.2170 => 1.2463, std.dev.: 0.0094)
  SingleSource/Regression/C/uint64_to_float: 2.12% (1.4528 => 1.4836, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/lists: 1.90% (7.3703 => 7.5105, std.dev.: 0.0079)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.89% (3.8582 => 3.9312, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/methcall: 1.30% (8.5434 => 8.6545, std.dev.: 0.0366)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.27% (1.0477 => 1.0610, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.27% (5.0196 => 5.0832, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.30% (0.1483 => 0.1182, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.88% (0.2571 => 0.2394, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.34% (0.5226 => 0.2386, std.dev.: 0.0196)
  SingleSource/Benchmarks/Linpack/linpack-pc: -49.35% (57.2347 => 28.9867, std.dev.: 9.1574)
  MultiSource/Applications/sgefa/sgefa: -46.75% (1.5790 => 0.8408, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -26.50% (0.0400 => 0.0294, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.29% (15.9508 => 13.0328, std.dev.: 0.5324)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -13.91% (4.0006 => 3.4443, std.dev.: 0.1763)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.45% (20.8247 => 18.4407, std.dev.: 0.1401)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.79% (3.4956 => 3.1533, std.dev.: 0.0301)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.10% (50.0284 => 46.9768, std.dev.: 0.1181)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.86% (2.5938 => 2.4936, std.dev.: 0.0241)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.23% (3.7437 => 3.6228, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.64% (17.1431 => 16.6904, std.dev.: 0.0883)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (89.7126 => 88.5790, std.dev.: 0.1324)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1348 => 0.1358, std.dev.: 0.0173)

Report Time: 1.61s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130927/db4b3103/attachment.html>


More information about the llvm-testresults mailing list