[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 29 04:04:28 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16797?compare_to=16794&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16797, Order: 193594, Start Time: 2013-10-29 09:11:34, End Time: 2013-10-29 11:07:51
      To: 16794, Order: 193589, Start Time: 2013-10-29 06:57:29, End Time: 2013-10-29 08:45:08
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 41 (46 on baseline)
Performance Improvements: 3 (19 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1063 (1042 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Treesort: 100.90% (0.0446 => 0.0896, std.dev.: 0.0023)
  SingleSource/UnitTests/Threads/tls: 87.56% (0.0225 => 0.0422, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/perlin: 81.19% (0.0537 => 0.0973, std.dev.: 0.0083)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 73.86% (0.0176 => 0.0306, std.dev.: 0.0020)
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: 71.71% (0.0152 => 0.0261, std.dev.: 0.0024)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 71.17% (0.0163 => 0.0279, std.dev.: 0.0028)
  SingleSource/UnitTests/2002-12-13-MishaTest: 70.94% (0.0203 => 0.0347, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/flops-1: 69.73% (0.0294 => 0.0499, std.dev.: 0.0051)
  SingleSource/Regression/C++/EH/exception_spec_test: 63.24% (0.0340 => 0.0555, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/pi: 62.04% (0.0216 => 0.0350, std.dev.: 0.0014)
  SingleSource/Benchmarks/Stanford/IntMM: 58.89% (0.0433 => 0.0688, std.dev.: 0.0063)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 57.33% (0.0225 => 0.0354, std.dev.: 0.0019)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 49.58% (0.0480 => 0.0718, std.dev.: 0.0070)
  SingleSource/Benchmarks/Stanford/Puzzle: 45.26% (0.1244 => 0.1807, std.dev.: 0.0207)
  MultiSource/Applications/hbd/hbd: 43.89% (1.5943 => 2.2940, std.dev.: 0.1298)
  MultiSource/Applications/Burg/burg: 41.77% (1.4272 => 2.0234, std.dev.: 0.0793)
  MultiSource/Applications/JM/ldecod/ldecod: 30.47% (7.6437 => 9.9727, std.dev.: 0.2627)
  MultiSource/Applications/lua/lua: 26.45% (4.2739 => 5.4045, std.dev.: 0.2307)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.86% (1.4124 => 1.7776, std.dev.: 0.1248)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 24.81% (9.8108 => 12.2446, std.dev.: 0.6291)
  MultiSource/Applications/siod/siod: 23.83% (2.5425 => 3.1483, std.dev.: 0.0252)
  MultiSource/Applications/oggenc/oggenc: 17.95% (5.4291 => 6.4036, std.dev.: 0.0109)
  MultiSource/Applications/SPASS/SPASS: 14.40% (16.3034 => 18.6516, std.dev.: 0.3885)
  MultiSource/Applications/sqlite3/sqlite3: 13.83% (16.3794 => 18.6449, std.dev.: 0.7194)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 4.25% (0.2613 => 0.2724, std.dev.: 0.0016)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 80.79% (0.0151 => 0.0273, std.dev.: 0.0027)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 70.90% (1.4735 => 2.5182, std.dev.: 0.3500)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 56.07% (0.0478 => 0.0746, std.dev.: 0.0052)
  MultiSource/Applications/SPASS/SPASS: 43.08% (8.0202 => 11.4757, std.dev.: 1.1490)
  MultiSource/Applications/minisat/minisat: 41.46% (6.3863 => 9.0341, std.dev.: 0.2534)
  SingleSource/Benchmarks/Stanford/Queens: 37.91% (0.0335 => 0.0462, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 26.07% (60.9595 => 76.8489, std.dev.: 3.8836)
  SingleSource/Benchmarks/Shootout/ary3: 21.85% (4.6846 => 5.7082, std.dev.: 0.1450)
  SingleSource/Benchmarks/Misc/ffbench: 5.87% (1.4064 => 1.4889, std.dev.: 0.0099)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.08% (0.5044 => 0.5250, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.00% (4.0770 => 4.2402, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/flops: 3.96% (9.2689 => 9.6355, std.dev.: 0.0134)
  MultiSource/Applications/spiff/spiff: 3.93% (2.8612 => 2.9737, std.dev.: 0.0158)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.36% (4.4108 => 4.5148, std.dev.: 0.0385)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.31% (45.1806 => 46.2229, std.dev.: 0.2278)
  SingleSource/Benchmarks/Misc/fbench: 1.15% (4.9314 => 4.9879, std.dev.: 0.0197)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/PAQ8p/paq8p: -9.29% (108.1842 => 98.1316, std.dev.: 3.3951)
  MultiSource/Applications/aha/aha: -4.67% (3.7742 => 3.5978, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout-C++/ary3: -3.23% (4.9055 => 4.7472, std.dev.: 0.0478)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 22.97% (0.1393 => 0.1713, std.dev.: 0.0218)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/pointer_arithmetic: 169.23% (0.0065 => 0.0175, std.dev.: 0.0014)
  SingleSource/Benchmarks/Stanford/Treesort: 97.36% (0.0454 => 0.0896, std.dev.: 0.0023)
  SingleSource/UnitTests/Threads/tls: 81.90% (0.0232 => 0.0422, std.dev.: 0.0010)
  SingleSource/UnitTests/2002-12-13-MishaTest: 75.25% (0.0198 => 0.0347, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/pi: 71.57% (0.0204 => 0.0350, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/perlin: 68.34% (0.0578 => 0.0973, std.dev.: 0.0083)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 67.21% (0.0183 => 0.0306, std.dev.: 0.0020)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 65.09% (0.0169 => 0.0279, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/flops-1: 64.69% (0.0303 => 0.0499, std.dev.: 0.0051)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 61.64% (0.0219 => 0.0354, std.dev.: 0.0019)
  SingleSource/Regression/C++/EH/exception_spec_test: 55.46% (0.0357 => 0.0555, std.dev.: 0.0053)
  SingleSource/Benchmarks/Stanford/IntMM: 54.61% (0.0445 => 0.0688, std.dev.: 0.0063)
  MultiSource/Applications/hbd/hbd: 46.15% (1.5696 => 2.2940, std.dev.: 0.1298)
  MultiSource/Applications/Burg/burg: 44.59% (1.3994 => 2.0234, std.dev.: 0.0793)
  SingleSource/Benchmarks/Stanford/Puzzle: 43.87% (0.1256 => 0.1807, std.dev.: 0.0207)
  MultiSource/Applications/spiff/spiff: 35.08% (0.8911 => 1.2037, std.dev.: 0.1201)
  MultiSource/Applications/JM/ldecod/ldecod: 34.72% (7.4026 => 9.9727, std.dev.: 0.2627)
  MultiSource/Applications/siod/siod: 28.61% (2.4480 => 3.1483, std.dev.: 0.0252)
  MultiSource/Applications/lua/lua: 27.94% (4.2242 => 5.4045, std.dev.: 0.2307)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 26.60% (1.4041 => 1.7776, std.dev.: 0.1248)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 25.77% (9.7354 => 12.2446, std.dev.: 0.6291)
  SingleSource/Benchmarks/Misc/richards_benchmark: 20.34% (0.0772 => 0.0929, std.dev.: 0.0052)
  MultiSource/Applications/oggenc/oggenc: 20.05% (5.3339 => 6.4036, std.dev.: 0.0109)
  MultiSource/Applications/SPASS/SPASS: 15.39% (16.1646 => 18.6516, std.dev.: 0.3885)
  MultiSource/Applications/sqlite3/sqlite3: 14.46% (16.2888 => 18.6449, std.dev.: 0.7194)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.46% (24.6139 => 25.2196, std.dev.: 0.1804)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Queens: 91.70% (0.0241 => 0.0462, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 61.12% (0.0463 => 0.0746, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.91% (7.6426 => 12.2976, std.dev.: 0.0395)
  SingleSource/Benchmarks/Shootout-C++/matrix: 47.50% (2.8554 => 4.2117, std.dev.: 0.0386)
  MultiSource/Applications/minisat/minisat: 43.95% (6.2760 => 9.0341, std.dev.: 0.2534)
  MultiSource/Applications/SPASS/SPASS: 39.42% (8.2311 => 11.4757, std.dev.: 1.1490)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 26.58% (60.7119 => 76.8489, std.dev.: 3.8836)
  SingleSource/Benchmarks/Shootout/ary3: 21.52% (4.6972 => 5.7082, std.dev.: 0.1450)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.34% (1.1431 => 1.3870, std.dev.: 0.0582)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.56% (3.1730 => 3.3811, std.dev.: 0.0209)
  SingleSource/Benchmarks/Misc/ffbench: 6.12% (1.4030 => 1.4889, std.dev.: 0.0099)
  MultiSource/Applications/spiff/spiff: 5.47% (2.8194 => 2.9737, std.dev.: 0.0158)
  MultiSource/Applications/sqlite3/sqlite3: 4.82% (4.2733 => 4.4793, std.dev.: 0.0604)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.45% (4.0596 => 4.2402, std.dev.: 0.0029)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.81% (5.3716 => 5.5761, std.dev.: 0.0715)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.70% (1.7652 => 1.8128, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.13% (1.0477 => 1.0700, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.06% (5.4925 => 5.6055, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc/flops: 2.04% (9.4433 => 9.6355, std.dev.: 0.0134)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.23% (0.1483 => 0.1183, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/distray/distray: -11.98% (0.1194 => 0.1051, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.24% (0.5226 => 0.2339, std.dev.: 0.0156)
  MultiSource/Applications/sgefa/sgefa: -42.34% (1.5790 => 0.9105, std.dev.: 0.0033)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.04% (0.3304 => 0.2708, std.dev.: 0.0004)
  SingleSource/Benchmarks/Linpack/linpack-pc: -15.01% (57.2347 => 48.6410, std.dev.: 2.0273)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.48% (20.8247 => 18.4334, std.dev.: 0.1763)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -11.00% (3.4956 => 3.1111, std.dev.: 0.0316)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.54% (3.7437 => 3.3493, std.dev.: 0.0850)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.61% (50.0284 => 46.2229, std.dev.: 0.2278)
  SingleSource/Benchmarks/Shootout/sieve: -6.70% (7.2254 => 6.7415, std.dev.: 0.0579)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.07% (8.1346 => 7.6409, std.dev.: 0.0697)
  SingleSource/Benchmarks/Shootout-C++/ary3: -5.06% (5.0002 => 4.7472, std.dev.: 0.0478)
  SingleSource/Benchmarks/Stanford/FloatMM: -4.78% (0.7287 => 0.6939, std.dev.: 0.0031)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.48% (2.5938 => 2.4777, std.dev.: 0.0262)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.13% (3.7874 => 3.6688, std.dev.: 0.0109)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.74% (17.1431 => 16.6726, std.dev.: 0.0455)
  SingleSource/Benchmarks/Misc/oourafft: -2.46% (3.7484 => 3.6561, std.dev.: 0.0358)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.15% (4.3592 => 4.2653, std.dev.: 0.0164)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 27.08% (0.1348 => 0.1713, std.dev.: 0.0218)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131029/e5e2cc8c/attachment.html>


More information about the llvm-testresults mailing list