[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 29 10:59:28 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16808?compare_to=16804&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16808, Order: 193614, Start Time: 2013-10-29 16:04:33, End Time: 2013-10-29 18:02:52
      To: 16804, Order: 193607, Start Time: 2013-10-29 13:42:28, End Time: 2013-10-29 15:43:26
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (35 on baseline)
Performance Improvements: 34 (22 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 144.59% (0.0074 => 0.0181, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 49.04% (0.5816 => 0.8668, std.dev.: 0.0259)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 46.76% (0.7337 => 1.0768, std.dev.: 0.0366)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.17% (1.4535 => 2.1246, std.dev.: 0.1598)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 39.61% (5.0098 => 6.9943, std.dev.: 0.2177)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 37.40% (1.1140 => 1.5306, std.dev.: 0.0898)
  MultiSource/Benchmarks/Bullet/bullet: 24.15% (34.2436 => 42.5124, std.dev.: 0.2895)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21.73% (7.5494 => 9.1899, std.dev.: 0.5232)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.66% (0.5014 => 0.5448, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 7.97% (0.1343 => 0.1450, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 70.34% (0.0263 => 0.0448, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 34.77% (0.0302 => 0.0407, std.dev.: 0.0029)
  MultiSource/Benchmarks/Bullet/bullet: 11.53% (7.1296 => 7.9515, std.dev.: 0.1420)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 7.24% (0.3411 => 0.3658, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 5.37% (0.4635 => 0.4884, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.42% (4.0273 => 4.1247, std.dev.: 0.0172)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.39% (1.5810 => 1.6188, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.64% (1.8292 => 1.8592, std.dev.: 0.0011)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.37% (44.4772 => 45.0880, std.dev.: 0.1495)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.29% (2.4823 => 2.5142, std.dev.: 0.0111)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.11% (12.1523 => 12.2866, std.dev.: 0.0465)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.05% (1.2812 => 1.2946, std.dev.: 0.0038)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/fbench: -47.79% (0.1425 => 0.0744, std.dev.: 0.0064)
  SingleSource/Benchmarks/Stanford/IntMM: -47.64% (0.0827 => 0.0433, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/methcall: -28.05% (0.2856 => 0.2055, std.dev.: 0.0225)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -22.24% (0.1151 => 0.0895, std.dev.: 0.0058)
  SingleSource/Benchmarks/Dhrystone/dry: -20.68% (0.0711 => 0.0564, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -18.06% (0.4119 => 0.3375, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout-C++/ary2: -16.78% (0.3123 => 0.2599, std.dev.: 0.0115)
  SingleSource/Benchmarks/Shootout-C++/wc: -15.15% (0.2600 => 0.2206, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -14.74% (0.2503 => 0.2134, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout-C++/strcat: -14.72% (0.2405 => 0.2051, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -14.57% (0.2237 => 0.1911, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/fibo: -14.42% (0.2205 => 0.1887, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -13.52% (0.2270 => 0.1963, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/objinst: -13.06% (0.2458 => 0.2137, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/lists: -12.90% (0.3039 => 0.2647, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -12.74% (0.4410 => 0.3848, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -12.32% (0.4122 => 0.3614, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.30% (1.4735 => 1.2922, std.dev.: 0.0274)
  SingleSource/Benchmarks/Shootout-C++/moments: -12.07% (0.4307 => 0.3787, std.dev.: 0.0080)
  SingleSource/Benchmarks/Shootout-C++/random: -11.77% (0.2277 => 0.2009, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/matrix: -11.72% (0.2714 => 0.2396, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/hash: -10.95% (0.4557 => 0.4058, std.dev.: 0.0022)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.95% (0.1900 => 0.1768, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: -48.96% (0.0241 => 0.0123, std.dev.: 0.0005)
  MultiSource/Applications/JM/ldecod/ldecod: -37.27% (0.1041 => 0.0653, std.dev.: 0.0144)
  SingleSource/Benchmarks/Stanford/Quicksort: -32.53% (0.0415 => 0.0280, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -28.02% (0.1902 => 0.1369, std.dev.: 0.0154)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -17.03% (4.7414 => 3.9340, std.dev.: 0.2678)
  SingleSource/Benchmarks/Shootout-C++/moments: -11.51% (0.1225 => 0.1084, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.86% (0.7792 => 0.7102, std.dev.: 0.0156)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -3.38% (2.9574 => 2.8574, std.dev.: 0.0386)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -2.89% (4.6005 => 4.4675, std.dev.: 0.0462)
  SingleSource/Benchmarks/Shootout-C++/lists: -2.19% (16.5259 => 16.1643, std.dev.: 0.0999)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.21% (1.6222 => 1.6026, std.dev.: 0.0012)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.81% (0.1380 => 0.1405, std.dev.: 0.0194)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 54.54% (0.5609 => 0.8668, std.dev.: 0.0259)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 53.02% (0.7037 => 1.0768, std.dev.: 0.0366)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.31% (1.4041 => 2.1246, std.dev.: 0.1598)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 48.61% (1.6047 => 2.3847, std.dev.: 0.0836)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 42.54% (0.3822 => 0.5448, std.dev.: 0.0079)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 41.89% (4.9293 => 6.9943, std.dev.: 0.2177)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 39.97% (1.0935 => 1.5306, std.dev.: 0.0898)
  MultiSource/Benchmarks/Bullet/bullet: 29.79% (32.7552 => 42.5124, std.dev.: 0.2895)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 26.48% (7.2661 => 9.1899, std.dev.: 0.5232)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 23.66% (0.0748 => 0.0925, std.dev.: 0.0040)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 20.74% (24.6139 => 29.7177, std.dev.: 1.0427)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 19.82% (44.2807 => 53.0552, std.dev.: 3.1095)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 19.64% (0.4624 => 0.5532, std.dev.: 0.0328)
  MultiSource/Applications/kimwitu++/kc: 18.98% (18.3608 => 21.8457, std.dev.: 0.6437)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 15.63% (0.1254 => 0.1450, std.dev.: 0.0036)
  MultiSource/Benchmarks/NPB-serial/is/is: 14.01% (0.0735 => 0.0838, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 13.76% (1.2007 => 1.3659, std.dev.: 0.0607)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.12% (1.4304 => 1.5894, std.dev.: 0.0491)
  MultiSource/Applications/spiff/spiff: 6.54% (0.8911 => 0.9494, std.dev.: 0.0119)
  MultiSource/Applications/d/make_dparser: 4.32% (3.4962 => 3.6473, std.dev.: 0.0343)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 61.17% (7.6426 => 12.3174, std.dev.: 0.0327)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 55.02% (0.0289 => 0.0448, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.46% (2.8554 => 4.2392, std.dev.: 0.0245)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.70% (1.1431 => 1.3797, std.dev.: 0.0598)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.67% (9.4586 => 11.2249, std.dev.: 0.1929)
  MultiSource/Benchmarks/Bullet/bullet: 13.06% (7.0333 => 7.9515, std.dev.: 0.1420)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.78% (0.5182 => 0.5637, std.dev.: 0.0161)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.38% (1.2516 => 1.3314, std.dev.: 0.0107)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.16% (3.1730 => 3.3684, std.dev.: 0.0146)
  SingleSource/UnitTests/Vector/multiplies: 5.99% (0.5561 => 0.5894, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 4.48% (0.3501 => 0.3658, std.dev.: 0.0051)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.63% (89.7126 => 92.9695, std.dev.: 0.3179)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.65% (4.0181 => 4.1247, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.92% (6.5990 => 6.7257, std.dev.: 0.0197)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.39% (8.8798 => 9.0032, std.dev.: 0.0213)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.81% (0.2571 => 0.2396, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.87% (0.5226 => 0.2411, std.dev.: 0.0160)
  MultiSource/Applications/sgefa/sgefa: -42.38% (1.5790 => 0.9098, std.dev.: 0.0044)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.83% (0.3304 => 0.2715, std.dev.: 0.0218)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.08% (57.2347 => 47.4581, std.dev.: 1.5960)
  SingleSource/Benchmarks/Shootout-C++/moments: -15.64% (0.1285 => 0.1084, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.22% (15.9508 => 13.5228, std.dev.: 0.2970)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.33% (20.8247 => 18.4649, std.dev.: 0.1738)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.61% (3.4956 => 3.1247, std.dev.: 0.0285)
  MultiSource/Benchmarks/Olden/em3d/em3d: -10.24% (5.0288 => 4.5137, std.dev.: 0.0438)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.88% (50.0284 => 45.0880, std.dev.: 0.1495)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.50% (3.0561 => 2.8574, std.dev.: 0.0386)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.86% (3.7437 => 3.5245, std.dev.: 0.0415)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.07% (2.5938 => 2.5142, std.dev.: 0.0111)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.85% (3.7874 => 3.6794, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.72% (2.4471 => 2.3805, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.67% (5.2422 => 5.1023, std.dev.: 0.0494)
  SingleSource/Benchmarks/Misc/oourafft: -2.36% (3.7484 => 3.6600, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.15% (5.4473 => 5.3301, std.dev.: 0.0175)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.07% (4.3592 => 4.2690, std.dev.: 0.0201)
  SingleSource/Benchmarks/Misc/whetstone: -1.70% (3.6303 => 3.5686, std.dev.: 0.0236)
  SingleSource/Benchmarks/Misc/flops-5: -1.05% (2.8061 => 2.7765, std.dev.: 0.0073)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.23% (0.1348 => 0.1405, std.dev.: 0.0194)

Report Time: 0.82s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131029/c38983dd/attachment.html>


More information about the llvm-testresults mailing list