[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Jun 13 11:32:05 PDT 2013
http://llvm.org/perf/db_default/v4/nts/12352?compare_to=12348&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13
Comparing:
Run: 12352, Order: 183910, Start Time: 2013-06-13 16:39:36, End Time: 2013-06-13 18:32:56
To: 12348, Order: 183902, Start Time: 2013-06-13 14:25:17, End Time: 2013-06-13 16:15:07
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16
===============
Tests Summary
===============
Performance Regressions: 46 (67 on baseline)
Performance Improvements: 10 (26 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1014 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 60.47% (0.0344 => 0.0552, std.dev.: 0.0028)
SingleSource/Benchmarks/Misc-C++/mandel-text: 57.64% (0.0229 => 0.0361, std.dev.: 0.0023)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 53.84% (0.1055 => 0.1623, std.dev.: 0.0110)
MultiSource/Benchmarks/Prolangs-C++/office/office: 53.36% (0.2367 => 0.3630, std.dev.: 0.0082)
MultiSource/Benchmarks/Fhourstones/fhourstones: 52.93% (0.1725 => 0.2638, std.dev.: 0.0178)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 48.86% (0.1005 => 0.1496, std.dev.: 0.0109)
MultiSource/Benchmarks/Olden/mst/mst: 48.81% (0.1432 => 0.2131, std.dev.: 0.0111)
SingleSource/Benchmarks/Misc/fp-convert: 47.95% (0.0317 => 0.0469, std.dev.: 0.0027)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 46.76% (1.4137 => 2.0748, std.dev.: 0.0680)
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 43.46% (0.0543 => 0.0779, std.dev.: 0.0028)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 39.36% (0.0564 => 0.0786, std.dev.: 0.0068)
MultiSource/Benchmarks/McCat/09-vor/vor: 34.13% (0.3554 => 0.4767, std.dev.: 0.0162)
MultiSource/Benchmarks/McCat/05-eks/eks: 29.57% (0.5533 => 0.7169, std.dev.: 0.0230)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 27.57% (0.3174 => 0.4049, std.dev.: 0.0210)
SingleSource/Benchmarks/Misc-C++/bigfib: 21.78% (0.7148 => 0.8705, std.dev.: 0.0317)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 16.44% (5.8966 => 6.8659, std.dev.: 0.1389)
MultiSource/Applications/Burg/burg: 12.93% (1.4568 => 1.6451, std.dev.: 0.0123)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.06% (1.6249 => 1.7883, std.dev.: 0.0413)
MultiSource/Applications/kimwitu++/kc: 5.89% (20.2225 => 21.4139, std.dev.: 0.4136)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.77% (0.2270 => 0.2401, std.dev.: 0.0041)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: 69.36% (0.1606 => 0.2720, std.dev.: 0.0224)
SingleSource/Benchmarks/Shootout/ary3: 67.58% (5.7857 => 9.6958, std.dev.: 0.3219)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 58.17% (0.0502 => 0.0794, std.dev.: 0.0025)
SingleSource/Benchmarks/Shootout/heapsort: 38.72% (3.0624 => 4.2481, std.dev.: 0.2942)
MultiSource/Benchmarks/Fhourstones/fhourstones: 37.88% (1.3231 => 1.8243, std.dev.: 0.0771)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 36.50% (0.0274 => 0.0374, std.dev.: 0.0023)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 31.00% (0.0713 => 0.0934, std.dev.: 0.0070)
SingleSource/Benchmarks/CoyoteBench/lpbench: 25.83% (4.0461 => 5.0913, std.dev.: 0.3867)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.16% (1.2509 => 1.5406, std.dev.: 0.0089)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 16.73% (0.4273 => 0.4988, std.dev.: 0.0161)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.84% (0.1308 => 0.1476, std.dev.: 0.0018)
MultiSource/Benchmarks/7zip/7zip-benchmark: 9.36% (9.9024 => 10.8289, std.dev.: 0.1759)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.81% (0.2700 => 0.2938, std.dev.: 0.0066)
SingleSource/Benchmarks/Misc/flops-7: 7.69% (1.7387 => 1.8724, std.dev.: 0.0475)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.63% (2.9753 => 3.1727, std.dev.: 0.0496)
MultiSource/Benchmarks/Olden/tsp/tsp: 5.38% (1.6247 => 1.7121, std.dev.: 0.0285)
SingleSource/Benchmarks/Misc/ffbench: 4.54% (1.3715 => 1.4338, std.dev.: 0.0030)
MultiSource/Benchmarks/Olden/bh/bh: 3.20% (2.4432 => 2.5214, std.dev.: 0.0180)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.45% (4.1239 => 4.2251, std.dev.: 0.0279)
SingleSource/Benchmarks/Shootout-C++/methcall: 2.19% (11.3397 => 11.5878, std.dev.: 0.0313)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.05% (4.2786 => 4.3663, std.dev.: 0.0052)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.74% (2.8981 => 2.9484, std.dev.: 0.0097)
SingleSource/Benchmarks/Shootout/lists: 1.57% (7.3166 => 7.4314, std.dev.: 0.0323)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.51% (4.5790 => 4.6480, std.dev.: 0.0180)
SingleSource/Benchmarks/Misc/oourafft: 1.29% (3.7647 => 3.8133, std.dev.: 0.0149)
MultiSource/Benchmarks/NPB-serial/is/is: 1.02% (12.0335 => 12.1565, std.dev.: 0.0336)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -20.11% (0.3397 => 0.2714, std.dev.: 0.0059)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -19.04% (2.0473 => 1.6574, std.dev.: 0.1201)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.04% (1.1894 => 0.9986, std.dev.: 0.0433)
MultiSource/Applications/JM/lencod/lencod: -4.63% (17.7765 => 16.9530, std.dev.: 0.1831)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.54% (2.9931 => 2.7375, std.dev.: 0.0938)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.52% (0.5272 => 0.4981, std.dev.: 0.0034)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -2.84% (40.4023 => 39.2560, std.dev.: 0.2976)
SingleSource/Benchmarks/Shootout/methcall: -2.00% (8.4671 => 8.2979, std.dev.: 0.0178)
MultiSource/Benchmarks/VersaBench/bmm/bmm: -1.72% (2.7537 => 2.7062, std.dev.: 0.0153)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.27% (5.5455 => 5.4748, std.dev.: 0.0067)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -2.54% (0.1458 => 0.1421, std.dev.: 0.0093)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C++/NP/np: 61.68% (0.0214 => 0.0346, std.dev.: 0.0022)
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 60.93% (0.0343 => 0.0552, std.dev.: 0.0028)
SingleSource/Benchmarks/Misc-C++/mandel-text: 60.44% (0.0225 => 0.0361, std.dev.: 0.0023)
MultiSource/Benchmarks/Prolangs-C++/office/office: 58.17% (0.2295 => 0.3630, std.dev.: 0.0082)
MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 58.01% (0.0493 => 0.0779, std.dev.: 0.0028)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 52.39% (0.1065 => 0.1623, std.dev.: 0.0110)
MultiSource/Benchmarks/Olden/mst/mst: 51.67% (0.1405 => 0.2131, std.dev.: 0.0111)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 45.57% (1.4253 => 2.0748, std.dev.: 0.0680)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 45.29% (0.0541 => 0.0786, std.dev.: 0.0068)
SingleSource/Benchmarks/Misc/fp-convert: 45.20% (0.0323 => 0.0469, std.dev.: 0.0027)
MultiSource/Benchmarks/SciMark2-C/scimark2: 44.33% (0.3765 => 0.5434, std.dev.: 0.0403)
MultiSource/Benchmarks/Fhourstones/fhourstones: 41.75% (0.1861 => 0.2638, std.dev.: 0.0178)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 40.21% (0.1067 => 0.1496, std.dev.: 0.0109)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 32.28% (0.3061 => 0.4049, std.dev.: 0.0210)
SingleSource/Benchmarks/Misc/dt: 31.02% (0.0374 => 0.0490, std.dev.: 0.0044)
MultiSource/Benchmarks/Prolangs-C++/city/city: 28.71% (1.5862 => 2.0416, std.dev.: 0.0579)
MultiSource/Benchmarks/McCat/09-vor/vor: 28.04% (0.3723 => 0.4767, std.dev.: 0.0162)
MultiSource/Benchmarks/McCat/05-eks/eks: 25.82% (0.5698 => 0.7169, std.dev.: 0.0230)
SingleSource/Benchmarks/Misc-C++/bigfib: 23.32% (0.7059 => 0.8705, std.dev.: 0.0317)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 22.37% (1.1193 => 1.3697, std.dev.: 0.0794)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 21.68% (5.6424 => 6.8659, std.dev.: 0.1389)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 21.13% (1.5014 => 1.8187, std.dev.: 0.0974)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 17.50% (1.5981 => 1.8778, std.dev.: 0.0943)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 13.71% (1.5727 => 1.7883, std.dev.: 0.0413)
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.46% (0.2393 => 0.2715, std.dev.: 0.0112)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.05% (1.6292 => 1.7930, std.dev.: 0.0389)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.31% (25.9348 => 28.3488, std.dev.: 0.6509)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.15% (1.4757 => 1.6108, std.dev.: 0.0369)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.34% (0.6254 => 0.6713, std.dev.: 0.0134)
MultiSource/Applications/Burg/burg: 7.00% (1.5375 => 1.6451, std.dev.: 0.0123)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.77% (0.5196 => 0.5548, std.dev.: 0.0037)
MultiSource/Applications/kimwitu++/kc: 6.09% (20.1855 => 21.4139, std.dev.: 0.4136)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.08% (1.6563 => 1.7570, std.dev.: 0.0293)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.73% (1.5372 => 1.5792, std.dev.: 0.0104)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 72.98% (0.0459 => 0.0794, std.dev.: 0.0025)
SingleSource/Benchmarks/Shootout/ary3: 61.27% (6.0122 => 9.6958, std.dev.: 0.3219)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 49.68% (0.0624 => 0.0934, std.dev.: 0.0070)
SingleSource/Benchmarks/Shootout/heapsort: 41.66% (2.9988 => 4.2481, std.dev.: 0.2942)
MultiSource/Benchmarks/Fhourstones/fhourstones: 34.83% (1.3530 => 1.8243, std.dev.: 0.0771)
MultiSource/Benchmarks/Olden/mst/mst: 29.59% (0.2099 => 0.2720, std.dev.: 0.0224)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.47% (1.2579 => 1.5406, std.dev.: 0.0089)
MultiSource/Applications/sgefa/sgefa: 18.35% (1.1695 => 1.3841, std.dev.: 0.0177)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.55% (6.1372 => 7.1529, std.dev.: 0.0890)
MultiSource/Applications/obsequi/Obsequi: 14.64% (2.2398 => 2.5677, std.dev.: 0.0753)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 11.34% (0.4480 => 0.4988, std.dev.: 0.0161)
MultiSource/Benchmarks/Olden/health/health: 8.59% (0.3341 => 0.3628, std.dev.: 0.0099)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 8.53% (0.1360 => 0.1476, std.dev.: 0.0018)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.23% (5.2003 => 5.6283, std.dev.: 0.0066)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 8.02% (62.4345 => 67.4443, std.dev.: 1.9314)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.53% (3.1853 => 3.4252, std.dev.: 0.0263)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.39% (3.9713 => 4.2251, std.dev.: 0.0279)
MultiSource/Benchmarks/7zip/7zip-benchmark: 5.73% (10.2418 => 10.8289, std.dev.: 0.1759)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.92% (3.2201 => 3.3784, std.dev.: 0.0329)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.87% (4.6639 => 4.8910, std.dev.: 0.0183)
SingleSource/Benchmarks/Misc/ffbench: 4.69% (1.3696 => 1.4338, std.dev.: 0.0030)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.30% (5.9362 => 6.1912, std.dev.: 0.0480)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.71% (5.2788 => 5.4748, std.dev.: 0.0067)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.58% (5.5010 => 5.6981, std.dev.: 0.0258)
MultiSource/Benchmarks/Olden/bh/bh: 3.19% (2.4435 => 2.5214, std.dev.: 0.0180)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.48% (5.6582 => 5.7988, std.dev.: 0.0307)
SingleSource/Benchmarks/Misc/oourafft: 2.19% (3.7315 => 3.8133, std.dev.: 0.0149)
MultiSource/Benchmarks/Olden/em3d/em3d: 1.91% (5.1628 => 5.2613, std.dev.: 0.0379)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.91% (4.3727 => 4.4561, std.dev.: 0.0170)
SingleSource/Benchmarks/Shootout/lists: 1.85% (7.2961 => 7.4314, std.dev.: 0.0323)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.71% (39.9248 => 40.6082, std.dev.: 0.2531)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 1.69% (2.8994 => 2.9484, std.dev.: 0.0097)
SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.19% (4.5935 => 4.6480, std.dev.: 0.0180)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.60% (0.1151 => 0.1029, std.dev.: 0.0031)
MultiSource/Applications/JM/lencod/lencod: -10.48% (18.9387 => 16.9530, std.dev.: 0.1831)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.33% (0.2006 => 0.1839, std.dev.: 0.0052)
SingleSource/UnitTests/2006-12-11-LoadConstants: -6.97% (0.1563 => 0.1454, std.dev.: 0.0025)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/puzzle: -42.93% (1.2911 => 0.7368, std.dev.: 0.0107)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.53% (4.4050 => 3.2363, std.dev.: 0.0885)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.16% (6.2328 => 5.0386, std.dev.: 0.0164)
SingleSource/UnitTests/Vectorizer/gcc-loops: -16.33% (25.3677 => 21.2242, std.dev.: 0.0563)
SingleSource/Benchmarks/Misc/salsa20: -12.86% (10.3398 => 9.0103, std.dev.: 0.0803)
MultiSource/Benchmarks/mafft/pairlocalalign: -9.63% (48.3307 => 43.6745, std.dev.: 0.0400)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.32% (1.6679 => 1.5125, std.dev.: 0.0003)
SingleSource/Benchmarks/Shootout-C++/hash: -8.93% (0.7941 => 0.7232, std.dev.: 0.0200)
MultiSource/Applications/SIBsim4/SIBsim4: -7.80% (3.5327 => 3.2571, std.dev.: 0.0480)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.18% (9.8728 => 9.2624, std.dev.: 0.0286)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.73% (5.5889 => 5.2686, std.dev.: 0.0308)
MultiSource/Applications/sqlite3/sqlite3: -5.06% (4.6358 => 4.4010, std.dev.: 0.0759)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.49% (4.5717 => 4.3663, std.dev.: 0.0052)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.26% (5.3184 => 5.0917, std.dev.: 0.0428)
MultiSource/Applications/lambda-0_1_3/lambda: -3.80% (9.1099 => 8.7638, std.dev.: 0.0468)
MultiSource/Applications/hexxagon/hexxagon: -3.52% (15.4979 => 14.9530, std.dev.: 0.1477)
SingleSource/Benchmarks/Misc/flops: -3.26% (10.2170 => 9.8840, std.dev.: 0.0276)
SingleSource/Benchmarks/Shootout/sieve: -2.86% (8.0178 => 7.7884, std.dev.: 0.0389)
MultiSource/Benchmarks/BitBench/five11/five11: -2.69% (5.7342 => 5.5798, std.dev.: 0.0381)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.65% (3.8665 => 3.7642, std.dev.: 0.0366)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.99% (4.2167 => 4.1328, std.dev.: 0.0072)
SingleSource/Benchmarks/Misc/ReedSolomon: -1.58% (8.5243 => 8.3899, std.dev.: 0.0166)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -1.39% (0.1441 => 0.1421, std.dev.: 0.0093)
Report Time: 0.90s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130613/5e9ae586/attachment.html>
More information about the llvm-testresults
mailing list