[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Oct 17 15:21:00 PDT 2013
http://llvm.org/perf/db_default/v4/nts/16418?compare_to=16414&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 16418, Order: 192915, Start Time: 2013-10-17 20:30:52, End Time: 2013-10-17 22:24:09
To: 16414, Order: 192902, Start Time: 2013-10-17 18:01:23, End Time: 2013-10-17 20:01:07
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 35 (69 on baseline)
Performance Improvements: 30 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1042 (1024 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Perm: 73.48% (0.0362 => 0.0628, std.dev.: 0.0014)
SingleSource/Benchmarks/Stanford/Treesort: 46.17% (0.0509 => 0.0744, std.dev.: 0.0027)
MultiSource/Applications/viterbi/viterbi: 38.38% (0.2134 => 0.2953, std.dev.: 0.0233)
MultiSource/Applications/obsequi/Obsequi: 35.73% (1.1890 => 1.6138, std.dev.: 0.0689)
MultiSource/Applications/Burg/burg: 24.83% (1.5746 => 1.9655, std.dev.: 0.1062)
MultiSource/Applications/lua/lua: 19.74% (4.3966 => 5.2643, std.dev.: 0.2410)
SingleSource/Benchmarks/Shootout-C++/methcall: 18.71% (0.2154 => 0.2557, std.dev.: 0.0142)
MultiSource/Applications/JM/ldecod/ldecod: 18.38% (8.1471 => 9.6442, std.dev.: 0.1768)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 14.34% (0.1618 => 0.1850, std.dev.: 0.0087)
SingleSource/Benchmarks/Shootout-C++/ary2: 13.42% (0.2616 => 0.2967, std.dev.: 0.0006)
SingleSource/Benchmarks/Shootout-C++/ary3: 11.53% (0.2636 => 0.2940, std.dev.: 0.0075)
MultiSource/Applications/SIBsim4/SIBsim4: 11.15% (1.7085 => 1.8990, std.dev.: 0.0595)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.12% (0.3994 => 0.4398, std.dev.: 0.0087)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.79% (0.3116 => 0.3421, std.dev.: 0.0051)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: 9.54% (0.1666 => 0.1825, std.dev.: 0.0049)
SingleSource/Benchmarks/Shootout-C++/ackermann: 7.68% (0.2069 => 0.2228, std.dev.: 0.0056)
SingleSource/Benchmarks/Shootout-C++/reversefile: 5.29% (0.3763 => 0.3962, std.dev.: 0.0063)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Misc-C++/stepanov_container: 45.95% (5.2935 => 7.7261, std.dev.: 0.4239)
MultiSource/Applications/SPASS/SPASS: 38.96% (9.1968 => 12.7797, std.dev.: 0.7366)
SingleSource/Benchmarks/Shootout-C++/ackermann: 27.56% (3.6310 => 4.6317, std.dev.: 0.0688)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 27.16% (0.1436 => 0.1826, std.dev.: 0.0103)
SingleSource/Benchmarks/McGill/chomp: 18.14% (1.0213 => 1.2066, std.dev.: 0.0115)
SingleSource/Benchmarks/Shootout-C++/hash: 14.88% (0.7314 => 0.8402, std.dev.: 0.0171)
SingleSource/Benchmarks/Shootout/hash: 14.57% (5.1390 => 5.8880, std.dev.: 0.1476)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 9.46% (21.4840 => 23.5164, std.dev.: 0.0129)
SingleSource/Benchmarks/Misc/ffbench: 8.42% (1.3983 => 1.5161, std.dev.: 0.0139)
MultiSource/Benchmarks/Bullet/bullet: 6.60% (7.2515 => 7.7301, std.dev.: 0.1469)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.48% (0.3719 => 0.3960, std.dev.: 0.0052)
SingleSource/Benchmarks/Shootout/ary3: 3.57% (5.7140 => 5.9178, std.dev.: 0.0730)
SingleSource/Benchmarks/Misc/flops-8: 3.49% (2.5294 => 2.6176, std.dev.: 0.0102)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.96% (1.8116 => 1.8653, std.dev.: 0.0171)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.97% (3.9115 => 3.9887, std.dev.: 0.0106)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.84% (2.3809 => 2.4246, std.dev.: 0.0004)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.75% (3.3684 => 3.4274, std.dev.: 0.0184)
SingleSource/Benchmarks/Misc/flops-7: 1.72% (1.7300 => 1.7597, std.dev.: 0.0072)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -38.78% (0.1248 => 0.0764, std.dev.: 0.0110)
SingleSource/Regression/C/uint64_to_float: -29.12% (0.0594 => 0.0421, std.dev.: 0.0009)
SingleSource/Regression/C++/EH/exception_spec_test: -21.89% (0.0466 => 0.0364, std.dev.: 0.0014)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -20.58% (0.3100 => 0.2462, std.dev.: 0.0109)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -18.03% (0.0588 => 0.0482, std.dev.: 0.0018)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -17.16% (0.2034 => 0.1685, std.dev.: 0.0086)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -15.40% (0.3921 => 0.3317, std.dev.: 0.0188)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -13.41% (1.6528 => 1.4311, std.dev.: 0.0576)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -11.96% (2.2183 => 1.9529, std.dev.: 0.0726)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.33% (0.4029 => 0.3613, std.dev.: 0.0084)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -9.37% (0.1142 => 0.1035, std.dev.: 0.0022)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -6.06% (0.9377 => 0.8809, std.dev.: 0.0061)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -4.86% (0.9839 => 0.9361, std.dev.: 0.0064)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.14% (0.2825 => 0.2708, std.dev.: 0.0020)
MultiSource/Benchmarks/SciMark2-C/scimark2: -4.07% (0.3910 => 0.3751, std.dev.: 0.0027)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -3.41% (0.6889 => 0.6654, std.dev.: 0.0061)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -3.24% (1.0247 => 0.9915, std.dev.: 0.0033)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -24.02% (0.4350 => 0.3305, std.dev.: 0.0304)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.94% (2.9571 => 2.3971, std.dev.: 0.1360)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -18.28% (52.0105 => 42.5051, std.dev.: 1.7145)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -16.06% (73.5746 => 61.7561, std.dev.: 1.3800)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -9.25% (43.6332 => 39.5952, std.dev.: 1.0683)
MultiSource/Benchmarks/FreeBench/neural/neural: -6.83% (0.2520 => 0.2348, std.dev.: 0.0044)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.57% (0.3030 => 0.2831, std.dev.: 0.0011)
SingleSource/Benchmarks/Dhrystone/dry: -3.53% (0.5018 => 0.4841, std.dev.: 0.0015)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.86% (1.8404 => 1.7878, std.dev.: 0.0112)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.76% (1.5284 => 1.4862, std.dev.: 0.0074)
SingleSource/Benchmarks/Shootout-C++/matrix: -2.39% (2.8987 => 2.8293, std.dev.: 0.0069)
SingleSource/Benchmarks/Misc/pi: -2.37% (1.6826 => 1.6428, std.dev.: 0.0108)
SingleSource/Benchmarks/CoyoteBench/almabench: -1.18% (35.6730 => 35.2526, std.dev.: 0.0627)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -1.09% (0.1381 => 0.1366, std.dev.: 0.0068)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Perm: 94.43% (0.0323 => 0.0628, std.dev.: 0.0014)
SingleSource/Benchmarks/Stanford/Treesort: 63.88% (0.0454 => 0.0744, std.dev.: 0.0027)
MultiSource/Applications/viterbi/viterbi: 49.44% (0.1976 => 0.2953, std.dev.: 0.0233)
MultiSource/Applications/Burg/burg: 40.45% (1.3994 => 1.9655, std.dev.: 0.1062)
MultiSource/Applications/obsequi/Obsequi: 39.71% (1.1551 => 1.6138, std.dev.: 0.0689)
MultiSource/Applications/JM/ldecod/ldecod: 30.28% (7.4026 => 9.6442, std.dev.: 0.1768)
MultiSource/Applications/JM/lencod/lencod: 26.31% (16.5902 => 20.9550, std.dev.: 0.7512)
SingleSource/Benchmarks/Shootout-C++/methcall: 25.90% (0.2031 => 0.2557, std.dev.: 0.0142)
MultiSource/Applications/lua/lua: 24.62% (4.2242 => 5.2643, std.dev.: 0.2410)
SingleSource/Benchmarks/Misc/richards_benchmark: 24.48% (0.0772 => 0.0961, std.dev.: 0.0019)
MultiSource/Applications/sqlite3/sqlite3: 24.26% (16.2888 => 20.2401, std.dev.: 0.8047)
MultiSource/Applications/SIBsim4/SIBsim4: 23.85% (1.5333 => 1.8990, std.dev.: 0.0595)
MultiSource/Applications/lambda-0_1_3/lambda: 22.01% (0.8014 => 0.9778, std.dev.: 0.0632)
MultiSource/Applications/siod/siod: 21.86% (2.4480 => 2.9831, std.dev.: 0.1258)
SingleSource/Benchmarks/Misc/flops: 20.41% (0.1034 => 0.1245, std.dev.: 0.0067)
SingleSource/Benchmarks/Misc-C++/stepanov_container: 19.01% (0.8802 => 1.0475, std.dev.: 0.0317)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 18.99% (0.2069 => 0.2462, std.dev.: 0.0109)
MultiSource/Applications/ClamAV/clamscan: 17.57% (16.5398 => 19.4456, std.dev.: 0.9531)
SingleSource/Benchmarks/Shootout-C++/ackermann: 16.96% (0.1905 => 0.2228, std.dev.: 0.0056)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 15.77% (0.1598 => 0.1850, std.dev.: 0.0087)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 15.73% (0.2956 => 0.3421, std.dev.: 0.0051)
SingleSource/Benchmarks/Shootout-C++/ary2: 15.67% (0.2565 => 0.2967, std.dev.: 0.0006)
SingleSource/Benchmarks/Shootout-C++/ary3: 15.66% (0.2542 => 0.2940, std.dev.: 0.0075)
SingleSource/Benchmarks/Stanford/Oscar: 15.45% (0.0673 => 0.0777, std.dev.: 0.0028)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.66% (0.8233 => 0.9440, std.dev.: 0.0114)
SingleSource/Benchmarks/Shootout-C++/spellcheck: 14.62% (0.3837 => 0.4398, std.dev.: 0.0087)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 14.15% (0.1597 => 0.1823, std.dev.: 0.0026)
MultiSource/Applications/kimwitu++/kc: 14.12% (18.3608 => 20.9531, std.dev.: 0.8437)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: 11.48% (0.1637 => 0.1825, std.dev.: 0.0049)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 10.64% (7.2661 => 8.0394, std.dev.: 0.2138)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 10.27% (0.1237 => 0.1364, std.dev.: 0.0006)
SingleSource/Benchmarks/Shootout-C++/reversefile: 10.15% (0.3597 => 0.3962, std.dev.: 0.0063)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 6.14% (0.4624 => 0.4908, std.dev.: 0.0106)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.43% (0.9494 => 0.9915, std.dev.: 0.0033)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 4.11% (0.2601 => 0.2708, std.dev.: 0.0020)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Misc-C++/stepanov_container: 69.88% (4.5479 => 7.7261, std.dev.: 0.4239)
SingleSource/Benchmarks/Shootout-C++/methcall: 62.67% (7.6426 => 12.4320, std.dev.: 0.0749)
MultiSource/Applications/SPASS/SPASS: 55.26% (8.2311 => 12.7797, std.dev.: 0.7366)
MultiSource/Applications/minisat/minisat: 51.33% (6.2760 => 9.4977, std.dev.: 1.1929)
MultiSource/Benchmarks/Olden/bisort/bisort: 45.75% (0.6647 => 0.9688, std.dev.: 0.0747)
SingleSource/Benchmarks/Shootout/ary3: 25.99% (4.6972 => 5.9178, std.dev.: 0.0730)
MultiSource/Applications/obsequi/Obsequi: 22.97% (2.1884 => 2.6910, std.dev.: 0.0749)
MultiSource/Benchmarks/Ptrdist/ks/ks: 22.47% (1.1431 => 1.4000, std.dev.: 0.0714)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 21.40% (1.3008 => 1.5792, std.dev.: 0.0365)
SingleSource/Benchmarks/McGill/chomp: 18.75% (1.0161 => 1.2066, std.dev.: 0.0115)
SingleSource/Benchmarks/Shootout-C++/ackermann: 15.78% (4.0006 => 4.6317, std.dev.: 0.0688)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.68% (2.1111 => 2.4210, std.dev.: 0.0013)
SingleSource/Benchmarks/Shootout/hash: 13.21% (5.2009 => 5.8880, std.dev.: 0.1476)
SingleSource/Benchmarks/Shootout-C++/hash: 13.14% (0.7426 => 0.8402, std.dev.: 0.0171)
SingleSource/Benchmarks/Shootout-C++/fibo: 10.99% (4.9428 => 5.4862, std.dev.: 0.0093)
MultiSource/Benchmarks/Bullet/bullet: 9.91% (7.0333 => 7.7301, std.dev.: 0.1469)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 9.27% (21.5217 => 23.5164, std.dev.: 0.0129)
SingleSource/Benchmarks/Misc/ffbench: 8.06% (1.4030 => 1.5161, std.dev.: 0.0139)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.02% (3.1730 => 3.4274, std.dev.: 0.0184)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.47% (36.8417 => 39.5952, std.dev.: 1.0683)
SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0016)
SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.55% (6.1088 => 6.4481, std.dev.: 0.0798)
MultiSource/Benchmarks/Ptrdist/bc/bc: 5.08% (1.1013 => 1.1573, std.dev.: 0.0029)
SingleSource/Benchmarks/Misc/himenobmtxpa: 4.09% (4.0596 => 4.2258, std.dev.: 0.0046)
SingleSource/Benchmarks/Misc/flops-8: 3.82% (2.5214 => 2.6176, std.dev.: 0.0102)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.17% (2.5368 => 2.6173, std.dev.: 0.0101)
MultiSource/Benchmarks/SciMark2-C/scimark2: 3.14% (89.7126 => 92.5267, std.dev.: 0.2730)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.97% (4.0181 => 4.1373, std.dev.: 0.0362)
SingleSource/Benchmarks/Misc/flops-7: 2.36% (1.7191 => 1.7597, std.dev.: 0.0072)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.99% (0.5182 => 0.5285, std.dev.: 0.0028)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.89% (4.4696 => 4.5542, std.dev.: 0.0311)
MultiSource/Applications/lambda-0_1_3/lambda: 1.80% (8.1346 => 8.2811, std.dev.: 0.0556)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.71% (2.4920 => 2.5347, std.dev.: 0.0058)
SingleSource/Benchmarks/SmallPT/smallpt: 1.48% (16.7972 => 17.0464, std.dev.: 0.0143)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/Vector/Altivec/casts: -19.89% (0.1483 => 0.1188, std.dev.: 0.0102)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -55.07% (0.5226 => 0.2348, std.dev.: 0.0044)
MultiSource/Applications/sgefa/sgefa: -42.29% (1.5790 => 0.9113, std.dev.: 0.0053)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -33.25% (0.0400 => 0.0267, std.dev.: 0.0031)
MultiSource/Benchmarks/Olden/em3d/em3d: -29.18% (5.0288 => 3.5615, std.dev.: 0.0624)
SingleSource/Benchmarks/Linpack/linpack-pc: -24.10% (57.2347 => 43.4426, std.dev.: 2.2152)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.00% (15.9508 => 13.0796, std.dev.: 0.4720)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.64% (3.4956 => 3.1237, std.dev.: 0.0261)
SingleSource/UnitTests/Vectorizer/gcc-loops: -10.50% (20.8247 => 18.6376, std.dev.: 0.0759)
MultiSource/Benchmarks/mafft/pairlocalalign: -8.04% (50.0284 => 46.0078, std.dev.: 0.4305)
MultiSource/Applications/SIBsim4/SIBsim4: -3.83% (3.7437 => 3.6005, std.dev.: 0.0481)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.89% (3.7874 => 3.6780, std.dev.: 0.0038)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.20% (4.3592 => 4.2633, std.dev.: 0.0168)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.17% (17.1431 => 16.7712, std.dev.: 0.0379)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.34% (0.1348 => 0.1366, std.dev.: 0.0068)
Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131017/2e14c965/attachment.html>
More information about the llvm-testresults
mailing list