[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Wed Aug 7 21:27:34 PDT 2013
http://llvm.org/perf/db_default/v4/nts/14199?compare_to=14196&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15
Comparing:
Run: 14199, Order: 187956, Start Time: 2013-08-08 02:43:31, End Time: 2013-08-08 04:29:26
To: 14196, Order: 187939, Start Time: 2013-08-08 00:21:05, End Time: 2013-08-08 02:18:35
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57
===============
Tests Summary
===============
New Failures: 0 (2 on baseline)
Performance Regressions: 2 (35 on baseline)
Performance Improvements: 163 (115 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 940 (955 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/life/life: 2.74% (2.5215 => 2.5907, std.dev.: 0.0039)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.74% (0.6562 => 0.6676, std.dev.: 0.0001)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -38.93% (0.1513 => 0.0924, std.dev.: 0.0037)
SingleSource/Regression/C/2003-05-23-TransparentUnion: -38.51% (0.0296 => 0.0182, std.dev.: 0.0025)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -36.94% (0.1126 => 0.0710, std.dev.: 0.0037)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -35.14% (0.1417 => 0.0919, std.dev.: 0.0050)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -35.01% (0.1568 => 0.1019, std.dev.: 0.0027)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -32.27% (0.4183 => 0.2833, std.dev.: 0.0012)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -30.13% (0.1102 => 0.0770, std.dev.: 0.0040)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -28.81% (0.1444 => 0.1028, std.dev.: 0.0013)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -25.80% (0.3368 => 0.2499, std.dev.: 0.0024)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -25.73% (0.1399 => 0.1039, std.dev.: 0.0057)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -25.38% (6.8798 => 5.1340, std.dev.: 0.0312)
MultiSource/Benchmarks/McCat/15-trie/trie: -25.30% (0.0830 => 0.0620, std.dev.: 0.0008)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -25.28% (2.0046 => 1.4978, std.dev.: 0.0042)
MultiSource/Benchmarks/Ptrdist/ft/ft: -25.25% (0.3050 => 0.2280, std.dev.: 0.0038)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -24.90% (0.2313 => 0.1737, std.dev.: 0.0046)
MultiSource/Benchmarks/Olden/mst/mst: -23.98% (0.1839 => 0.1398, std.dev.: 0.0005)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -23.82% (0.0697 => 0.0531, std.dev.: 0.0003)
MultiSource/Benchmarks/McCat/18-imp/imp: -23.55% (0.5282 => 0.4038, std.dev.: 0.0005)
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -23.16% (0.1861 => 0.1430, std.dev.: 0.0062)
MultiSource/Benchmarks/Olden/tsp/tsp: -22.35% (0.1799 => 0.1397, std.dev.: 0.0009)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -22.11% (6.5089 => 5.0701, std.dev.: 0.0494)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -22.10% (9.8518 => 7.6742, std.dev.: 0.0059)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -22.01% (2.1254 => 1.6575, std.dev.: 0.0076)
MultiSource/Benchmarks/McCat/04-bisect/bisect: -21.54% (0.1755 => 0.1377, std.dev.: 0.0016)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -21.23% (0.2096 => 0.1651, std.dev.: 0.0019)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -20.94% (2.4759 => 1.9575, std.dev.: 0.0079)
MultiSource/Benchmarks/Olden/em3d/em3d: -20.72% (0.2597 => 0.2059, std.dev.: 0.0008)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -20.57% (0.0661 => 0.0525, std.dev.: 0.0007)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -20.35% (0.1361 => 0.1084, std.dev.: 0.0025)
MultiSource/Benchmarks/Olden/power/power: -20.25% (0.1793 => 0.1430, std.dev.: 0.0048)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -19.87% (0.1107 => 0.0887, std.dev.: 0.0029)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -19.72% (0.4127 => 0.3313, std.dev.: 0.0021)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -18.62% (0.0983 => 0.0800, std.dev.: 0.0012)
MultiSource/Benchmarks/Olden/bh/bh: -18.00% (0.4160 => 0.3411, std.dev.: 0.0009)
MultiSource/Benchmarks/McCat/08-main/main: -17.84% (0.3672 => 0.3017, std.dev.: 0.0011)
MultiSource/Benchmarks/nbench/nbench: -17.61% (1.5966 => 1.3155, std.dev.: 0.0071)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -17.39% (1.8776 => 1.5511, std.dev.: 0.0102)
MultiSource/Benchmarks/Olden/health/health: -17.25% (0.1913 => 0.1583, std.dev.: 0.0017)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -16.89% (0.3458 => 0.2874, std.dev.: 0.0045)
MultiSource/Benchmarks/McCat/05-eks/eks: -16.64% (0.6647 => 0.5541, std.dev.: 0.0010)
MultiSource/Benchmarks/McCat/09-vor/vor: -15.91% (0.4280 => 0.3599, std.dev.: 0.0021)
MultiSource/Benchmarks/Ptrdist/bc/bc: -15.79% (1.5843 => 1.3342, std.dev.: 0.0011)
MultiSource/Benchmarks/Prolangs-C/loader/loader: -15.54% (0.4189 => 0.3538, std.dev.: 0.0132)
MultiSource/Applications/obsequi/Obsequi: -14.96% (1.3980 => 1.1888, std.dev.: 0.0051)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -14.14% (0.0884 => 0.0759, std.dev.: 0.0030)
MultiSource/Benchmarks/mafft/pairlocalalign: -12.71% (12.4339 => 10.8540, std.dev.: 0.3815)
MultiSource/Benchmarks/Ptrdist/ks/ks: -12.42% (0.2029 => 0.1777, std.dev.: 0.0022)
MultiSource/Benchmarks/Olden/bisort/bisort: -12.17% (0.0838 => 0.0736, std.dev.: 0.0012)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -12.14% (29.9768 => 26.3365, std.dev.: 0.5552)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -12.14% (0.1260 => 0.1107, std.dev.: 0.0011)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -11.97% (11.4812 => 10.1069, std.dev.: 0.0170)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -11.46% (0.8351 => 0.7394, std.dev.: 0.0024)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -11.41% (0.7868 => 0.6970, std.dev.: 0.0008)
SingleSource/Benchmarks/Misc-C++/bigfib: -10.29% (0.8252 => 0.7403, std.dev.: 0.0307)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -10.29% (1.6517 => 1.4818, std.dev.: 0.0098)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -10.28% (0.3677 => 0.3299, std.dev.: 0.0012)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -10.08% (1.0049 => 0.9036, std.dev.: 0.0132)
SingleSource/Benchmarks/Misc-C++/Large/ray: -9.87% (0.4042 => 0.3643, std.dev.: 0.0005)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -9.77% (1.6575 => 1.4955, std.dev.: 0.0099)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -9.73% (1.6872 => 1.5230, std.dev.: 0.0107)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -9.43% (1.0996 => 0.9959, std.dev.: 0.0400)
SingleSource/Benchmarks/CoyoteBench/fftbench: -9.26% (0.4707 => 0.4271, std.dev.: 0.0146)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -9.25% (0.6483 => 0.5883, std.dev.: 0.0054)
SingleSource/Benchmarks/Misc/oourafft: -9.14% (0.2658 => 0.2415, std.dev.: 0.0016)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.00% (17.0148 => 15.4835, std.dev.: 0.0148)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -8.95% (0.2917 => 0.2656, std.dev.: 0.0078)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.59% (0.1607 => 0.1469, std.dev.: 0.0011)
MultiSource/Benchmarks/FreeBench/neural/neural: -7.87% (0.2249 => 0.2072, std.dev.: 0.0027)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.30% (0.1739 => 0.1612, std.dev.: 0.0009)
MultiSource/Applications/kimwitu++/kc: -6.96% (21.0267 => 19.5634, std.dev.: 0.0962)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.94% (1.4866 => 1.3834, std.dev.: 0.0104)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -6.86% (1.2743 => 1.1869, std.dev.: 0.0131)
MultiSource/Applications/SPASS/SPASS: -6.50% (18.4708 => 17.2693, std.dev.: 0.1812)
MultiSource/Benchmarks/MallocBench/gs/gs: -6.48% (5.1024 => 4.7719, std.dev.: 0.0333)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.89% (0.6585 => 0.6197, std.dev.: 0.0033)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -5.82% (0.7382 => 0.6952, std.dev.: 0.0059)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.59% (1.0208 => 0.9637, std.dev.: 0.0079)
MultiSource/Applications/hbd/hbd: -4.96% (1.7753 => 1.6873, std.dev.: 0.0101)
MultiSource/Benchmarks/sim/sim: -4.92% (0.4042 => 0.3843, std.dev.: 0.0014)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.92% (6.1314 => 5.8299, std.dev.: 0.0327)
MultiSource/Applications/siod/siod: -4.87% (2.6676 => 2.5376, std.dev.: 0.0494)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.72% (1.4815 => 1.4116, std.dev.: 0.0072)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.57% (1.5759 => 1.5039, std.dev.: 0.0085)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.51% (1.4373 => 1.3725, std.dev.: 0.0077)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -4.47% (0.7852 => 0.7501, std.dev.: 0.0089)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.23% (1.4288 => 1.3684, std.dev.: 0.0093)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -4.12% (1.1850 => 1.1362, std.dev.: 0.0067)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.05% (1.4579 => 1.3989, std.dev.: 0.0099)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.97% (1.5397 => 1.4785, std.dev.: 0.0103)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.71% (0.3880 => 0.3736, std.dev.: 0.0037)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.61% (0.3016 => 0.2907, std.dev.: 0.0018)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.55% (1.4037 => 1.3539, std.dev.: 0.0124)
MultiSource/Applications/oggenc/oggenc: -3.46% (5.9727 => 5.7660, std.dev.: 0.0249)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -3.38% (1.4688 => 1.4191, std.dev.: 0.0078)
MultiSource/Benchmarks/PAQ8p/paq8p: -3.36% (2.6123 => 2.5245, std.dev.: 0.0115)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.14% (1.4446 => 1.3992, std.dev.: 0.0096)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.14% (1.5001 => 1.4530, std.dev.: 0.0081)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.08% (1.5044 => 1.4581, std.dev.: 0.0010)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.03% (1.4094 => 1.3667, std.dev.: 0.0025)
MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.00% (1.2416 => 1.2044, std.dev.: 0.0138)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.64% (1.4133 => 1.3760, std.dev.: 0.0120)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.63% (1.4184 => 1.3811, std.dev.: 0.0086)
MultiSource/Benchmarks/Prolangs-C++/city/city: -2.56% (1.7186 => 1.6746, std.dev.: 0.0099)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.34% (1.3803 => 1.3480, std.dev.: 0.0111)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.14% (1.4572 => 1.4260, std.dev.: 0.0083)
MultiSource/Applications/Burg/burg: -2.06% (1.5082 => 1.4771, std.dev.: 0.0037)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.01% (1.4782 => 1.4485, std.dev.: 0.0087)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.96% (1.6338 => 1.6017, std.dev.: 0.0063)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -1.96% (1.5174 => 1.4877, std.dev.: 0.0089)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.91% (1.6202 => 1.5892, std.dev.: 0.0087)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -1.81% (0.7403 => 0.7269, std.dev.: 0.0031)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.80% (1.3741 => 1.3494, std.dev.: 0.0092)
MultiSource/Applications/hexxagon/hexxagon: -1.74% (1.1457 => 1.1258, std.dev.: 0.0020)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.61% (1.3554 => 1.3336, std.dev.: 0.0076)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -1.54% (1.5206 => 1.4972, std.dev.: 0.0085)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.49% (1.3663 => 1.3460, std.dev.: 0.0078)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.45% (1.7020 => 1.6774, std.dev.: 0.0081)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/mst/mst: -50.47% (0.2679 => 0.1327, std.dev.: 0.0011)
MultiSource/Benchmarks/Ptrdist/ft/ft: -44.20% (1.3700 => 0.7645, std.dev.: 0.0457)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -38.43% (0.0817 => 0.0503, std.dev.: 0.0034)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -34.57% (6.9740 => 4.5629, std.dev.: 0.0545)
MultiSource/Benchmarks/Olden/bisort/bisort: -33.95% (1.0161 => 0.6711, std.dev.: 0.0014)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -33.19% (0.0681 => 0.0455, std.dev.: 0.0013)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -22.12% (0.1894 => 0.1475, std.dev.: 0.0025)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -21.52% (1.5750 => 1.2360, std.dev.: 0.0249)
SingleSource/Benchmarks/CoyoteBench/lpbench: -21.16% (5.2330 => 4.1257, std.dev.: 0.3602)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -20.60% (3.3926 => 2.6938, std.dev.: 0.1744)
MultiSource/Benchmarks/McCat/09-vor/vor: -20.21% (0.1400 => 0.1117, std.dev.: 0.0004)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -20.11% (1.8472 => 1.4757, std.dev.: 0.0021)
MultiSource/Benchmarks/Fhourstones/fhourstones: -19.73% (1.5619 => 1.2538, std.dev.: 0.0331)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -18.49% (0.5328 => 0.4343, std.dev.: 0.0120)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -17.12% (25.6635 => 21.2710, std.dev.: 1.2157)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -17.09% (73.5939 => 61.0163, std.dev.: 2.9028)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -15.14% (48.2659 => 40.9580, std.dev.: 2.4579)
MultiSource/Benchmarks/McCat/08-main/main: -14.74% (0.0855 => 0.0729, std.dev.: 0.0037)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -12.64% (0.0973 => 0.0850, std.dev.: 0.0004)
MultiSource/Benchmarks/Olden/health/health: -11.26% (0.3731 => 0.3311, std.dev.: 0.0002)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.65% (2.6656 => 2.3818, std.dev.: 0.0831)
MultiSource/Applications/obsequi/Obsequi: -10.39% (2.3656 => 2.1198, std.dev.: 0.0729)
MultiSource/Applications/SPASS/SPASS: -9.26% (8.8461 => 8.0266, std.dev.: 0.0979)
MultiSource/Benchmarks/Olden/tsp/tsp: -7.88% (1.7369 => 1.6000, std.dev.: 0.0026)
MultiSource/Applications/minisat/minisat: -7.85% (6.8282 => 6.2922, std.dev.: 0.0069)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -7.18% (0.3580 => 0.3323, std.dev.: 0.0006)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.90% (4.2766 => 3.9816, std.dev.: 0.0910)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -6.87% (0.1471 => 0.1370, std.dev.: 0.0009)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.34% (0.4999 => 0.4682, std.dev.: 0.0021)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -5.86% (0.3293 => 0.3100, std.dev.: 0.0025)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.45% (0.3760 => 0.3555, std.dev.: 0.0010)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.34% (0.1968 => 0.1863, std.dev.: 0.0016)
MultiSource/Benchmarks/Olden/bh/bh: -5.27% (2.5441 => 2.4100, std.dev.: 0.0012)
MultiSource/Benchmarks/PAQ8p/paq8p: -4.69% (95.2282 => 90.7651, std.dev.: 1.0361)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -3.97% (1.4995 => 1.4399, std.dev.: 0.0169)
SingleSource/Benchmarks/Dhrystone/dry: -3.92% (0.5250 => 0.5044, std.dev.: 0.0040)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -3.69% (3.7151 => 3.5780, std.dev.: 0.0349)
MultiSource/Applications/siod/siod: -2.89% (3.6378 => 3.5326, std.dev.: 0.0103)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.74% (2.5757 => 2.5051, std.dev.: 0.0246)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.41% (0.5308 => 0.5180, std.dev.: 0.0009)
SingleSource/Benchmarks/Misc-C++/Large/ray: -1.95% (5.0479 => 4.9497, std.dev.: 0.0092)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.68% (5.8595 => 5.7611, std.dev.: 0.0076)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.58% (1.2001 => 1.1811, std.dev.: 0.0013)
MultiSource/Benchmarks/llubenchmark/llu: -1.58% (2.0415 => 2.0092, std.dev.: 0.0051)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.48% (3.2946 => 3.2459, std.dev.: 0.0008)
MultiSource/Benchmarks/Ptrdist/ks/ks: -1.01% (1.3688 => 1.3550, std.dev.: 0.0001)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Applications/ClamAV/clamscan: -1.97% (0.1368 => 0.1341, std.dev.: 0.0067)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -3.03% (0.2735 => 0.2652, std.dev.: 0.0046)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -14.46% (0.0325 => 0.0278, std.dev.: 0.0000)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/mediabench/gsm/toast/toast
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -5.72% (0.2813 => 0.2652, std.dev.: 0.0046)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.42% (0.0345 => 0.0278, std.dev.: 0.0000)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/FreeBench/distray/distray: 16.55% (0.1033 => 0.1204, std.dev.: 0.0007)
SingleSource/Benchmarks/Misc/oourafft: 5.74% (0.2284 => 0.2415, std.dev.: 0.0016)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.46% (0.6785 => 0.6952, std.dev.: 0.0059)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.44% (0.9407 => 0.9637, std.dev.: 0.0079)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.46% (0.7010 => 0.7112, std.dev.: 0.0013)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.17% (3.7285 => 6.2328, std.dev.: 0.1637)
SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2882, std.dev.: 0.0122)
MultiSource/Benchmarks/FreeBench/neural/neural: 42.51% (0.3171 => 0.4519, std.dev.: 0.0322)
SingleSource/Benchmarks/Misc/pi: 26.26% (1.9835 => 2.5043, std.dev.: 0.0246)
SingleSource/Benchmarks/Shootout/hash: 22.89% (4.1846 => 5.1426, std.dev.: 0.2835)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.03% (0.1678 => 0.1863, std.dev.: 0.0016)
MultiSource/Applications/lambda-0_1_3/lambda: 11.02% (7.0762 => 7.8560, std.dev.: 0.0656)
SingleSource/Benchmarks/Shootout/nestedloop: 8.36% (0.1364 => 0.1478, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9469, std.dev.: 0.0231)
SingleSource/Benchmarks/Linpack/linpack-pc: 8.10% (48.3256 => 52.2392, std.dev.: 0.3265)
MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (1.2557 => 1.3550, std.dev.: 0.0001)
MultiSource/Applications/JM/lencod/lencod: 7.18% (7.1799 => 7.6952, std.dev.: 0.0696)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.93% (3.2027 => 3.4246, std.dev.: 0.0068)
MultiSource/Benchmarks/FreeBench/mason/mason: 6.22% (0.2799 => 0.2973, std.dev.: 0.0034)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6223, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.72% (3.4085 => 3.6035, std.dev.: 0.0303)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.46% (5.5008 => 5.8011, std.dev.: 0.0033)
MultiSource/Applications/siod/siod: 4.64% (3.3761 => 3.5326, std.dev.: 0.0103)
MultiSource/Benchmarks/Olden/tsp/tsp: 4.31% (1.5339 => 1.6000, std.dev.: 0.0026)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.27% (4.3151 => 4.4994, std.dev.: 0.0081)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.12% (5.1471 => 5.3590, std.dev.: 0.0771)
SingleSource/Benchmarks/Misc/whetstone: 3.85% (3.4559 => 3.5890, std.dev.: 0.0133)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.74% (3.3384 => 3.4632, std.dev.: 0.0445)
SingleSource/Benchmarks/CoyoteBench/huffbench: 3.26% (25.0200 => 25.8357, std.dev.: 0.0280)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.02% (0.6480 => 0.6676, std.dev.: 0.0001)
SingleSource/Benchmarks/Shootout-C++/hash2: 3.01% (3.3877 => 3.4896, std.dev.: 0.0275)
MultiSource/Benchmarks/Prolangs-C++/life/life: 2.64% (2.5240 => 2.5907, std.dev.: 0.0039)
SingleSource/Benchmarks/Misc/ffbench: 2.35% (1.3679 => 1.4001, std.dev.: 0.0108)
SingleSource/Benchmarks/Shootout/matrix: 2.31% (1.7358 => 1.7759, std.dev.: 0.0032)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.56% (1.4398 => 1.4623, std.dev.: 0.0026)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Olden/power/power: -36.08% (0.2237 => 0.1430, std.dev.: 0.0048)
MultiSource/Benchmarks/Olden/bisort/bisort: -31.34% (0.1072 => 0.0736, std.dev.: 0.0012)
MultiSource/Benchmarks/Olden/tsp/tsp: -23.16% (0.1818 => 0.1397, std.dev.: 0.0009)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -22.22% (0.0675 => 0.0525, std.dev.: 0.0007)
MultiSource/Benchmarks/MallocBench/gs/gs: -21.69% (6.0938 => 4.7719, std.dev.: 0.0333)
MultiSource/Benchmarks/Olden/health/health: -20.57% (0.1993 => 0.1583, std.dev.: 0.0017)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -20.38% (0.1114 => 0.0887, std.dev.: 0.0029)
MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.23% (1.5228 => 1.2148, std.dev.: 0.0103)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -20.03% (0.1518 => 0.1214, std.dev.: 0.0022)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.63% (0.3576 => 0.2874, std.dev.: 0.0045)
MultiSource/Applications/obsequi/Obsequi: -19.05% (1.4685 => 1.1888, std.dev.: 0.0051)
MultiSource/Applications/lua/lua: -17.51% (5.3200 => 4.3887, std.dev.: 0.0318)
MultiSource/Applications/hbd/hbd: -16.44% (2.0193 => 1.6873, std.dev.: 0.0101)
MultiSource/Applications/hexxagon/hexxagon: -15.26% (1.3285 => 1.1258, std.dev.: 0.0020)
MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.88% (1.3985 => 1.2044, std.dev.: 0.0138)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.07% (0.0773 => 0.0672, std.dev.: 0.0033)
MultiSource/Benchmarks/Olden/em3d/em3d: -13.01% (0.2367 => 0.2059, std.dev.: 0.0008)
MultiSource/Applications/sgefa/sgefa: -12.93% (0.4809 => 0.4187, std.dev.: 0.0041)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.61% (0.7091 => 0.6197, std.dev.: 0.0033)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.71% (0.1870 => 0.1651, std.dev.: 0.0019)
MultiSource/Applications/JM/ldecod/ldecod: -11.52% (8.6720 => 7.6730, std.dev.: 0.0537)
MultiSource/Applications/lambda-0_1_3/lambda: -10.76% (0.9461 => 0.8443, std.dev.: 0.0351)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.00% (1.7797 => 1.6017, std.dev.: 0.0063)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -9.90% (0.1141 => 0.1028, std.dev.: 0.0013)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.36% (0.3655 => 0.3313, std.dev.: 0.0021)
MultiSource/Benchmarks/Ptrdist/ks/ks: -8.73% (0.1947 => 0.1777, std.dev.: 0.0022)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -7.81% (0.3073 => 0.2833, std.dev.: 0.0012)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -7.58% (1.1012 => 1.0177, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.26% (1.4514 => 1.3460, std.dev.: 0.0078)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.19% (1.5144 => 1.4055, std.dev.: 0.0167)
MultiSource/Applications/kimwitu++/kc: -7.18% (21.0770 => 19.5634, std.dev.: 0.0962)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.07% (1.5345 => 1.4260, std.dev.: 0.0083)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.88% (1.5426 => 1.4364, std.dev.: 0.0131)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.69% (0.2498 => 0.2331, std.dev.: 0.0023)
MultiSource/Applications/siod/siod: -6.53% (2.7150 => 2.5376, std.dev.: 0.0494)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.49% (1.4794 => 1.3834, std.dev.: 0.0104)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -6.30% (1.5815 => 1.4818, std.dev.: 0.0098)
MultiSource/Benchmarks/Ptrdist/ft/ft: -6.25% (0.2432 => 0.2280, std.dev.: 0.0038)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.14% (1.6226 => 1.5230, std.dev.: 0.0107)
MultiSource/Applications/Burg/burg: -6.11% (1.5733 => 1.4771, std.dev.: 0.0037)
MultiSource/Benchmarks/PAQ8p/paq8p: -5.99% (2.6853 => 2.5245, std.dev.: 0.0115)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.85% (1.4333 => 1.3494, std.dev.: 0.0092)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.81% (1.5239 => 1.4353, std.dev.: 0.0182)
MultiSource/Applications/oggenc/oggenc: -5.66% (6.1121 => 5.7660, std.dev.: 0.0249)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.55% (1.5437 => 1.4581, std.dev.: 0.0010)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.41% (6.1631 => 5.8299, std.dev.: 0.0327)
MultiSource/Benchmarks/Olden/bh/bh: -5.33% (0.3603 => 0.3411, std.dev.: 0.0009)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.07% (1.5361 => 1.4582, std.dev.: 0.0096)
MultiSource/Applications/minisat/minisat: -5.05% (0.8278 => 0.7860, std.dev.: 0.0077)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.01% (1.4940 => 1.4191, std.dev.: 0.0078)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.97% (1.4721 => 1.3989, std.dev.: 0.0099)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.84% (1.4166 => 1.3480, std.dev.: 0.0111)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.79% (1.4506 => 1.3811, std.dev.: 0.0086)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.72% (1.4853 => 1.4152, std.dev.: 0.0178)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.69% (1.4339 => 1.3667, std.dev.: 0.0025)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.51% (1.4783 => 1.4116, std.dev.: 0.0072)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.31% (1.5629 => 1.4955, std.dev.: 0.0099)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.07% (5.2851 => 5.0701, std.dev.: 0.0494)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.99% (5.3476 => 5.1340, std.dev.: 0.0312)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.89% (1.4947 => 1.4366, std.dev.: 0.0108)
MultiSource/Benchmarks/nbench/nbench: -3.82% (1.3677 => 1.3155, std.dev.: 0.0071)
MultiSource/Applications/SPASS/SPASS: -3.58% (17.9111 => 17.2693, std.dev.: 0.1812)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.28% (1.5479 => 1.4972, std.dev.: 0.0085)
MultiSource/Benchmarks/Ptrdist/bc/bc: -3.18% (1.3780 => 1.3342, std.dev.: 0.0011)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.13% (1.5357 => 1.4877, std.dev.: 0.0089)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.05% (0.7189 => 0.6970, std.dev.: 0.0008)
MultiSource/Benchmarks/McCat/18-imp/imp: -2.77% (0.4153 => 0.4038, std.dev.: 0.0005)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.59% (1.5376 => 1.4978, std.dev.: 0.0042)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.29% (1.3649 => 1.3336, std.dev.: 0.0076)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.90% (10.3031 => 10.1069, std.dev.: 0.0170)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.81% (1.6185 => 1.5892, std.dev.: 0.0087)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.80% (1.4750 => 1.4485, std.dev.: 0.0087)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.63% (1.3952 => 1.3725, std.dev.: 0.0077)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Applications/lemon/lemon: -37.82% (1.4194 => 0.8826, std.dev.: 0.0907)
MultiSource/Benchmarks/Olden/mst/mst: -37.82% (0.2134 => 0.1327, std.dev.: 0.0011)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.18% (2.1022 => 1.4257, std.dev.: 0.0097)
MultiSource/Benchmarks/Ptrdist/ft/ft: -30.26% (1.0962 => 0.7645, std.dev.: 0.0457)
MultiSource/Benchmarks/Olden/bisort/bisort: -29.69% (0.9545 => 0.6711, std.dev.: 0.0014)
MultiSource/Benchmarks/MallocBench/gs/gs: -29.18% (0.1189 => 0.0842, std.dev.: 0.0030)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.04% (0.0816 => 0.0579, std.dev.: 0.0001)
MultiSource/Applications/viterbi/viterbi: -27.23% (3.4923 => 2.5414, std.dev.: 0.0220)
MultiSource/Applications/JM/ldecod/ldecod: -25.26% (0.0859 => 0.0642, std.dev.: 0.0004)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2421, std.dev.: 0.2992)
MultiSource/Applications/minisat/minisat: -21.51% (8.0162 => 6.2922, std.dev.: 0.0069)
SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6171, std.dev.: 0.1125)
MultiSource/Applications/obsequi/Obsequi: -18.72% (2.6081 => 2.1198, std.dev.: 0.0729)
SingleSource/Benchmarks/Misc/mandel: -14.23% (1.1996 => 1.0289, std.dev.: 0.0013)
MultiSource/Applications/SPASS/SPASS: -12.96% (9.2220 => 8.0266, std.dev.: 0.0979)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.85% (0.3557 => 0.3100, std.dev.: 0.0025)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.67% (0.0884 => 0.0772, std.dev.: 0.0002)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.49% (0.5173 => 0.4682, std.dev.: 0.0021)
SingleSource/Benchmarks/Shootout/strcat: -8.85% (0.1593 => 0.1452, std.dev.: 0.0047)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.72% (2.6094 => 2.3818, std.dev.: 0.0831)
MultiSource/Benchmarks/Olden/health/health: -6.89% (0.3556 => 0.3311, std.dev.: 0.0002)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.99% (1.3148 => 1.2360, std.dev.: 0.0249)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.78% (0.3773 => 0.3555, std.dev.: 0.0010)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.15% (1.7207 => 1.6320, std.dev.: 0.0173)
SingleSource/Regression/C/uint64_to_float: -5.14% (1.5184 => 1.4403, std.dev.: 0.0189)
MultiSource/Applications/lua/lua: -4.49% (31.0707 => 29.6765, std.dev.: 0.4359)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.48% (0.3479 => 0.3323, std.dev.: 0.0006)
SingleSource/Benchmarks/Misc/fbench: -4.35% (4.9602 => 4.7444, std.dev.: 0.0113)
SingleSource/UnitTests/Vectorizer/gcc-loops: -3.47% (21.6864 => 20.9349, std.dev.: 0.2746)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.42% (5.2218 => 5.0430, std.dev.: 0.0277)
MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.16% (2.7049 => 2.6193, std.dev.: 0.0277)
MultiSource/Benchmarks/Olden/bh/bh: -3.13% (2.4879 => 2.4100, std.dev.: 0.0012)
MultiSource/Benchmarks/PAQ8p/paq8p: -3.10% (93.6732 => 90.7651, std.dev.: 1.0361)
MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9618, std.dev.: 0.0298)
MultiSource/Applications/sgefa/sgefa: -2.63% (1.4030 => 1.3661, std.dev.: 0.0020)
SingleSource/Benchmarks/Misc/ReedSolomon: -2.45% (8.6172 => 8.4060, std.dev.: 0.0684)
SingleSource/Benchmarks/Misc/oourafft: -2.20% (3.7891 => 3.7058, std.dev.: 0.0017)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1427, std.dev.: 0.0842)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.82% (1.5030 => 1.4757, std.dev.: 0.0021)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.67% (1.2012 => 1.1811, std.dev.: 0.0013)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.59% (5.0180 => 4.9381, std.dev.: 0.0008)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.56% (5.8810 => 5.7893, std.dev.: 0.0251)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -2.69% (0.1378 => 0.1341, std.dev.: 0.0067)
Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130807/dd5b4d18/attachment.html>
More information about the llvm-testresults
mailing list