[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jul 19 14:52:09 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13602?compare_to=13599&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13602, Order: 186711, Start Time: 2013-07-19 19:59:41, End Time: 2013-07-19 21:53:38
      To: 13599, Order: 186694, Start Time: 2013-07-19 17:38:29, End Time: 2013-07-19 19:36:35
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 24 (199 on baseline)
Performance Improvements: 29 (40 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (868 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 42.74% (0.1528 => 0.2181, std.dev.: 0.0134)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 32.88% (0.0660 => 0.0877, std.dev.: 0.0074)
  MultiSource/Benchmarks/Olden/em3d/em3d: 32.04% (0.2503 => 0.3305, std.dev.: 0.0109)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 26.48% (1.8808 => 2.3788, std.dev.: 0.0335)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 26.18% (0.1971 => 0.2487, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 21.16% (6.3870 => 7.7383, std.dev.: 0.1907)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 12.73% (2.0655 => 2.3284, std.dev.: 0.0324)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 12.64% (0.8285 => 0.9332, std.dev.: 0.0133)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.16% (1.6087 => 1.7722, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.34% (1.6779 => 1.7843, std.dev.: 0.0144)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 5.70% (6.4583 => 6.8264, std.dev.: 0.1168)
  SingleSource/Benchmarks/Shootout-C++/objinst: 3.57% (0.3394 => 0.3515, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.19% (1.5910 => 1.6259, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.17% (1.8407 => 1.8806, std.dev.: 0.0119)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.88% (1.3598 => 1.3853, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 89.67% (0.0213 => 0.0404, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 39.53% (0.0511 => 0.0713, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 24.00% (0.1229 => 0.1524, std.dev.: 0.0093)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 23.14% (2.4366 => 3.0005, std.dev.: 0.0492)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 6.44% (1.7734 => 1.8876, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/lowercase: 5.15% (0.7805 => 0.8207, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/random: 3.64% (2.3902 => 2.4773, std.dev.: 0.0010)
  MultiSource/Applications/sqlite3/sqlite3: 2.14% (4.3048 => 4.3968, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.18% (3.2875 => 3.3263, std.dev.: 0.0121)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2008-04-18-LoopBug: -39.29% (0.0280 => 0.0170, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/heapsort: -37.78% (0.1011 => 0.0629, std.dev.: 0.0078)
  SingleSource/Regression/C++/2003-05-14-array-init: -36.42% (0.0324 => 0.0206, std.dev.: 0.0007)
  SingleSource/Regression/C/2003-05-22-VarSizeArray: -36.16% (0.0318 => 0.0203, std.dev.: 0.0017)
  SingleSource/UnitTests/TestLoop: -35.58% (0.0371 => 0.0239, std.dev.: 0.0048)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -35.02% (0.0594 => 0.0386, std.dev.: 0.0015)
  SingleSource/UnitTests/2003-05-26-Shorts: -34.93% (0.0458 => 0.0298, std.dev.: 0.0058)
  SingleSource/Regression/C/globalrefs: -34.21% (0.0418 => 0.0275, std.dev.: 0.0022)
  SingleSource/Regression/C/2003-05-21-UnionTest: -34.18% (0.0316 => 0.0208, std.dev.: 0.0025)
  SingleSource/UnitTests/2003-08-20-FoldBug: -34.06% (0.0320 => 0.0211, std.dev.: 0.0040)
  SingleSource/Regression/C++/fixups: -32.73% (0.0498 => 0.0335, std.dev.: 0.0030)
  SingleSource/Regression/C++/ofstream_ctor: -20.78% (0.4451 => 0.3526, std.dev.: 0.0313)
  SingleSource/UnitTests/initp1: -20.03% (0.0729 => 0.0583, std.dev.: 0.0030)
  SingleSource/Regression/C/sumarraymalloc: -15.93% (0.0634 => 0.0533, std.dev.: 0.0012)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -14.37% (0.1615 => 0.1383, std.dev.: 0.0087)
  MultiSource/Applications/d/make_dparser: -13.24% (5.4056 => 4.6899, std.dev.: 0.2598)
  MultiSource/Applications/aha/aha: -7.58% (0.1635 => 0.1511, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -7.13% (0.1683 => 0.1563, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/random: -6.41% (0.3793 => 0.3550, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc-C++/bigfib: -4.30% (0.9177 => 0.8782, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.66% (0.6577 => 0.6468, std.dev.: 0.0022)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -30.83% (0.1330 => 0.0920, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -20.48% (0.6254 => 0.4973, std.dev.: 0.0066)
  MultiSource/Benchmarks/FreeBench/mason/mason: -8.26% (0.3099 => 0.2843, std.dev.: 0.0057)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -4.52% (0.4641 => 0.4431, std.dev.: 0.0077)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.12% (2.4872 => 2.4095, std.dev.: 0.0238)
  SingleSource/Benchmarks/Shootout-C++/lists1: -1.77% (0.6254 => 0.6143, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: -1.27% (3.0472 => 3.0086, std.dev.: 0.0033)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.05% (1.5155 => 1.4996, std.dev.: 0.0060)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.30% (0.1331 => 0.1335, std.dev.: 0.0018)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: 142.20% (0.1282 => 0.3105, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 137.37% (0.1322 => 0.3138, std.dev.: 0.0452)
  SingleSource/UnitTests/Vector/Altivec/test1: 129.09% (0.1382 => 0.3166, std.dev.: 0.0292)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 126.47% (0.1432 => 0.3243, std.dev.: 0.0184)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 113.00% (0.2416 => 0.5146, std.dev.: 0.0752)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 101.22% (0.1972 => 0.3968, std.dev.: 0.0489)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 87.96% (0.2250 => 0.4229, std.dev.: 0.0050)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 84.30% (0.2006 => 0.3697, std.dev.: 0.0182)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 80.69% (0.2232 => 0.4033, std.dev.: 0.0222)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 77.98% (0.2734 => 0.4866, std.dev.: 0.0386)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 75.60% (0.1242 => 0.2181, std.dev.: 0.0134)
  SingleSource/Benchmarks/Shootout-C++/random: 67.77% (0.2116 => 0.3550, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/mandel: 65.70% (0.0481 => 0.0797, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 64.23% (0.2231 => 0.3664, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 63.53% (0.1075 => 0.1758, std.dev.: 0.0176)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 60.44% (0.2768 => 0.4441, std.dev.: 0.0386)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 59.34% (0.2238 => 0.3566, std.dev.: 0.0083)
  SingleSource/Benchmarks/Shootout-C++/hello: 58.69% (0.1934 => 0.3069, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 57.90% (0.1886 => 0.2978, std.dev.: 0.0065)
  MultiSource/Benchmarks/Olden/em3d/em3d: 56.12% (0.2117 => 0.3305, std.dev.: 0.0109)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 55.63% (1.4253 => 2.2182, std.dev.: 0.1484)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 54.62% (0.2206 => 0.3411, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 54.02% (1.5862 => 2.4430, std.dev.: 0.1332)
  SingleSource/Benchmarks/Shootout-C++/methcall: 53.03% (0.2195 => 0.3359, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 51.42% (0.3425 => 0.5186, std.dev.: 0.0160)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 51.21% (0.0580 => 0.0877, std.dev.: 0.0074)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 51.09% (0.1646 => 0.2487, std.dev.: 0.0127)
  MultiSource/Applications/oggenc/oggenc: 50.43% (5.9886 => 9.0089, std.dev.: 0.1329)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 50.34% (0.2175 => 0.3270, std.dev.: 0.0056)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 50.33% (0.2295 => 0.3450, std.dev.: 0.0171)
  SingleSource/Benchmarks/Misc/flops-2: 50.32% (0.0316 => 0.0475, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 49.98% (0.2393 => 0.3589, std.dev.: 0.0125)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 49.61% (0.0258 => 0.0386, std.dev.: 0.0015)
  SingleSource/Regression/C++/ofstream_ctor: 49.41% (0.2360 => 0.3526, std.dev.: 0.0313)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 49.31% (1.5932 => 2.3788, std.dev.: 0.0335)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 48.95% (0.2151 => 0.3204, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout-C++/ary: 48.85% (0.2747 => 0.4089, std.dev.: 0.0008)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 48.20% (4.9917 => 7.3977, std.dev.: 0.4291)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 48.19% (0.3113 => 0.4613, std.dev.: 0.0138)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.11% (0.2513 => 0.3722, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout-C++/moments: 47.75% (0.4006 => 0.5919, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout-C++/objinst: 46.64% (0.2397 => 0.3515, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout/random: 46.57% (0.0335 => 0.0491, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/dt: 45.99% (0.0374 => 0.0546, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/flops-8: 45.85% (0.0325 => 0.0474, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 45.70% (1.5981 => 2.3284, std.dev.: 0.0324)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 45.61% (0.0717 => 0.1044, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/strcat: 44.56% (0.2309 => 0.3338, std.dev.: 0.0136)
  SingleSource/Benchmarks/Shootout-C++/lists1: 44.53% (0.3290 => 0.4755, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 44.44% (0.0738 => 0.1066, std.dev.: 0.0097)
  SingleSource/Benchmarks/Misc/flops-5: 43.90% (0.0328 => 0.0472, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 43.82% (0.0696 => 0.1001, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc/flops-4: 43.21% (0.0324 => 0.0464, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 43.11% (0.0726 => 0.1039, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/flops-6: 42.99% (0.0328 => 0.0469, std.dev.: 0.0020)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 42.94% (7.7211 => 11.0368, std.dev.: 0.5056)
  SingleSource/Benchmarks/Shootout-C++/ary2: 42.90% (0.2951 => 0.4217, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/lists: 42.90% (0.2837 => 0.4054, std.dev.: 0.0080)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 42.53% (0.2937 => 0.4186, std.dev.: 0.0279)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 42.47% (5.4314 => 7.7383, std.dev.: 0.1907)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 42.45% (0.0768 => 0.1094, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 42.39% (0.0802 => 0.1142, std.dev.: 0.0060)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 41.57% (0.0522 => 0.0739, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 41.51% (0.0766 => 0.1084, std.dev.: 0.0005)
  MultiSource/Applications/hexxagon/hexxagon: 40.66% (1.0794 => 1.5183, std.dev.: 0.0503)
  SingleSource/Benchmarks/Shootout/strcat: 40.66% (0.0305 => 0.0429, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 39.57% (0.3429 => 0.4786, std.dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 39.37% (0.3061 => 0.4266, std.dev.: 0.0050)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 39.31% (5.6424 => 7.8606, std.dev.: 0.6124)
  MultiSource/Benchmarks/Bullet/bullet: 39.24% (35.5296 => 49.4729, std.dev.: 2.3606)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 38.86% (0.0350 => 0.0486, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 38.28% (0.3848 => 0.5321, std.dev.: 0.0134)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 38.13% (0.0847 => 0.1170, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 37.23% (0.2415 => 0.3314, std.dev.: 0.0346)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 37.05% (0.0888 => 0.1217, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 36.49% (0.0740 => 0.1010, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout-C++/hash2: 36.46% (0.4740 => 0.6468, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 36.22% (0.4293 => 0.5848, std.dev.: 0.0123)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 36.21% (0.0950 => 0.1294, std.dev.: 0.0095)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 34.83% (0.1424 => 0.1920, std.dev.: 0.0100)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 34.66% (0.0779 => 0.1049, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/hash: 34.39% (0.4554 => 0.6120, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 33.26% (0.1422 => 0.1895, std.dev.: 0.0120)
  SingleSource/Benchmarks/Stanford/Bubblesort: 32.65% (0.0389 => 0.0516, std.dev.: 0.0003)
  MultiSource/Applications/hbd/hbd: 32.42% (1.6386 => 2.1698, std.dev.: 0.1392)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 32.33% (5.1587 => 6.8264, std.dev.: 0.1168)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 31.73% (0.0602 => 0.0793, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/flops: 31.46% (0.1106 => 0.1454, std.dev.: 0.0119)
  MultiSource/Benchmarks/FreeBench/distray/distray: 31.24% (0.1037 => 0.1361, std.dev.: 0.0089)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 30.73% (2.0439 => 2.6720, std.dev.: 0.0986)
  MultiSource/Applications/SPASS/SPASS: 30.42% (17.6379 => 23.0042, std.dev.: 1.2100)
  SingleSource/Benchmarks/Shootout/hash: 29.98% (0.0617 => 0.0802, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/flops-3: 29.71% (0.0350 => 0.0454, std.dev.: 0.0003)
  SingleSource/Benchmarks/Stanford/FloatMM: 29.71% (0.0451 => 0.0585, std.dev.: 0.0025)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 29.70% (0.0559 => 0.0725, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/mandel-2: 29.58% (0.0355 => 0.0460, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 29.49% (1.3686 => 1.7722, std.dev.: 0.0296)
  MultiSource/Benchmarks/llubenchmark/llu: 28.89% (0.0540 => 0.0696, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/ffbench: 28.81% (0.0788 => 0.1015, std.dev.: 0.0076)
  SingleSource/Benchmarks/Stanford/RealMM: 27.73% (0.0458 => 0.0585, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 27.24% (0.7334 => 0.9332, std.dev.: 0.0133)
  SingleSource/Benchmarks/Stanford/IntMM: 26.59% (0.0455 => 0.0576, std.dev.: 0.0014)
  SingleSource/Benchmarks/McGill/queens: 26.18% (0.0550 => 0.0694, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/perlin: 26.05% (0.0622 => 0.0784, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 25.95% (0.1241 => 0.1563, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/fbench: 25.84% (0.0778 => 0.0979, std.dev.: 0.0014)
  MultiSource/Applications/d/make_dparser: 25.63% (3.7330 => 4.6899, std.dev.: 0.2598)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 24.71% (0.0425 => 0.0530, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 24.60% (0.4861 => 0.6057, std.dev.: 0.0342)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.48% (1.5108 => 1.8806, std.dev.: 0.0119)
  SingleSource/Benchmarks/Misc-C++/bigfib: 24.41% (0.7059 => 0.8782, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 24.28% (0.2158 => 0.2682, std.dev.: 0.0011)
  SingleSource/Benchmarks/Stanford/Queens: 23.75% (0.0459 => 0.0568, std.dev.: 0.0020)
  SingleSource/Regression/C/sumarraymalloc: 23.67% (0.0431 => 0.0533, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 23.31% (0.9599 => 1.1837, std.dev.: 0.0641)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.18% (1.4485 => 1.7843, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.93% (1.4991 => 1.8428, std.dev.: 0.0618)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 22.17% (0.1132 => 0.1383, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 21.76% (0.3617 => 0.4404, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 21.41% (1.4771 => 1.7934, std.dev.: 0.0165)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 20.90% (51.0211 => 61.6856, std.dev.: 3.6680)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.47% (1.5372 => 1.8518, std.dev.: 0.0423)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 20.42% (15.9860 => 19.2511, std.dev.: 0.7186)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 20.24% (1.4238 => 1.7120, std.dev.: 0.0239)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 19.73% (1.4202 => 1.7004, std.dev.: 0.0775)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 19.21% (0.5196 => 0.6194, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.13% (1.3667 => 1.6282, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc/richards_benchmark: 18.95% (0.0802 => 0.0954, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 18.94% (0.0549 => 0.0653, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 18.90% (1.3833 => 1.6447, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 18.84% (1.4081 => 1.6734, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 18.61% (1.4131 => 1.6761, std.dev.: 0.0424)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 18.50% (1.4757 => 1.7487, std.dev.: 0.0362)
  SingleSource/Benchmarks/Stanford/Oscar: 18.36% (0.0719 => 0.0851, std.dev.: 0.0022)
  MultiSource/Applications/kimwitu++/kc: 18.13% (20.1855 => 23.8448, std.dev.: 0.3080)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 17.94% (1.3838 => 1.6321, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 17.64% (1.5478 => 1.8208, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 17.61% (1.4165 => 1.6659, std.dev.: 0.0406)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 16.94% (1.3832 => 1.6175, std.dev.: 0.0276)
  MultiSource/Benchmarks/FreeBench/mason/mason: 16.90% (0.0710 => 0.0830, std.dev.: 0.0010)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 15.89% (1.1954 => 1.3853, std.dev.: 0.0040)
  MultiSource/Benchmarks/sim/sim: 15.74% (0.3716 => 0.4301, std.dev.: 0.0016)
  MultiSource/Applications/minisat/minisat: 15.66% (0.7844 => 0.9072, std.dev.: 0.0238)
  SingleSource/Benchmarks/Misc/oourafft: 15.45% (0.2239 => 0.2585, std.dev.: 0.0063)
  MultiSource/Applications/ClamAV/clamscan: 15.16% (17.3229 => 19.9496, std.dev.: 0.8238)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 14.80% (0.1034 => 0.1187, std.dev.: 0.0017)
  MultiSource/Benchmarks/mafft/pairlocalalign: 14.78% (10.7257 => 12.3114, std.dev.: 0.5832)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 14.71% (1.2006 => 1.3772, std.dev.: 0.0074)
  MultiSource/Applications/siod/siod: 14.44% (2.4944 => 2.8547, std.dev.: 0.1015)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 14.22% (0.7791 => 0.8899, std.dev.: 0.0378)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 14.15% (0.1527 => 0.1743, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout/matrix: 13.70% (0.0825 => 0.0938, std.dev.: 0.0032)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.78% (0.1265 => 0.1414, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.91% (6.6236 => 7.3461, std.dev.: 0.1653)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 10.11% (25.9348 => 28.5565, std.dev.: 0.7460)
  MultiSource/Applications/sqlite3/sqlite3: 9.78% (16.9719 => 18.6310, std.dev.: 0.5152)
  SingleSource/Benchmarks/McGill/chomp: 8.90% (0.1876 => 0.2043, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.24% (2.6076 => 2.8225, std.dev.: 0.0663)
  MultiSource/Applications/aha/aha: 7.39% (0.1407 => 0.1511, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 5.13% (1.5735 => 1.6542, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.87% (1.5806 => 1.6259, std.dev.: 0.0133)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 114.89% (0.0188 => 0.0404, std.dev.: 0.0029)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 92.22% (0.1208 => 0.2322, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 63.66% (0.1750 => 0.2864, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 53.33% (0.0465 => 0.0713, std.dev.: 0.0044)
  MultiSource/Applications/viterbi/viterbi: 35.64% (2.5688 => 3.4844, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 30.48% (9.8728 => 12.8817, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 30.03% (0.1172 => 0.1524, std.dev.: 0.0093)
  SingleSource/Benchmarks/Misc/perlin: 26.79% (3.6271 => 4.5989, std.dev.: 0.0040)
  MultiSource/Applications/sgefa/sgefa: 20.21% (1.1695 => 1.4059, std.dev.: 0.0040)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.29% (2.5366 => 3.0005, std.dev.: 0.0492)
  SingleSource/Benchmarks/Misc/mandel: 17.24% (1.0293 => 1.2068, std.dev.: 0.0013)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.91% (0.1455 => 0.1701, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 14.28% (5.2788 => 6.0327, std.dev.: 0.0020)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.90% (0.9806 => 1.0973, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 11.60% (4.6639 => 5.2048, std.dev.: 0.0454)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.59% (4.5094 => 4.9869, std.dev.: 0.0234)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.52% (2.9004 => 3.2055, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 8.87% (4.6379 => 5.0491, std.dev.: 0.0029)
  MultiSource/Applications/lua/lua: 8.69% (28.2496 => 30.7044, std.dev.: 0.3461)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 7.70% (1.0605 => 1.1422, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.00% (3.1853 => 3.4084, std.dev.: 0.0388)
  SingleSource/Benchmarks/Misc/lowercase: 5.95% (0.7746 => 0.8207, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.92% (5.6582 => 5.9368, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.50% (3.6291 => 3.7923, std.dev.: 0.0264)
  SingleSource/Benchmarks/Misc/fbench: 4.46% (4.7508 => 4.9629, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.45% (1.0571 => 1.1041, std.dev.: 0.0075)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 3.77% (2.8994 => 3.0086, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 3.71% (0.4795 => 0.4973, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.30% (3.2201 => 3.3263, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.12% (5.9362 => 6.1216, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.93% (2.9023 => 2.9873, std.dev.: 0.0163)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (39.9248 => 41.0880, std.dev.: 0.2323)
  SingleSource/Benchmarks/Shootout/methcall: 2.19% (8.3425 => 8.5250, std.dev.: 0.0218)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.04% (4.3727 => 4.4618, std.dev.: 0.0023)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.70% (34.3107 => 34.8949, std.dev.: 0.0487)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.57% (16.5355 => 16.7945, std.dev.: 0.0504)
  SingleSource/Benchmarks/Misc/oourafft: 1.56% (3.7315 => 3.7897, std.dev.: 0.0101)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.14% (12.1841 => 12.3226, std.dev.: 0.0214)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -26.50% (0.1113 => 0.0818, std.dev.: 0.0098)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.27% (1.2911 => 0.7324, std.dev.: 0.0117)
  SingleSource/Benchmarks/Shootout-C++/matrix: -32.52% (4.3226 => 2.9170, std.dev.: 0.4660)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -30.14% (4.4050 => 3.0773, std.dev.: 0.0408)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -23.89% (1.6105 => 1.2258, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -23.36% (4.8986 => 3.7545, std.dev.: 0.0382)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.68% (9.1099 => 7.0434, std.dev.: 0.0774)
  SingleSource/Benchmarks/Shootout/hash: -22.05% (5.3656 => 4.1827, std.dev.: 0.3691)
  SingleSource/Benchmarks/Shootout-C++/hash: -20.65% (0.7941 => 0.6301, std.dev.: 0.0165)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.70% (11.6227 => 9.6821, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -16.59% (5.5763 => 4.6511, std.dev.: 0.1751)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.58% (25.3677 => 21.6697, std.dev.: 0.0756)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -14.21% (6.2328 => 5.3473, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -14.03% (5.7264 => 4.9232, std.dev.: 0.0470)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.79% (1.6679 => 1.4379, std.dev.: 0.0340)
  SingleSource/Benchmarks/Misc/salsa20: -13.18% (10.3398 => 8.9766, std.dev.: 0.0248)
  SingleSource/Benchmarks/Misc/flops: -13.17% (10.2170 => 8.8718, std.dev.: 0.4246)
  MultiSource/Benchmarks/Olden/tsp/tsp: -11.67% (1.6613 => 1.4674, std.dev.: 0.0300)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.30% (16.4665 => 14.7702, std.dev.: 0.5301)
  MultiSource/Applications/siod/siod: -8.23% (3.7240 => 3.4177, std.dev.: 0.0401)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.08% (6.3757 => 5.8607, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -7.96% (5.3184 => 4.8950, std.dev.: 0.0561)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -7.84% (2.4808 => 2.2863, std.dev.: 0.0680)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.68% (4.5717 => 4.2661, std.dev.: 0.0104)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.39% (3.5939 => 3.3644, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.17% (5.5889 => 5.2999, std.dev.: 0.0473)
  MultiSource/Applications/sqlite3/sqlite3: -5.16% (4.6358 => 4.3968, std.dev.: 0.0252)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -4.98% (1.6535 => 1.5711, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -4.48% (1.3084 => 1.2498, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.21% (2.8537 => 2.7337, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.07% (4.5935 => 4.4067, std.dev.: 0.0419)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.95% (2.5087 => 2.4095, std.dev.: 0.0238)
  MultiSource/Applications/spiff/spiff: -3.93% (2.8536 => 2.7414, std.dev.: 0.0276)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.74% (1.6440 => 1.5825, std.dev.: 0.0114)
  SingleSource/Benchmarks/Misc/whetstone: -3.65% (3.5970 => 3.4656, std.dev.: 0.0307)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -2.92% (0.4445 => 0.4315, std.dev.: 0.0037)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.59% (3.8665 => 3.7662, std.dev.: 0.0135)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.16% (48.3307 => 47.2879, std.dev.: 0.2719)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.81% (1.1791 => 1.1577, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout/lists: -1.13% (7.2961 => 7.2134, std.dev.: 0.0299)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -7.36% (0.1441 => 0.1335, std.dev.: 0.0018)

Report Time: 1.99s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130719/b895b5f3/attachment.html>


More information about the llvm-testresults mailing list