[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Mar 25 15:08:19 PDT 2013


http://llvm.org/perf/db_default/v4/nts/9813?compare_to=9808&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9813, Order: 177894, Start Time: 2013-03-25 20:17:11, End Time: 2013-03-25 22:09:09
      To: 9808, Order: 177876, Start Time: 2013-03-25 18:06:49, End Time: 2013-03-25 19:54:19
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (3 on baseline)
Performance Regressions: 65 (93 on baseline)
Performance Improvements: 0 (26 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 30 (29 on baseline)
Unchanged Tests: 1013 (950 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: 65.12% (0.0559 => 0.0923, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 57.01% (0.0335 => 0.0526, std.dev.: 0.0035)
  SingleSource/Benchmarks/Stanford/IntMM: 56.83% (0.0454 => 0.0712, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/hash: 56.49% (0.4427 => 0.6928, std.dev.: 0.0283)
  SingleSource/Benchmarks/Misc/ffbench: 55.11% (0.0773 => 0.1199, std.dev.: 0.0048)
  SingleSource/Benchmarks/Stanford/Oscar: 53.61% (0.0707 => 0.1086, std.dev.: 0.0032)
  SingleSource/Benchmarks/Stanford/Perm: 53.49% (0.0344 => 0.0528, std.dev.: 0.0026)
  SingleSource/Benchmarks/Stanford/RealMM: 51.39% (0.0469 => 0.0710, std.dev.: 0.0027)
  SingleSource/Benchmarks/Stanford/FloatMM: 50.94% (0.0479 => 0.0723, std.dev.: 0.0035)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 49.00% (0.0500 => 0.0745, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/fp-convert: 38.31% (0.0308 => 0.0426, std.dev.: 0.0037)
  SingleSource/Benchmarks/Stanford/Puzzle: 38.12% (0.1170 => 0.1616, std.dev.: 0.0156)
  SingleSource/Benchmarks/McGill/misr: 37.52% (0.0741 => 0.1019, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/fbench: 35.25% (0.0729 => 0.0986, std.dev.: 0.0086)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 34.80% (0.2986 => 0.4025, std.dev.: 0.0071)
  MultiSource/Applications/lua/lua: 29.03% (4.3033 => 5.5524, std.dev.: 0.1849)
  MultiSource/Applications/aha/aha: 27.34% (0.1269 => 0.1616, std.dev.: 0.0120)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 15.77% (1.1371 => 1.3164, std.dev.: 0.0372)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.12% (1.3356 => 1.5376, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 15.02% (1.0810 => 1.2434, std.dev.: 0.0195)
  MultiSource/Applications/ClamAV/clamscan: 13.01% (16.7564 => 18.9371, std.dev.: 0.4611)
  MultiSource/Applications/hbd/hbd: 11.85% (1.5926 => 1.7814, std.dev.: 0.0650)
  MultiSource/Applications/JM/lencod/lencod: 11.52% (17.4857 => 19.5000, std.dev.: 0.0511)
  MultiSource/Applications/d/make_dparser: 10.68% (3.7269 => 4.1248, std.dev.: 0.0481)
  MultiSource/Applications/oggenc/oggenc: 8.40% (5.5099 => 5.9725, std.dev.: 0.0101)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.45% (2.5429 => 2.7069, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 6.41% (1.3929 => 1.4822, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.28% (1.0572 => 1.1236, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.80% (0.2119 => 0.2242, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.74% (1.3105 => 1.3857, std.dev.: 0.0215)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.52% (4.1312 => 4.3593, std.dev.: 0.0563)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.12% (0.2596 => 0.2729, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.04% (1.1886 => 1.2485, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.78% (1.3626 => 1.4277, std.dev.: 0.0247)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.71% (26.6886 => 27.9447, std.dev.: 0.3378)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.48% (0.5154 => 0.5385, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.82% (0.3898 => 0.4047, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Quicksort: 77.50% (0.0240 => 0.0426, std.dev.: 0.0003)
  SingleSource/Benchmarks/Stanford/Towers: 73.33% (0.0225 => 0.0390, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 45.68% (3.2697 => 4.7633, std.dev.: 0.1549)
  SingleSource/Benchmarks/Stanford/Perm: 42.61% (0.0352 => 0.0502, std.dev.: 0.0011)
  SingleSource/Benchmarks/Stanford/Bubblesort: 40.76% (0.0314 => 0.0442, std.dev.: 0.0017)
  SingleSource/Benchmarks/Stanford/Puzzle: 32.44% (0.1526 => 0.2021, std.dev.: 0.0123)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.62% (2.3513 => 2.9771, std.dev.: 0.1552)
  MultiSource/Applications/minisat/minisat: 25.95% (6.4513 => 8.1252, std.dev.: 0.1203)
  SingleSource/Benchmarks/Shootout-C++/ary3: 23.80% (1.4121 => 1.7482, std.dev.: 0.0403)
  SingleSource/Benchmarks/Shootout/ary3: 17.58% (9.0496 => 10.6405, std.dev.: 0.3441)
  MultiSource/Applications/oggenc/oggenc: 15.90% (0.1767 => 0.2048, std.dev.: 0.0080)
  SingleSource/Benchmarks/McGill/misr: 15.43% (0.3908 => 0.4511, std.dev.: 0.0048)
  MultiSource/Applications/SPASS/SPASS: 14.85% (8.3614 => 9.6031, std.dev.: 0.0896)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.74% (9.3595 => 10.5520, std.dev.: 0.1976)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.69% (0.4326 => 0.4875, std.dev.: 0.0129)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.46% (44.2892 => 47.5932, std.dev.: 0.4383)
  SingleSource/Benchmarks/Misc/flops-7: 6.38% (1.9806 => 2.1069, std.dev.: 0.0078)
  MultiSource/Benchmarks/Bullet/bullet: 6.29% (7.1139 => 7.5617, std.dev.: 0.0492)
  SingleSource/Benchmarks/Shootout/hash: 3.90% (4.2252 => 4.3900, std.dev.: 0.0313)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.61% (22.0200 => 22.8151, std.dev.: 0.1702)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.22% (13.5228 => 13.9579, std.dev.: 0.1174)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.98% (3.7768 => 3.8892, std.dev.: 0.0267)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.56% (2.3009 => 2.3599, std.dev.: 0.0130)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.66% (1.0460 => 1.0634, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/salsa20: 1.27% (9.0705 => 9.1860, std.dev.: 0.0060)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.16% (52.3951 => 53.0016, std.dev.: 0.2283)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.15% (2.7294 => 2.7607, std.dev.: 0.0058)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.14% (13.1267 => 13.2767, std.dev.: 0.0016)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 5.33% (1.1278 => 1.1879, std.dev.: 0.0358)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/sumarray-dbl
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.77% (0.0261 => 0.0263, std.dev.: 0.0089)
  MultiSource/Applications/Burg/burg: 38.46% (0.0013 => 0.0018, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 3.09% (0.1522 => 0.1569, std.dev.: 0.0208)
  MultiSource/Applications/lemon/lemon: 13.40% (1.0856 => 1.2311, std.dev.: 0.4220)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 3.05% (0.1116 => 0.1150, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.32% (0.0634 => 0.0636, std.dev.: 0.0195)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 41.80% (0.0189 => 0.0268, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.71% (1.2904 => 1.2995, std.dev.: 0.1218)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -8.00% (0.0625 => 0.0575, std.dev.: 0.0065)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -13.15% (0.0289 => 0.0251, std.dev.: 0.0017)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: -66.67% (0.0003 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 67.16% (0.0067 => 0.0112, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.94% (29.3454 => 31.6768, std.dev.: 0.9314)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/sumarray-dbl: 14.29% (0.0007 => 0.0008, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 9.24% (24.7178 => 27.0009, std.dev.: 0.0377)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl
  SingleSource/UnitTests/Vector/sumarray-dbl: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000)

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 18.18% (0.4125 => 0.4875, std.dev.: 0.0129)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.29% (0.0663 => 0.0555, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -17.85% (1.6803 => 1.3803, std.dev.: 0.0075)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/RealMM: 66.67% (0.0426 => 0.0710, std.dev.: 0.0027)
  SingleSource/Benchmarks/Stanford/IntMM: 65.58% (0.0430 => 0.0712, std.dev.: 0.0054)
  SingleSource/Benchmarks/Stanford/Oscar: 63.80% (0.0663 => 0.1086, std.dev.: 0.0032)
  SingleSource/Benchmarks/Stanford/FloatMM: 63.57% (0.0442 => 0.0723, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/hash: 61.87% (0.4280 => 0.6928, std.dev.: 0.0283)
  SingleSource/Benchmarks/Misc/salsa20: 59.14% (0.0580 => 0.0923, std.dev.: 0.0030)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 58.91% (0.0331 => 0.0526, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/ffbench: 58.39% (0.0757 => 0.1199, std.dev.: 0.0048)
  SingleSource/Benchmarks/Stanford/Perm: 56.21% (0.0338 => 0.0528, std.dev.: 0.0026)
  SingleSource/Benchmarks/McGill/misr: 51.41% (0.0673 => 0.1019, std.dev.: 0.0048)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 48.11% (0.0503 => 0.0745, std.dev.: 0.0035)
  SingleSource/Benchmarks/Stanford/Puzzle: 43.26% (0.1128 => 0.1616, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc/fp-convert: 39.67% (0.0305 => 0.0426, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/fbench: 36.57% (0.0722 => 0.0986, std.dev.: 0.0086)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 35.52% (0.2970 => 0.4025, std.dev.: 0.0071)
  MultiSource/Applications/aha/aha: 32.79% (0.1217 => 0.1616, std.dev.: 0.0120)
  MultiSource/Applications/lua/lua: 32.72% (4.1835 => 5.5524, std.dev.: 0.1849)
  MultiSource/Benchmarks/Olden/tsp/tsp: 18.34% (0.1292 => 0.1529, std.dev.: 0.0089)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 17.27% (23.8286 => 27.9447, std.dev.: 0.3378)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 17.11% (1.0617 => 1.2434, std.dev.: 0.0195)
  MultiSource/Applications/ClamAV/clamscan: 17.02% (16.1821 => 18.9371, std.dev.: 0.4611)
  MultiSource/Applications/d/make_dparser: 16.67% (3.5353 => 4.1248, std.dev.: 0.0481)
  MultiSource/Applications/JM/lencod/lencod: 16.62% (16.7203 => 19.5000, std.dev.: 0.0511)
  MultiSource/Applications/hbd/hbd: 16.38% (1.5307 => 1.7814, std.dev.: 0.0650)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 16.29% (1.1320 => 1.3164, std.dev.: 0.0372)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 15.12% (1.3357 => 1.5376, std.dev.: 0.0078)
  MultiSource/Benchmarks/McCat/09-vor/vor: 13.13% (0.3358 => 0.3799, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.19% (1.3451 => 1.4822, std.dev.: 0.0346)
  MultiSource/Applications/oggenc/oggenc: 9.53% (5.4527 => 5.9725, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 7.85% (1.0418 => 1.1236, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.24% (1.3313 => 1.4277, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.18% (1.2929 => 1.3857, std.dev.: 0.0215)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.14% (4.0688 => 4.3593, std.dev.: 0.0563)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.84% (0.7182 => 0.7673, std.dev.: 0.0145)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.82% (14.7643 => 15.7715, std.dev.: 0.3114)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.78% (1.2537 => 1.3387, std.dev.: 0.0259)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.46% (1.1727 => 1.2485, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 6.35% (1.2704 => 1.3511, std.dev.: 0.0291)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.34% (0.5064 => 0.5385, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.05% (2.5524 => 2.7069, std.dev.: 0.0380)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.26% (0.2130 => 0.2242, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.22% (0.2107 => 0.2217, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.77% (0.3900 => 0.4047, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 86.60% (0.0209 => 0.0390, std.dev.: 0.0025)
  SingleSource/Benchmarks/Stanford/Quicksort: 71.08% (0.0249 => 0.0426, std.dev.: 0.0003)
  SingleSource/Benchmarks/Stanford/Bubblesort: 52.41% (0.0290 => 0.0442, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 46.64% (3.2482 => 4.7633, std.dev.: 0.1549)
  SingleSource/Benchmarks/Shootout-C++/ary2: 45.22% (0.0314 => 0.0456, std.dev.: 0.0051)
  SingleSource/Benchmarks/Stanford/Perm: 39.44% (0.0360 => 0.0502, std.dev.: 0.0011)
  MultiSource/Applications/minisat/minisat: 31.17% (6.1945 => 8.1252, std.dev.: 0.1203)
  SingleSource/Benchmarks/Shootout/ary3: 28.36% (8.2895 => 10.6405, std.dev.: 0.3441)
  SingleSource/Benchmarks/Misc/fp-convert: 27.49% (5.6800 => 7.2417, std.dev.: 0.0885)
  SingleSource/Benchmarks/Shootout/heapsort: 25.52% (3.1404 => 3.9418, std.dev.: 0.2935)
  SingleSource/Benchmarks/Stanford/Puzzle: 22.48% (0.1650 => 0.2021, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 16.64% (2.5458 => 2.9695, std.dev.: 0.0705)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.03% (2.5659 => 2.9771, std.dev.: 0.1552)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.91% (9.1037 => 10.5520, std.dev.: 0.1976)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.60% (4.7906 => 5.5377, std.dev.: 0.0724)
  SingleSource/Benchmarks/Shootout-C++/moments: 15.59% (0.1007 => 0.1164, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.93% (4.4289 => 5.0903, std.dev.: 0.0164)
  MultiSource/Applications/SPASS/SPASS: 13.33% (8.4733 => 9.6031, std.dev.: 0.0896)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 12.90% (3.3471 => 3.7790, std.dev.: 0.1166)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.79% (4.1182 => 4.6451, std.dev.: 0.0327)
  MultiSource/Applications/oggenc/oggenc: 12.16% (0.1826 => 0.2048, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc/pi: 10.96% (2.0512 => 2.2760, std.dev.: 0.0038)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.22% (12.6632 => 13.9579, std.dev.: 0.1174)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.71% (5.1006 => 5.5958, std.dev.: 0.0217)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.13% (43.6112 => 47.5932, std.dev.: 0.4383)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.11% (4.0968 => 4.4701, std.dev.: 0.0634)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.98% (4.8642 => 5.3011, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/flops-7: 8.61% (1.9399 => 2.1069, std.dev.: 0.0078)
  MultiSource/Applications/hexxagon/hexxagon: 7.11% (14.4795 => 15.5085, std.dev.: 0.0478)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.56% (4.7982 => 5.1128, std.dev.: 0.0568)
  MultiSource/Benchmarks/Bullet/bullet: 5.98% (7.1351 => 7.5617, std.dev.: 0.0492)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.61% (8.6184 => 9.1023, std.dev.: 0.0724)
  MultiSource/Applications/lambda-0_1_3/lambda: 5.15% (6.9897 => 7.3497, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/hash: 5.07% (4.1780 => 4.3900, std.dev.: 0.0313)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.64% (5.1346 => 5.3726, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.49% (6.0602 => 6.2714, std.dev.: 0.0693)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.35% (22.0762 => 22.8151, std.dev.: 0.1702)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.29% (9.6958 => 10.0152, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout/methcall: 2.89% (8.4644 => 8.7094, std.dev.: 0.0041)
  MultiSource/Benchmarks/sim/sim: 2.89% (3.8564 => 3.9679, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.78% (4.5865 => 4.7142, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.51% (1.0374 => 1.0634, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.18% (3.8064 => 3.8892, std.dev.: 0.0267)
  MultiSource/Benchmarks/FreeBench/neural/neural: 2.11% (1.0845 => 1.1074, std.dev.: 0.0004)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.74% (89.3093 => 90.8590, std.dev.: 0.0469)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.67% (3.3943 => 3.4509, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.38% (16.6302 => 16.8590, std.dev.: 0.0647)
  SingleSource/Benchmarks/Misc/perlin: 1.37% (4.5691 => 4.6315, std.dev.: 0.0143)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.17% (2.7289 => 2.7607, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout/fib2: 1.14% (4.9040 => 4.9599, std.dev.: 0.0011)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -45.06% (0.0810 => 0.0445, std.dev.: 0.0124)
  MultiSource/Benchmarks/FreeBench/neural/neural: -19.32% (0.2542 => 0.2051, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/mason/mason: -16.40% (0.0817 => 0.0683, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: -39.27% (0.5213 => 0.3166, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -32.80% (0.0756 => 0.0508, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -18.85% (6.4626 => 5.2446, std.dev.: 0.0989)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -17.05% (0.3279 => 0.2720, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/ary3: -13.02% (2.0100 => 1.7482, std.dev.: 0.0403)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -10.79% (5.6245 => 5.0176, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.00% (7.1548 => 6.4391, std.dev.: 0.2017)
  SingleSource/Benchmarks/Dhrystone/dry: -6.14% (0.5278 => 0.4954, std.dev.: 0.0111)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.82% (4.2970 => 4.0470, std.dev.: 0.0039)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.34% (3.9434 => 3.7330, std.dev.: 0.0012)
  SingleSource/Benchmarks/McGill/misr: -4.61% (0.4729 => 0.4511, std.dev.: 0.0048)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.09% (0.4111 => 0.3943, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.34% (3.0513 => 2.9495, std.dev.: 0.0116)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.26% (2.4484 => 2.3685, std.dev.: 0.0300)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.25% (4.8478 => 4.6901, std.dev.: 0.0052)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.12% (1.0088 => 0.9773, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/flops: -3.04% (9.3754 => 9.0907, std.dev.: 0.0157)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.56% (4.3713 => 4.2593, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.01% (5.0818 => 4.9798, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.72% (3.3618 => 3.3040, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.63% (9.0122 => 8.8652, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.53% (1.9660 => 1.9359, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.13% (8.7510 => 8.6525, std.dev.: 0.0221)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 5.24% (1.1288 => 1.1879, std.dev.: 0.0358)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.05% (0.0248 => 0.0263, std.dev.: 0.0089)
  MultiSource/Applications/Burg/burg: 38.46% (0.0013 => 0.0018, std.dev.: 0.0000)
  MultiSource/Applications/ClamAV/clamscan: 6.23% (0.1477 => 0.1569, std.dev.: 0.0208)
  MultiSource/Applications/lemon/lemon: 4.38% (1.1794 => 1.2311, std.dev.: 0.4220)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -12.15% (0.1309 => 0.1150, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.75% (0.0613 => 0.0636, std.dev.: 0.0195)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -2.90% (0.0276 => 0.0268, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.45% (1.1660 => 1.2995, std.dev.: 0.1218)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -41.38% (0.0029 => 0.0017, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.20% (0.0594 => 0.0575, std.dev.: 0.0065)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -30.47% (0.0361 => 0.0251, std.dev.: 0.0017)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 21.74% (0.0092 => 0.0112, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.32% (29.7937 => 31.6768, std.dev.: 0.9314)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.30% (26.9213 => 27.0009, std.dev.: 0.0377)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130325/64ddac35/attachment.html>


More information about the llvm-testresults mailing list