[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Mar 21 17:56:38 PDT 2013


http://llvm.org/perf/db_default/v4/nts/9657?compare_to=9653&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9657, Order: 177674, Start Time: 2013-03-21 23:04:41, End Time: 2013-03-22 00:57:23
      To: 9653, Order: 177659, Start Time: 2013-03-21 20:55:07, End Time: 2013-03-21 22:42:33
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (3 on baseline)
Performance Regressions: 57 (81 on baseline)
Performance Improvements: 0 (23 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (2 on baseline)
Existing Failures: 29 (29 on baseline)
Unchanged Tests: 1020 (966 on baseline)
Total Tests: 1106

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 58.04% (0.0989 => 0.1563, std.dev.: 0.0079)
  MultiSource/Benchmarks/McCat/08-main/main: 54.78% (0.2908 => 0.4501, std.dev.: 0.0320)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 47.96% (0.1007 => 0.1490, std.dev.: 0.0071)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 41.49% (0.1463 => 0.2070, std.dev.: 0.0177)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 41.48% (0.3814 => 0.5396, std.dev.: 0.0284)
  MultiSource/Benchmarks/McCat/09-vor/vor: 40.69% (0.3522 => 0.4955, std.dev.: 0.0432)
  MultiSource/Benchmarks/McCat/05-eks/eks: 32.35% (0.4900 => 0.6485, std.dev.: 0.0348)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.19% (0.2207 => 0.2763, std.dev.: 0.0048)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 24.93% (0.1765 => 0.2205, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 15.60% (1.4362 => 1.6603, std.dev.: 0.0271)
  MultiSource/Applications/spiff/spiff: 14.13% (0.9044 => 1.0322, std.dev.: 0.0268)
  MultiSource/Benchmarks/MallocBench/gs/gs: 13.45% (4.5388 => 5.1492, std.dev.: 0.1887)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 12.32% (4.9922 => 5.6074, std.dev.: 0.1530)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 11.30% (0.6725 => 0.7485, std.dev.: 0.0249)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 8.78% (0.2357 => 0.2564, std.dev.: 0.0027)
  MultiSource/Applications/kimwitu++/kc: 8.19% (19.0405 => 20.6004, std.dev.: 0.5703)
  MultiSource/Benchmarks/Bullet/bullet: 8.07% (34.6606 => 37.4584, std.dev.: 0.9040)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.72% (1.3988 => 1.5068, std.dev.: 0.0251)
  MultiSource/Applications/SIBsim4/SIBsim4: 7.49% (1.4358 => 1.5434, std.dev.: 0.0177)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.44% (26.5232 => 28.4953, std.dev.: 0.3984)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.06% (6.6237 => 7.0912, std.dev.: 0.0685)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.66% (0.2666 => 0.2817, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.06% (0.2094 => 0.2200, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 4.93% (0.2151 => 0.2257, std.dev.: 0.0025)
  MultiSource/Applications/minisat/minisat: 4.78% (0.7806 => 0.8179, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.01% (1.1598 => 1.1947, std.dev.: 0.0135)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.21% (10.7268 => 10.9643, std.dev.: 0.0632)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 65.19% (0.1132 => 0.1870, std.dev.: 0.0050)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 48.48% (0.8841 => 1.3127, std.dev.: 0.1263)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 43.37% (0.1365 => 0.1957, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout/ary3: 42.16% (6.8606 => 9.7527, std.dev.: 0.5971)
  MultiSource/Benchmarks/McCat/08-main/main: 38.75% (0.0702 => 0.0974, std.dev.: 0.0022)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 36.81% (0.0508 => 0.0695, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 31.73% (3.0961 => 4.0784, std.dev.: 0.3583)
  MultiSource/Applications/minisat/minisat: 29.65% (6.3145 => 8.1867, std.dev.: 0.0456)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 29.47% (0.0862 => 0.1116, std.dev.: 0.0072)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 28.82% (1.2678 => 1.6332, std.dev.: 0.0563)
  SingleSource/Benchmarks/Stanford/Perm: 28.06% (0.0360 => 0.0461, std.dev.: 0.0019)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 27.78% (1.5092 => 1.9285, std.dev.: 0.0894)
  SingleSource/Benchmarks/Shootout-C++/ary3: 23.98% (1.4352 => 1.7793, std.dev.: 0.1052)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.76% (1.2484 => 1.5325, std.dev.: 0.0386)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.41% (4.1164 => 4.8332, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/18-imp/imp: 14.17% (0.1482 => 0.1692, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout-C++/methcall: 7.24% (8.5410 => 9.1596, std.dev.: 0.0245)
  SingleSource/Benchmarks/Stanford/FloatMM: 6.61% (0.8165 => 0.8705, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/flops-7: 6.01% (1.9812 => 2.1003, std.dev.: 0.0302)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.50% (3.0725 => 3.2107, std.dev.: 0.0323)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.39% (0.5192 => 0.5420, std.dev.: 0.0034)
  MultiSource/Applications/lua/lua: 4.39% (28.0366 => 29.2674, std.dev.: 0.1204)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.12% (3.5987 => 3.6750, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc/ffbench: 1.97% (1.4249 => 1.4529, std.dev.: 0.0100)
  MultiSource/Applications/sqlite3/sqlite3: 1.74% (4.2914 => 4.3662, std.dev.: 0.0238)
  MultiSource/Applications/JM/lencod/lencod: 1.70% (6.9281 => 7.0459, std.dev.: 0.0427)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.46% (3.8730 => 3.9294, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.17% (1.8669 => 1.8888, std.dev.: 0.0085)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.16% (13.1371 => 13.2896, std.dev.: 0.0494)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.06% (4.0675 => 4.1105, std.dev.: 0.0130)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 48.85% (1.1332 => 1.6868, std.dev.: 0.0294)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.38% (0.0263 => 0.0264, std.dev.: 0.0063)
  MultiSource/Applications/Burg/burg: -35.71% (0.0014 => 0.0009, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 0.47% (0.1474 => 0.1481, std.dev.: 0.0202)
  MultiSource/Applications/lemon/lemon: -2.51% (1.2433 => 1.2121, std.dev.: 0.3762)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -0.92% (0.1084 => 0.1074, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 8.17% (0.0612 => 0.0662, std.dev.: 0.0140)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: - (0.0257 => 0.0257, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 2.36% (1.2978 => 1.3284, std.dev.: 0.0132)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 17.24% (0.0029 => 0.0034, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 0.64% (0.0623 => 0.0627, std.dev.: 0.0048)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.83% (0.0235 => 0.0291, std.dev.: 0.0058)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 72.73% (0.0066 => 0.0114, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.32% (29.4728 => 31.9248, std.dev.: 1.2647)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -80.00% (0.0005 => 0.0001, std.dev.: 0.0040)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0001 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.17% (27.0541 => 27.0996, std.dev.: 0.2447)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.98% (0.4125 => 0.4413, std.dev.: 0.0504)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -15.08% (0.0663 => 0.0563, std.dev.: 0.0048)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -17.36% (1.6803 => 1.3886, std.dev.: 0.0242)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 65.05% (0.0947 => 0.1563, std.dev.: 0.0079)
  MultiSource/Benchmarks/McCat/08-main/main: 58.15% (0.2846 => 0.4501, std.dev.: 0.0320)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 56.02% (0.0955 => 0.1490, std.dev.: 0.0071)
  MultiSource/Benchmarks/McCat/09-vor/vor: 47.56% (0.3358 => 0.4955, std.dev.: 0.0432)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 42.26% (0.3793 => 0.5396, std.dev.: 0.0284)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 38.46% (0.1495 => 0.2070, std.dev.: 0.0177)
  MultiSource/Benchmarks/McCat/05-eks/eks: 35.16% (0.4798 => 0.6485, std.dev.: 0.0348)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 27.60% (0.1728 => 0.2205, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 25.76% (0.2197 => 0.2763, std.dev.: 0.0048)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 19.58% (23.8286 => 28.4953, std.dev.: 0.3984)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 16.20% (1.2537 => 1.4568, std.dev.: 0.0608)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 16.04% (1.4308 => 1.6603, std.dev.: 0.0271)
  MultiSource/Benchmarks/MallocBench/gs/gs: 15.76% (4.4482 => 5.1492, std.dev.: 0.1887)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 14.93% (4.8791 => 5.6074, std.dev.: 0.1530)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.72% (0.6582 => 0.7485, std.dev.: 0.0249)
  MultiSource/Applications/spiff/spiff: 13.33% (0.9108 => 1.0322, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 13.18% (1.3313 => 1.5068, std.dev.: 0.0251)
  MultiSource/Applications/JM/lencod/lencod: 11.98% (16.7203 => 18.7227, std.dev.: 0.5732)
  MultiSource/Applications/kimwitu++/kc: 11.67% (18.4474 => 20.6004, std.dev.: 0.5703)
  MultiSource/Applications/SPASS/SPASS: 11.33% (16.3304 => 18.1809, std.dev.: 0.6837)
  MultiSource/Benchmarks/Bullet/bullet: 10.40% (33.9296 => 37.4584, std.dev.: 0.9040)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 10.39% (0.1520 => 0.1678, std.dev.: 0.0057)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 9.53% (0.2341 => 0.2564, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 9.45% (1.2835 => 1.4048, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.92% (1.3046 => 1.4210, std.dev.: 0.0324)
  MultiSource/Applications/SIBsim4/SIBsim4: 8.73% (1.4195 => 1.5434, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.43% (1.2270 => 1.3304, std.dev.: 0.0396)
  MultiSource/Applications/minisat/minisat: 8.27% (0.7554 => 0.8179, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.90% (1.2853 => 1.3868, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.54% (1.1428 => 1.1947, std.dev.: 0.0135)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.49% (0.2696 => 0.2817, std.dev.: 0.0006)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.31% (10.6134 => 10.9643, std.dev.: 0.0632)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 64.61% (0.1136 => 0.1870, std.dev.: 0.0050)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 47.58% (0.8895 => 1.3127, std.dev.: 0.1263)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 43.37% (0.1365 => 0.1957, std.dev.: 0.0132)
  MultiSource/Benchmarks/McCat/08-main/main: 40.55% (0.0693 => 0.0974, std.dev.: 0.0022)
  MultiSource/Applications/minisat/minisat: 32.16% (6.1945 => 8.1867, std.dev.: 0.0456)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.53% (0.0855 => 0.1116, std.dev.: 0.0072)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 28.23% (0.0542 => 0.0695, std.dev.: 0.0008)
  SingleSource/Benchmarks/Stanford/Perm: 28.06% (0.0360 => 0.0461, std.dev.: 0.0019)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 22.83% (1.5701 => 1.9285, std.dev.: 0.0894)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.77% (1.2483 => 1.5325, std.dev.: 0.0386)
  SingleSource/Benchmarks/Misc/fp-convert: 22.62% (5.6800 => 6.9651, std.dev.: 0.0344)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 18.68% (1.3761 => 1.6332, std.dev.: 0.0563)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.79% (4.7906 => 5.5470, std.dev.: 0.0109)
  MultiSource/Benchmarks/McCat/18-imp/imp: 15.49% (0.1465 => 0.1692, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.45% (4.4289 => 5.0687, std.dev.: 0.0526)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 13.08% (4.1182 => 4.6567, std.dev.: 0.2044)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.61% (4.8642 => 5.4287, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 11.37% (8.7510 => 9.7464, std.dev.: 0.0498)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.98% (5.1006 => 5.6608, std.dev.: 0.0271)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.99% (12.6632 => 13.9287, std.dev.: 0.2790)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.55% (57.5400 => 63.0331, std.dev.: 0.1645)
  SingleSource/Benchmarks/Misc/pi: 9.40% (2.0512 => 2.2441, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc/flops-7: 8.27% (1.9399 => 2.1003, std.dev.: 0.0302)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.16% (2.9511 => 3.1920, std.dev.: 0.0519)
  MultiSource/Applications/hexxagon/hexxagon: 7.50% (14.4795 => 15.5649, std.dev.: 0.1317)
  SingleSource/Benchmarks/Stanford/FloatMM: 7.18% (0.8122 => 0.8705, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.28% (8.6184 => 9.1596, std.dev.: 0.0245)
  SingleSource/Benchmarks/Shootout/lists: 6.15% (7.2055 => 7.6488, std.dev.: 0.0966)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.05% (4.5865 => 4.8642, std.dev.: 0.0294)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 6.01% (5.1346 => 5.4434, std.dev.: 0.0042)
  MultiSource/Applications/lambda-0_1_3/lambda: 5.40% (6.9897 => 7.3674, std.dev.: 0.0129)
  MultiSource/Applications/siod/siod: 5.31% (3.4143 => 3.5956, std.dev.: 0.0597)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.17% (5.7666 => 6.0650, std.dev.: 0.0137)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.82% (59.5643 => 62.4354, std.dev.: 1.0494)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 4.64% (4.0968 => 4.2867, std.dev.: 0.0023)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.59% (0.5182 => 0.5420, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/richards_benchmark: 4.47% (1.3414 => 1.4014, std.dev.: 0.0223)
  MultiSource/Applications/lua/lua: 3.89% (28.1709 => 29.2674, std.dev.: 0.1204)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.04% (3.0513 => 3.1442, std.dev.: 0.0189)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.70% (4.4250 => 4.5446, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.45% (5.0054 => 5.1278, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.13% (4.0247 => 4.1105, std.dev.: 0.0130)
  MultiSource/Applications/sqlite3/sqlite3: 2.07% (4.2776 => 4.3662, std.dev.: 0.0238)
  MultiSource/Benchmarks/FreeBench/neural/neural: 2.02% (1.0845 => 1.1064, std.dev.: 0.0035)
  MultiSource/Applications/sgefa/sgefa: 2.00% (1.2184 => 1.2428, std.dev.: 0.0011)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.86% (89.3093 => 90.9672, std.dev.: 0.1304)
  SingleSource/Benchmarks/Misc/perlin: 1.29% (4.5691 => 4.6281, std.dev.: 0.0118)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.18% (1.0374 => 1.0496, std.dev.: 0.0024)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.03% (23.4908 => 23.7324, std.dev.: 0.0477)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -49.26% (0.0810 => 0.0411, std.dev.: 0.0058)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: -37.31% (0.5213 => 0.3268, std.dev.: 0.0196)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.18% (0.3279 => 0.2683, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -17.75% (6.4626 => 5.3152, std.dev.: 0.1976)
  SingleSource/Benchmarks/McGill/misr: -17.68% (0.4729 => 0.3893, std.dev.: 0.0298)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -14.58% (9.6958 => 8.2822, std.dev.: 0.0329)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -11.25% (5.6245 => 4.9919, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.03% (7.1548 => 6.4374, std.dev.: 0.0661)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.13% (3.4205 => 3.2107, std.dev.: 0.0323)
  SingleSource/Benchmarks/Dhrystone/dry: -5.99% (0.5278 => 0.4962, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.48% (9.0122 => 8.5183, std.dev.: 0.0498)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.14% (3.9434 => 3.7408, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.95% (2.5458 => 2.4198, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.05% (6.0602 => 5.8145, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.74% (5.8948 => 5.6744, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.48% (5.0816 => 4.9049, std.dev.: 0.0234)
  SingleSource/Benchmarks/Misc/flops: -3.09% (9.3754 => 9.0855, std.dev.: 0.0539)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.00% (3.8286 => 3.7137, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.82% (4.3713 => 4.2479, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.18% (3.7569 => 3.6750, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.15% (6.0446 => 5.9146, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.88% (3.3618 => 3.2986, std.dev.: 0.0068)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.56% (0.6582 => 0.6479, std.dev.: 0.0007)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 49.43% (1.1288 => 1.6868, std.dev.: 0.0294)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.45% (0.0248 => 0.0264, std.dev.: 0.0063)
  MultiSource/Applications/Burg/burg: -30.77% (0.0013 => 0.0009, std.dev.: 0.0003)
  MultiSource/Applications/ClamAV/clamscan: 0.27% (0.1477 => 0.1481, std.dev.: 0.0202)
  MultiSource/Applications/lemon/lemon: 2.77% (1.1794 => 1.2121, std.dev.: 0.3762)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -17.95% (0.1309 => 0.1074, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 7.99% (0.0613 => 0.0662, std.dev.: 0.0140)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.88% (0.0276 => 0.0257, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.93% (1.1660 => 1.3284, std.dev.: 0.0132)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 17.24% (0.0029 => 0.0034, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.56% (0.0594 => 0.0627, std.dev.: 0.0048)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.39% (0.0361 => 0.0291, std.dev.: 0.0058)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 23.91% (0.0092 => 0.0114, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.15% (29.7937 => 31.9248, std.dev.: 1.2647)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0040)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 0.66% (26.9213 => 27.0996, std.dev.: 0.2447)

Report Time: 1.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130321/f8470682/attachment.html>


More information about the llvm-testresults mailing list