[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Apr 8 12:44:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10363?compare_to=10359&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10363, Order: 179029, Start Time: 2013-04-08 17:57:15, End Time: 2013-04-08 19:45:52
      To: 10359, Order: 179023, Start Time: 2013-04-08 15:51:42, End Time: 2013-04-08 17:36:43
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (12 on baseline)
Performance Regressions: 55 (105 on baseline)
Performance Improvements: 3 (52 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 20 (20 on baseline)
Unchanged Tests: 1030 (913 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 64.84% (0.0256 => 0.0422, std.dev.: 0.0017)
  SingleSource/UnitTests/Vector/constpool: 20.71% (8.4655 => 10.2183, std.dev.: 0.4100)
  MultiSource/Applications/spiff/spiff: 16.60% (0.9061 => 1.0565, std.dev.: 0.0434)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 9.92% (5.4718 => 6.0147, std.dev.: 0.1492)
  MultiSource/Applications/SIBsim4/SIBsim4: 9.64% (1.4579 => 1.5985, std.dev.: 0.0235)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 9.28% (1.8424 => 2.0134, std.dev.: 0.0487)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.19% (4.0296 => 4.3597, std.dev.: 0.0501)
  MultiSource/Applications/siod/siod: 8.09% (2.4549 => 2.6536, std.dev.: 0.0102)
  MultiSource/Applications/kimwitu++/kc: 8.07% (18.8953 => 20.4194, std.dev.: 0.3823)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.65% (1.6277 => 1.7523, std.dev.: 0.0273)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 6.95% (0.1454 => 0.1555, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.88% (15.0988 => 16.1380, std.dev.: 0.2619)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 6.44% (1.6081 => 1.7116, std.dev.: 0.0062)
  MultiSource/Applications/sqlite3/sqlite3: 6.34% (16.8005 => 17.8658, std.dev.: 0.2604)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.66% (45.2684 => 47.8317, std.dev.: 0.7451)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.50% (1.5419 => 1.6267, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.44% (0.6927 => 0.7304, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.15% (0.9469 => 0.9957, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 5.15% (1.4429 => 1.5172, std.dev.: 0.0218)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.74% (0.7695 => 0.8060, std.dev.: 0.0067)
  MultiSource/Applications/JM/ldecod/ldecod: 4.74% (7.5759 => 7.9347, std.dev.: 0.0630)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.64% (1.6683 => 1.7457, std.dev.: 0.0081)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 4.53% (0.5074 => 0.5304, std.dev.: 0.0047)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.49% (2.6130 => 2.7303, std.dev.: 0.0399)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.29% (1.3440 => 1.4016, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.10% (1.6208 => 1.6872, std.dev.: 0.0164)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 3.44% (0.3930 => 0.4065, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.34% (0.6200 => 0.6407, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 2.83% (1.4552 => 1.4964, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.67% (1.3694 => 1.4059, std.dev.: 0.0099)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 62.05% (5.7307 => 9.2866, std.dev.: 0.2317)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 45.06% (0.7492 => 1.0868, std.dev.: 0.1132)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 43.11% (3.0959 => 4.4304, std.dev.: 0.1852)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.76% (4.5837 => 5.9020, std.dev.: 0.0651)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.05% (1.4801 => 1.8805, std.dev.: 0.0269)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.86% (14.7875 => 17.8723, std.dev.: 0.2301)
  SingleSource/Benchmarks/Shootout-C++/fibo: 15.76% (4.1230 => 4.7729, std.dev.: 0.0431)
  MultiSource/Applications/siod/siod: 10.76% (3.2983 => 3.6532, std.dev.: 0.0079)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.68% (0.3274 => 0.3591, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.87% (43.2176 => 47.0528, std.dev.: 0.8382)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 8.47% (0.4299 => 0.4663, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.65% (4.9971 => 5.3794, std.dev.: 0.0100)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.44% (3.1594 => 3.3945, std.dev.: 0.0651)
  SingleSource/Benchmarks/Misc/flops: 7.34% (8.6795 => 9.3169, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 7.05% (2.2525 => 2.4114, std.dev.: 0.0310)
  SingleSource/Benchmarks/Misc/flops-7: 6.37% (1.9811 => 2.1073, std.dev.: 0.0094)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.32% (0.8869 => 0.9341, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.05% (8.5442 => 8.9755, std.dev.: 0.0444)
  SingleSource/Benchmarks/Dhrystone/fldry: 4.64% (0.6504 => 0.6806, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.31% (4.1188 => 4.2963, std.dev.: 0.0341)
  MultiSource/Benchmarks/FreeBench/neural/neural: 3.58% (0.7211 => 0.7469, std.dev.: 0.0041)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.46% (3.4388 => 3.5579, std.dev.: 0.0262)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.78% (0.7875 => 0.8094, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/bh/bh: 2.21% (2.4253 => 2.4790, std.dev.: 0.0205)
  SingleSource/Benchmarks/Misc/ffbench: 1.85% (1.3907 => 1.4164, std.dev.: 0.0053)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -12.57% (23.1283 => 20.2209, std.dev.: 0.4741)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.80% (2.3347 => 2.2227, std.dev.: 0.0351)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -4.09% (0.5055 => 0.4848, std.dev.: 0.0054)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: -1.15% (1.1603 => 1.1470, std.dev.: 0.2214)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 0.88% (0.0227 => 0.0229, std.dev.: 0.0024)
  MultiSource/Applications/ClamAV/clamscan: -0.47% (0.1495 => 0.1488, std.dev.: 0.0032)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -1.19% (0.1089 => 0.1076, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.02% (0.0589 => 0.0583, std.dev.: 0.0147)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 3.49% (0.0258 => 0.0267, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3.23% (0.0031 => 0.0032, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.70% (0.0027 => 0.0028, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 1.31% (0.0613 => 0.0621, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 11.66% (0.0223 => 0.0249, std.dev.: 0.0011)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 900.00% (0.0001 => 0.0010, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0008 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -56.73% (0.0104 => 0.0045, std.dev.: 0.0052)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -90.00% (0.0010 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.07% (24.5130 => 24.4951, std.dev.: 0.0925)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0001)
  MultiSource/Applications/lemon/lemon: -18.24% (1.1794 => 0.9643, std.dev.: 0.2099)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.37% (0.4125 => 0.4264, std.dev.: 0.0270)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -10.11% (0.0663 => 0.0596, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 1.98% (1.1660 => 1.1891, std.dev.: 0.0686)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -7.68% (1.6803 => 1.5513, std.dev.: 0.0109)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.06% (29.7937 => 31.6004, std.dev.: 1.1748)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -13.79% (0.0029 => 0.0025, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/test1: 33.33% (0.0006 => 0.0008, std.dev.: 0.0001)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 66.14% (0.0254 => 0.0422, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 34.71% (1.0958 => 1.4761, std.dev.: 0.0723)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 34.20% (1.1744 => 1.5760, std.dev.: 0.1185)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 33.13% (1.0528 => 1.4016, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 32.76% (1.1428 => 1.5172, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 32.42% (1.0617 => 1.4059, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 31.41% (1.1023 => 1.4485, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 30.80% (1.1626 => 1.5207, std.dev.: 0.0337)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 30.79% (1.0687 => 1.3977, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 29.60% (1.2419 => 1.6095, std.dev.: 0.1278)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 29.54% (1.0526 => 1.3635, std.dev.: 0.0661)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 28.93% (1.2270 => 1.5820, std.dev.: 0.0626)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 28.69% (1.1209 => 1.4425, std.dev.: 0.0253)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.98% (1.3692 => 1.7523, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 27.92% (1.0951 => 1.4009, std.dev.: 0.0255)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 27.86% (1.2723 => 1.6267, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 27.84% (1.0864 => 1.3889, std.dev.: 0.0375)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 27.58% (1.2929 => 1.6495, std.dev.: 0.0585)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 26.87% (1.3491 => 1.7116, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 26.64% (1.1699 => 1.4816, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 26.47% (1.2566 => 1.5892, std.dev.: 0.1036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 26.37% (1.1727 => 1.4819, std.dev.: 0.0315)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 26.00% (1.2925 => 1.6286, std.dev.: 0.0388)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 25.43% (1.3451 => 1.6872, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 24.65% (1.4005 => 1.7457, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 24.40% (1.2537 => 1.5596, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 22.48% (1.3313 => 1.6306, std.dev.: 0.0364)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.07% (1.2853 => 1.5690, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 21.93% (1.4622 => 1.7829, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 21.75% (1.2835 => 1.5626, std.dev.: 0.0333)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 21.50% (0.2112 => 0.2566, std.dev.: 0.0175)
  SingleSource/UnitTests/Vector/constpool: 20.03% (8.5132 => 10.2183, std.dev.: 0.4100)
  MultiSource/Benchmarks/Olden/tsp/tsp: 16.56% (0.1292 => 0.1506, std.dev.: 0.0027)
  MultiSource/Applications/spiff/spiff: 16.00% (0.9108 => 1.0565, std.dev.: 0.0434)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.69% (23.8286 => 27.3290, std.dev.: 0.4651)
  MultiSource/Applications/SIBsim4/SIBsim4: 12.61% (1.4195 => 1.5985, std.dev.: 0.0235)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 11.81% (5.3794 => 6.0147, std.dev.: 0.1492)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 10.91% (0.1348 => 0.1495, std.dev.: 0.0036)
  MultiSource/Applications/kimwitu++/kc: 10.69% (18.4474 => 20.4194, std.dev.: 0.3823)
  MultiSource/Applications/d/make_dparser: 10.68% (3.5353 => 3.9128, std.dev.: 0.1073)
  MultiSource/Applications/sqlite3/sqlite3: 10.35% (16.1895 => 17.8658, std.dev.: 0.2604)
  MultiSource/Applications/siod/siod: 9.67% (2.4196 => 2.6536, std.dev.: 0.0102)
  MultiSource/Applications/JM/ldecod/ldecod: 9.49% (7.2467 => 7.9347, std.dev.: 0.0630)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.30% (14.7643 => 16.1380, std.dev.: 0.2619)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 9.23% (0.7182 => 0.7845, std.dev.: 0.0167)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.22% (2.4999 => 2.7303, std.dev.: 0.0399)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.69% (1.8524 => 2.0134, std.dev.: 0.0487)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 8.42% (0.9184 => 0.9957, std.dev.: 0.0077)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.15% (4.0688 => 4.3597, std.dev.: 0.0501)
  SingleSource/Benchmarks/Misc/ReedSolomon: 5.13% (0.2086 => 0.2193, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 4.58% (1.4308 => 1.4964, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.58% (0.6984 => 0.7304, std.dev.: 0.0035)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 4.58% (0.3887 => 0.4065, std.dev.: 0.0030)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 4.09% (0.6155 => 0.6407, std.dev.: 0.0065)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 3.10% (0.7818 => 0.8060, std.dev.: 0.0067)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.77% (0.5161 => 0.5304, std.dev.: 0.0047)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 61.06% (0.3010 => 0.4848, std.dev.: 0.0054)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 41.14% (12.6632 => 17.8723, std.dev.: 0.2301)
  SingleSource/Benchmarks/Misc/fp-convert: 39.93% (5.6800 => 7.9482, std.dev.: 0.0372)
  MultiSource/Benchmarks/MallocBench/gs/gs: 37.01% (0.0608 => 0.0833, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 36.40% (3.2482 => 4.4304, std.dev.: 0.1852)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 31.29% (4.4954 => 5.9020, std.dev.: 0.0651)
  SingleSource/Benchmarks/Shootout-C++/ary: 28.51% (0.0505 => 0.0649, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/hash: 25.25% (4.1780 => 5.2329, std.dev.: 0.1836)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.47% (2.8804 => 3.4988, std.dev.: 0.0158)
  MultiSource/Applications/lambda-0_1_3/lambda: 20.00% (6.9897 => 8.3877, std.dev.: 0.3683)
  SingleSource/Benchmarks/McGill/chomp: 18.92% (1.0339 => 1.2295, std.dev.: 0.0088)
  MultiSource/Benchmarks/Olden/tsp/tsp: 17.19% (1.4232 => 1.6679, std.dev.: 0.0668)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.35% (3.7569 => 4.3336, std.dev.: 0.1473)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 15.02% (2.9511 => 3.3945, std.dev.: 0.0651)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.15% (8.7510 => 9.9892, std.dev.: 0.0362)
  SingleSource/Benchmarks/Misc/salsa20: 14.05% (9.1513 => 10.4373, std.dev.: 0.0967)
  SingleSource/Benchmarks/Shootout-C++/hash: 12.61% (0.6540 => 0.7365, std.dev.: 0.0244)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 12.14% (0.8330 => 0.9341, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout/ary3: 12.03% (8.2895 => 9.2866, std.dev.: 0.2317)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 11.43% (1.0331 => 1.1512, std.dev.: 0.0292)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.58% (2.0100 => 2.2227, std.dev.: 0.0351)
  MultiSource/Applications/hexxagon/hexxagon: 10.08% (14.4795 => 15.9393, std.dev.: 0.0940)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.44% (4.0968 => 4.4834, std.dev.: 0.0146)
  SingleSource/Benchmarks/Misc/flops-7: 8.63% (1.9399 => 2.1073, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.89% (43.6112 => 47.0528, std.dev.: 0.8382)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.56% (4.8642 => 5.2318, std.dev.: 0.0702)
  MultiSource/Applications/siod/siod: 7.00% (3.4143 => 3.6532, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/richards_benchmark: 6.01% (1.3414 => 1.4220, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.28% (5.1346 => 5.4059, std.dev.: 0.0133)
  SingleSource/Benchmarks/Dhrystone/fldry: 5.03% (0.6480 => 0.6806, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.62% (5.0818 => 5.3164, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.42% (4.1146 => 4.2963, std.dev.: 0.0341)
  MultiSource/Applications/spiff/spiff: 4.41% (2.7749 => 2.8972, std.dev.: 0.0168)
  MultiSource/Benchmarks/Olden/bh/bh: 4.38% (2.3749 => 2.4790, std.dev.: 0.0205)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.36% (23.4908 => 24.5148, std.dev.: 0.0679)
  SingleSource/Benchmarks/Shootout-C++/methcall: 4.14% (8.6184 => 8.9755, std.dev.: 0.0444)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.02% (3.4205 => 3.5579, std.dev.: 0.0262)
  SingleSource/Benchmarks/Shootout/lists: 4.01% (7.2055 => 7.4941, std.dev.: 0.0339)
  MultiSource/Applications/sqlite3/sqlite3: 3.81% (4.2776 => 4.4405, std.dev.: 0.0257)
  SingleSource/Benchmarks/Misc/whetstone: 3.46% (3.4590 => 3.5786, std.dev.: 0.0099)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.25% (2.7289 => 2.8177, std.dev.: 0.0250)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.90% (3.7953 => 3.9053, std.dev.: 0.0106)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.83% (90.5803 => 93.1465, std.dev.: 0.9214)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.81% (9.6958 => 9.9682, std.dev.: 0.0092)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 2.43% (2.7893 => 2.8572, std.dev.: 0.0235)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 2.41% (41.3934 => 42.3895, std.dev.: 0.3693)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.32% (1.4499 => 1.4835, std.dev.: 0.0130)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.29% (2.0956 => 2.1435, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.35% (3.4522 => 3.4988, std.dev.: 0.0094)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -47.28% (0.0810 => 0.0427, std.dev.: 0.0140)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.31% (0.3861 => 0.1378, std.dev.: 0.0066)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.68% (3.4380 => 1.4549, std.dev.: 0.0127)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.89% (3.8940 => 1.6786, std.dev.: 0.0032)
  MultiSource/Benchmarks/FreeBench/mason/mason: -43.97% (0.5213 => 0.2921, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.19% (6.8267 => 4.5611, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -31.48% (0.1871 => 0.1282, std.dev.: 0.0118)
  MultiSource/Benchmarks/FreeBench/neural/neural: -31.13% (1.0845 => 0.7469, std.dev.: 0.0041)
  MultiSource/Applications/viterbi/viterbi: -24.47% (3.4506 => 2.6064, std.dev.: 0.0154)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -24.27% (0.2316 => 0.1754, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.52% (5.8948 => 4.6260, std.dev.: 0.0428)
  SingleSource/Benchmarks/Misc/perlin: -19.36% (4.5691 => 3.6843, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -19.16% (3.5506 => 2.8702, std.dev.: 0.0946)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -17.83% (0.1789 => 0.1470, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -17.54% (6.0446 => 4.9841, std.dev.: 0.0168)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -16.44% (1.9660 => 1.6427, std.dev.: 0.0245)
  SingleSource/Benchmarks/McGill/misr: -16.43% (0.4729 => 0.3952, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.43% (6.4626 => 5.4008, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.85% (6.7010 => 5.7058, std.dev.: 0.0079)
  MultiSource/Benchmarks/mafft/pairlocalalign: -14.48% (57.5400 => 49.2086, std.dev.: 0.1971)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.52% (6.0602 => 5.3012, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -12.31% (9.0122 => 7.9025, std.dev.: 0.0266)
  SingleSource/Benchmarks/Misc/mandel: -11.93% (1.0882 => 0.9584, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.37% (5.0054 => 4.4861, std.dev.: 0.0239)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -9.32% (0.3091 => 0.2803, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.89% (5.0816 => 4.6300, std.dev.: 0.0103)
  MultiSource/Applications/oggenc/oggenc: -8.43% (0.1826 => 0.1672, std.dev.: 0.0029)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.89% (89.3093 => 82.2585, std.dev.: 0.0412)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -7.78% (2.5458 => 2.3477, std.dev.: 0.0027)
  SingleSource/Benchmarks/McGill/queens: -7.74% (1.7928 => 1.6541, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.45% (4.2970 => 3.9770, std.dev.: 0.0977)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.43% (9.5512 => 8.8412, std.dev.: 0.0354)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.40% (3.3978 => 3.1463, std.dev.: 0.0208)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.27% (0.4924 => 0.4566, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout/strcat: -7.25% (0.1572 => 0.1458, std.dev.: 0.0006)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.04% (13.2022 => 12.2723, std.dev.: 0.0280)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.60% (3.9434 => 3.7227, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.63% (3.0513 => 2.9101, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.43% (9.0356 => 8.6352, std.dev.: 0.0332)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.41% (5.7666 => 5.5125, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.39% (3.3618 => 3.2141, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.36% (5.6245 => 5.3794, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.27% (4.4289 => 4.2396, std.dev.: 0.0385)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -4.09% (4.7361 => 4.5426, std.dev.: 0.0738)
  SingleSource/Benchmarks/Misc/fbench: -4.03% (4.9661 => 4.7662, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.36% (3.3922 => 3.2782, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.96% (6.2349 => 6.0501, std.dev.: 0.0394)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.71% (3.8286 => 3.7247, std.dev.: 0.0011)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.39% (0.6582 => 0.6425, std.dev.: 0.0036)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.36% (4.3713 => 4.2681, std.dev.: 0.0306)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.27% (35.0623 => 34.2676, std.dev.: 0.0283)
  SingleSource/Benchmarks/Misc/flops-3: -1.58% (2.0809 => 2.0481, std.dev.: 0.0045)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.61% (1.1288 => 1.1470, std.dev.: 0.2214)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -7.66% (0.0248 => 0.0229, std.dev.: 0.0024)
  MultiSource/Applications/ClamAV/clamscan: 0.74% (0.1477 => 0.1488, std.dev.: 0.0032)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -17.80% (0.1309 => 0.1076, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.89% (0.0613 => 0.0583, std.dev.: 0.0147)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 10.34% (0.0029 => 0.0032, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.70% (0.0027 => 0.0028, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.0594 => 0.0621, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -31.02% (0.0361 => 0.0249, std.dev.: 0.0011)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 900.00% (0.0001 => 0.0010, std.dev.: 0.0001)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 700.00% (0.0001 => 0.0008, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -51.09% (0.0092 => 0.0045, std.dev.: 0.0052)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0006)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.01% (26.9213 => 24.4951, std.dev.: 0.0925)

Report Time: 0.60s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130408/9a57d3af/attachment.html>


More information about the llvm-testresults mailing list