[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed May 1 16:57:46 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11209?compare_to=11207&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 11209, Order: 180885, Start Time: 2013-05-01 22:11:06, End Time: 2013-05-01 23:57:47
      To: 11207, Order: 180871, Start Time: 2013-05-01 19:53:39, End Time: 2013-05-01 21:43:25
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (20 on baseline)
Performance Regressions: 3 (77 on baseline)
Performance Improvements: 24 (65 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 13 (12 on baseline)
Unchanged Tests: 1068 (927 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.55% (1.4739 => 1.8800, std.dev.: 0.0211)
  MultiSource/Benchmarks/McCat/18-imp/imp: 9.88% (0.1306 => 0.1435, std.dev.: 0.0015)
  MultiSource/Benchmarks/Bullet/bullet: 6.28% (7.0244 => 7.4655, std.dev.: 0.0812)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/flops-5: -38.01% (0.0492 => 0.0305, std.dev.: 0.0013)
  SingleSource/Benchmarks/McGill/queens: -37.49% (0.0859 => 0.0537, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/ReedSolomon: -23.89% (0.2838 => 0.2160, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -15.88% (0.2437 => 0.2050, std.dev.: 0.0060)
  SingleSource/Benchmarks/McGill/exptree: -13.19% (0.1099 => 0.0954, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -8.68% (1.7472 => 1.5956, std.dev.: 0.0264)
  SingleSource/Benchmarks/Shootout-C++/strcat: -4.87% (0.2238 => 0.2129, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.07% (1.8764 => 1.8001, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.03% (1.6924 => 1.6581, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.95% (1.6935 => 1.6605, std.dev.: 0.0097)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: -38.98% (10.5036 => 6.4096, std.dev.: 1.4235)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -12.09% (3.8881 => 3.4181, std.dev.: 0.1474)
  SingleSource/Benchmarks/Shootout/hash: -7.65% (5.5885 => 5.1609, std.dev.: 0.1349)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -7.11% (0.1968 => 0.1828, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/flops-7: -7.11% (2.1246 => 1.9736, std.dev.: 0.0496)
  SingleSource/Benchmarks/McGill/chomp: -3.85% (1.1572 => 1.1127, std.dev.: 0.0158)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.73% (0.3106 => 0.2990, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/ffbench: -2.61% (1.4354 => 1.3980, std.dev.: 0.0100)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -1.61% (1.5914 => 1.5657, std.dev.: 0.0084)
  SingleSource/Benchmarks/Stanford/FloatMM: -1.54% (0.8136 => 0.8011, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/flops-5: -1.50% (2.9017 => 2.8581, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.49% (1.8690 => 1.8411, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.41% (1.2634 => 1.2456, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.33% (8.7560 => 8.6392, std.dev.: 0.0018)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 0.10% (1.1390 => 1.1401, std.dev.: 0.3288)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lua/lua
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: -1.99% (0.1555 => 0.1524, std.dev.: 0.0013)
  MultiSource/Applications/lua/lua: -0.67% (27.6395 => 27.4552, std.dev.: 0.3829)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.26% (0.0559 => 0.0594, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.39% (0.0259 => 0.0260, std.dev.: 0.0041)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 12.94% (0.0085 => 0.0096, std.dev.: 0.0005)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/lua/lua
  MultiSource/Applications/lua/lua: -2.54% (28.1709 => 27.4552, std.dev.: 0.3829)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -4.44% (0.0248 => 0.0237, std.dev.: 0.0003)
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: -25.15% (1.1794 => 0.8828, std.dev.: 0.3685)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.83% (0.4125 => 0.4448, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.96% (0.1309 => 0.1231, std.dev.: 0.0186)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -19.00% (0.0663 => 0.0537, std.dev.: 0.0107)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.16% (1.1660 => 1.3194, std.dev.: 0.0228)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -37.93% (0.0029 => 0.0018, std.dev.: 0.0006)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.72% (0.0594 => 0.0628, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -29.64% (0.0361 => 0.0254, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -32.21% (1.6803 => 1.1390, std.dev.: 0.0110)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.36% (29.7937 => 28.4934, std.dev.: 2.7533)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 11.11% (0.0009 => 0.0010, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 100.00% (0.0001 => 0.0002, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.54% (26.9213 => 23.0078, std.dev.: 0.6943)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 28.50% (1.1744 => 1.5091, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.49% (1.0418 => 1.3386, std.dev.: 0.0536)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 28.47% (1.2925 => 1.6605, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 28.25% (1.2929 => 1.6581, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.13% (1.0617 => 1.3604, std.dev.: 0.0590)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 27.81% (1.0687 => 1.3659, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.56% (1.1023 => 1.4061, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 27.37% (1.0528 => 1.3409, std.dev.: 0.0396)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 27.12% (1.1428 => 1.4527, std.dev.: 0.0328)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.01% (1.1209 => 1.4237, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 26.78% (1.1626 => 1.4739, std.dev.: 0.0355)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.44% (1.0864 => 1.3736, std.dev.: 0.0293)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 26.20% (1.2419 => 1.5673, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 26.13% (1.0951 => 1.3813, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.91% (1.0526 => 1.3253, std.dev.: 0.0748)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.77% (1.3692 => 1.7221, std.dev.: 0.0705)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 25.76% (1.2270 => 1.5431, std.dev.: 0.0567)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 25.41% (1.2723 => 1.5956, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 25.40% (1.2704 => 1.5931, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 24.84% (1.3638 => 1.7025, std.dev.: 0.0499)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.60% (1.1699 => 1.4577, std.dev.: 0.0680)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.11% (1.4622 => 1.8001, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 23.02% (1.1727 => 1.4427, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.95% (1.2537 => 1.5414, std.dev.: 0.0911)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 22.00% (1.3491 => 1.6459, std.dev.: 0.0671)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 20.45% (1.4005 => 1.6869, std.dev.: 0.0506)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.36% (1.3357 => 1.6077, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 20.24% (1.3451 => 1.6173, std.dev.: 0.0454)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 17.45% (23.8286 => 27.9875, std.dev.: 0.2859)
  MultiSource/Benchmarks/Bullet/bullet: 11.03% (33.9296 => 37.6732, std.dev.: 0.9541)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.30% (1.4195 => 1.4806, std.dev.: 0.0130)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 1.76% (1.1277 => 1.1476, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 53.55% (0.3010 => 0.4622, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/lowercase: 46.13% (0.7986 => 1.1670, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/fp-convert: 39.83% (5.6800 => 7.9421, std.dev.: 0.0212)
  SingleSource/Benchmarks/Shootout-C++/ary2: 35.99% (0.0314 => 0.0427, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/methcall: 34.19% (8.6184 => 11.5652, std.dev.: 0.0242)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.03% (1.1586 => 1.5065, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout/hash: 23.53% (4.1780 => 5.1609, std.dev.: 0.1349)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 19.89% (0.0548 => 0.0657, std.dev.: 0.0004)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 19.75% (12.6632 => 15.1648, std.dev.: 0.8889)
  MultiSource/Applications/lambda-0_1_3/lambda: 19.46% (6.9897 => 8.3496, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.41% (3.7569 => 4.4860, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.87% (4.0968 => 4.8289, std.dev.: 0.1433)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.82% (4.8478 => 5.6632, std.dev.: 0.0689)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.11% (8.7510 => 9.9855, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.01% (4.5865 => 5.2290, std.dev.: 0.0790)
  MultiSource/Benchmarks/Olden/tsp/tsp: 12.95% (1.4232 => 1.6075, std.dev.: 0.0430)
  SingleSource/Benchmarks/Misc/salsa20: 12.66% (9.1513 => 10.3102, std.dev.: 0.0225)
  SingleSource/Benchmarks/Shootout/sieve: 11.47% (6.8087 => 7.5894, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.43% (2.5283 => 2.8174, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.87% (4.8642 => 5.3930, std.dev.: 0.0217)
  SingleSource/Benchmarks/Shootout/matrix: 10.59% (1.5499 => 1.7141, std.dev.: 0.0016)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.45% (0.1655 => 0.1828, std.dev.: 0.0012)
  MultiSource/Applications/hexxagon/hexxagon: 8.82% (14.4795 => 15.7569, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/flops: 7.97% (9.3754 => 10.1225, std.dev.: 0.0268)
  SingleSource/Benchmarks/McGill/chomp: 7.62% (1.0339 => 1.1127, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.25% (2.5458 => 2.7303, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.32% (4.7982 => 5.1016, std.dev.: 0.0818)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.24% (3.3943 => 3.6061, std.dev.: 0.0524)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.74% (90.5803 => 95.7816, std.dev.: 1.1407)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.63% (5.0818 => 5.3678, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.23% (6.2349 => 6.5609, std.dev.: 0.0899)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.04% (2.7893 => 2.9300, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.87% (9.0122 => 9.4513, std.dev.: 0.0418)
  MultiSource/Benchmarks/Bullet/bullet: 4.63% (7.1351 => 7.4655, std.dev.: 0.0812)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.06% (23.4908 => 24.4445, std.dev.: 0.0164)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.72% (1.0088 => 1.0463, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 3.70% (0.3085 => 0.3199, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/whetstone: 3.62% (3.4590 => 3.5841, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.54% (5.1006 => 5.2811, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.10% (6.1397 => 6.3301, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.83% (9.6958 => 9.9699, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.39% (1.4499 => 1.4845, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.04% (4.1182 => 4.2023, std.dev.: 0.0309)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.95% (2.0956 => 2.1365, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/fib2: 1.11% (4.9040 => 4.9584, std.dev.: 0.0190)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -47.90% (0.0810 => 0.0422, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/neural/neural: -23.72% (0.2542 => 0.1939, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -13.29% (0.0858 => 0.0744, std.dev.: 0.0029)
  SingleSource/Benchmarks/McGill/chomp: -12.11% (0.1957 => 0.1720, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -12.00% (0.0908 => 0.0799, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -9.70% (0.4051 => 0.3658, std.dev.: 0.0007)
  SingleSource/Benchmarks/Linpack/linpack-pc: -9.67% (0.2751 => 0.2485, std.dev.: 0.0022)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.42% (0.3990 => 0.3694, std.dev.: 0.0107)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -73.02% (1.0845 => 0.2926, std.dev.: 0.0618)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.62% (0.3861 => 0.1366, std.dev.: 0.0069)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.29% (3.4380 => 1.4684, std.dev.: 0.0069)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -57.15% (3.8940 => 1.6687, std.dev.: 0.0035)
  MultiSource/Benchmarks/FreeBench/mason/mason: -45.33% (0.5213 => 0.2850, std.dev.: 0.0234)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.93% (0.3091 => 0.1764, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.45% (6.8267 => 4.5429, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -28.78% (0.4520 => 0.3219, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.81% (0.4111 => 0.3009, std.dev.: 0.0036)
  MultiSource/Applications/viterbi/viterbi: -26.54% (3.4506 => 2.5347, std.dev.: 0.0151)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -23.87% (0.1789 => 0.1362, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -22.88% (0.2316 => 0.1786, std.dev.: 0.0169)
  SingleSource/Benchmarks/Misc/perlin: -20.79% (4.5691 => 3.6191, std.dev.: 0.0044)
  SingleSource/Benchmarks/McGill/misr: -19.75% (0.4729 => 0.3795, std.dev.: 0.0122)
  MultiSource/Benchmarks/mafft/pairlocalalign: -19.65% (57.5400 => 46.2340, std.dev.: 0.1277)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.45% (0.3279 => 0.2674, std.dev.: 0.0006)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -17.21% (1.9660 => 1.6276, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.80% (6.0446 => 5.0290, std.dev.: 0.0259)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.53% (6.4626 => 5.3943, std.dev.: 0.0345)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.43% (3.5506 => 3.0381, std.dev.: 0.0477)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.27% (6.7010 => 5.7451, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.57% (6.0602 => 5.2985, std.dev.: 0.0062)
  SingleSource/Benchmarks/Stanford/Puzzle: -11.39% (0.1650 => 0.1462, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.37% (5.0054 => 4.4864, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.18% (5.8948 => 5.2947, std.dev.: 0.0440)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -9.12% (5.0816 => 4.6180, std.dev.: 0.0153)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.93% (4.2970 => 3.9561, std.dev.: 0.0946)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.78% (9.5512 => 8.8085, std.dev.: 0.0062)
  SingleSource/Benchmarks/McGill/queens: -7.66% (1.7928 => 1.6555, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.63% (3.3978 => 3.1384, std.dev.: 0.0619)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.48% (13.2022 => 12.2144, std.dev.: 0.0194)
  SingleSource/Benchmarks/Shootout/strcat: -7.44% (0.1572 => 0.1455, std.dev.: 0.0027)
  SingleSource/Benchmarks/Dhrystone/dry: -6.03% (0.5278 => 0.4960, std.dev.: 0.0025)
  MultiSource/Applications/sgefa/sgefa: -5.85% (1.2184 => 1.1471, std.dev.: 0.0013)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.47% (3.4205 => 3.2334, std.dev.: 0.0509)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.08% (3.9434 => 3.7430, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.75% (3.0513 => 2.9063, std.dev.: 0.0148)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -4.70% (1.5779 => 1.5038, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/fbench: -4.54% (4.9661 => 4.7408, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.46% (3.3618 => 3.2120, std.dev.: 0.0436)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.40% (5.7666 => 5.5128, std.dev.: 0.0169)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.39% (9.0356 => 8.6392, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.37% (4.4289 => 4.2355, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.08% (5.6245 => 5.3948, std.dev.: 0.0059)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.47% (52.8418 => 51.0084, std.dev.: 0.4478)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.35% (4.3713 => 4.2248, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.33% (0.3093 => 0.2990, std.dev.: 0.0020)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.27% (0.6582 => 0.6367, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.90% (3.8286 => 3.7174, std.dev.: 0.0055)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.59% (5.6426 => 5.4962, std.dev.: 0.0277)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.21% (35.0623 => 34.2889, std.dev.: 0.0252)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.21% (6.7917 => 6.6419, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/ffbench: -2.09% (1.4279 => 1.3980, std.dev.: 0.0100)
  MultiSource/Applications/siod/siod: -2.04% (3.4143 => 3.3445, std.dev.: 0.0197)
  SingleSource/Benchmarks/Misc/flops-3: -1.92% (2.0809 => 2.0409, std.dev.: 0.0051)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.71% (1.8732 => 1.8411, std.dev.: 0.0069)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.41% (89.3093 => 88.0495, std.dev.: 0.1133)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.00% (1.1288 => 1.1401, std.dev.: 0.3288)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: 3.18% (0.1477 => 0.1524, std.dev.: 0.0013)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.10% (0.0613 => 0.0594, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -5.80% (0.0276 => 0.0260, std.dev.: 0.0041)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 4.35% (0.0092 => 0.0096, std.dev.: 0.0005)

Report Time: 1.50s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130501/9b664d24/attachment.html>


More information about the llvm-testresults mailing list