[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Apr 29 23:41:47 PDT 2013 

http://llvm.org/perf/db_default/v4/nts/11146?compare_to=11143&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 11146, Order: 180770, Start Time: 2013-04-30 05:00:13, End Time: 2013-04-30 06:41:48
      To: 11143, Order: 180767, Start Time: 2013-04-30 02:41:48, End Time: 2013-04-30 04:22:46
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (20 on baseline)
Performance Regressions: 8 (90 on baseline)
Performance Improvements: 9 (94 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 13 (12 on baseline)
Unchanged Tests: 1078 (885 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 4.87% (0.6529 => 0.6847, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.78% (0.6384 => 0.6625, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.84% (0.6614 => 0.6802, std.dev.: 0.0032)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.45% (1.0723 => 1.0879, std.dev.: 0.0057)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.02% (5.0330 => 5.3861, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.23% (4.0951 => 4.1865, std.dev.: 0.0328)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.14% (11.3060 => 11.5475, std.dev.: 0.0456)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.57% (51.1901 => 51.9931, std.dev.: 0.0146)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.78% (6.7417 => 6.6219, std.dev.: 0.0429)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: -7.39% (3.3258 => 3.0800, std.dev.: 0.0789)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.40% (1.1427 => 1.1038, std.dev.: 0.0081)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.51% (0.8078 => 0.7875, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.34% (5.1448 => 5.0245, std.dev.: 0.0407)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.48% (2.6512 => 2.6120, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.28% (4.8544 => 4.7923, std.dev.: 0.0239)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.09% (1.4787 => 1.4626, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.08% (1.3595 => 1.3448, std.dev.: 0.0049)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.32% (1.1353 => 1.1503, std.dev.: 0.0619)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lua/lua
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: -2.66% (0.1539 => 0.1498, std.dev.: 0.0031)
  MultiSource/Applications/lua/lua: 0.57% (27.3350 => 27.4898, std.dev.: 0.3740)
  MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -0.67% (0.0594 => 0.0590, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -15.12% (0.0258 => 0.0219, std.dev.: 0.0019)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -5.71% (0.0105 => 0.0099, std.dev.: 0.0004)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/lua/lua
  MultiSource/Applications/lua/lua: -2.42% (28.1709 => 27.4898, std.dev.: 0.3740)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -17.34% (0.0248 => 0.0205, std.dev.: 0.0019)
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0000)
  MultiSource/Applications/lemon/lemon: -26.01% (1.1794 => 0.8726, std.dev.: 0.2262)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.90% (0.4125 => 0.4286, std.dev.: 0.0101)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.93% (0.1309 => 0.1179, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -19.61% (0.0663 => 0.0533, std.dev.: 0.0042)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.82% (1.1660 => 1.3155, std.dev.: 0.0038)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -96.55% (0.0029 => 0.0001, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.05% (0.0594 => 0.0624, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.27% (0.0361 => 0.0277, std.dev.: 0.0000)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -34.31% (1.6803 => 1.1038, std.dev.: 0.0081)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 700.00% (0.0001 => 0.0008)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.28% (29.7937 => 28.5200, std.dev.: 0.3678)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -20.69% (0.0029 => 0.0023, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/casts: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -14.83% (26.9213 => 22.9281, std.dev.: 0.0697)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 29.83% (1.0958 => 1.4227, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 28.57% (1.0687 => 1.3740, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 28.44% (1.1428 => 1.4678, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 28.41% (1.0418 => 1.3378, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 28.06% (1.0617 => 1.3596, std.dev.: 0.0376)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 27.71% (1.1023 => 1.4078, std.dev.: 0.0433)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 27.57% (1.1626 => 1.4831, std.dev.: 0.0517)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 27.31% (1.1209 => 1.4270, std.dev.: 0.0394)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 27.14% (1.0528 => 1.3385, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 26.93% (1.0507 => 1.3337, std.dev.: 0.0894)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 26.59% (1.0864 => 1.3753, std.dev.: 0.0394)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 26.46% (1.1744 => 1.4851, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 26.39% (1.0890 => 1.3764, std.dev.: 0.0357)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 25.92% (1.0951 => 1.3790, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.62% (1.0526 => 1.3223, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 25.55% (1.2270 => 1.5405, std.dev.: 0.0888)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 24.76% (1.1699 => 1.4596, std.dev.: 0.0486)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 22.76% (1.2537 => 1.5391, std.dev.: 0.0481)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 22.76% (1.2835 => 1.5756, std.dev.: 0.0467)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 22.67% (1.1727 => 1.4386, std.dev.: 0.0459)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 22.59% (1.2419 => 1.5225, std.dev.: 0.0427)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 22.50% (1.2566 => 1.5393, std.dev.: 0.0587)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 22.31% (1.3046 => 1.5957, std.dev.: 0.0915)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.23% (1.2723 => 1.5551, std.dev.: 0.0536)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 22.03% (1.2853 => 1.5684, std.dev.: 0.0644)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 22.00% (1.2929 => 1.5774, std.dev.: 0.1066)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 21.66% (1.3313 => 1.6197, std.dev.: 0.0606)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 21.39% (1.3491 => 1.6377, std.dev.: 0.0894)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 21.35% (1.4622 => 1.7744, std.dev.: 0.0888)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.10% (1.2704 => 1.5384, std.dev.: 0.0836)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 20.97% (1.2925 => 1.5636, std.dev.: 0.0490)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 20.54% (1.3357 => 1.6100, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 19.99% (1.3451 => 1.6140, std.dev.: 0.0528)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 19.69% (1.3638 => 1.6324, std.dev.: 0.0619)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 19.26% (1.4005 => 1.6702, std.dev.: 0.0817)
  SingleSource/UnitTests/Vector/constpool: 3.37% (8.5132 => 8.8000, std.dev.: 0.0764)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.34% (0.6582 => 0.6802, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.87% (1.5284 => 1.5723, std.dev.: 0.0116)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.46% (0.9184 => 0.9410, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.22% (0.6481 => 0.6625, std.dev.: 0.0038)
  MultiSource/Applications/treecc/treecc: 1.32% (2.2217 => 2.2510, std.dev.: 0.0085)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: 54.15% (0.3010 => 0.4640, std.dev.: 0.0195)
  SingleSource/Benchmarks/Misc/lowercase: 46.43% (0.7986 => 1.1694, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc/fp-convert: 39.70% (5.6800 => 7.9351, std.dev.: 0.0025)
  MultiSource/Benchmarks/MallocBench/gs/gs: 38.65% (0.0608 => 0.0843, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/methcall: 33.99% (8.6184 => 11.5475, std.dev.: 0.0456)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 30.04% (1.1586 => 1.5067, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout/hash: 23.49% (4.1780 => 5.1593, std.dev.: 0.0128)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.18% (2.8804 => 3.4904, std.dev.: 0.0595)
  SingleSource/Benchmarks/Shootout-C++/ary: 20.59% (0.0505 => 0.0609, std.dev.: 0.0020)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 20.33% (12.6632 => 15.2370, std.dev.: 0.7714)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.53% (3.7569 => 4.4906, std.dev.: 0.0008)
  MultiSource/Applications/lambda-0_1_3/lambda: 19.42% (6.9897 => 8.3468, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 17.46% (4.0968 => 4.8121, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.78% (4.8478 => 5.6614, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.12% (4.5865 => 5.2342, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.08% (8.7510 => 9.9830, std.dev.: 0.0062)
  MultiSource/Benchmarks/Olden/tsp/tsp: 12.91% (1.4232 => 1.6070, std.dev.: 0.0278)
  SingleSource/Benchmarks/Misc/salsa20: 12.39% (9.1513 => 10.2847, std.dev.: 0.0141)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.41% (2.5283 => 2.8167, std.dev.: 0.1089)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 10.93% (4.8642 => 5.3959, std.dev.: 0.0099)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.82% (0.1655 => 0.1834, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/hash: 10.49% (0.6540 => 0.7226, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/sieve: 9.86% (6.8087 => 7.4799, std.dev.: 0.0528)
  MultiSource/Applications/hexxagon/hexxagon: 8.80% (14.4795 => 15.7532, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc/flops: 7.99% (9.3754 => 10.1242, std.dev.: 0.0001)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.97% (2.4191 => 2.6120, std.dev.: 0.0053)
  SingleSource/Benchmarks/McGill/chomp: 7.58% (1.0339 => 1.1123, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.22% (2.5458 => 2.7295, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.41% (4.7982 => 5.1056, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/hash2: 6.17% (3.3943 => 3.6036, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.52% (5.0818 => 5.3624, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.43% (9.0122 => 9.5012, std.dev.: 0.0250)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.40% (1.0331 => 1.0889, std.dev.: 0.0120)
  SingleSource/Benchmarks/Dhrystone/fldry: 5.08% (0.6480 => 0.6809, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.05% (6.2349 => 6.5496, std.dev.: 0.1069)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.98% (2.7893 => 2.9282, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.74% (5.1346 => 5.3780, std.dev.: 0.0247)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 4.06% (23.4908 => 24.4435, std.dev.: 0.2129)
  SingleSource/Benchmarks/Misc/whetstone: 3.68% (3.4590 => 3.5862, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.52% (5.1006 => 5.2802, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.06% (6.1397 => 6.3273, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 3.03% (9.6958 => 9.9896, std.dev.: 0.0250)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 2.84% (1.0088 => 1.0374, std.dev.: 0.0054)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.40% (2.4484 => 2.5071, std.dev.: 0.0066)
  MultiSource/Applications/spiff/spiff: 2.34% (2.7749 => 2.8398, std.dev.: 0.0070)
  MultiSource/Benchmarks/Olden/power/power: 2.16% (1.2248 => 1.2513, std.dev.: 0.0048)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.15% (1.4499 => 1.4811, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.06% (4.1182 => 4.2030, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout/fib2: 1.09% (4.9040 => 4.9575, std.dev.: 0.0194)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -48.77% (0.0810 => 0.0415, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/neural/neural: -23.49% (0.2542 => 0.1945, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -18.54% (0.1176 => 0.0958, std.dev.: 0.0059)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.50% (0.0817 => 0.0674, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -17.19% (0.0803 => 0.0665, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -16.20% (0.0895 => 0.0750, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -14.67% (0.0893 => 0.0762, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -13.31% (0.0789 => 0.0684, std.dev.: 0.0005)
  SingleSource/Benchmarks/McGill/chomp: -13.23% (0.1957 => 0.1698, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -12.12% (0.0858 => 0.0754, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.89% (0.0908 => 0.0800, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -11.57% (0.0985 => 0.0871, std.dev.: 0.0009)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.29% (0.2751 => 0.2523, std.dev.: 0.0017)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -6.54% (0.3990 => 0.3729, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.95% (0.7182 => 0.6755, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.35% (6.9229 => 6.6219, std.dev.: 0.0429)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.90% (10.6134 => 10.1998, std.dev.: 0.0093)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.95% (1.6187 => 1.5709, std.dev.: 0.0045)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.78% (0.7818 => 0.7601, std.dev.: 0.0010)
  MultiSource/Benchmarks/nbench/nbench: -2.57% (1.2881 => 1.2550, std.dev.: 0.0094)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -73.14% (1.0845 => 0.2913, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.21% (0.3861 => 0.1382, std.dev.: 0.0004)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.46% (3.4380 => 1.4626, std.dev.: 0.0053)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -57.27% (3.8940 => 1.6639, std.dev.: 0.0081)
  MultiSource/Benchmarks/FreeBench/mason/mason: -46.40% (0.5213 => 0.2794, std.dev.: 0.0064)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.70% (0.3091 => 0.1771, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.49% (6.8267 => 4.5407, std.dev.: 0.0085)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -28.83% (0.4520 => 0.3217, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.76% (0.4111 => 0.3011, std.dev.: 0.0042)
  MultiSource/Applications/viterbi/viterbi: -26.64% (3.4506 => 2.5313, std.dev.: 0.0082)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -25.77% (0.1789 => 0.1328, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -25.11% (0.4368 => 0.3271, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout/ary3: -24.06% (8.2895 => 6.2948, std.dev.: 0.3735)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -23.10% (0.2316 => 0.1781, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -22.50% (0.1871 => 0.1450, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/perlin: -20.84% (4.5691 => 3.6171, std.dev.: 0.0063)
  MultiSource/Benchmarks/mafft/pairlocalalign: -19.52% (57.5400 => 46.3057, std.dev.: 0.2309)
  SingleSource/Benchmarks/McGill/misr: -19.41% (0.4729 => 0.3811, std.dev.: 0.0068)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.24% (0.3279 => 0.2681, std.dev.: 0.0126)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -17.03% (1.9660 => 1.6311, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.88% (6.0446 => 5.0245, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.54% (6.4626 => 5.3935, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.77% (3.5506 => 3.0263, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -14.27% (6.7010 => 5.7449, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.60% (6.0602 => 5.2968, std.dev.: 0.0106)
  MultiSource/Benchmarks/McCat/18-imp/imp: -12.49% (0.1465 => 0.1282, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc/mandel: -12.35% (1.0882 => 0.9538, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -11.60% (4.7243 => 4.1761, std.dev.: 0.0662)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -10.38% (0.1040 => 0.0932, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.37% (5.0054 => 4.4863, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.21% (5.8948 => 5.2930, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.80% (5.0816 => 4.6343, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -8.20% (4.2970 => 3.9448, std.dev.: 0.0430)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.70% (9.5512 => 8.8153, std.dev.: 0.0264)
  SingleSource/Benchmarks/McGill/queens: -7.68% (1.7928 => 1.6551, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.65% (3.3978 => 3.1380, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.49% (0.4924 => 0.4555, std.dev.: 0.0007)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.49% (13.2022 => 12.2131, std.dev.: 0.0252)
  SingleSource/Benchmarks/Shootout/strcat: -7.38% (0.1572 => 0.1456, std.dev.: 0.0003)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.71% (3.4205 => 3.1910, std.dev.: 0.0619)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -6.21% (0.5182 => 0.4860, std.dev.: 0.0092)
  MultiSource/Applications/oggenc/oggenc: -6.02% (0.1826 => 0.1716, std.dev.: 0.0029)
  MultiSource/Benchmarks/FreeBench/distray/distray: -5.88% (0.2431 => 0.2288, std.dev.: 0.0038)
  SingleSource/Benchmarks/Dhrystone/dry: -5.78% (0.5278 => 0.4973, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -5.72% (0.2167 => 0.2043, std.dev.: 0.0039)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.17% (3.9434 => 3.7397, std.dev.: 0.0245)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -5.15% (1.5779 => 1.4967, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/fbench: -4.78% (4.9661 => 4.7285, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.73% (3.0513 => 2.9071, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.64% (5.7666 => 5.4993, std.dev.: 0.0093)
  MultiSource/Benchmarks/Olden/em3d/em3d: -4.48% (4.5899 => 4.3845, std.dev.: 0.0191)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.47% (9.0356 => 8.6315, std.dev.: 0.0489)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.47% (3.3618 => 3.2115, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.40% (4.4289 => 4.2339, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.24% (5.6245 => 5.3861, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.12% (3.3922 => 3.2526, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.07% (0.3093 => 0.2967, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.31% (4.3713 => 4.2265, std.dev.: 0.0469)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.04% (0.8122 => 0.7875, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.99% (3.8286 => 3.7140, std.dev.: 0.0427)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.59% (2.7587 => 2.6873, std.dev.: 0.0090)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.32% (35.0623 => 34.2480, std.dev.: 0.0733)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.19% (6.7917 => 6.6429, std.dev.: 0.0371)
  SingleSource/Benchmarks/Misc/ffbench: -2.06% (1.4279 => 1.3985, std.dev.: 0.0107)
  MultiSource/Applications/siod/siod: -1.90% (3.4143 => 3.3494, std.dev.: 0.0177)
  SingleSource/Benchmarks/Misc/flops-3: -1.66% (2.0809 => 2.0464, std.dev.: 0.0023)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.61% (52.8418 => 51.9931, std.dev.: 0.0146)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.50% (1.3158 => 1.2960, std.dev.: 0.0007)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.26% (89.3093 => 88.1839, std.dev.: 0.0341)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.26% (1.1828 => 1.1679, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.20% (16.6302 => 16.4303, std.dev.: 0.0525)
  MultiSource/Benchmarks/sim/sim: -1.17% (3.8564 => 3.8113, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -1.16% (3.6942 => 3.6514, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.00% (22.0762 => 21.8553, std.dev.: 0.0774)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.90% (1.1288 => 1.1503, std.dev.: 0.0619)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  MultiSource/Applications/ClamAV/clamscan: 1.42% (0.1477 => 0.1498, std.dev.: 0.0031)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.75% (0.0613 => 0.0590, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -20.65% (0.0276 => 0.0219, std.dev.: 0.0019)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 700.00% (0.0001 => 0.0008, std.dev.: 0.0000)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 7.61% (0.0092 => 0.0099, std.dev.: 0.0004)

Report Time: 1.03s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130430/46512c07/attachment.html>

More information about the llvm-testresults mailing list