[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Fri Mar 15 10:36:02 PDT 2013
http://llvm.org/perf/db_default/v4/nts/9443?compare_to=9440&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11
Comparing:
Run: 9443, Order: 177160, Start Time: 2013-03-15 15:55:18, End Time: 2013-03-15 17:36:41
To: 9440, Order: 177152, Start Time: 2013-03-15 13:49:13, End Time: 2013-03-15 15:33:56
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00
===============
Tests Summary
===============
New Failures: 43 (43 on baseline)
New Passes: 0 (3 on baseline)
Performance Regressions: 19 (22 on baseline)
Performance Improvements: 21 (26 on baseline)
Existing Failures: 29 (29 on baseline)
Unchanged Tests: 992 (981 on baseline)
Total Tests: 1104
===========================
Run-Over-Run Changes Detail
===========================
New Failures - Compile Time
---------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/JM/ldecod/ldecod
MultiSource/Applications/JM/lencod/lencod
MultiSource/Applications/SPASS/SPASS
MultiSource/Applications/hbd/hbd
MultiSource/Applications/minisat/minisat
MultiSource/Applications/oggenc/oggenc
MultiSource/Benchmarks/Bullet/bullet
MultiSource/Benchmarks/MallocBench/espresso/espresso
MultiSource/Benchmarks/MallocBench/gs/gs
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/PAQ8p/paq8p
MultiSource/Benchmarks/Prolangs-C++/employ/employ
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
MultiSource/Benchmarks/VersaBench/dbms/dbms
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant
SingleSource/Benchmarks/Shootout-C++/hash
MultiSource/Applications/ClamAV/clamscan: -0.02% (16.6925 => 16.6892, std.dev.: 0.1653)
MultiSource/Applications/JM/ldecod/ldecod: -1.21% (7.6934 => 7.6005, std.dev.: 0.2640)
MultiSource/Applications/JM/lencod/lencod: -2.08% (17.8735 => 17.5014, std.dev.: 0.3958)
MultiSource/Applications/SPASS/SPASS: -0.08% (16.9051 => 16.8911, std.dev.: 0.4820)
MultiSource/Applications/hbd/hbd: -1.41% (1.6012 => 1.5786, std.dev.: 0.1580)
MultiSource/Applications/minisat/minisat: -7.83% (0.7722 => 0.7117, std.dev.: 0.0366)
MultiSource/Applications/oggenc/oggenc: -85.59% (5.5214 => 0.7956, std.dev.: 2.2895)
MultiSource/Benchmarks/Bullet/bullet: -1.62% (34.7929 => 34.2276, std.dev.: 0.7778)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.23% (5.4774 => 5.4103, std.dev.: 0.5309)
MultiSource/Benchmarks/MallocBench/gs/gs: 0.10% (4.5512 => 4.5556, std.dev.: 0.4576)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -1.20% (15.2361 => 15.0531, std.dev.: 0.5695)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.07% (1.3410 => 1.3401, std.dev.: 0.0118)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -12.39% (0.2906 => 0.2546, std.dev.: 0.0203)
MultiSource/Benchmarks/PAQ8p/paq8p: -97.50% (2.5850 => 0.0646, std.dev.: 1.2168)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: -67.23% (0.3335 => 0.1093, std.dev.: 0.1056)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -0.41% (9.7855 => 9.7453, std.dev.: 0.6064)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.10% (0.9444 => 0.9548, std.dev.: 0.0452)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -0.35% (5.0191 => 5.0014, std.dev.: 0.4898)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.87% (1.5574 => 1.5127, std.dev.: 0.0619)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.35% (26.7517 => 0.1735, std.dev.: 13.0348)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -95.52% (1.8571 => 0.0832, std.dev.: 0.8936)
SingleSource/Benchmarks/Shootout-C++/hash: -75.53% (0.4242 => 0.1038, std.dev.: 0.1894)
New Failures - Execution Time
-----------------------------
MultiSource/Applications/JM/ldecod/ldecod
MultiSource/Applications/JM/lencod/lencod
MultiSource/Applications/SPASS/SPASS
MultiSource/Applications/hbd/hbd
MultiSource/Applications/minisat/minisat
MultiSource/Applications/oggenc/oggenc
MultiSource/Benchmarks/Bullet/bullet
MultiSource/Benchmarks/MallocBench/espresso/espresso
MultiSource/Benchmarks/MallocBench/gs/gs
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/PAQ8p/paq8p
MultiSource/Benchmarks/Prolangs-C++/employ/employ
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
MultiSource/Benchmarks/VersaBench/dbms/dbms
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant
SingleSource/Benchmarks/Shootout-C++/hash
MultiSource/Applications/JM/ldecod/ldecod: -100.00% (0.0646 => 0.0000, std.dev.: 0.0000)
MultiSource/Applications/JM/lencod/lencod: -100.00% (7.2596 => 0.0000, std.dev.: 0.0000)
MultiSource/Applications/SPASS/SPASS: -100.00% (8.2135 => 0.0001, std.dev.: 4.2365)
MultiSource/Applications/hbd/hbd: -100.00% (0.0029 => 0.0000, std.dev.: 0.0014)
MultiSource/Applications/minisat/minisat: -100.00% (6.1911 => 0.0000, std.dev.: 3.1447)
MultiSource/Applications/oggenc/oggenc: -100.00% (0.1821 => 0.0000, std.dev.: 0.0874)
MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.0769 => 0.0000, std.dev.: 3.3294)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -100.00% (0.6661 => 0.0000, std.dev.: 0.2977)
MultiSource/Benchmarks/MallocBench/gs/gs: -100.00% (0.0643 => 0.0000, std.dev.: 0.0346)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -100.00% (0.3583 => 0.0000, std.dev.: 0.1689)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.96% (0.2771 => 0.0001, std.dev.: 0.1296)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -100.00% (0.3386 => 0.0000, std.dev.: 0.1629)
MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (91.1763 => 0.0001, std.dev.: 44.4291)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: -100.00% (0.0116 => 0.0000, std.dev.: 0.0055)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -100.00% (2.3430 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -100.00% (0.0008 => 0.0000, std.dev.: 0.0024)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -100.00% (0.0345 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.98% (0.5238 => 0.0001, std.dev.: 0.2493)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -100.00% (3.8630 => 0.0001, std.dev.: 1.7527)
SingleSource/Benchmarks/Shootout-C++/hash: -100.00% (0.6300 => 0.0000, std.dev.: 0.3132)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Misc/fp-convert: 22.15% (5.7041 => 6.9673, std.dev.: 0.0134)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.94% (4.4273 => 5.0886, std.dev.: 0.0170)
MultiSource/Applications/sgefa/sgefa: 11.15% (1.2186 => 1.3545, std.dev.: 0.0031)
MultiSource/Applications/hexxagon/hexxagon: 10.20% (14.4691 => 15.9443, std.dev.: 0.2676)
MultiSource/Benchmarks/mafft/pairlocalalign: 6.85% (59.6082 => 63.6939, std.dev.: 0.4826)
SingleSource/Benchmarks/Shootout/strcat: 6.54% (0.1575 => 0.1678, std.dev.: 0.0008)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.46% (4.1137 => 4.3795, std.dev.: 0.0119)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 6.15% (1.8150 => 1.9267, std.dev.: 0.0059)
SingleSource/Benchmarks/Misc/richards_benchmark: 4.01% (1.3354 => 1.3890, std.dev.: 0.0097)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.00% (8.7595 => 9.1097, std.dev.: 0.0041)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.84% (3.3542 => 3.4829, std.dev.: 0.0055)
MultiSource/Applications/lambda-0_1_3/lambda: 3.65% (6.9966 => 7.2518, std.dev.: 0.0535)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.75% (0.4109 => 0.4222, std.dev.: 0.0008)
SingleSource/Benchmarks/Shootout/methcall: 1.67% (8.5467 => 8.6895, std.dev.: 0.0132)
SingleSource/Benchmarks/Misc/ReedSolomon: 1.52% (9.0801 => 9.2179, std.dev.: 0.0071)
SingleSource/Regression/C/uint64_to_float: 1.48% (1.7415 => 1.7673, std.dev.: 0.0082)
MultiSource/Benchmarks/NPB-serial/is/is: 1.32% (13.1553 => 13.3283, std.dev.: 0.0443)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.26% (3.3475 => 3.3898, std.dev.: 0.0039)
MultiSource/Applications/siod/siod: 1.07% (3.4893 => 3.5265, std.dev.: 0.0081)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.24% (0.1172 => 0.0970, std.dev.: 0.0011)
SingleSource/Benchmarks/Misc-C++/bigfib: -2.19% (0.7025 => 0.6871, std.dev.: 0.0035)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.36% (1.9423 => 1.9158, std.dev.: 0.0082)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/mason/mason: -43.32% (0.5215 => 0.2956, std.dev.: 0.0324)
SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -31.39% (0.0790 => 0.0542, std.dev.: 0.0016)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.79% (1.6823 => 1.2485, std.dev.: 0.0270)
SingleSource/Benchmarks/McGill/misr: -19.72% (0.4838 => 0.3884, std.dev.: 0.0077)
SingleSource/Benchmarks/McGill/queens: -8.30% (1.8018 => 1.6522, std.dev.: 0.0153)
SingleSource/Benchmarks/McGill/chomp: -8.29% (1.1216 => 1.0286, std.dev.: 0.0130)
MultiSource/Benchmarks/Prolangs-C++/life/life: -4.75% (2.6528 => 2.5269, std.dev.: 0.0341)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.62% (5.1043 => 4.9193, std.dev.: 0.0045)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.32% (3.9136 => 3.7835, std.dev.: 0.0225)
MultiSource/Benchmarks/Ptrdist/ks/ks: -3.16% (1.1582 => 1.1216, std.dev.: 0.0015)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.02% (4.8647 => 4.7177, std.dev.: 0.0076)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.00% (6.2448 => 6.0576, std.dev.: 0.0448)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.59% (3.7580 => 3.6606, std.dev.: 0.0297)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.58% (2.8056 => 2.7331, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.36% (3.6918 => 3.6048, std.dev.: 0.0041)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.05% (5.7795 => 5.6610, std.dev.: 0.0057)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.38% (4.3335 => 4.2737, std.dev.: 0.0059)
SingleSource/Benchmarks/Shootout/matrix: -1.04% (1.5734 => 1.5571, std.dev.: 0.0015)
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: 3.02% (1.1479 => 1.1826, std.dev.: 0.1189)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
MultiSource/Benchmarks/Ptrdist/anagram/anagram
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vectorizer/gcc-loops
MultiSource/Applications/ALAC/decode/alacconvert-decode: 10.48% (0.0229 => 0.0253, std.dev.: 0.0053)
MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
MultiSource/Applications/ClamAV/clamscan: -100.00% (0.1471 => 0.0000, std.dev.: 0.0704)
MultiSource/Applications/lemon/lemon: -2.85% (1.1676 => 1.1343, std.dev.: 0.3400)
MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1111 => 0.1111, std.dev.: 0.0071)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.96% (0.0605 => 0.0635, std.dev.: 0.0028)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.37% (0.0268 => 0.0267, std.dev.: 0.0002)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.88% (1.1664 => 1.3050, std.dev.: 0.0162)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 61.11% (0.0018 => 0.0029, std.dev.: 0.0006)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.37% (0.0595 => 0.0621, std.dev.: 0.0000)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.36% (0.0294 => 0.0290, std.dev.: 0.0060)
SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/Regression/C/2003-05-21-UnionTest: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/SignlessTypes/Large/cast: -31.53% (0.0111 => 0.0076, std.dev.: 0.0043)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -85.71% (0.0007 => 0.0001, std.dev.: 0.0002)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.47% (29.4560 => 29.3170, std.dev.: 1.5585)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0001 => 0.0001, std.dev.: 0.0024)
SingleSource/UnitTests/Vector/Altivec/casts: -85.71% (0.0007 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/test1: 600.00% (0.0001 => 0.0007, std.dev.: 0.0002)
SingleSource/UnitTests/Vectorizer/gcc-loops: 1.20% (26.4995 => 26.8187, std.dev.: 0.2710)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Compile Time
---------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/JM/ldecod/ldecod
MultiSource/Applications/JM/lencod/lencod
MultiSource/Applications/SPASS/SPASS
MultiSource/Applications/hbd/hbd
MultiSource/Applications/minisat/minisat
MultiSource/Applications/oggenc/oggenc
MultiSource/Benchmarks/Bullet/bullet
MultiSource/Benchmarks/MallocBench/espresso/espresso
MultiSource/Benchmarks/MallocBench/gs/gs
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/PAQ8p/paq8p
MultiSource/Benchmarks/Prolangs-C++/employ/employ
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
MultiSource/Benchmarks/VersaBench/dbms/dbms
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant
SingleSource/Benchmarks/Shootout-C++/hash
MultiSource/Applications/ClamAV/clamscan: 3.13% (16.1821 => 16.6892, std.dev.: 0.1653)
MultiSource/Applications/JM/ldecod/ldecod: 4.88% (7.2467 => 7.6005, std.dev.: 0.2640)
MultiSource/Applications/JM/lencod/lencod: 4.67% (16.7203 => 17.5014, std.dev.: 0.3958)
MultiSource/Applications/SPASS/SPASS: 3.43% (16.3304 => 16.8911, std.dev.: 0.4820)
MultiSource/Applications/hbd/hbd: 3.13% (1.5307 => 1.5786, std.dev.: 0.1580)
MultiSource/Applications/minisat/minisat: -5.79% (0.7554 => 0.7117, std.dev.: 0.0366)
MultiSource/Applications/oggenc/oggenc: -85.41% (5.4527 => 0.7956, std.dev.: 2.2895)
MultiSource/Benchmarks/Bullet/bullet: 0.88% (33.9296 => 34.2276, std.dev.: 0.7778)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 0.57% (5.3794 => 5.4103, std.dev.: 0.5309)
MultiSource/Benchmarks/MallocBench/gs/gs: 2.41% (4.4482 => 4.5556, std.dev.: 0.4576)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.96% (14.7643 => 15.0531, std.dev.: 0.5695)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.65% (1.3183 => 1.3401, std.dev.: 0.0118)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -8.02% (0.2768 => 0.2546, std.dev.: 0.0203)
MultiSource/Benchmarks/PAQ8p/paq8p: -97.42% (2.4999 => 0.0646, std.dev.: 1.2168)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: -67.35% (0.3348 => 0.1093, std.dev.: 0.1056)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 2.91% (9.4701 => 9.7453, std.dev.: 0.6064)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.32% (0.9066 => 0.9548, std.dev.: 0.0452)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.51% (4.8791 => 5.0014, std.dev.: 0.4898)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.03% (1.5284 => 1.5127, std.dev.: 0.0619)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.27% (23.8286 => 0.1735, std.dev.: 13.0348)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -95.51% (1.8524 => 0.0832, std.dev.: 0.8936)
SingleSource/Benchmarks/Shootout-C++/hash: -75.75% (0.4280 => 0.1038, std.dev.: 0.1894)
New Failures - Execution Time
-----------------------------
MultiSource/Applications/JM/ldecod/ldecod
MultiSource/Applications/JM/lencod/lencod
MultiSource/Applications/SPASS/SPASS
MultiSource/Applications/hbd/hbd
MultiSource/Applications/minisat/minisat
MultiSource/Applications/oggenc/oggenc
MultiSource/Benchmarks/Bullet/bullet
MultiSource/Benchmarks/MallocBench/espresso/espresso
MultiSource/Benchmarks/MallocBench/gs/gs
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/PAQ8p/paq8p
MultiSource/Benchmarks/Prolangs-C++/employ/employ
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc
MultiSource/Benchmarks/VersaBench/dbms/dbms
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant
SingleSource/Benchmarks/Shootout-C++/hash
MultiSource/Applications/JM/ldecod/ldecod: -100.00% (0.0654 => 0.0000, std.dev.: 0.0000)
MultiSource/Applications/JM/lencod/lencod: -100.00% (7.1542 => 0.0000, std.dev.: 0.0000)
MultiSource/Applications/SPASS/SPASS: -100.00% (8.4733 => 0.0001, std.dev.: 4.2365)
MultiSource/Applications/hbd/hbd: -100.00% (0.0029 => 0.0000, std.dev.: 0.0014)
MultiSource/Applications/minisat/minisat: -100.00% (6.1945 => 0.0000, std.dev.: 3.1447)
MultiSource/Applications/oggenc/oggenc: -100.00% (0.1826 => 0.0000, std.dev.: 0.0874)
MultiSource/Benchmarks/Bullet/bullet: -100.00% (7.1351 => 0.0000, std.dev.: 3.3294)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -100.00% (0.6582 => 0.0000, std.dev.: 0.2977)
MultiSource/Benchmarks/MallocBench/gs/gs: -100.00% (0.0608 => 0.0000, std.dev.: 0.0346)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -100.00% (0.3539 => 0.0000, std.dev.: 0.1689)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -99.97% (0.3279 => 0.0001, std.dev.: 0.1296)
MultiSource/Benchmarks/Olden/voronoi/voronoi: -100.00% (0.3400 => 0.0000, std.dev.: 0.1629)
MultiSource/Benchmarks/PAQ8p/paq8p: -100.00% (90.5803 => 0.0001, std.dev.: 44.4291)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: -100.00% (0.0116 => 0.0000, std.dev.: 0.0055)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -100.00% (0.0001 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/VersaBench/dbms/dbms: -100.00% (2.5659 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -100.00% (0.0008 => 0.0000, std.dev.: 0.0024)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -100.00% (0.0352 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -99.98% (0.5182 => 0.0001, std.dev.: 0.2493)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -100.00% (3.9434 => 0.0001, std.dev.: 1.7527)
SingleSource/Benchmarks/Shootout-C++/hash: -100.00% (0.6540 => 0.0000, std.dev.: 0.3132)
New Passes - Execution Time
---------------------------
MultiSource/Benchmarks/McCat/12-IOtest/iotest
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
SingleSource/Benchmarks/BenchmarkGame/puzzle
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.16% (0.4125 => 0.4338, std.dev.: 0.0617)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -9.50% (0.0663 => 0.0600, std.dev.: 0.0013)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.70% (1.6803 => 1.2485, std.dev.: 0.0270)
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.59% (0.7182 => 0.7512, std.dev.: 0.0005)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.62% (1.8668 => 1.9158, std.dev.: 0.0082)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.56% (4.5532 => 4.6244, std.dev.: 0.0205)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/ary2: 54.78% (0.0314 => 0.0486, std.dev.: 0.0035)
SingleSource/Benchmarks/Misc/fp-convert: 22.66% (5.6800 => 6.9673, std.dev.: 0.0134)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.90% (4.4289 => 5.0886, std.dev.: 0.0170)
MultiSource/Applications/sgefa/sgefa: 11.17% (1.2184 => 1.3545, std.dev.: 0.0031)
MultiSource/Benchmarks/mafft/pairlocalalign: 10.69% (57.5400 => 63.6939, std.dev.: 0.4826)
MultiSource/Applications/hexxagon/hexxagon: 10.12% (14.4795 => 15.9443, std.dev.: 0.2676)
SingleSource/Benchmarks/Misc/pi: 7.91% (2.0512 => 2.2135, std.dev.: 0.0615)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.90% (4.0968 => 4.3795, std.dev.: 0.0119)
SingleSource/Benchmarks/Shootout/strcat: 6.74% (0.1572 => 0.1678, std.dev.: 0.0008)
SingleSource/Regression/C/uint64_to_float: 4.90% (1.6847 => 1.7673, std.dev.: 0.0082)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.10% (8.7510 => 9.1097, std.dev.: 0.0041)
MultiSource/Applications/lambda-0_1_3/lambda: 3.75% (6.9897 => 7.2518, std.dev.: 0.0535)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.60% (3.3618 => 3.4829, std.dev.: 0.0055)
SingleSource/Benchmarks/Misc/richards_benchmark: 3.55% (1.3414 => 1.3890, std.dev.: 0.0097)
MultiSource/Applications/siod/siod: 3.29% (3.4143 => 3.5265, std.dev.: 0.0081)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.70% (0.4111 => 0.4222, std.dev.: 0.0008)
SingleSource/Benchmarks/Shootout/methcall: 2.66% (8.4644 => 8.6895, std.dev.: 0.0132)
SingleSource/Benchmarks/Misc/ReedSolomon: 2.02% (9.0356 => 9.2179, std.dev.: 0.0071)
SingleSource/Benchmarks/Shootout/fib2: 1.06% (4.9040 => 4.9561, std.dev.: 0.0032)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C/sumarraymalloc: -50.86% (0.0810 => 0.0398, std.dev.: 0.0127)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.52% (0.1176 => 0.0970, std.dev.: 0.0011)
SingleSource/Benchmarks/McGill/chomp: -10.58% (0.1957 => 0.1750, std.dev.: 0.0008)
MultiSource/Applications/lemon/lemon: -6.08% (1.2932 => 1.2146, std.dev.: 0.0290)
SingleSource/Benchmarks/Misc-C++/bigfib: -1.62% (0.6984 => 0.6871, std.dev.: 0.0035)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/mason/mason: -43.30% (0.5213 => 0.2956, std.dev.: 0.0324)
SingleSource/Benchmarks/Shootout-C++/ary3: -30.62% (2.0100 => 1.3945, std.dev.: 0.1997)
SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -28.31% (0.0756 => 0.0542, std.dev.: 0.0016)
SingleSource/Benchmarks/McGill/misr: -17.87% (0.4729 => 0.3884, std.dev.: 0.0077)
SingleSource/Benchmarks/McGill/queens: -7.84% (1.7928 => 1.6522, std.dev.: 0.0153)
SingleSource/Benchmarks/Dhrystone/dry: -7.31% (0.5278 => 0.4892, std.dev.: 0.0149)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -4.61% (3.8286 => 3.6520, std.dev.: 0.0384)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.97% (5.8948 => 5.6610, std.dev.: 0.0057)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.55% (5.1006 => 4.9193, std.dev.: 0.0045)
MultiSource/Benchmarks/Ptrdist/ks/ks: -3.19% (1.1586 => 1.1216, std.dev.: 0.0015)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.01% (4.8642 => 4.7177, std.dev.: 0.0076)
MultiSource/Applications/SIBsim4/SIBsim4: -2.91% (3.4205 => 3.3210, std.dev.: 0.0302)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.84% (6.2349 => 6.0576, std.dev.: 0.0448)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -2.84% (3.8940 => 3.7835, std.dev.: 0.0225)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.56% (3.7569 => 3.6606, std.dev.: 0.0297)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.42% (3.6942 => 3.6048, std.dev.: 0.0041)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.23% (4.3713 => 4.2737, std.dev.: 0.0059)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.20% (40.0804 => 39.1982, std.dev.: 0.3053)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -2.01% (2.7893 => 2.7331, std.dev.: 0.0065)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.00% (1.9660 => 1.9267, std.dev.: 0.0059)
SingleSource/Benchmarks/Misc-C++/Large/ray: -1.27% (4.9678 => 4.9049, std.dev.: 0.0043)
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: 4.77% (1.1288 => 1.1826, std.dev.: 0.1189)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
MultiSource/Benchmarks/Ptrdist/anagram/anagram
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
SingleSource/UnitTests/Vectorizer/gcc-loops
MultiSource/Applications/ALAC/decode/alacconvert-decode: 2.02% (0.0248 => 0.0253, std.dev.: 0.0053)
MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013, std.dev.: 0.0000)
MultiSource/Applications/ClamAV/clamscan: -100.00% (0.1477 => 0.0000, std.dev.: 0.0704)
MultiSource/Applications/lemon/lemon: -3.82% (1.1794 => 1.1343, std.dev.: 0.3400)
MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -15.13% (0.1309 => 0.1111, std.dev.: 0.0071)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 3.59% (0.0613 => 0.0635, std.dev.: 0.0028)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -3.26% (0.0276 => 0.0267, std.dev.: 0.0002)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.92% (1.1660 => 1.3050, std.dev.: 0.0162)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029, std.dev.: 0.0006)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0006)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.55% (0.0594 => 0.0621, std.dev.: 0.0000)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.67% (0.0361 => 0.0290, std.dev.: 0.0060)
SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/SignlessTypes/Large/cast: -17.39% (0.0092 => 0.0076, std.dev.: 0.0043)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0002)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.60% (29.7937 => 29.3170, std.dev.: 1.5585)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0024)
SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001)
SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0002)
SingleSource/UnitTests/Vectorizer/gcc-loops: -0.38% (26.9213 => 26.8187, std.dev.: 0.2710)
Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130315/5a6cbd4b/attachment.html>
More information about the llvm-testresults
mailing list