[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Nov 29 10:49:15 PST 2012


http://llvm.org/perf/db_default/v4/nts/6388?compare_to=6385&baseline=4940
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6

Comparing:
     Run: 6388, Order: 168900, Start Time: 2012-11-29 17:10:58, End Time: 2012-11-29 18:49:49
      To: 6385, Order: 168887, Start Time: 2012-11-29 15:14:58, End Time: 2012-11-29 16:52:55
Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
New Passes: 0 (28 on baseline)
Performance Regressions: 25 (67 on baseline)
Performance Improvements: 2 (30 on baseline)
Added Tests: 0 (51 on baseline)
Existing Failures: 42 (40 on baseline)
Unchanged Tests: 1025 (876 on baseline)
Total Tests: 1094

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 77.47% (0.0586 => 0.1040, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 63.50% (0.0748 => 0.1223, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 56.62% (0.3264 => 0.5112, std.dev.: 0.0217)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 51.21% (0.0865 => 0.1308, std.dev.: 0.0082)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 45.26% (0.0380 => 0.0552, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 44.58% (0.0895 => 0.1294, std.dev.: 0.0107)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 42.65% (0.1170 => 0.1669, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 27.04% (0.0673 => 0.0855, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/football/football: 20.81% (0.9363 => 1.1311, std.dev.: 0.0050)
  MultiSource/Benchmarks/nbench/nbench: 20.20% (1.2095 => 1.4538, std.dev.: 0.0928)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.22% (4.9348 => 5.7350, std.dev.: 0.2529)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 15.41% (1.2041 => 1.3897, std.dev.: 0.0468)
  MultiSource/Applications/sqlite3/sqlite3: 7.77% (15.5513 => 16.7593, std.dev.: 0.3520)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 6.83% (0.3515 => 0.3755, std.dev.: 0.0081)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.01% (0.7715 => 0.8179, std.dev.: 0.0114)
  MultiSource/Applications/siod/siod: 5.72% (2.3268 => 2.4598, std.dev.: 0.0504)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.57% (0.5439 => 0.5579, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 51.70% (0.0294 => 0.0446, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.56% (2.9746 => 3.1697, std.dev.: 0.0734)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 6.08% (21.6802 => 22.9986, std.dev.: 0.2595)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 4.40% (4.2816 => 4.4698, std.dev.: 0.0628)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.02% (5.5123 => 5.6785, std.dev.: 0.0320)
  SingleSource/Benchmarks/Misc/pi: 2.45% (2.1538 => 2.2066, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.33% (5.0354 => 5.1527, std.dev.: 0.0032)
  SingleSource/Benchmarks/Shootout/methcall: 1.79% (8.2645 => 8.4121, std.dev.: 0.0172)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.71% (1.0072 => 0.9598, std.dev.: 0.0060)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -11.41% (3.0600 => 2.7110, std.dev.: 0.1092)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: 18.69% (1.1346 => 1.3467, std.dev.: 0.1475)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 0.22% (0.3700 => 0.3708, std.dev.: 0.0089)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 16.82% (0.0220 => 0.0257, std.dev.: 0.0044)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.70% (0.0428 => 0.0425, std.dev.: 0.0137)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -0.90% (0.0334 => 0.0331, std.dev.: 0.0100)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -1.90% (0.0315 => 0.0309, std.dev.: 0.0097)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -5.37% (0.0447 => 0.0423, std.dev.: 0.0108)
  SingleSource/UnitTests/Vector/Altivec/casts: -2.40% (0.0208 => 0.0203, std.dev.: 0.0067)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0219 => 0.0219, std.dev.: 0.0057)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/SciMark2-C/scimark2
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002)
  MultiSource/Applications/ClamAV/clamscan: 13.70% (0.1460 => 0.1660, std.dev.: 0.0200)
  MultiSource/Applications/lemon/lemon: 0.04% (1.2237 => 1.2242, std.dev.: 0.2257)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.35% (0.4165 => 0.4067, std.dev.: 0.0250)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.18% (0.1449 => 0.1582, std.dev.: 0.0170)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 14.29% (0.0007 => 0.0008, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.62% (0.0642 => 0.0646, std.dev.: 0.0163)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 12.25% (0.0302 => 0.0339, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.23% (0.0595 => 0.0552, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.03% (1.1523 => 1.1520, std.dev.: 0.0385)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 0.01% (9.4045 => 9.4057, std.dev.: 0.0391)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0030 => 0.0030, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -3.70% (0.0027 => 0.0026, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.50% (0.0605 => 0.0602, std.dev.: 0.0116)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.56% (0.0273 => 0.0266, std.dev.: 0.0075)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.01% (0.8056 => 0.8057, std.dev.: 0.0233)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -8.86% (0.0079 => 0.0072, std.dev.: 0.0044)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -0.37% (34.4951 => 34.3660, std.dev.: 0.2222)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Benchmarks/SciMark2-C/scimark2: -67.09% (28.5821 => 9.4057, std.dev.: 0.0391)

New Passes - Compile Time
-------------------------
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc-C++/bigfib
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/strcat
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/kimwitu++/kc: 17.22% (16.4461 => 19.2786, std.dev.: 0.4387)
  MultiSource/Applications/sqlite3/sqlite3: 2546.76% (0.6332 => 16.7593, std.dev.: 0.3520)
  MultiSource/Benchmarks/McCat/08-main/main: 55.43% (0.1831 => 0.2846, std.dev.: 0.0674)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 0.96% (0.1559 => 0.1574, std.dev.: 0.0201)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7194.97% (0.3123 => 22.7822, std.dev.: 1.1524)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1573.12% (0.3344 => 5.5949, std.dev.: 0.0712)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 40.27% (0.2364 => 0.3316, std.dev.: 0.0069)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.66% (0.6010 => 0.6410, std.dev.: 0.0072)
  SingleSource/Benchmarks/Misc/mandel: 4.20% (0.0429 => 0.0447, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 4.75% (0.3266 => 0.3421, std.dev.: 0.0832)
  SingleSource/Benchmarks/Shootout-C++/strcat: 4.11% (0.1969 => 0.2050, std.dev.: 0.0648)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 7.14% (0.0224 => 0.0240, std.dev.: 0.0001)
  SingleSource/UnitTests/byval-alignment: -26.96% (0.0230 => 0.0168, std.dev.: 0.0059)

New Passes - Execution Time
---------------------------
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc-C++/bigfib
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/strcat
  SingleSource/Regression/C/uint64_to_float
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0523, std.dev.: 0.0050)
  MultiSource/Applications/oggenc/oggenc: 12.59% (0.1462 => 0.1646, std.dev.: 0.0237)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 4.4891, std.dev.: 0.0446)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0689, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.4864, std.dev.: 0.0085)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.5216, std.dev.: 0.0243)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 6.2766, std.dev.: 0.0426)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 5.0946, std.dev.: 0.1503)
  SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.3638, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 1.3783, std.dev.: 0.0195)
  SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0001, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0807, std.dev.: 0.0031)
  SingleSource/Regression/C/uint64_to_float: -29.66% (2.1832 => 1.5356, std.dev.: 0.0037)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0001)
  SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0001)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 80.56% (0.0576 => 0.1040, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 74.47% (0.0701 => 0.1223, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 70.51% (0.2998 => 0.5112, std.dev.: 0.0217)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 62.35% (0.0340 => 0.0552, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 59.12% (0.0822 => 0.1308, std.dev.: 0.0082)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 54.68% (0.1079 => 0.1669, std.dev.: 0.0136)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 52.24% (0.0850 => 0.1294, std.dev.: 0.0107)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 44.53% (0.6010 => 0.8686, std.dev.: 0.0746)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 31.54% (0.0650 => 0.0855, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/football/football: 29.00% (0.8768 => 1.1311, std.dev.: 0.0050)
  MultiSource/Benchmarks/nbench/nbench: 28.99% (1.1271 => 1.4538, std.dev.: 0.0928)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 25.49% (4.5702 => 5.7350, std.dev.: 0.2529)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 24.41% (1.1170 => 1.3897, std.dev.: 0.0468)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 19.70% (0.3137 => 0.3755, std.dev.: 0.0081)
  MultiSource/Benchmarks/Olden/tsp/tsp: 15.65% (0.1112 => 0.1286, std.dev.: 0.0063)
  MultiSource/Applications/siod/siod: 10.88% (2.2184 => 2.4598, std.dev.: 0.0504)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 10.36% (0.8656 => 0.9553, std.dev.: 0.0169)
  MultiSource/Applications/lambda-0_1_3/lambda: 8.23% (0.7557 => 0.8179, std.dev.: 0.0114)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 7.47% (0.5191 => 0.5579, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 6.70% (0.8359 => 0.8919, std.dev.: 0.0117)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.59% (0.8007 => 0.8535, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 6.46% (0.8805 => 0.9374, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.46% (0.8611 => 0.9167, std.dev.: 0.0208)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 6.26% (0.1756 => 0.1866, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 6.06% (0.2378 => 0.2522, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 5.77% (0.9074 => 0.9598, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.17% (0.9039 => 0.9506, std.dev.: 0.0115)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.56% (0.6586 => 0.6886, std.dev.: 0.0101)
  MultiSource/Benchmarks/mafft/pairlocalalign: 4.54% (8.6247 => 9.0161, std.dev.: 0.1046)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.74% (0.2969 => 0.3080, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 97.35% (0.0226 => 0.0446, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/pi: 39.70% (1.5795 => 2.2066, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 33.32% (2.9096 => 3.8792, std.dev.: 0.1546)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 21.24% (4.8436 => 5.8726, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.61% (8.2783 => 9.7357, std.dev.: 0.0350)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 16.72% (14.6451 => 17.0944, std.dev.: 0.2909)
  SingleSource/Benchmarks/McGill/misr: 16.62% (0.4001 => 0.4666, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 11.98% (3.9917 => 4.4698, std.dev.: 0.0628)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.85% (2.7995 => 3.1313, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.51% (6.3772 => 7.0473, std.dev.: 0.1020)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.37% (7.4933 => 8.2706, std.dev.: 0.0397)
  MultiSource/Benchmarks/llubenchmark/llu: 10.05% (1.9967 => 2.1973, std.dev.: 0.0695)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 10.02% (1.1857 => 1.3045, std.dev.: 0.0015)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 7.37% (23.5781 => 25.3156, std.dev.: 0.0209)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 6.54% (4.8362 => 5.1527, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.43% (2.9753 => 3.1667, std.dev.: 0.0619)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 6.36% (3.3761 => 3.5909, std.dev.: 0.0645)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.87% (4.8660 => 5.1515, std.dev.: 0.0584)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.83% (4.5327 => 4.7971, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.82% (5.4187 => 5.7343, std.dev.: 0.0381)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.27% (5.3218 => 5.6024, std.dev.: 0.0372)
  MultiSource/Applications/aha/aha: 5.27% (3.3398 => 3.5157, std.dev.: 0.0186)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 5.26% (0.3937 => 0.4144, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 5.24% (0.4353 => 0.4581, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/richards_benchmark: 4.23% (1.3037 => 1.3589, std.dev.: 0.0209)
  MultiSource/Benchmarks/Olden/power/power: 3.61% (1.2061 => 1.2497, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.13% (22.2997 => 22.9986, std.dev.: 0.2595)
  SingleSource/Benchmarks/Misc/whetstone: 2.88% (2.1224 => 2.1835, std.dev.: 0.0156)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.33% (3.4104 => 3.4897, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/bh/bh: 2.23% (2.3560 => 2.4086, std.dev.: 0.0198)
  SingleSource/Benchmarks/McGill/queens: 2.20% (1.7056 => 1.7431, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.11% (11.5690 => 11.8126, std.dev.: 0.0492)
  MultiSource/Applications/spiff/spiff: 1.88% (2.8561 => 2.9097, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/methcall: 1.75% (8.2676 => 8.4121, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.68% (4.9469 => 5.0301, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc/ReedSolomon: 1.36% (8.5322 => 8.6485, std.dev.: 0.0139)
  SingleSource/Benchmarks/Misc/flops-7: 1.19% (1.7156 => 1.7360, std.dev.: 0.0004)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/mandel-2: -42.19% (2.8951 => 1.6736, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -21.27% (7.2130 => 5.6785, std.dev.: 0.0320)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -19.88% (1.4529 => 1.1641, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -16.80% (9.9065 => 8.2420, std.dev.: 0.0111)
  MultiSource/Benchmarks/Olden/em3d/em3d: -12.67% (5.4641 => 4.7719, std.dev.: 0.1152)
  SingleSource/Benchmarks/Misc/flops-8: -9.76% (2.5609 => 2.3109, std.dev.: 0.0050)
  SingleSource/Benchmarks/McGill/chomp: -9.47% (1.1216 => 1.0154, std.dev.: 0.0032)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.83% (63.1822 => 57.6011, std.dev.: 0.1044)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -7.71% (1.0512 => 0.9701, std.dev.: 0.0228)
  SingleSource/Benchmarks/Stanford/FloatMM: -6.63% (0.8807 => 0.8223, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/ffbench: -6.25% (1.4296 => 1.3403, std.dev.: 0.0218)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.19% (4.7482 => 4.4545, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/sieve: -6.02% (7.0599 => 6.6348, std.dev.: 0.0355)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.93% (5.1305 => 4.8264, std.dev.: 0.0158)
  SingleSource/Benchmarks/Misc/flops: -5.51% (9.3748 => 8.8585, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -5.29% (6.2275 => 5.8979, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -4.84% (5.6343 => 5.3615, std.dev.: 0.0197)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -4.57% (4.3552 => 4.1561, std.dev.: 0.0528)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.32% (6.1706 => 5.9043, std.dev.: 0.0287)
  SingleSource/Benchmarks/Shootout-C++/methcall: -3.81% (8.9760 => 8.6340, std.dev.: 0.0218)
  SingleSource/Benchmarks/Misc/perlin: -3.73% (5.1084 => 4.9181, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.63% (5.1557 => 4.9687, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.55% (4.7449 => 4.5763, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.28% (4.9686 => 4.8054, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -3.15% (5.4300 => 5.2587, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/fbench: -2.54% (3.3840 => 3.2982, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc/flops-5: -1.80% (2.8957 => 2.8435, std.dev.: 0.0062)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.69% (3.5679 => 3.5075, std.dev.: 0.0074)
  SingleSource/Benchmarks/Misc/fp-convert: -1.61% (15.8853 => 15.6302, std.dev.: 0.0373)
  MultiSource/Benchmarks/FreeBench/neural/neural: -1.48% (1.0841 => 1.0681, std.dev.: 0.0023)

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc
  SingleSource/Benchmarks/LivermoreLoops/kernel01
  SingleSource/Benchmarks/LivermoreLoops/kernel02
  SingleSource/Benchmarks/LivermoreLoops/kernel03
  SingleSource/Benchmarks/LivermoreLoops/kernel04
  SingleSource/Benchmarks/LivermoreLoops/kernel05
  SingleSource/Benchmarks/LivermoreLoops/kernel06
  SingleSource/Benchmarks/LivermoreLoops/kernel07
  SingleSource/Benchmarks/LivermoreLoops/kernel08
  SingleSource/Benchmarks/LivermoreLoops/kernel09
  SingleSource/Benchmarks/LivermoreLoops/kernel10
  SingleSource/Benchmarks/LivermoreLoops/kernel11
  SingleSource/Benchmarks/LivermoreLoops/kernel12
  SingleSource/Benchmarks/LivermoreLoops/kernel13
  SingleSource/Benchmarks/LivermoreLoops/kernel14
  SingleSource/Benchmarks/LivermoreLoops/kernel15
  SingleSource/Benchmarks/LivermoreLoops/kernel16
  SingleSource/Benchmarks/LivermoreLoops/kernel17
  SingleSource/Benchmarks/LivermoreLoops/kernel18
  SingleSource/Benchmarks/LivermoreLoops/kernel19
  SingleSource/Benchmarks/LivermoreLoops/kernel20
  SingleSource/Benchmarks/LivermoreLoops/kernel21
  SingleSource/Benchmarks/LivermoreLoops/kernel22
  SingleSource/Benchmarks/LivermoreLoops/kernel23
  SingleSource/Benchmarks/LivermoreLoops/kernel24
  SingleSource/UnitTests/Vectorizer/gcc-loops

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc
  SingleSource/Benchmarks/LivermoreLoops/kernel01
  SingleSource/Benchmarks/LivermoreLoops/kernel02
  SingleSource/Benchmarks/LivermoreLoops/kernel03
  SingleSource/Benchmarks/LivermoreLoops/kernel04
  SingleSource/Benchmarks/LivermoreLoops/kernel05
  SingleSource/Benchmarks/LivermoreLoops/kernel06
  SingleSource/Benchmarks/LivermoreLoops/kernel07
  SingleSource/Benchmarks/LivermoreLoops/kernel08
  SingleSource/Benchmarks/LivermoreLoops/kernel09
  SingleSource/Benchmarks/LivermoreLoops/kernel10
  SingleSource/Benchmarks/LivermoreLoops/kernel11
  SingleSource/Benchmarks/LivermoreLoops/kernel12
  SingleSource/Benchmarks/LivermoreLoops/kernel13
  SingleSource/Benchmarks/LivermoreLoops/kernel14
  SingleSource/Benchmarks/LivermoreLoops/kernel15
  SingleSource/Benchmarks/LivermoreLoops/kernel16
  SingleSource/Benchmarks/LivermoreLoops/kernel17
  SingleSource/Benchmarks/LivermoreLoops/kernel18
  SingleSource/Benchmarks/LivermoreLoops/kernel19
  SingleSource/Benchmarks/LivermoreLoops/kernel20
  SingleSource/Benchmarks/LivermoreLoops/kernel21
  SingleSource/Benchmarks/LivermoreLoops/kernel22
  SingleSource/Benchmarks/LivermoreLoops/kernel23
  SingleSource/Benchmarks/LivermoreLoops/kernel24

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/obsequi/Obsequi: 31.23% (1.0262 => 1.3467, std.dev.: 0.1475)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 50.55% (0.2463 => 0.3708, std.dev.: 0.0089)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 108.94% (0.0123 => 0.0257, std.dev.: 0.0044)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.17% (0.0408 => 0.0425, std.dev.: 0.0137)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 30.31% (0.0254 => 0.0331, std.dev.: 0.0100)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 2.32% (0.0302 => 0.0309, std.dev.: 0.0097)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 10.16% (0.0384 => 0.0423, std.dev.: 0.0108)
  SingleSource/UnitTests/Vector/Altivec/casts: 6.84% (0.0190 => 0.0203, std.dev.: 0.0067)
  SingleSource/UnitTests/Vector/Altivec/test1: 21.67% (0.0180 => 0.0219, std.dev.: 0.0057)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: 100.00% (0.0007 => 0.0014, std.dev.: 0.0002)
  MultiSource/Applications/ClamAV/clamscan: 15.44% (0.1438 => 0.1660, std.dev.: 0.0200)
  MultiSource/Applications/lemon/lemon: 8.06% (1.1329 => 1.2242, std.dev.: 0.2257)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.33% (0.4164 => 0.4067, std.dev.: 0.0250)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 15.56% (0.1369 => 0.1582, std.dev.: 0.0170)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 0.78% (0.0641 => 0.0646, std.dev.: 0.0163)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 73.85% (0.0195 => 0.0339, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -4.50% (0.0578 => 0.0552, std.dev.: 0.0032)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.73% (1.1437 => 1.1520, std.dev.: 0.0385)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 2900.00% (0.0001 => 0.0030, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 85.71% (0.0014 => 0.0026, std.dev.: 0.0001)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.99% (0.0627 => 0.0602, std.dev.: 0.0116)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 47.78% (0.0180 => 0.0266, std.dev.: 0.0075)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 0.50% (0.8017 => 0.8057, std.dev.: 0.0233)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0001)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 16.13% (0.0062 => 0.0072, std.dev.: 0.0044)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000, std.dev.: 0.0000)

Report Time: 2.09s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20121129/8b062a55/attachment.html>


More information about the llvm-testresults mailing list