[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 21 21:56:08 PDT 2012


http://llvm.org/perf/db_default/v4/nts/5087?compare_to=5086&baseline=4940
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:6

Comparing:
     Run: 5087, Order: 166407, Start Time: 2012-10-22 03:34:13, End Time: 2012-10-22 04:58:10
      To: 5086, Order: 166405, Start Time: 2012-10-22 01:06:27, End Time: 2012-10-22 03:17:08
Baseline: 4940, Order: 166107, Start Time: 2012-10-17 21:14:35, End Time: 2012-10-17 22:37:44

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 46 (1 on baseline)
Performance Regressions: 16 (37 on baseline)
Performance Improvements: 6 (6 on baseline)
Existing Failures: 68 (67 on baseline)
Unchanged Tests: 906 (930 on baseline)
Total Tests: 1042

===========================
Run-Over-Run Changes Detail
===========================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/JM/lencod/lencod
  MultiSource/Applications/SIBsim4/SIBsim4
  MultiSource/Applications/d/make_dparser
  MultiSource/Applications/lua/lua
  MultiSource/Applications/minisat/minisat
  MultiSource/Applications/treecc/treecc
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000
  MultiSource/Benchmarks/Bullet/bullet
  MultiSource/Benchmarks/FreeBench/distray/distray
  MultiSource/Benchmarks/MallocBench/espresso/espresso
  MultiSource/Benchmarks/MallocBench/gs/gs
  MultiSource/Benchmarks/McCat/09-vor/vor
  MultiSource/Benchmarks/McCat/18-imp/imp
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32
  MultiSource/Benchmarks/Olden/bh/bh
  MultiSource/Benchmarks/Olden/health/health
  MultiSource/Benchmarks/Olden/mst/mst
  MultiSource/Benchmarks/Olden/power/power
  MultiSource/Benchmarks/Olden/voronoi/voronoi
  MultiSource/Benchmarks/Prolangs-C++/city/city
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo
  MultiSource/Benchmarks/Ptrdist/bc/bc
  MultiSource/Benchmarks/VersaBench/dbms/dbms
  SingleSource/Benchmarks/Adobe-C++/loop_unroll
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm
  SingleSource/Benchmarks/CoyoteBench/almabench
  SingleSource/Benchmarks/McGill/chomp
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake
  SingleSource/Benchmarks/Misc-C++/stepanov_container
  SingleSource/Benchmarks/Misc/mandel-2
  SingleSource/Benchmarks/Misc/matmul_f64_4x4
  SingleSource/Benchmarks/Shootout-C++/hash
  SingleSource/Benchmarks/Shootout-C++/hash2
  SingleSource/Benchmarks/Shootout-C++/moments
  SingleSource/Regression/C++/EH/function_try_block
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas
  SingleSource/Regression/C/DuffsDevice
  SingleSource/UnitTests/2008-04-18-LoopBug
  SingleSource/UnitTests/2008-04-20-LoopBug2
  SingleSource/UnitTests/2008-07-13-InlineSetjmp
  MultiSource/Applications/JM/lencod/lencod: 333565.00% (0.0020 => 6.6733, std.dev.: 0.0082)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.82% (3.3872 => 3.1900, std.dev.: 0.0159)
  MultiSource/Applications/d/make_dparser: 33100.00% (0.0001 => 0.0332, std.dev.: 0.0027)
  MultiSource/Applications/lua/lua: 28597900.00% (0.0001 => 28.5980, std.dev.: 0.0034)
  MultiSource/Applications/minisat/minisat: 6965.80% (0.0883 => 6.2391, std.dev.: 0.0043)
  MultiSource/Applications/treecc/treecc: -90.00% (0.0010 => 0.0001, std.dev.: 0.0006)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 21777.68% (0.0112 => 2.4503, std.dev.: 0.0632)
  MultiSource/Benchmarks/Bullet/bullet: -74.67% (28.1263 => 7.1230, std.dev.: 0.0415)
  MultiSource/Benchmarks/FreeBench/distray/distray: 86.67% (0.1298 => 0.2423, std.dev.: 0.0050)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 50.35% (0.4119 => 0.6193, std.dev.: 0.0031)
  MultiSource/Benchmarks/MallocBench/gs/gs: 81400.00% (0.0001 => 0.0815, std.dev.: 0.0021)
  MultiSource/Benchmarks/McCat/09-vor/vor: -0.78% (0.1285 => 0.1275, std.dev.: 0.0016)
  MultiSource/Benchmarks/McCat/18-imp/imp: 161.08% (0.0555 => 0.1449, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 58000.00% (0.0001 => 0.0581, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -99.91% (338.5404 => 0.2995, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -99.94% (499.2699 => 0.3194, std.dev.: 0.0147)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -0.17% (1.8886 => 1.8853, std.dev.: 0.0055)
  MultiSource/Benchmarks/Olden/bh/bh: 12030.30% (0.0198 => 2.4018, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/health/health: 2.89% (0.3422 => 0.3521, std.dev.: 0.0150)
  MultiSource/Benchmarks/Olden/mst/mst: 19.66% (0.1160 => 0.1388, std.dev.: 0.0113)
  MultiSource/Benchmarks/Olden/power/power: 462.78% (0.2136 => 1.2021, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 2246.90% (0.0145 => 0.3403, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 18900.00% (0.0001 => 0.0190, std.dev.: 0.0041)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -85.96% (0.0712 => 0.0100, std.dev.: 0.0002)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -43.98% (0.0964 => 0.0540, std.dev.: 0.0016)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 110170.00% (0.0010 => 1.1027, std.dev.: 0.0027)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.47% (2.7413 => 2.5090, std.dev.: 0.1152)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.27% (2.4091 => 2.5842, std.dev.: 0.0091)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -25.00% (8.9555 => 6.7162, std.dev.: 0.0160)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 451.56% (0.6680 => 3.6844, std.dev.: 0.0031)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -0.02% (3.4113 => 3.4107, std.dev.: 0.0018)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.24% (21.8845 => 22.1561, std.dev.: 0.0090)
  SingleSource/Benchmarks/McGill/chomp: 695.82% (0.1413 => 1.1245, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 733.51% (0.3969 => 3.3082, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1021.81% (0.4063 => 4.5579, std.dev.: 0.0762)
  SingleSource/Benchmarks/Misc/mandel-2: 206478.57% (0.0014 => 2.8921, std.dev.: 0.0112)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -0.07% (1.4551 => 1.4541, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout-C++/hash: 633400.00% (0.0001 => 0.6335, std.dev.: 0.0054)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3372000.00% (0.0001 => 3.3721, std.dev.: 0.0047)
  SingleSource/Benchmarks/Shootout-C++/moments: 100900.00% (0.0001 => 0.1010, std.dev.: 0.0002)
  SingleSource/Regression/C++/EH/function_try_block: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: - (0.0001 => 0.0001, std.dev.: 0.0010)
  SingleSource/Regression/C/DuffsDevice: -85.71% (0.0007 => 0.0001)
  SingleSource/UnitTests/2008-04-18-LoopBug: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2008-04-20-LoopBug2: - (0.0001 => 0.0001)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.29% (0.6072 => 0.6697, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 4.91% (0.2078 => 0.2180, std.dev.: 0.0031)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.51% (0.4653 => 0.4863, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.47% (0.2730 => 0.2852, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 4.04% (0.2972 => 0.3092, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.91% (0.6131 => 0.6371, std.dev.: 0.0062)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.38% (0.3222 => 0.3331, std.dev.: 0.0009)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.38% (0.5916 => 0.6116, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/constpool: 3.37% (8.2103 => 8.4866, std.dev.: 0.0260)
  MultiSource/Benchmarks/nbench/nbench: 2.79% (1.1143 => 1.1454, std.dev.: 0.0056)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.70% (1.2358 => 1.2692, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.33% (0.8027 => 0.8214, std.dev.: 0.0014)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.70% (1.2473 => 1.2685, std.dev.: 0.0052)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.42% (0.8754 => 0.8878, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.13% (8.6844 => 8.7828, std.dev.: 0.0126)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/siod/siod: 5.04% (3.5800 => 3.7605, std.dev.: 0.0050)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/d/make_dparser: -1.02% (3.2876 => 3.2540, std.dev.: 0.0052)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/hash: -42.68% (7.4932 => 4.2954, std.dev.: 0.0093)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.69% (2.5267 => 2.4335, std.dev.: 0.0267)
  MultiSource/Applications/hexxagon/hexxagon: -3.51% (14.5098 => 14.0009, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.41% (22.3625 => 22.0481, std.dev.: 0.1149)
  MultiSource/Benchmarks/llubenchmark/llu: -1.14% (2.0333 => 2.0102, std.dev.: 0.0056)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc-C++/bigfib
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/strcat
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/kimwitu++/kc: 1.68% (16.1509 => 16.4226, std.dev.: 0.0638)
  MultiSource/Applications/obsequi/Obsequi: -0.59% (1.0422 => 1.0361, std.dev.: 0.0084)
  MultiSource/Applications/sqlite3/sqlite3: 0.44% (0.6342 => 0.6370, std.dev.: 0.0028)
  MultiSource/Benchmarks/McCat/08-main/main: 5.03% (0.1808 => 0.1899, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.40% (0.1687 => 0.1579, std.dev.: 0.0045)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -2.71% (0.3252 => 0.3164, std.dev.: 0.0033)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -0.97% (0.2487 => 0.2463, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.04% (0.3365 => 0.3330, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.37% (0.2409 => 0.2376, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/bigfib: 0.12% (0.5952 => 0.5959, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/mandel: 10.59% (0.0444 => 0.0491, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/reversefile: -1.86% (0.3329 => 0.3267, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/strcat: 1.79% (0.1952 => 0.1987, std.dev.: 0.0008)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 11.74% (0.0213 => 0.0238, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: -0.47% (0.0213 => 0.0212, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.48% (0.0419 => 0.0417, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 32.38% (0.0244 => 0.0323, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -15.31% (0.0307 => 0.0260, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 0.98% (0.0410 => 0.0414, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0197 => 0.0197)
  SingleSource/UnitTests/Vector/Altivec/test1: 3.47% (0.0202 => 0.0209, std.dev.: 0.0002)
  SingleSource/UnitTests/byval-alignment: 8.72% (0.0298 => 0.0324, std.dev.: 0.0009)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc-C++/bigfib
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/strcat
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: -88.89% (0.0009 => 0.0001, std.dev.: 0.0006)
  MultiSource/Applications/ClamAV/clamscan: 95.61% (0.0752 => 0.1471, std.dev.: 0.0010)
  MultiSource/Applications/SPASS/SPASS: 8300000.00% (0.0001 => 8.3001, std.dev.: 0.0437)
  MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Applications/lemon/lemon: 0.65% (1.1406 => 1.1480, std.dev.: 0.0342)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Applications/oggenc/oggenc: 149000.00% (0.0001 => 0.1491, std.dev.: 0.0013)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.44% (0.4134 => 0.4033, std.dev.: 0.0102)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.79% (0.1423 => 0.1369, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0001 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: - (0.0594 => 0.0594, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 9.76% (0.0205 => 0.0225, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 0.18% (0.0570 => 0.0571, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: - (1.1419 => 1.1419, std.dev.: 0.0138)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -78.95% (0.0019 => 0.0004, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.19% (0.0554 => 0.0616, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 2.15% (0.0233 => 0.0238, std.dev.: 0.0013)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.62% (0.8019 => 0.7969, std.dev.: 0.0026)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-07-10-SignConversions: -85.71% (0.0007 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: -66.67% (0.0003 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 98.08% (0.0052 => 0.0103, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000)
  SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Applications/SPASS/SPASS
  MultiSource/Applications/SPASS/SPASS: -1.57% (8.4326 => 8.3001, std.dev.: 0.0437)

New Passes - Execution Time
---------------------------
  SingleSource/Regression/C/uint64_to_float
  SingleSource/Regression/C/uint64_to_float: -23.90% (2.1832 => 1.6614, std.dev.: 0.0059)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 12.59% (0.0810 => 0.0912, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/tsp/tsp: 9.62% (0.1112 => 0.1219, std.dev.: 0.0028)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 6.18% (0.3137 => 0.3331, std.dev.: 0.0009)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 6.04% (0.1905 => 0.2020, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 6.01% (0.6010 => 0.6371, std.dev.: 0.0062)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 5.60% (0.2180 => 0.2302, std.dev.: 0.0032)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.48% (0.8321 => 0.8777, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 4.56% (0.2279 => 0.2383, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 4.09% (0.7473 => 0.7779, std.dev.: 0.0063)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 4.02% (0.4847 => 0.5042, std.dev.: 0.0048)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.30% (0.8148 => 0.8417, std.dev.: 0.0073)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 3.28% (1.1606 => 1.1987, std.dev.: 0.0104)
  MultiSource/Applications/hbd/hbd: 2.94% (1.4269 => 1.4688, std.dev.: 0.0137)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.60% (0.5961 => 0.6116, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 2.59% (0.8007 => 0.8214, std.dev.: 0.0014)
  MultiSource/Applications/spiff/spiff: 2.15% (0.7950 => 0.8121, std.dev.: 0.0049)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.69% (0.6586 => 0.6697, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.69% (0.9435 => 0.9594, std.dev.: 0.0046)
  MultiSource/Benchmarks/nbench/nbench: 1.62% (1.1271 => 1.1454, std.dev.: 0.0056)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.57% (6.6074 => 6.7114, std.dev.: 0.0133)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 1.56% (8.6476 => 8.7828, std.dev.: 0.0126)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.42% (1.6386 => 1.6619, std.dev.: 0.0088)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.32% (4.1305 => 4.1852, std.dev.: 0.0182)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.25% (0.8768 => 0.8878, std.dev.: 0.0021)
  MultiSource/Benchmarks/Bullet/bullet: 1.12% (31.8598 => 32.2179, std.dev.: 0.0903)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 58.91% (1.5795 => 2.5100, std.dev.: 0.0045)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.26% (14.6451 => 16.7333, std.dev.: 0.1426)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 7.90% (1.1857 => 1.2794, std.dev.: 0.0040)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.00% (63.1822 => 66.9721, std.dev.: 0.1176)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 3.02% (44.5605 => 45.9041, std.dev.: 0.4562)
  SingleSource/Benchmarks/Misc/ReedSolomon: 2.99% (8.5322 => 8.7874, std.dev.: 0.0221)
  MultiSource/Applications/siod/siod: 2.63% (3.6643 => 3.7605, std.dev.: 0.0050)
  SingleSource/Benchmarks/Dhrystone/dry: 1.99% (0.5081 => 0.5182, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/bh/bh: 1.94% (2.3560 => 2.4018, std.dev.: 0.0014)
  MultiSource/Applications/minisat/minisat: 1.41% (6.1525 => 6.2391, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.26% (4.8362 => 4.8970, std.dev.: 0.0123)
  SingleSource/Benchmarks/Misc/whetstone: 1.02% (2.1224 => 2.1441, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.38% (0.3269 => 0.2995, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/heapsort: -7.83% (3.2926 => 3.0348, std.dev.: 0.0043)
  MultiSource/Applications/lua/lua: -4.14% (29.8330 => 28.5980, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.51% (3.4237 => 3.3721, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -1.19% (3.3479 => 3.3082, std.dev.: 0.0100)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.07% (3.7781 => 3.7376, std.dev.: 0.0087)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc-C++/bigfib
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/strcat
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/kimwitu++/kc: -0.14% (16.4461 => 16.4226, std.dev.: 0.0638)
  MultiSource/Applications/obsequi/Obsequi: 0.96% (1.0262 => 1.0361, std.dev.: 0.0084)
  MultiSource/Applications/sqlite3/sqlite3: 0.60% (0.6332 => 0.6370, std.dev.: 0.0028)
  MultiSource/Benchmarks/McCat/08-main/main: 3.71% (0.1831 => 0.1899, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 1.28% (0.1559 => 0.1579, std.dev.: 0.0045)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.31% (0.3123 => 0.3164, std.dev.: 0.0033)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.2463 => 0.2463, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -0.42% (0.3344 => 0.3330, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 0.51% (0.2364 => 0.2376, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc-C++/bigfib: -0.85% (0.6010 => 0.5959, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/mandel: 14.45% (0.0429 => 0.0491, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 0.03% (0.3266 => 0.3267, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/strcat: 0.91% (0.1969 => 0.1987, std.dev.: 0.0008)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 6.25% (0.0224 => 0.0238, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 72.36% (0.0123 => 0.0212, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 2.21% (0.0408 => 0.0417, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: 27.17% (0.0254 => 0.0323, std.dev.: 0.0003)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -13.91% (0.0302 => 0.0260, std.dev.: 0.0022)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 7.81% (0.0384 => 0.0414, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/casts: 3.68% (0.0190 => 0.0197)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.11% (0.0180 => 0.0209, std.dev.: 0.0002)
  SingleSource/UnitTests/byval-alignment: 40.87% (0.0230 => 0.0324, std.dev.: 0.0009)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/kimwitu++/kc
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/oggenc/oggenc
  MultiSource/Applications/sqlite3/sqlite3
  MultiSource/Benchmarks/McCat/08-main/main
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/Benchmarks/CoyoteBench/fftbench
  SingleSource/Benchmarks/Misc-C++-EH/spirit
  SingleSource/Benchmarks/Misc-C++/Large/ray
  SingleSource/Benchmarks/Misc-C++/bigfib
  SingleSource/Benchmarks/Misc/mandel
  SingleSource/Benchmarks/Shootout-C++/reversefile
  SingleSource/Benchmarks/Shootout-C++/strcat
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2003-07-10-SignConversions
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/byval-alignment
  MultiSource/Applications/Burg/burg: -85.71% (0.0007 => 0.0001, std.dev.: 0.0006)
  MultiSource/Applications/ClamAV/clamscan: 2.29% (0.1438 => 0.1471, std.dev.: 0.0010)
  MultiSource/Applications/kimwitu++/kc: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Applications/lemon/lemon: 1.33% (1.1329 => 1.1480, std.dev.: 0.0342)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000)
  MultiSource/Applications/oggenc/oggenc: 1.98% (0.1462 => 0.1491, std.dev.: 0.0013)
  MultiSource/Applications/sqlite3/sqlite3: - (0.0000 => 0.0000)
  MultiSource/Benchmarks/McCat/08-main/main: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.15% (0.4164 => 0.4033, std.dev.: 0.0102)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: - (0.1369 => 0.1369, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -87.50% (0.0008 => 0.0001, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.33% (0.0641 => 0.0594, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 15.38% (0.0195 => 0.0225, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -1.21% (0.0578 => 0.0571, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.16% (1.1437 => 1.1419, std.dev.: 0.0138)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 1900.00% (0.0001 => 0.0020, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -71.43% (0.0014 => 0.0004, std.dev.: 0.0011)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -1.75% (0.0627 => 0.0616, std.dev.: 0.0007)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 32.22% (0.0180 => 0.0238, std.dev.: 0.0013)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: - (0.0000 => 0.0001)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -0.60% (0.8017 => 0.7969, std.dev.: 0.0026)
  SingleSource/Benchmarks/CoyoteBench/fftbench: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/Large/ray: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++/bigfib: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/mandel: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/reversefile: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/strcat: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2003-07-10-SignConversions: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 66.13% (0.0062 => 0.0103, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0000 => 0.0000, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0000 => 0.0000)
  SingleSource/UnitTests/Vector/Altivec/test1: - (0.0000 => 0.0000)
  SingleSource/UnitTests/byval-alignment: - (0.0000 => 0.0000, std.dev.: 0.0000)

Report Time: 2.27s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20121021/59614951/attachment.html>


More information about the llvm-testresults mailing list