[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Apr 3 18:28:45 PDT 2012
http://llvm.org/perf/db_default/v4/nts/54?compare_to=52&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 54, Order: 153988, Start Time: 2012-04-04 01:14:18, End Time: 2012-04-04 01:28:48
To: 52, Order: 153982, Start Time: 2012-04-04 00:49:20, End Time: 2012-04-04 01:03:49
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 3 (80 on baseline)
Performance Improvements: 12 (99 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 865 (701 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Applications/spiff/spiff: 12.50% (0.6400 => 0.7200, std. dev.: 0.0143)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Stanford/Puzzle: 7.69% (0.1300 => 0.1400, std. dev.: 0.0030)
MultiSource/Benchmarks/BitBench/drop3/drop3: 3.13% (0.3200 => 0.3300, std. dev.: 0.0030)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/EH/dead_try_block: -100.00% (0.0200 => 0.0000, std. dev.: 0.0046)
SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
SingleSource/UnitTests/ms_struct-bitfield-1: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0400 => 0.0100, std. dev.: 0.0066)
SingleSource/Benchmarks/Stanford/FloatMM: -50.00% (0.0400 => 0.0200, std. dev.: 0.0046)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -31.58% (0.1900 => 0.1300, std. dev.: 0.0117)
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -18.18% (0.1100 => 0.0900, std. dev.: 0.0049)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.26% (0.3900 => 0.3500, std. dev.: 0.0143)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: -10.00% (0.1000 => 0.0900, std. dev.: 0.0030)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/McCat/09-vor/vor: -30.00% (0.1000 => 0.0700, std. dev.: 0.0063)
SingleSource/Benchmarks/Stanford/Quicksort: -25.00% (0.0400 => 0.0300, std. dev.: 0.0030)
MultiSource/Benchmarks/McCat/18-imp/imp: -14.29% (0.0700 => 0.0600, std. dev.: 0.0030)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Quicksort: 300.00% (0.0100 => 0.0400)
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 200.00% (0.0100 => 0.0300)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 200.00% (0.0100 => 0.0300)
SingleSource/Regression/C/DuffsDevice: 200.00% (0.0100 => 0.0300)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 100.00% (0.0300 => 0.0600)
MultiSource/Benchmarks/llubenchmark/llu: 100.00% (0.0200 => 0.0400)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 100.00% (0.0200 => 0.0400)
SingleSource/Benchmarks/Misc-C++/mandel-text: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Misc/fp-convert: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Shootout/hash: 100.00% (0.0200 => 0.0400)
SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/pointer_method: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/ConstructorDestructorAttributes: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/badidx: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-08-02-CastTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-09-ArrayResolution: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-12-StructureArgs: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-10-29-ScalarReplBug: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/Threads/tls: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/Vector/sumarray-dbl: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/printargs: 100.00% (0.0100 => 0.0200)
MultiSource/Applications/aha/aha: 80.00% (0.0500 => 0.0900)
SingleSource/Benchmarks/Dhrystone/fldry: 66.67% (0.0300 => 0.0500)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 47.06% (0.1700 => 0.2500)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 42.86% (0.1400 => 0.2000)
MultiSource/Benchmarks/Olden/perimeter/perimeter: 40.00% (0.0500 => 0.0700)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Olden/mst/mst: 33.33% (0.0600 => 0.0800)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/McGill/queens: 33.33% (0.0300 => 0.0400)
SingleSource/Regression/C/uint64_to_float: 33.33% (0.0300 => 0.0400)
SingleSource/UnitTests/Vector/SSE/sse_shift: 33.33% (0.0300 => 0.0400)
SingleSource/UnitTests/initp1: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.57% (0.1400 => 0.1800)
MultiSource/Applications/spiff/spiff: 26.32% (0.5700 => 0.7200)
MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0800 => 0.1000)
MultiSource/Benchmarks/Olden/treeadd/treeadd: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.22% (0.0900 => 0.1100)
MultiSource/Benchmarks/Olden/health/health: 22.22% (0.0900 => 0.1100)
MultiSource/Benchmarks/Ptrdist/ft/ft: 20.00% (0.1000 => 0.1200)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.67% (0.0600 => 0.0700)
SingleSource/Benchmarks/Misc/whetstone: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 16.67% (0.1800 => 0.2100)
MultiSource/Benchmarks/Olden/em3d/em3d: 15.38% (0.1300 => 0.1500)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 13.33% (0.1500 => 0.1700)
SingleSource/Benchmarks/Shootout-C++/ackermann: 12.50% (0.1600 => 0.1800)
SingleSource/Benchmarks/Shootout-C++/fibo: 11.76% (0.1700 => 0.1900)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 10.53% (0.5700 => 0.6300)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.34% (0.5800 => 0.6400)
MultiSource/Benchmarks/Olden/bh/bh: 9.09% (0.2200 => 0.2400)
MultiSource/Applications/lambda-0_1_3/lambda: 8.51% (0.4700 => 0.5100)
MultiSource/Benchmarks/FreeBench/neural/neural: 8.33% (0.1200 => 0.1300)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.25% (0.9700 => 1.0500)
MultiSource/Applications/sgefa/sgefa: 8.00% (0.2500 => 0.2700)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.00% (0.2500 => 0.2700)
MultiSource/Applications/hexxagon/hexxagon: 7.69% (0.7800 => 0.8400)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 7.50% (0.4000 => 0.4300)
MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 7.37% (0.9500 => 1.0200)
MultiSource/Applications/Burg/burg: 7.14% (0.8400 => 0.9000)
SingleSource/Benchmarks/Shootout-C++/reversefile: 6.90% (0.2900 => 0.3100)
SingleSource/Benchmarks/Misc/ReedSolomon: 6.25% (0.1600 => 0.1700)
SingleSource/Benchmarks/Shootout-C++/heapsort: 5.56% (0.1800 => 0.1900)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/kimwitu++/kc: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Stanford/Treesort: 40.00% (0.0500 => 0.0700)
SingleSource/Benchmarks/Shootout-C++/ary: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.56% (0.7200 => 0.9400)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.86% (1.3900 => 1.6800)
MultiSource/Benchmarks/nbench/nbench: 8.63% (16.9200 => 18.3800)
SingleSource/Benchmarks/Stanford/Puzzle: 7.69% (0.1300 => 0.1400)
MultiSource/Benchmarks/BitBench/drop3/drop3: 6.45% (0.3100 => 0.3300)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Misc/mandel-2: -100.00% (0.0300 => 0.0000)
SingleSource/Benchmarks/Shootout/ary3: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C++/EH/dead_try_block: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C++/EH/throw_rethrow_test: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2004-02-03-AggregateCopy: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C/pointer_arithmetic: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2002-05-02-CastTest3: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2003-05-02-DependentPHI: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2003-05-12-MinIntProblem: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2003-07-10-SignConversions: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2003-09-18-BitFieldTest: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2008-04-18-LoopBug: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/conditional-gnu-ext: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/ms_struct-bitfield-1: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/ms_struct-bitfield-init-1: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0100 => 0.0000)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -75.00% (0.0400 => 0.0100)
SingleSource/Benchmarks/Misc/flops-4: -66.67% (0.0300 => 0.0100)
SingleSource/Benchmarks/Shootout/methcall: -66.67% (0.0300 => 0.0100)
SingleSource/Regression/C/PR640: -66.67% (0.0300 => 0.0100)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -50.00% (0.0400 => 0.0200)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -50.00% (0.0600 => 0.0300)
SingleSource/Benchmarks/BenchmarkGame/recursive: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/Misc/pi: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/Shootout/ackermann: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/Stanford/FloatMM: -50.00% (0.0400 => 0.0200)
SingleSource/Regression/C++/2003-09-29-NonPODsByValue: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/2011-03-28-Bitfield: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/BuiltinTypeInfo: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/inlined_cleanup: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2004-03-15-IndirectGoto: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/PR1386: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2002-05-02-CastTest2: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-10-13-SwitchTest: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2005-05-12-Int64ToFP: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2007-01-04-KNR-Args: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2008-07-13-InlineSetjmp: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/FloatPrecision: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/Vector/sumarray: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/member-function-pointers: -50.00% (0.0200 => 0.0100)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -40.00% (0.0500 => 0.0300)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -33.33% (0.0600 => 0.0400)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -27.78% (0.1800 => 0.1300)
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Dhrystone/dry: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Misc/dt: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Misc/flops: -25.00% (0.0800 => 0.0600)
SingleSource/Benchmarks/Misc/salsa20: -25.00% (0.0400 => 0.0300)
SingleSource/Regression/C/bigstack: -25.00% (0.0400 => 0.0300)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -25.00% (0.0800 => 0.0600)
MultiSource/Benchmarks/Prolangs-C++/simul/simul: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/CoyoteBench/lpbench: -20.00% (0.1000 => 0.0800)
SingleSource/Benchmarks/Misc/mandel: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Misc/richards_benchmark: -20.00% (0.0500 => 0.0400)
SingleSource/UnitTests/SignlessTypes/Large/cast: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -18.18% (0.1100 => 0.0900)
MultiSource/Benchmarks/McCat/09-vor/vor: -17.39% (0.2300 => 0.1900)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.63% (0.4100 => 0.3500)
MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.29% (0.0700 => 0.0600)
SingleSource/Benchmarks/Shootout-C++/matrix: -14.29% (0.2100 => 0.1800)
SingleSource/Benchmarks/Shootout-C++/wc: -14.29% (0.2100 => 0.1800)
MultiSource/Benchmarks/McCat/08-main/main: -10.53% (0.1900 => 0.1700)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -10.42% (0.4800 => 0.4300)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -10.00% (0.1000 => 0.0900)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.00% (0.1000 => 0.0900)
SingleSource/UnitTests/SignlessTypes/rem: -10.00% (0.1000 => 0.0900)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.09% (0.5500 => 0.5000)
MultiSource/Benchmarks/Prolangs-C/loader/loader: -8.70% (0.2300 => 0.2100)
SingleSource/Benchmarks/Shootout-C++/lists: -8.70% (0.2300 => 0.2100)
SingleSource/Benchmarks/Misc/himenobmtxpa: -7.69% (0.1300 => 0.1200)
MultiSource/Benchmarks/McCat/18-imp/imp: -7.14% (0.2800 => 0.2600)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -7.14% (0.4200 => 0.3900)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -6.25% (0.1600 => 0.1500)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -5.77% (1.0400 => 0.9800)
MultiSource/Applications/minisat/minisat: -5.45% (0.5500 => 0.5200)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -100.00% (0.0100 => 0.0000)
MultiSource/Benchmarks/McCat/09-vor/vor: -36.36% (0.1100 => 0.0700)
MultiSource/Applications/JM/ldecod/ldecod: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/McCat/08-main/main: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Olden/mst/mst: -25.00% (0.0800 => 0.0600)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Shootout/strcat: -23.08% (0.1300 => 0.1000)
SingleSource/Benchmarks/Misc-C++/bigfib: -20.59% (0.3400 => 0.2700)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -19.05% (0.2100 => 0.1700)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.0700 => 0.0600)
MultiSource/Applications/spiff/spiff: -7.53% (1.8600 => 1.7200)
MultiSource/Benchmarks/Olden/health/health: -6.90% (0.2900 => 0.2700)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.67% (0.3000 => 0.2800)
SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.25% (0.1600 => 0.1500)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.21% (3.2200 => 3.0200)
SingleSource/Benchmarks/Shootout-C++/methcall: -6.20% (5.0000 => 4.6900)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 0.48s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120403/bf291209/attachment.html>
More information about the llvm-testresults
mailing list