[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Apr 3 18:03:46 PDT 2012
http://llvm.org/perf/db_default/v4/nts/52?compare_to=51&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 52, Order: 153982, Start Time: 2012-04-04 00:49:20, End Time: 2012-04-04 01:03:49
To: 51, Order: 153980, Start Time: 2012-04-04 00:15:58, End Time: 2012-04-04 00:30:25
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 5 (83 on baseline)
Performance Improvements: 10 (99 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 865 (698 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.76% (0.1700 => 0.1900, std. dev.: 0.0075)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/JM/ldecod/ldecod: 40.00% (0.0500 => 0.0700, std. dev.: 0.0075)
MultiSource/Benchmarks/Ptrdist/ft/ft: 22.22% (0.8100 => 0.9900, std. dev.: 0.0220)
SingleSource/Benchmarks/Stanford/FloatMM: 2.44% (0.4100 => 0.4200, std. dev.: 0.0030)
MultiSource/Applications/minisat/minisat: 1.39% (6.4600 => 6.5500, std. dev.: 0.0119)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Misc/mandel-2: -75.00% (0.0400 => 0.0100, std. dev.: 0.0030)
SingleSource/UnitTests/2003-07-09-SignedArgs: -66.67% (0.0300 => 0.0100, std. dev.: 0.0046)
SingleSource/Regression/C++/pointer_method2: -50.00% (0.0200 => 0.0100, std. dev.: 0.0030)
SingleSource/UnitTests/printargs: -50.00% (0.0200 => 0.0100, std. dev.: 0.0030)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -40.00% (0.1000 => 0.0600, std. dev.: 0.0083)
SingleSource/Benchmarks/Shootout-C++/objinst: -15.79% (0.1900 => 0.1600, std. dev.: 0.0092)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout-C++/ary: -66.67% (0.0300 => 0.0100, std. dev.: 0.0049)
MultiSource/Applications/d/make_dparser: -50.00% (0.0200 => 0.0100, std. dev.: 0.0030)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -20.00% (0.0500 => 0.0400, std. dev.: 0.0030)
MultiSource/Benchmarks/Ptrdist/bc/bc: -6.25% (0.4800 => 0.4500, std. dev.: 0.0092)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 133.33% (0.0300 => 0.0700)
MultiSource/Benchmarks/llubenchmark/llu: 100.00% (0.0200 => 0.0400)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Misc-C++/mandel-text: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Misc/fp-convert: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/EH/simple_throw: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/fixups: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/pointer_method: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/matrixTranspose: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-09-ArrayResolution: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-12-StructureArgs: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/DefaultInitDynArrays: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/Vector/sumarray-dbl: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0100 => 0.0200)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 66.67% (0.0300 => 0.0500)
SingleSource/Benchmarks/Dhrystone/fldry: 66.67% (0.0300 => 0.0500)
MultiSource/Applications/aha/aha: 60.00% (0.0500 => 0.0800)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 50.00% (0.0600 => 0.0900)
MultiSource/Benchmarks/Olden/mst/mst: 50.00% (0.0600 => 0.0900)
MultiSource/Benchmarks/Ptrdist/ft/ft: 50.00% (0.1000 => 0.1500)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 47.06% (0.1700 => 0.2500)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 44.44% (0.0900 => 0.1300)
MultiSource/Benchmarks/Fhourstones/fhourstones: 37.50% (0.0800 => 0.1100)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 33.33% (0.0600 => 0.0800)
SingleSource/Benchmarks/Shootout/objinst: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Olden/health/health: 33.33% (0.0900 => 0.1200)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.57% (0.1400 => 0.1800)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.57% (0.0700 => 0.0900)
MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/McCat/15-trie/trie: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/Olden/power/power: 25.00% (0.0800 => 0.1000)
SingleSource/Benchmarks/Stanford/Oscar: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/McCat/04-bisect/bisect: 22.22% (0.0900 => 0.1100)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.43% (0.1400 => 0.1700)
MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.00% (0.2000 => 0.2400)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.75% (0.1600 => 0.1900)
MultiSource/Applications/viterbi/viterbi: 18.18% (0.1100 => 0.1300)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.67% (0.0600 => 0.0700)
SingleSource/Benchmarks/McGill/exptree: 16.67% (0.0600 => 0.0700)
MultiSource/Applications/lambda-0_1_3/lambda: 12.77% (0.4700 => 0.5300)
SingleSource/Benchmarks/Misc/oourafft: 12.50% (0.1600 => 0.1800)
MultiSource/Applications/spiff/spiff: 12.28% (0.5700 => 0.6400)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.28% (0.5700 => 0.6400)
SingleSource/Benchmarks/Shootout-C++/lists1: 12.00% (0.2500 => 0.2800)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.76% (0.1700 => 0.1900)
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.11% (0.1800 => 0.2000)
SingleSource/Benchmarks/Shootout-C++/sumcol: 11.11% (0.1800 => 0.2000)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 9.09% (0.2200 => 0.2400)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 9.09% (0.2200 => 0.2400)
MultiSource/Benchmarks/FreeBench/neural/neural: 8.33% (0.1200 => 0.1300)
SingleSource/Benchmarks/Misc-C++/Large/ray: 7.69% (0.2600 => 0.2800)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 7.14% (0.5600 => 0.6000)
SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.3000 => 0.3200)
MultiSource/Applications/hexxagon/hexxagon: 6.41% (0.7800 => 0.8300)
SingleSource/Benchmarks/Shootout-C++/hello: 6.25% (0.1600 => 0.1700)
SingleSource/Regression/C++/ofstream_ctor: 6.25% (0.1600 => 0.1700)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.88% (1.0200 => 1.0800)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 5.56% (0.1800 => 0.1900)
MultiSource/Applications/hbd/hbd: 5.56% (1.0800 => 1.1400)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.15% (0.9700 => 1.0200)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/kimwitu++/kc: 400.00% (0.0100 => 0.0500)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: 100.00% (0.0100 => 0.0200)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.56% (0.7200 => 0.9400)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/Ptrdist/ft/ft: 20.73% (0.8200 => 0.9900)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.14% (1.3900 => 1.6700)
MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.11% (0.0900 => 0.1000)
SingleSource/Benchmarks/Shootout-C++/lists: 10.14% (4.9300 => 5.4300)
SingleSource/Benchmarks/Shootout/nestedloop: 6.67% (0.1500 => 0.1600)
MultiSource/Benchmarks/FreeBench/mason/mason: 5.26% (0.1900 => 0.2000)
SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.1900 => 0.2000)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Shootout/ackermann: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C++/EH/throw_rethrow_test: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2003-05-14-initialize-string: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2003-06-16-InvalidInitializer: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2002-08-02-CastTest2: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2003-07-08-BitOpsTest: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2005-05-13-SDivTwo: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2007-04-25-weak: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2008-07-13-InlineSetjmp: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/Threads/2010-12-08-tls: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/stmtexpr: -100.00% (0.0200 => 0.0000)
SingleSource/Benchmarks/Misc/mandel-2: -66.67% (0.0300 => 0.0100)
SingleSource/UnitTests/2003-07-09-SignedArgs: -66.67% (0.0300 => 0.0100)
MultiSource/Benchmarks/Prolangs-C++/NP/np: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/Misc/dt: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/Shootout/ary3: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/Shootout/sieve: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/2003-09-29-NonPODsByValue: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/simple_rethrow: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2003-05-22-LocalTypeTest: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2003-05-23-TransparentUnion: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2004-03-15-IndirectGoto: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2002-05-19-DivTest: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2002-08-19-CodegenBug: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-04-22-Switch: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-05-02-DependentPHI: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-05-31-CastToBool: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-08-05-CastFPToUint: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2006-02-04-DivRem: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2007-01-04-KNR-Args: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2007-03-02-VaCopy: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -50.00% (0.0800 => 0.0400)
SingleSource/UnitTests/Vector/multiplies: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/Vector/sumarray: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/ms_struct-bitfield-init-1: -50.00% (0.0200 => 0.0100)
MultiSource/Benchmarks/FreeBench/mason/mason: -42.86% (0.0700 => 0.0400)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -40.00% (0.0500 => 0.0300)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -33.33% (0.0900 => 0.0600)
SingleSource/Benchmarks/McGill/misr: -33.33% (0.0600 => 0.0400)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Dhrystone/dry: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Misc/salsa20: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Shootout/heapsort: -25.00% (0.0400 => 0.0300)
SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Olden/bisort/bisort: -20.00% (0.0500 => 0.0400)
MultiSource/Benchmarks/Prolangs-C++/simul/simul: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Misc/perlin: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Misc/richards_benchmark: -20.00% (0.0500 => 0.0400)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -14.29% (0.0700 => 0.0600)
SingleSource/Benchmarks/Misc/ffbench: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -14.29% (0.7000 => 0.6000)
MultiSource/Benchmarks/SciMark2-C/scimark2: -13.04% (0.2300 => 0.2000)
MultiSource/Benchmarks/McCat/05-eks/eks: -12.50% (0.4000 => 0.3500)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -11.11% (0.1800 => 0.1600)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -10.00% (0.1000 => 0.0900)
SingleSource/Benchmarks/CoyoteBench/lpbench: -10.00% (0.1000 => 0.0900)
SingleSource/UnitTests/SignlessTypes/rem: -10.00% (0.1000 => 0.0900)
SingleSource/Benchmarks/Shootout-C++/ary3: -9.09% (0.2200 => 0.2000)
SingleSource/Benchmarks/Shootout-C++/ary2: -8.70% (0.2300 => 0.2100)
SingleSource/Benchmarks/Shootout-C++/lists: -8.70% (0.2300 => 0.2100)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.66% (1.2700 => 1.1600)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -8.62% (0.5800 => 0.5300)
SingleSource/Benchmarks/Shootout-C++/sieve: -8.33% (0.2400 => 0.2200)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -7.69% (0.2600 => 0.2400)
SingleSource/Benchmarks/McGill/chomp: -7.69% (0.1300 => 0.1200)
SingleSource/Benchmarks/Misc/himenobmtxpa: -7.69% (0.1300 => 0.1200)
SingleSource/Benchmarks/Misc/ReedSolomon: -6.25% (0.1600 => 0.1500)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -6.25% (0.4800 => 0.4500)
SingleSource/Benchmarks/Shootout-C++/objinst: -5.88% (0.1700 => 0.1600)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -5.62% (0.8900 => 0.8400)
SingleSource/Benchmarks/Shootout-C++/except: -5.26% (0.1900 => 0.1800)
SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.1900 => 0.1800)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/city/city: -100.00% (0.0100 => 0.0000)
SingleSource/Benchmarks/Shootout-C++/ary: -66.67% (0.0300 => 0.0100)
MultiSource/Applications/d/make_dparser: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/Stanford/Towers: -50.00% (0.0200 => 0.0100)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/McCat/08-main/main: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -20.00% (0.0500 => 0.0400)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -14.29% (0.2100 => 0.1800)
MultiSource/Benchmarks/Ptrdist/bc/bc: -10.00% (0.5000 => 0.4500)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -8.33% (0.2400 => 0.2200)
SingleSource/Benchmarks/Shootout/strcat: -7.69% (0.1300 => 0.1200)
SingleSource/Benchmarks/Shootout-C++/hash: -6.38% (0.4700 => 0.4400)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.25% (0.1600 => 0.1500)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.21% (3.2200 => 3.0200)
SingleSource/Benchmarks/Shootout-C++/methcall: -5.80% (5.0000 => 4.7100)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.26% (0.3800 => 0.3600)
SingleSource/Benchmarks/McGill/misr: -5.26% (0.1900 => 0.1800)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 0.42s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120403/be40d047/attachment.html>
More information about the llvm-testresults
mailing list