[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Mon Apr 2 22:47:39 PDT 2012
http://llvm.org/perf/db_default/v4/nts/23?compare_to=22&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 23, Order: 153935, Start Time: 2012-04-03 05:33:12, End Time: 2012-04-03 05:47:40
To: 22, Order: 153933, Start Time: 2012-04-03 04:39:10, End Time: 2012-04-03 04:53:39
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 5 (95 on baseline)
Performance Improvements: 7 (90 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 868 (695 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Bubblesort: 100.00% (0.0200 => 0.0400, std. dev.: 0.0046)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 36.36% (0.1100 => 0.1500, std. dev.: 0.0137)
MultiSource/Benchmarks/MallocBench/gs/gs: 3.22% (3.1100 => 3.2100, std. dev.: 0.0358)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.92% (1.0400 => 1.0600, std. dev.: 0.0070)
SingleSource/Benchmarks/Misc/pi: 1.69% (0.5900 => 0.6000, std. dev.: 0.0000)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/UnitTests/block-byref-test: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -50.00% (0.0800 => 0.0400, std. dev.: 0.0094)
SingleSource/Benchmarks/CoyoteBench/fftbench: -6.45% (0.3100 => 0.2900, std. dev.: 0.0063)
SingleSource/Benchmarks/Shootout-C++/hash2: -5.71% (0.3500 => 0.3300, std. dev.: 0.0049)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -5.56% (7.1900 => 6.7900, std. dev.: 0.0525)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Misc/himenobmtxpa: -2.22% (0.9000 => 0.8800, std. dev.: 0.0050)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.63% (1.2300 => 1.2100, std. dev.: 0.0049)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Quicksort: 300.00% (0.0100 => 0.0400)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 200.00% (0.0100 => 0.0300)
SingleSource/Benchmarks/Misc/fp-convert: 200.00% (0.0100 => 0.0300)
SingleSource/Regression/C/badidx: 200.00% (0.0100 => 0.0300)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 166.67% (0.0300 => 0.0800)
MultiSource/Benchmarks/llubenchmark/llu: 150.00% (0.0200 => 0.0500)
MultiSource/Benchmarks/Prolangs-C++/family/family: 100.00% (0.0200 => 0.0400)
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Shootout/hash: 100.00% (0.0200 => 0.0400)
SingleSource/Benchmarks/Stanford/Bubblesort: 100.00% (0.0200 => 0.0400)
SingleSource/Regression/C++/EH/ctor_dtor_count: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/pointer_method: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/ConstructorDestructorAttributes: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/matrixTranspose: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-05-02-ManyArguments: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-08-02-CastTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-12-StructureArgs: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-09-18-BitFieldTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-10-29-ScalarReplBug: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2006-12-01-float_varg: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/Vector/sumarray-dbl: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/printargs: 100.00% (0.0100 => 0.0200)
MultiSource/Applications/aha/aha: 80.00% (0.0500 => 0.0900)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 66.67% (0.0300 => 0.0500)
SingleSource/Benchmarks/Dhrystone/fldry: 66.67% (0.0300 => 0.0500)
MultiSource/Benchmarks/Ptrdist/ft/ft: 60.00% (0.1000 => 0.1600)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 58.82% (0.1700 => 0.2700)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 50.00% (0.0600 => 0.0900)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: 50.00% (0.1000 => 0.1500)
SingleSource/Benchmarks/Stanford/Oscar: 50.00% (0.0400 => 0.0600)
MultiSource/Benchmarks/Olden/bisort/bisort: 40.00% (0.0500 => 0.0700)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: 33.33% (0.0600 => 0.0800)
SingleSource/Benchmarks/Shootout/objinst: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Shootout/random: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0300 => 0.0400)
SingleSource/Regression/C/uint64_to_float: 33.33% (0.0300 => 0.0400)
SingleSource/UnitTests/Vector/SSE/sse_shift: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/McCat/04-bisect/bisect: 33.33% (0.0900 => 0.1200)
MultiSource/Benchmarks/Olden/health/health: 33.33% (0.0900 => 0.1200)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.57% (0.1400 => 0.1800)
MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0800 => 0.1000)
MultiSource/Benchmarks/Olden/power/power: 25.00% (0.0800 => 0.1000)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.43% (0.1400 => 0.1700)
SingleSource/Regression/C++/ofstream_ctor: 18.75% (0.1600 => 0.1900)
MultiSource/Applications/viterbi/viterbi: 18.18% (0.1100 => 0.1300)
MultiSource/Benchmarks/Ptrdist/ks/ks: 18.18% (0.1100 => 0.1300)
MultiSource/Applications/spiff/spiff: 17.54% (0.5700 => 0.6700)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.0600 => 0.0700)
SingleSource/Benchmarks/Misc/fbench: 16.67% (0.0600 => 0.0700)
SingleSource/Benchmarks/Shootout-C++/ary: 15.00% (0.2000 => 0.2300)
MultiSource/Applications/lambda-0_1_3/lambda: 12.77% (0.4700 => 0.5300)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 12.28% (0.5700 => 0.6400)
MultiSource/Applications/Burg/burg: 11.90% (0.8400 => 0.9400)
MultiSource/Benchmarks/Prolangs-C++/office/office: 11.76% (0.1700 => 0.1900)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/Olden/tsp/tsp: 11.11% (0.0900 => 0.1000)
SingleSource/Benchmarks/Shootout-C++/sumcol: 11.11% (0.1800 => 0.2000)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 11.11% (0.4500 => 0.5000)
SingleSource/Benchmarks/Shootout-C++/moments: 10.00% (0.3000 => 0.3300)
MultiSource/Benchmarks/Olden/bh/bh: 9.09% (0.2200 => 0.2400)
MultiSource/Benchmarks/McCat/09-vor/vor: 8.70% (0.2300 => 0.2500)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2300 => 0.2500)
MultiSource/Benchmarks/FreeBench/neural/neural: 8.33% (0.1200 => 0.1300)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.69% (0.1300 => 0.1400)
SingleSource/Benchmarks/Misc/himenobmtxpa: 7.69% (0.1300 => 0.1400)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 6.90% (0.5800 => 0.6200)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 6.43% (3.4200 => 3.6400)
MultiSource/Applications/hexxagon/hexxagon: 6.41% (0.7800 => 0.8300)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.25% (0.1600 => 0.1700)
SingleSource/Benchmarks/Misc/oourafft: 6.25% (0.1600 => 0.1700)
SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.1600 => 0.1700)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.19% (0.9700 => 1.0300)
SingleSource/Benchmarks/Shootout-C++/random: 5.56% (0.1800 => 0.1900)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/BitBench/uuencode/uuencode: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Shootout-C++/ary: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.56% (0.7200 => 0.9400)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 19.42% (1.3900 => 1.6600)
MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 6.67% (0.3000 => 0.3200)
SingleSource/Benchmarks/Shootout/nestedloop: 6.67% (0.1500 => 0.1600)
SingleSource/Benchmarks/Shootout-C++/hash2: 6.30% (2.5400 => 2.7000)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.80% (0.6900 => 0.7300)
SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.1900 => 0.2000)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/EH/dead_try_block: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C++/EH/throw_rethrow_test: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C++/pointer_member: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C/2003-05-14-initialize-string: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2004-02-03-AggregateCopy: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2007-04-25-weak: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/block-byref-test: -100.00% (0.0100 => 0.0000)
SingleSource/Benchmarks/Misc/flops-5: -66.67% (0.0300 => 0.0100)
SingleSource/Benchmarks/Misc/mandel-2: -66.67% (0.0300 => 0.0100)
SingleSource/Benchmarks/Stanford/Perm: -66.67% (0.0300 => 0.0100)
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -50.00% (0.0400 => 0.0200)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -50.00% (0.0400 => 0.0200)
MultiSource/Benchmarks/Prolangs-C++/NP/np: -50.00% (0.0200 => 0.0100)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/Misc/pi: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/Shootout/heapsort: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/Shootout/sieve: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/2003-09-29-NonPODsByValue: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2003-05-21-BitfieldHandling: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2002-05-03-NotTest: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-07-08-BitOpsTest: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-08-05-CastFPToUint: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-08-20-FoldBug: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -50.00% (0.0400 => 0.0200)
SingleSource/UnitTests/2006-02-04-DivRem: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2008-07-13-InlineSetjmp: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/AtomicOps: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/FloatPrecision: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/TestLoop: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/Vector/divides: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/Vector/sumarray: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/byval-alignment: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/member-function-pointers: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/ms_struct-bitfield-init-1: -50.00% (0.0200 => 0.0100)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -42.86% (0.0700 => 0.0400)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -42.86% (0.0700 => 0.0400)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -40.00% (0.0500 => 0.0300)
SingleSource/UnitTests/SignlessTypes/Large/cast: -40.00% (0.0500 => 0.0300)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -30.00% (0.1000 => 0.0700)
MultiSource/Benchmarks/FreeBench/mason/mason: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/SciMark2-C/scimark2: -26.09% (0.2300 => 0.1700)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Prolangs-C++/garage/garage: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Misc/dt: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Stanford/FloatMM: -25.00% (0.0400 => 0.0300)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -25.00% (0.0800 => 0.0600)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Misc/mandel: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Misc/perlin: -20.00% (0.0500 => 0.0400)
MultiSource/Applications/sgefa/sgefa: -12.00% (0.2500 => 0.2200)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -11.36% (0.4400 => 0.3900)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -11.11% (0.1800 => 0.1600)
SingleSource/Benchmarks/Shootout-C++/matrix: -9.52% (0.2100 => 0.1900)
SingleSource/Benchmarks/Shootout-C++/ary3: -9.09% (0.2200 => 0.2000)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.57% (0.7000 => 0.6400)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -8.00% (0.2500 => 0.2300)
MultiSource/Benchmarks/Olden/em3d/em3d: -7.69% (0.1300 => 0.1200)
SingleSource/Benchmarks/McGill/chomp: -7.69% (0.1300 => 0.1200)
MultiSource/Benchmarks/McCat/05-eks/eks: -7.50% (0.4000 => 0.3700)
MultiSource/Applications/obsequi/Obsequi: -6.90% (0.8700 => 0.8100)
SingleSource/Benchmarks/Shootout-C++/hello: -6.25% (0.1600 => 0.1500)
SingleSource/Benchmarks/Shootout-C++/hash2: -5.71% (0.3500 => 0.3300)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.45% (0.5500 => 0.5200)
SingleSource/Benchmarks/Shootout-C++/except: -5.26% (0.1900 => 0.1800)
SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.1900 => 0.1800)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -5.00% (0.4000 => 0.3800)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/employ/employ: -100.00% (0.0100 => 0.0000)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -50.00% (0.0200 => 0.0100)
MultiSource/Applications/JM/ldecod/ldecod: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/McCat/08-main/main: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Shootout-C++/moments: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Misc-C++/bigfib: -20.59% (0.3400 => 0.2700)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -14.29% (0.2100 => 0.1800)
MultiSource/Benchmarks/Olden/perimeter/perimeter: -13.04% (0.2300 => 0.2000)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -9.09% (0.2200 => 0.2000)
SingleSource/Benchmarks/Shootout-C++/methcall: -9.00% (5.0000 => 4.5500)
SingleSource/Benchmarks/Shootout-C++/hash: -6.38% (0.4700 => 0.4400)
SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.25% (0.1600 => 0.1500)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.21% (3.2200 => 3.0200)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 0.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120403/7b4677cb/attachment.html>
More information about the llvm-testresults
mailing list