[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Apr 3 22:11:27 PDT 2012
http://llvm.org/perf/db_default/v4/nts/63?compare_to=61&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 63, Order: 153996, Start Time: 2012-04-04 04:57:03, End Time: 2012-04-04 05:11:30
To: 61, Order: 153995, Start Time: 2012-04-04 04:21:11, End Time: 2012-04-04 04:35:37
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 6 (80 on baseline)
Performance Improvements: 14 (96 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 860 (704 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.78% (0.7200 => 0.7400, std. dev.: 0.0049)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/hash2: 17.56% (2.6200 => 3.0800, std. dev.: 0.0768)
SingleSource/Benchmarks/Shootout-C++/objinst: 2.93% (4.7800 => 4.9200, std. dev.: 0.0150)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 1.74% (1.1500 => 1.1700, std. dev.: 0.0045)
SingleSource/Benchmarks/Shootout/matrix: 1.09% (2.7500 => 2.7800, std. dev.: 0.0100)
MultiSource/Applications/lua/lua: 1.00% (22.9900 => 23.2200, std. dev.: 0.0522)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/global_type: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
SingleSource/Regression/C++/pointer_member: -100.00% (0.0200 => 0.0000, std. dev.: 0.0030)
SingleSource/UnitTests/Threads/tls: -100.00% (0.0200 => 0.0000, std. dev.: 0.0049)
SingleSource/Benchmarks/Stanford/Treesort: -75.00% (0.0400 => 0.0100, std. dev.: 0.0064)
SingleSource/Benchmarks/Misc/salsa20: -66.67% (0.0300 => 0.0100, std. dev.: 0.0046)
SingleSource/Benchmarks/Stanford/Queens: -50.00% (0.0200 => 0.0100, std. dev.: 0.0030)
MultiSource/Benchmarks/FreeBench/distray/distray: -37.50% (0.0800 => 0.0500, std. dev.: 0.0090)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -33.33% (0.0600 => 0.0400, std. dev.: 0.0077)
SingleSource/Benchmarks/Shootout-C++/sieve: -20.00% (0.2500 => 0.2000, std. dev.: 0.0111)
SingleSource/Benchmarks/Shootout-C++/methcall: -16.67% (0.1800 => 0.1500, std. dev.: 0.0087)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -8.11% (0.3700 => 0.3400, std. dev.: 0.0066)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -3.36% (1.1900 => 1.1500, std. dev.: 0.0089)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Stanford/Treesort: -42.86% (0.0700 => 0.0400, std. dev.: 0.0066)
MultiSource/Benchmarks/Fhourstones/fhourstones: -2.13% (0.9400 => 0.9200, std. dev.: 0.0050)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Stanford/Quicksort: 200.00% (0.0100 => 0.0300)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 100.00% (0.0100 => 0.0200)
MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 100.00% (0.0100 => 0.0200)
MultiSource/Benchmarks/llubenchmark/llu: 100.00% (0.0200 => 0.0400)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 100.00% (0.0200 => 0.0400)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Misc/fp-convert: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Shootout/hash: 100.00% (0.0200 => 0.0400)
SingleSource/Regression/C++/fixups: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/short_circuit_dtor: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/badidx: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/matrixTranspose: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-05-12-MinIntProblem: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-05-14-AtExit: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-09-18-BitFieldTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2006-12-01-float_varg: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/DefaultInitDynArrays: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/SignlessTypes/cast2: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/Vector/sumarray-dbl: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/printargs: 100.00% (0.0100 => 0.0200)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 58.82% (0.1700 => 0.2700)
MultiSource/Benchmarks/Ptrdist/ft/ft: 50.00% (0.1000 => 0.1500)
SingleSource/Benchmarks/Stanford/Oscar: 50.00% (0.0400 => 0.0600)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 42.86% (0.1400 => 0.2000)
MultiSource/Applications/aha/aha: 40.00% (0.0500 => 0.0700)
MultiSource/Applications/viterbi/viterbi: 36.36% (0.1100 => 0.1500)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: 33.33% (0.0600 => 0.0800)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Dhrystone/fldry: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Shootout/objinst: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0300 => 0.0400)
SingleSource/Regression/C/uint64_to_float: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/BitBench/drop3/drop3: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0800 => 0.1000)
MultiSource/Benchmarks/McCat/15-trie/trie: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/Olden/power/power: 25.00% (0.0800 => 0.1000)
SingleSource/Benchmarks/Dhrystone/dry: 25.00% (0.0400 => 0.0500)
SingleSource/Regression/C++/ofstream_ctor: 25.00% (0.1600 => 0.2000)
MultiSource/Benchmarks/Olden/health/health: 22.22% (0.0900 => 0.1100)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.43% (0.1400 => 0.1700)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 20.00% (0.1500 => 0.1800)
MultiSource/Benchmarks/Prolangs-C++/life/life: 16.67% (0.0600 => 0.0700)
MultiSource/Applications/spiff/spiff: 12.28% (0.5700 => 0.6400)
MultiSource/Applications/hexxagon/hexxagon: 11.54% (0.7800 => 0.8700)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 11.11% (0.1800 => 0.2000)
SingleSource/Benchmarks/Shootout-C++/random: 11.11% (0.1800 => 0.2000)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.71% (0.5600 => 0.6200)
MultiSource/Applications/lambda-0_1_3/lambda: 10.64% (0.4700 => 0.5200)
MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 10.00% (0.2000 => 0.2200)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 9.09% (0.2200 => 0.2400)
SingleSource/Benchmarks/Shootout-C++/lists1: 8.00% (0.2500 => 0.2700)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.69% (0.1300 => 0.1400)
SingleSource/Benchmarks/Misc/himenobmtxpa: 7.69% (0.1300 => 0.1400)
MultiSource/Applications/hbd/hbd: 7.41% (1.0800 => 1.1600)
SingleSource/Benchmarks/CoyoteBench/fftbench: 6.67% (0.3000 => 0.3200)
SingleSource/Benchmarks/Shootout-C++/moments: 6.67% (0.3000 => 0.3200)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 6.25% (0.1600 => 0.1700)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 6.25% (0.4800 => 0.5100)
SingleSource/Benchmarks/Shootout-C++/ackermann: 6.25% (0.1600 => 0.1700)
MultiSource/Applications/Burg/burg: 5.95% (0.8400 => 0.8900)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 5.56% (3.4200 => 3.6100)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 5.26% (0.5700 => 0.6000)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/kimwitu++/kc: 100.00% (0.0100 => 0.0200)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: 100.00% (0.0100 => 0.0200)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Shootout-C++/ary: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 31.94% (0.7200 => 0.9500)
SingleSource/Benchmarks/Shootout-C++/hash2: 21.26% (2.5400 => 3.0800)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.14% (1.3900 => 1.6700)
MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 8.70% (0.6900 => 0.7500)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Shootout/ary3: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C++/EH/ctor_dtor_count: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C++/EH/ctor_dtor_count-2: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C++/EH/throw_rethrow_test: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C++/global_type: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C++/pointer_member: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C/2003-05-14-initialize-string: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2002-08-02-CastTest: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2002-08-02-CastTest2: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2004-02-02-NegativeZero: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2005-05-12-Int64ToFP: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2005-05-13-SDivTwo: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2009-12-07-StructReturn: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/Threads/2010-12-08-tls: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/Threads/tls: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/Vector/multiplies: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/ms_struct-bitfield-init-1: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/ms_struct_pack_layout-1: -100.00% (0.0100 => 0.0000)
SingleSource/Benchmarks/Misc/salsa20: -75.00% (0.0400 => 0.0100)
SingleSource/Benchmarks/Stanford/Queens: -66.67% (0.0300 => 0.0100)
SingleSource/Regression/C++/EH/function_try_block: -66.67% (0.0300 => 0.0100)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -60.00% (0.0500 => 0.0200)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -50.00% (0.0400 => 0.0200)
MultiSource/Benchmarks/Prolangs-C++/NP/np: -50.00% (0.0200 => 0.0100)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -50.00% (0.0600 => 0.0300)
SingleSource/Benchmarks/Stanford/Treesort: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/ConditionalExpr: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/dead_try_block: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/simple_rethrow: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2003-05-21-BitfieldHandling: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2003-05-22-LocalTypeTest: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2008-01-07-LongDouble: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/PR1386: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2002-05-19-DivTest: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-10-13-SwitchTest: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2007-03-02-VaCopy: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/TestLoop: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/Vector/divides: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/Vector/sumarray: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/byval-alignment: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/stmtexpr: -50.00% (0.0200 => 0.0100)
MultiSource/Benchmarks/FreeBench/distray/distray: -37.50% (0.0800 => 0.0500)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -37.50% (0.0800 => 0.0500)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Misc/dt: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Shootout/heapsort: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Stanford/FloatMM: -25.00% (0.0400 => 0.0300)
SingleSource/Regression/C/bigstack: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Olden/tsp/tsp: -22.22% (0.0900 => 0.0700)
SingleSource/Benchmarks/CoyoteBench/huffbench: -22.22% (0.0900 => 0.0700)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: -22.22% (0.0900 => 0.0700)
SingleSource/Benchmarks/Shootout-C++/methcall: -21.05% (0.1900 => 0.1500)
MultiSource/Benchmarks/McCat/17-bintr/bintr: -20.00% (0.0500 => 0.0400)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -20.00% (0.1000 => 0.0800)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -20.00% (0.1000 => 0.0800)
SingleSource/Benchmarks/Misc/mandel: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Misc/perlin: -20.00% (0.0500 => 0.0400)
SingleSource/Benchmarks/Shootout-C++/sieve: -16.67% (0.2400 => 0.2000)
MultiSource/Benchmarks/FreeBench/mason/mason: -14.29% (0.0700 => 0.0600)
SingleSource/Benchmarks/Shootout-C++/nestedloop: -11.76% (0.1700 => 0.1500)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -11.11% (0.1800 => 0.1600)
SingleSource/Benchmarks/CoyoteBench/lpbench: -10.00% (0.1000 => 0.0900)
SingleSource/UnitTests/SignlessTypes/rem: -10.00% (0.1000 => 0.0900)
SingleSource/Benchmarks/Shootout-C++/matrix: -9.52% (0.2100 => 0.1900)
SingleSource/Benchmarks/Shootout-C++/ary3: -9.09% (0.2200 => 0.2000)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -8.57% (0.7000 => 0.6400)
MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -7.87% (0.8900 => 0.8200)
SingleSource/Benchmarks/Shootout-C++/wordfreq: -7.69% (0.2600 => 0.2400)
MultiSource/Benchmarks/McCat/05-eks/eks: -7.50% (0.4000 => 0.3700)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.90% (0.5800 => 0.5400)
SingleSource/Benchmarks/Misc/ReedSolomon: -6.25% (0.1600 => 0.1500)
SingleSource/Benchmarks/Shootout-C++/hash: -6.06% (0.3300 => 0.3100)
SingleSource/Benchmarks/Shootout-C++/hash2: -5.71% (0.3500 => 0.3300)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -5.56% (0.3600 => 0.3400)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -100.00% (0.0100 => 0.0000)
MultiSource/Benchmarks/Prolangs-C++/city/city: -100.00% (0.0100 => 0.0000)
SingleSource/Benchmarks/Shootout-C++/ary2: -66.67% (0.0300 => 0.0100)
MultiSource/Applications/JM/ldecod/ldecod: -42.86% (0.0700 => 0.0400)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.57% (0.0700 => 0.0500)
SingleSource/Benchmarks/Shootout-C++/moments: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Stanford/Treesort: -20.00% (0.0500 => 0.0400)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -14.29% (0.2100 => 0.1800)
SingleSource/Benchmarks/Shootout-C++/hash: -8.51% (0.4700 => 0.4300)
SingleSource/Benchmarks/Shootout/strcat: -7.69% (0.1300 => 0.1200)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.21% (3.2200 => 3.0200)
SingleSource/Benchmarks/Shootout-C++/methcall: -6.00% (5.0000 => 4.7000)
SingleSource/Benchmarks/Misc-C++/bigfib: -5.88% (0.3400 => 0.3200)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 0.41s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120404/abb3b2d7/attachment.html>
More information about the llvm-testresults
mailing list