[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Apr 3 00:21:29 PDT 2012
http://llvm.org/perf/db_default/v4/nts/25?compare_to=23&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 25, Order: 153937, Start Time: 2012-04-03 07:07:00, End Time: 2012-04-03 07:21:31
To: 23, Order: 153935, Start Time: 2012-04-03 05:33:12, End Time: 2012-04-03 05:47:40
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 5 (91 on baseline)
Performance Improvements: 10 (90 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 865 (699 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 17.07% (0.4100 => 0.4800, std. dev.: 0.0224)
MultiSource/Benchmarks/Bullet/bullet: 1.13% (26.4800 => 26.7800, std. dev.: 0.0774)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/partialsums: 17.46% (0.6300 => 0.7400, std. dev.: 0.0070)
SingleSource/Benchmarks/Shootout-C++/lists: 13.59% (4.9300 => 5.6000, std. dev.: 0.1286)
SingleSource/Benchmarks/Misc/whetstone: 1.47% (1.3600 => 1.3800, std. dev.: 0.0045)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/2003-06-08-BaseType: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
SingleSource/Regression/C++/2003-06-13-Crasher: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
SingleSource/Regression/C++/2003-08-20-EnumSizeProblem: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
SingleSource/Regression/C/PR491: -100.00% (0.0200 => 0.0000, std. dev.: 0.0046)
SingleSource/UnitTests/2003-07-09-SignedArgs: -100.00% (0.0200 => 0.0000, std. dev.: 0.0049)
SingleSource/Benchmarks/Misc/fbench: -71.43% (0.0700 => 0.0200, std. dev.: 0.0092)
SingleSource/Benchmarks/Stanford/Oscar: -50.00% (0.0600 => 0.0300, std. dev.: 0.0070)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/UnitTests/SignlessTypes/Large/cast: -100.00% (0.0100 => 0.0000, std. dev.: 0.0030)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.59% (1.2600 => 1.2400, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc/fbench: -1.14% (1.7500 => 1.7300, std. dev.: 0.0060)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Shootout/hash: 150.00% (0.0200 => 0.0500)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 133.33% (0.0300 => 0.0700)
MultiSource/Benchmarks/Prolangs-C++/family/family: 100.00% (0.0200 => 0.0400)
MultiSource/Benchmarks/llubenchmark/llu: 100.00% (0.0200 => 0.0400)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Misc/fp-convert: 100.00% (0.0100 => 0.0200)
SingleSource/Benchmarks/Stanford/Quicksort: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C++/pointer_method: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-05-22-VarSizeArray: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/ConstructorDestructorAttributes: 100.00% (0.0100 => 0.0200)
SingleSource/Regression/C/badidx: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-05-02-ManyArguments: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2002-12-13-MishaTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-07-06-IntOverflow: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-09-18-BitFieldTest: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2003-10-29-ScalarReplBug: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2005-05-13-SDivTwo: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/2005-07-17-INT-To-FP: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/ms_struct_pack_layout: 100.00% (0.0100 => 0.0200)
SingleSource/UnitTests/printargs: 100.00% (0.0100 => 0.0200)
MultiSource/Applications/aha/aha: 80.00% (0.0500 => 0.0900)
MultiSource/Benchmarks/Ptrdist/ft/ft: 60.00% (0.1000 => 0.1600)
MultiSource/Benchmarks/Olden/mst/mst: 50.00% (0.0600 => 0.0900)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 41.18% (0.1700 => 0.2400)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 40.00% (0.0500 => 0.0700)
SingleSource/Benchmarks/CoyoteBench/almabench: 40.00% (0.0500 => 0.0700)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 33.33% (0.0600 => 0.0800)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/IntMM: 33.33% (0.0300 => 0.0400)
SingleSource/Benchmarks/Stanford/RealMM: 33.33% (0.0300 => 0.0400)
SingleSource/UnitTests/Vector/SSE/sse_shift: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.57% (0.1400 => 0.1800)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 28.57% (0.0700 => 0.0900)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 28.57% (0.0700 => 0.0900)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 26.67% (0.1500 => 0.1900)
MultiSource/Benchmarks/McCat/15-trie/trie: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/Olden/power/power: 25.00% (0.0800 => 0.1000)
SingleSource/Benchmarks/Misc/salsa20: 25.00% (0.0400 => 0.0500)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 22.22% (0.0900 => 0.1100)
MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 21.43% (0.1400 => 0.1700)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 18.75% (0.1600 => 0.1900)
SingleSource/Benchmarks/Shootout-C++/ackermann: 18.75% (0.1600 => 0.1900)
MultiSource/Applications/viterbi/viterbi: 18.18% (0.1100 => 0.1300)
MultiSource/Benchmarks/Ptrdist/ks/ks: 18.18% (0.1100 => 0.1300)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.54% (0.5700 => 0.6700)
MultiSource/Benchmarks/FreeBench/neural/neural: 16.67% (0.1200 => 0.1400)
MultiSource/Benchmarks/Prolangs-C++/life/life: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/Prolangs-C++/trees/trees: 16.67% (0.0600 => 0.0700)
SingleSource/Benchmarks/McGill/exptree: 16.67% (0.0600 => 0.0700)
MultiSource/Benchmarks/McCat/08-main/main: 15.79% (0.1900 => 0.2200)
SingleSource/Benchmarks/Misc/himenobmtxpa: 15.38% (0.1300 => 0.1500)
MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 14.29% (0.4200 => 0.4800)
MultiSource/Applications/lambda-0_1_3/lambda: 12.77% (0.4700 => 0.5300)
SingleSource/Benchmarks/Misc/oourafft: 12.50% (0.1600 => 0.1800)
SingleSource/Regression/C++/ofstream_ctor: 12.50% (0.1600 => 0.1800)
MultiSource/Benchmarks/Prolangs-C++/office/office: 11.76% (0.1700 => 0.1900)
SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.76% (0.1700 => 0.1900)
SingleSource/Benchmarks/Shootout-C++/objinst: 11.76% (0.1700 => 0.1900)
MultiSource/Benchmarks/Olden/health/health: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/Olden/tsp/tsp: 11.11% (0.0900 => 0.1000)
SingleSource/Benchmarks/Shootout-C++/heapsort: 11.11% (0.1800 => 0.2000)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 11.11% (0.0900 => 0.1000)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 10.34% (0.5800 => 0.6400)
MultiSource/Benchmarks/Prolangs-C/loader/loader: 8.70% (0.2300 => 0.2500)
MultiSource/Benchmarks/nbench/nbench: 8.33% (0.8400 => 0.9100)
SingleSource/Benchmarks/Shootout-C++/lists1: 8.00% (0.2500 => 0.2700)
MultiSource/Benchmarks/Olden/em3d/em3d: 7.69% (0.1300 => 0.1400)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.69% (0.1300 => 0.1400)
MultiSource/Applications/Burg/burg: 7.14% (0.8400 => 0.9000)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.02% (3.4200 => 3.6600)
MultiSource/Applications/hexxagon/hexxagon: 6.41% (0.7800 => 0.8300)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 6.19% (0.9700 => 1.0300)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 6.12% (0.4900 => 0.5200)
MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.56% (0.1800 => 0.1900)
SingleSource/Benchmarks/Shootout-C++/strcat: 5.56% (0.1800 => 0.1900)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/kimwitu++/kc: 200.00% (0.0100 => 0.0300)
SingleSource/Benchmarks/Stanford/Treesort: 40.00% (0.0500 => 0.0700)
SingleSource/Benchmarks/Shootout-C++/ary: 33.33% (0.0300 => 0.0400)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.56% (0.7200 => 0.9400)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.86% (1.3900 => 1.6800)
SingleSource/Benchmarks/BenchmarkGame/partialsums: 17.46% (0.6300 => 0.7400)
SingleSource/Benchmarks/Shootout-C++/lists: 13.59% (4.9300 => 5.6000)
SingleSource/Benchmarks/Shootout/strcat: 7.69% (0.1300 => 0.1400)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: 7.50% (0.4000 => 0.4300)
MultiSource/Benchmarks/nbench/nbench: 6.26% (16.9200 => 17.9800)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.25% (0.1600 => 0.1700)
SingleSource/Benchmarks/Shootout-C++/lists1: 5.26% (0.1900 => 0.2000)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C++/2003-06-08-BaseType: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C++/2003-06-13-Crasher: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C++/2003-08-20-EnumSizeProblem: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2003-05-14-initialize-string: -100.00% (0.0100 => 0.0000)
SingleSource/Regression/C/2003-05-21-BitfieldHandling: -100.00% (0.0200 => 0.0000)
SingleSource/Regression/C/PR491: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2002-10-09-ArrayResolution: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2002-10-13-BadLoad: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/2003-07-09-SignedArgs: -100.00% (0.0300 => 0.0000)
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2006-02-04-DivRem: -100.00% (0.0200 => 0.0000)
SingleSource/UnitTests/2008-04-18-LoopBug: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/block-byref-test: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/block-copied-in-cxxobj: -100.00% (0.0100 => 0.0000)
SingleSource/Benchmarks/Misc/fbench: -66.67% (0.0600 => 0.0200)
SingleSource/Benchmarks/Misc/flops-3: -66.67% (0.0300 => 0.0100)
SingleSource/Benchmarks/Misc/flops-8: -66.67% (0.0300 => 0.0100)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -60.00% (0.0500 => 0.0200)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: -57.14% (0.0700 => 0.0300)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -50.00% (0.0400 => 0.0200)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -50.00% (0.0600 => 0.0300)
SingleSource/Benchmarks/Dhrystone/dry: -50.00% (0.0400 => 0.0200)
SingleSource/Benchmarks/Misc/pi: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/BuiltinTypeInfo: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/ConditionalExpr: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/dead_try_block: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/EH/simple_rethrow: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C++/pointer_member: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/2003-05-23-TransparentUnion: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/PR1386: -50.00% (0.0200 => 0.0100)
SingleSource/Regression/C/globalrefs: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2002-05-02-CastTest2: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2002-05-19-DivTest: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-05-26-Shorts: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-05-31-CastToBool: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2003-08-05-CastFPToUint: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2005-05-12-Int64ToFP: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2005-11-29-LongSwitch: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/2007-03-02-VaCopy: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/AtomicOps: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/TestLoop: -50.00% (0.0200 => 0.0100)
SingleSource/UnitTests/byval-alignment: -50.00% (0.0200 => 0.0100)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -40.00% (0.1000 => 0.0600)
SingleSource/Benchmarks/Misc/mandel: -40.00% (0.0500 => 0.0300)
SingleSource/UnitTests/Vector/SSE/sse_isamax: -37.50% (0.0800 => 0.0500)
MultiSource/Benchmarks/FreeBench/mason/mason: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/BitBench/drop3/drop3: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Misc/dt: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Shootout/heapsort: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Stanford/FloatMM: -25.00% (0.0400 => 0.0300)
SingleSource/Benchmarks/Stanford/Oscar: -25.00% (0.0400 => 0.0300)
SingleSource/Regression/C/bigstack: -25.00% (0.0400 => 0.0300)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -22.22% (0.1800 => 0.1400)
MultiSource/Benchmarks/Olden/bisort/bisort: -20.00% (0.0500 => 0.0400)
SingleSource/UnitTests/SignlessTypes/Large/cast: -20.00% (0.0500 => 0.0400)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -13.33% (0.1500 => 0.1300)
MultiSource/Benchmarks/SciMark2-C/scimark2: -13.04% (0.2300 => 0.2000)
SingleSource/Benchmarks/Misc/ReedSolomon: -12.50% (0.1600 => 0.1400)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -10.00% (0.1000 => 0.0900)
SingleSource/UnitTests/SignlessTypes/rem: -10.00% (0.1000 => 0.0900)
SingleSource/Benchmarks/Shootout-C++/matrix: -9.52% (0.2100 => 0.1900)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -9.09% (0.5500 => 0.5000)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.66% (1.2700 => 1.1600)
SingleSource/Benchmarks/McGill/chomp: -7.69% (0.1300 => 0.1200)
MultiSource/Benchmarks/McCat/05-eks/eks: -7.50% (0.4000 => 0.3700)
MultiSource/Applications/obsequi/Obsequi: -6.90% (0.8700 => 0.8100)
SingleSource/Benchmarks/Shootout-C++/except: -5.26% (0.1900 => 0.1800)
SingleSource/Benchmarks/Shootout-C++/methcall: -5.26% (0.1900 => 0.1800)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/city/city: -100.00% (0.0100 => 0.0000)
SingleSource/UnitTests/SignlessTypes/Large/cast: -100.00% (0.0100 => 0.0000)
MultiSource/Applications/JM/ldecod/ldecod: -42.86% (0.0700 => 0.0400)
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.57% (0.0700 => 0.0500)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.81% (0.2100 => 0.1600)
SingleSource/Benchmarks/Misc-C++/bigfib: -17.65% (0.3400 => 0.2800)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -14.29% (0.0700 => 0.0600)
MultiSource/Benchmarks/Olden/health/health: -6.90% (0.2900 => 0.2700)
MultiSource/Applications/spiff/spiff: -6.45% (1.8600 => 1.7400)
SingleSource/Benchmarks/Shootout-C++/hash: -6.38% (0.4700 => 0.4400)
SingleSource/Benchmarks/Shootout-C++/nestedloop: -6.25% (0.1600 => 0.1500)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.21% (3.2200 => 3.0200)
SingleSource/Benchmarks/Shootout-C++/methcall: -6.00% (5.0000 => 4.7000)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 0.42s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120403/cae8ff8d/attachment.html>
More information about the llvm-testresults
mailing list