[llvm-testresults] llvmsuitebot1__clang_DEV__x86_64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Apr 5 14:34:42 PDT 2012
http://llvm.org/perf/db_default/v4/nts/129?compare_to=126&baseline=4
Nickname: llvmsuitebot1__clang_DEV__x86_64:2
Comparing:
Run: 129, Order: 154116, Start Time: 2012-04-05 20:51:12, End Time: 2012-04-05 21:34:45
To: 126, Order: 154113, Start Time: 2012-04-05 19:02:59, End Time: 2012-04-05 19:46:27
Baseline: 4, Order: 153780, Start Time: 2012-03-30 22:20:19, End Time: 2012-03-30 22:34:44
===============
Tests Summary
===============
Performance Regressions: 50 (45 on baseline)
Performance Improvements: 11 (50 on baseline)
Existing Failures: 8 (8 on baseline)
Unchanged Tests: 819 (785 on baseline)
Total Tests: 888
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/UnitTests/SignlessTypes/div: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/build2: 200.00% (0.0100 => 0.0300, std. dev.: 0.0000)
MultiSource/Benchmarks/BitBench/uudecode/uudecode: 100.00% (0.0200 => 0.0400, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout/fib2: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/EH/inlined_cleanup: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/fixups: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/pointer_method: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/2008-01-07-LongDouble: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C/PR491: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2003-05-12-MinIntProblem: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2003-07-09-LoadShorts: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/TestLoop: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 75.00% (0.0400 => 0.0700, std. dev.: 0.0082)
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 38.89% (0.1800 => 0.2500, std. dev.: 0.0047)
MultiSource/Benchmarks/BitBench/five11/five11: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/bh/bh: 33.33% (0.1800 => 0.2400, std. dev.: 0.0047)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 30.23% (0.4300 => 0.5600, std. dev.: 0.0386)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.57% (0.1400 => 0.1800, std. dev.: 0.0082)
SingleSource/Regression/C++/ofstream_ctor: 28.57% (0.1400 => 0.1800, std. dev.: 0.0082)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 26.09% (0.4600 => 0.5800, std. dev.: 0.0216)
MultiSource/Benchmarks/FreeBench/mason/mason: 25.00% (0.0400 => 0.0500, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_expandfft: 25.00% (0.0800 => 0.1000, std. dev.: 0.0047)
MultiSource/Benchmarks/McCat/09-vor/vor: 25.00% (0.2000 => 0.2500, std. dev.: 0.0094)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 23.08% (0.1300 => 0.1600, std. dev.: 0.0094)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 18.92% (0.3700 => 0.4400, std. dev.: 0.0170)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 18.18% (0.1100 => 0.1300, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/objinst: 11.76% (0.1700 => 0.1900, std. dev.: 0.0047)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 9.52% (0.2100 => 0.2300, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 8.33% (0.2400 => 0.2600, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C++/employ/employ: 8.00% (0.2500 => 0.2700, std. dev.: 0.0047)
SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (0.3100 => 0.3300, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.36% (0.5600 => 0.5900, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/football/football: 4.76% (0.6300 => 0.6600, std. dev.: 0.0082)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.06% (3.5900 => 3.7000, std. dev.: 0.0340)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.00% (1.0000 => 1.0300, std. dev.: 0.0082)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.79% (3.2300 => 3.3200, std. dev.: 0.0205)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.37% (5.4800 => 5.6100, std. dev.: 0.0497)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.71% (1.1700 => 1.1900, std. dev.: 0.0047)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 1.33% (10.5600 => 10.7000, std. dev.: 0.0327)
MultiSource/Applications/JM/lencod/lencod: 1.26% (11.9100 => 12.0600, std. dev.: 0.0374)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 300.00% (0.0100 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 15.38% (0.1300 => 0.1500, std. dev.: 0.0000)
MultiSource/Benchmarks/McCat/17-bintr/bintr: 11.11% (0.0900 => 0.1000, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout-C++/hash2: 4.76% (2.5200 => 2.6400, std. dev.: 0.0125)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.85% (0.2600 => 0.2700, std. dev.: 0.0000)
MultiSource/Benchmarks/BitBench/drop3/drop3: 3.23% (0.3100 => 0.3200, std. dev.: 0.0000)
MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.13% (0.3200 => 0.3300, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/tsp/tsp: 2.63% (1.1400 => 1.1700, std. dev.: 0.0000)
SingleSource/Benchmarks/CoyoteBench/fftbench: 2.63% (0.7600 => 0.7800, std. dev.: 0.0000)
SingleSource/Benchmarks/BenchmarkGame/recursive: 1.10% (0.9100 => 0.9200, std. dev.: 0.0000)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C/ConstructorDestructorAttributes: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/UnitTests/2003-10-13-SwitchTest: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout/random: -66.67% (0.0300 => 0.0100, std. dev.: 0.0047)
MultiSource/Benchmarks/llubenchmark/llu: -50.00% (0.0400 => 0.0200, std. dev.: 0.0047)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -33.33% (0.0600 => 0.0400, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/power/power: -20.00% (0.1000 => 0.0800, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -20.00% (0.0500 => 0.0400, std. dev.: 0.0000)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/Shootout-C++/moments: -20.00% (0.0500 => 0.0400, std. dev.: 0.0000)
MultiSource/Applications/sqlite3/sqlite3: -1.39% (3.6000 => 3.5500, std. dev.: 0.0141)
MultiSource/Applications/obsequi/Obsequi: -1.18% (1.7000 => 1.6800, std. dev.: 0.0047)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -1.18% (2.5500 => 2.5200, std. dev.: 0.0082)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Regression/C++/EH/simple_throw: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/fixups: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/Regression/C++/pointer_method: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2002-10-12-StructureArgsSimple: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/2003-05-12-MinIntProblem: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/SignlessTypes/cast2: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
SingleSource/UnitTests/ms_struct-bitfield-init: 100.00% (0.0100 => 0.0200, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 47.06% (0.1700 => 0.2500, std. dev.: 0.0047)
MultiSource/Applications/aha/aha: 40.00% (0.0500 => 0.0700, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 28.57% (0.1400 => 0.1800, std. dev.: 0.0082)
MultiSource/Benchmarks/Fhourstones/fhourstones: 25.00% (0.0800 => 0.1000, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: 18.18% (0.2200 => 0.2600, std. dev.: 0.0000)
MultiSource/Benchmarks/Prolangs-C++/objects/objects: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
SingleSource/Benchmarks/McGill/exptree: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
MultiSource/Applications/spiff/spiff: 12.28% (0.5700 => 0.6400, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/objinst: 11.76% (0.1700 => 0.1900, std. dev.: 0.0047)
MultiSource/Applications/hexxagon/hexxagon: 11.54% (0.7800 => 0.8700, std. dev.: 0.0163)
MultiSource/Applications/lambda-0_1_3/lambda: 10.64% (0.4700 => 0.5200, std. dev.: 0.0125)
SingleSource/Benchmarks/CoyoteBench/fftbench: 10.00% (0.3000 => 0.3300, std. dev.: 0.0000)
MultiSource/Benchmarks/Olden/bh/bh: 9.09% (0.2200 => 0.2400, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 8.70% (0.2300 => 0.2500, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 5.36% (0.5600 => 0.5900, std. dev.: 0.0000)
MultiSource/Applications/Burg/burg: 4.76% (0.8400 => 0.8800, std. dev.: 0.0141)
MultiSource/Benchmarks/mafft/pairlocalalign: 2.79% (6.8200 => 7.0100, std. dev.: 0.0125)
MultiSource/Applications/SPASS/SPASS: 2.38% (11.3300 => 11.6000, std. dev.: 0.0205)
MultiSource/Benchmarks/Bullet/bullet: 2.04% (26.5000 => 27.0400, std. dev.: 0.1236)
MultiSource/Applications/kimwitu++/kc: 1.90% (12.6200 => 12.8600, std. dev.: 0.0822)
MultiSource/Applications/lua/lua: 1.29% (3.0900 => 3.1300, std. dev.: 0.0047)
MultiSource/Benchmarks/PAQ8p/paq8p: 1.27% (1.5800 => 1.6000, std. dev.: 0.0047)
MultiSource/Applications/sqlite3/sqlite3: 1.23% (12.2100 => 12.3600, std. dev.: 0.0205)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.23% (1.6300 => 1.6500, std. dev.: 0.0047)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
SingleSource/Benchmarks/Stanford/Quicksort: 33.33% (0.0300 => 0.0400, std. dev.: 0.0000)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 30.56% (0.7200 => 0.9400, std. dev.: 0.0000)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 20.14% (1.3900 => 1.6700, std. dev.: 0.0047)
MultiSource/Benchmarks/McCat/18-imp/imp: 16.67% (0.0600 => 0.0700, std. dev.: 0.0000)
SingleSource/UnitTests/Vector/SSE/sse_stepfft: 5.00% (0.4000 => 0.4200, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/hash2: 3.94% (2.5400 => 2.6400, std. dev.: 0.0125)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 3.85% (0.2600 => 0.2700, std. dev.: 0.0000)
MultiSource/Benchmarks/BitBench/drop3/drop3: 3.23% (0.3100 => 0.3200, std. dev.: 0.0000)
MultiSource/Applications/lua/lua: 1.32% (22.6900 => 22.9900, std. dev.: 0.0732)
SingleSource/Benchmarks/CoyoteBench/fftbench: 1.30% (0.7700 => 0.7800, std. dev.: 0.0000)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.27% (0.7900 => 0.8000, std. dev.: 0.0000)
MultiSource/Applications/siod/siod: 1.03% (2.9200 => 2.9500, std. dev.: 0.0047)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Shootout/ary3: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/Regression/C++/global_ctor: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/Regression/C/2003-05-21-BitfieldHandling: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/UnitTests/2002-05-02-CastTest1: -100.00% (0.0100 => 0.0000, std. dev.: 0.0000)
SingleSource/UnitTests/2003-10-13-SwitchTest: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/UnitTests/2005-11-29-LongSwitch: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: -100.00% (0.0200 => 0.0000, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout/random: -66.67% (0.0300 => 0.0100, std. dev.: 0.0047)
MultiSource/Benchmarks/BitBench/uuencode/uuencode: -60.00% (0.0500 => 0.0200, std. dev.: 0.0082)
MultiSource/Benchmarks/Olden/treeadd/treeadd: -50.00% (0.0400 => 0.0200, std. dev.: 0.0000)
MultiSource/Benchmarks/VersaBench/8b10b/8b10b: -50.00% (0.0600 => 0.0300, std. dev.: 0.0094)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -50.00% (0.0600 => 0.0300, std. dev.: 0.0082)
SingleSource/Regression/C++/2011-03-28-Bitfield: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
SingleSource/UnitTests/2003-04-22-Switch: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
SingleSource/UnitTests/2003-05-31-CastToBool: -50.00% (0.0200 => 0.0100, std. dev.: 0.0000)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -42.86% (0.0700 => 0.0400, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/bisort/bisort: -40.00% (0.0500 => 0.0300, std. dev.: 0.0047)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -30.00% (0.1000 => 0.0700, std. dev.: 0.0094)
MultiSource/Benchmarks/FreeBench/mason/mason: -28.57% (0.0700 => 0.0500, std. dev.: 0.0000)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -25.00% (0.0400 => 0.0300, std. dev.: 0.0000)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -22.22% (0.1800 => 0.1400, std. dev.: 0.0141)
MultiSource/Benchmarks/BitBench/five11/five11: -20.00% (0.0500 => 0.0400, std. dev.: 0.0000)
SingleSource/Benchmarks/Misc/ReedSolomon: -12.50% (0.1600 => 0.1400, std. dev.: 0.0047)
SingleSource/Benchmarks/Shootout-C++/except: -10.53% (0.1900 => 0.1700, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.50% (0.4000 => 0.3700, std. dev.: 0.0047)
MultiSource/Applications/obsequi/Obsequi: -6.90% (0.8700 => 0.8100, std. dev.: 0.0216)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.30% (1.2700 => 1.1900, std. dev.: 0.0047)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -5.66% (2.6500 => 2.5000, std. dev.: 0.0163)
MultiSource/Applications/oggenc/oggenc: -4.99% (4.0100 => 3.8100, std. dev.: 0.0082)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -28.57% (0.0700 => 0.0500, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc-C++/bigfib: -23.53% (0.3400 => 0.2600, std. dev.: 0.0189)
MultiSource/Benchmarks/McCat/09-vor/vor: -18.18% (0.1100 => 0.0900, std. dev.: 0.0047)
MultiSource/Benchmarks/Olden/health/health: -13.79% (0.2900 => 0.2500, std. dev.: 0.0047)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -12.50% (0.2400 => 0.2100, std. dev.: 0.0082)
SingleSource/Benchmarks/Shootout-C++/methcall: -8.80% (5.0000 => 4.5600, std. dev.: 0.0685)
SingleSource/Benchmarks/Shootout-C++/hash: -8.51% (0.4700 => 0.4300, std. dev.: 0.0125)
MultiSource/Applications/spiff/spiff: -6.99% (1.8600 => 1.7300, std. dev.: 0.0340)
SingleSource/Benchmarks/Misc-C++/Large/ray: -6.21% (3.2200 => 3.0200, std. dev.: 0.0047)
MultiSource/Benchmarks/Prolangs-C++/life/life: -4.39% (1.1400 => 1.0900, std. dev.: 0.0094)
SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.43% (4.1200 => 4.0200, std. dev.: 0.0047)
MultiSource/Applications/SIBsim4/SIBsim4: -2.41% (3.7300 => 3.6400, std. dev.: 0.0236)
SingleSource/Benchmarks/Misc/salsa20: -1.90% (7.8800 => 7.7300, std. dev.: 0.0525)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.80% (1.1100 => 1.0900, std. dev.: 0.0047)
SingleSource/Benchmarks/Misc/pi: -1.67% (0.6000 => 0.5900, std. dev.: 0.0000)
SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.59% (0.6300 => 0.6200, std. dev.: 0.0000)
MultiSource/Applications/viterbi/viterbi: -1.50% (2.0000 => 1.9700, std. dev.: 0.0082)
SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.41% (3.5400 => 3.4900, std. dev.: 0.0000)
SingleSource/Benchmarks/Shootout/methcall: -1.29% (3.8700 => 3.8200, std. dev.: 0.0170)
MultiSource/Applications/obsequi/Obsequi: -1.18% (1.7000 => 1.6800, std. dev.: 0.0047)
MultiSource/Benchmarks/Bullet/bullet: -1.04% (4.8000 => 4.7500, std. dev.: 0.0170)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Olden/voronoi/voronoi
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
Report Time: 0.95s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20120405/0041973d/attachment.html>
More information about the llvm-testresults
mailing list