[llvm-testresults] linaro-chrome-03__LNT-TestOnly-O3__clang_DEV__armv7 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jan 8 11:56:33 PST 2014


http://llvm.org/perf/db_default/v4/nts/20052?compare_to=20047&baseline=17571
Nickname: linaro-chrome-03__LNT-TestOnly-O3__clang_DEV__armv7:19

Comparing:
     Run: 20052, Order: 198780, Start Time: 2014-01-08 19:10:36, End Time: 2014-01-08 20:01:20
      To: 20047, Order: 198775, Start Time: 2014-01-08 18:13:03, End Time: 2014-01-08 19:03:14
Baseline: 17571, Order: 195660, Start Time: 2013-11-25 19:30:19, End Time: 2013-11-25 20:16:10

===============
Tests Summary
===============

Performance Regressions: 7 (467 on baseline)
Performance Improvements: 7 (137 on baseline)
Unchanged Tests: 1096 (506 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-22-LocalTypeTest: 71.43% (0.0350 => 0.0600, std.dev.: 0.0065)
  SingleSource/UnitTests/2003-07-10-SignConversions: 66.67% (0.0450 => 0.0750, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 20.00% (0.1500 => 0.1800, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout-C++/hash: 10.66% (1.3600 => 1.5050, std.dev.: 0.0432)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 6.34% (16.5600 => 17.6100, std.dev.: 0.2957)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 35.17% (18.7950 => 25.4050, std.dev.: 1.7082)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.11% (4.5100 => 4.5600, std.dev.: 0.0093)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/block-byref-test: -100.00% (0.0250 => 0.0000, std.dev.: 0.0047)
  SingleSource/Regression/C++/2003-06-08-VirtualFunctions: -75.00% (0.0400 => 0.0100, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -30.19% (0.2650 => 0.1850, std.dev.: 0.0212)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -23.12% (0.9950 => 0.7650, std.dev.: 0.0576)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -15.91% (0.2200 => 0.1850, std.dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/08-main/main: -33.33% (0.1350 => 0.0900, std.dev.: 0.0059)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -18.82% (0.9300 => 0.7550, std.dev.: 0.0457)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2005-05-06-LongLongSignedShift: 400.00% (0.0050 => 0.0250)
  SingleSource/Regression/C/2003-06-16-VolatileError: 133.33% (0.0150 => 0.0350)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 125.00% (0.0200 => 0.0450)
  SingleSource/UnitTests/2003-07-10-SignConversions: 114.29% (0.0350 => 0.0750)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 72.73% (0.0550 => 0.0950)
  SingleSource/Regression/C/DuffsDevice: 72.73% (0.0550 => 0.0950)
  SingleSource/Regression/C++/2003-06-13-Crasher: 66.67% (0.0150 => 0.0250)
  SingleSource/Regression/C++/BuiltinTypeInfo: 62.50% (0.0400 => 0.0650)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 50.98% (0.2550 => 0.3850)
  MultiSource/Benchmarks/Prolangs-C++/fsm/fsm: 50.00% (0.1500 => 0.2250)
  SingleSource/UnitTests/2008-04-18-LoopBug: 50.00% (0.0300 => 0.0450)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 50.00% (0.0700 => 0.1050)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 48.78% (0.2050 => 0.3050)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 45.45% (0.0550 => 0.0800)
  SingleSource/UnitTests/2006-01-29-SimpleIndirectCall: 42.86% (0.0350 => 0.0500)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 42.86% (0.0350 => 0.0500)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 42.34% (4.0150 => 5.7150)
  SingleSource/Regression/C++/pointer_method: 40.00% (0.0500 => 0.0700)
  SingleSource/UnitTests/block-byref-cxxobj-test: 40.00% (0.0250 => 0.0350)
  SingleSource/UnitTests/Vector/build2: 40.00% (0.0750 => 0.1050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 38.46% (0.2600 => 0.3600)
  SingleSource/UnitTests/2002-12-13-MishaTest: 37.50% (0.0400 => 0.0550)
  SingleSource/UnitTests/2003-05-12-MinIntProblem: 37.50% (0.0400 => 0.0550)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 37.50% (0.0400 => 0.0550)
  SingleSource/UnitTests/2006-12-01-float_varg: 37.50% (0.0400 => 0.0550)
  MultiSource/Applications/SIBsim4/SIBsim4: 36.70% (4.4550 => 6.0900)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 36.00% (0.6250 => 0.8500)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 35.48% (0.1550 => 0.2100)
  SingleSource/Regression/C/ConstructorDestructorAttributes: 33.33% (0.0300 => 0.0400)
  SingleSource/UnitTests/Threads/tls: 33.33% (0.0600 => 0.0800)
  SingleSource/Regression/C++/short_circuit_dtor: 33.33% (0.0450 => 0.0600)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 32.50% (0.2000 => 0.2650)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.17% (4.3050 => 5.6900)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 28.09% (0.4450 => 0.5700)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 27.91% (0.2150 => 0.2750)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.88% (1.1300 => 1.4450)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 27.27% (0.2200 => 0.2800)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 27.27% (0.0550 => 0.0700)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 26.83% (0.2050 => 0.2600)
  SingleSource/Benchmarks/Shootout/ary3: 26.67% (0.0750 => 0.0950)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 26.32% (0.0950 => 0.1200)
  MultiSource/Applications/hbd/hbd: 26.06% (4.2400 => 5.3450)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 25.00% (0.1600 => 0.2000)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: 25.00% (0.0400 => 0.0500)
  MultiSource/Benchmarks/Prolangs-C++/family/family: 24.14% (0.1450 => 0.1800)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 24.14% (0.2900 => 0.3600)
  SingleSource/Benchmarks/Stanford/IntMM: 24.00% (0.1250 => 0.1550)
  SingleSource/Regression/C/sumarray2d: 23.53% (0.0850 => 0.1050)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 23.44% (3.2850 => 4.0550)
  SingleSource/Regression/C/PR10189: 23.08% (0.0650 => 0.0800)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 22.73% (0.2200 => 0.2700)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 22.22% (0.3600 => 0.4400)
  SingleSource/UnitTests/2005-05-12-Int64ToFP: 22.22% (0.0450 => 0.0550)
  MultiSource/Applications/Burg/burg: 21.76% (3.6300 => 4.4200)
  SingleSource/Benchmarks/Shootout/objinst: 21.74% (0.1150 => 0.1400)
  SingleSource/Benchmarks/Stanford/RealMM: 21.74% (0.1150 => 0.1400)
  MultiSource/Applications/minisat/minisat: 21.60% (2.1300 => 2.5900)
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: 21.28% (0.2350 => 0.2850)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 20.97% (0.3100 => 0.3750)
  MultiSource/Applications/sqlite3/sqlite3: 20.21% (63.1750 => 75.9450)
  SingleSource/Benchmarks/Linpack/linpack-pc: 20.00% (0.8250 => 0.9900)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 20.00% (0.1500 => 0.1800)
  SingleSource/Benchmarks/Shootout/strcat: 20.00% (0.0750 => 0.0900)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 20.00% (0.1000 => 0.1200)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 20.00% (0.1000 => 0.1200)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 19.83% (1.1850 => 1.4200)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 19.49% (1.3600 => 1.6250)
  MultiSource/Benchmarks/Olden/power/power: 19.28% (0.4150 => 0.4950)
  SingleSource/UnitTests/SignlessTypes/factor: 19.05% (0.1050 => 0.1250)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 18.89% (0.4500 => 0.5350)
  SingleSource/Benchmarks/McGill/exptree: 18.75% (0.2400 => 0.2850)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 18.33% (4.6100 => 5.4550)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 18.18% (0.0550 => 0.0650)
  SingleSource/UnitTests/2002-05-02-CastTest2: 18.18% (0.0550 => 0.0650)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 17.39% (0.1150 => 0.1350)
  SingleSource/Benchmarks/Stanford/Queens: 17.39% (0.1150 => 0.1350)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.19% (0.3200 => 0.3750)
  MultiSource/Applications/aha/aha: 17.11% (0.3800 => 0.4450)
  MultiSource/Applications/siod/siod: 17.07% (9.3750 => 10.9750)
  MultiSource/Benchmarks/PAQ8p/paq8p: 16.70% (9.0400 => 10.5500)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 16.67% (0.4800 => 0.5600)
  MultiSource/Benchmarks/sim/sim: 16.39% (0.9150 => 1.0650)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 16.13% (0.9300 => 1.0800)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 16.08% (17.2250 => 19.9950)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 15.89% (1.0700 => 1.2400)
  MultiSource/Applications/oggenc/oggenc: 15.75% (18.3550 => 21.2450)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 15.74% (1.1750 => 1.3600)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 15.69% (0.2550 => 0.2950)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 15.38% (0.1300 => 0.1500)
  SingleSource/Benchmarks/Shootout-C++/lists: 15.20% (0.8550 => 0.9850)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 15.19% (92.4350 => 106.4750)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 15.09% (0.2650 => 0.3050)
  SingleSource/Benchmarks/Stanford/Perm: 15.00% (0.1000 => 0.1150)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 14.89% (0.2350 => 0.2700)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 14.84% (3.5050 => 4.0250)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 14.75% (0.3050 => 0.3500)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.47% (3.4550 => 3.9550)
  MultiSource/Benchmarks/FreeBench/mason/mason: 14.29% (0.1750 => 0.2000)
  MultiSource/Benchmarks/Olden/tsp/tsp: 14.10% (0.3900 => 0.4450)
  SingleSource/UnitTests/SignlessTypes/rem: 14.08% (0.3550 => 0.4050)
  SingleSource/Regression/C++/ofstream_ctor: 14.06% (0.6400 => 0.7300)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 13.87% (1.9100 => 2.1750)
  SingleSource/Benchmarks/Shootout-C++/strcat: 13.85% (0.6500 => 0.7400)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 13.43% (2.0100 => 2.2800)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.23% (3.8550 => 4.3650)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 13.21% (3.9750 => 4.5000)
  MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 12.77% (0.2350 => 0.2650)
  MultiSource/Applications/sgefa/sgefa: 12.59% (1.4300 => 1.6100)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 12.57% (2.5450 => 2.8650)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 12.50% (0.1200 => 0.1350)
  SingleSource/UnitTests/vla: 12.50% (0.1200 => 0.1350)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 12.50% (0.6800 => 0.7650)
  MultiSource/Applications/hexxagon/hexxagon: 12.25% (3.3050 => 3.7100)
  SingleSource/Benchmarks/Shootout-C++/ary: 12.21% (0.8600 => 0.9650)
  MultiSource/Applications/d/make_dparser: 11.95% (13.8900 => 15.5500)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.94% (0.3350 => 0.3750)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 11.84% (3.7150 => 4.1550)
  SingleSource/Benchmarks/Shootout-C++/ary2: 11.80% (0.8900 => 0.9950)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 11.67% (0.3000 => 0.3350)
  SingleSource/Benchmarks/Shootout-C++/random: 11.54% (0.6500 => 0.7250)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 11.40% (28.2450 => 31.4650)
  SingleSource/Benchmarks/Misc/flops-2: 11.11% (0.0900 => 0.1000)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 11.11% (4.9500 => 5.5000)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 10.87% (0.2300 => 0.2550)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 10.74% (1.2100 => 1.3400)
  SingleSource/Benchmarks/Misc/mandel: 10.71% (0.1400 => 0.1550)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 10.54% (2.3250 => 2.5700)
  SingleSource/Benchmarks/Shootout-C++/wc: 10.49% (0.7150 => 0.7900)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 10.42% (0.2400 => 0.2650)
  SingleSource/Benchmarks/Shootout-C++/hash2: 10.42% (1.4400 => 1.5900)
  MultiSource/Applications/viterbi/viterbi: 10.38% (0.5300 => 0.5850)
  SingleSource/Benchmarks/Shootout/heapsort: 10.34% (0.1450 => 0.1600)
  MultiSource/Benchmarks/MallocBench/gs/gs: 10.34% (13.2050 => 14.5700)
  SingleSource/Benchmarks/Shootout-C++/moments: 10.33% (1.2100 => 1.3350)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.28% (2.6750 => 2.9500)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 10.26% (0.1950 => 0.2150)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 10.17% (4.7200 => 5.2000)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 10.15% (3.6950 => 4.0700)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 10.14% (0.3450 => 0.3800)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 10.06% (0.7950 => 0.8750)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 10.03% (3.7400 => 4.1150)
  SingleSource/Benchmarks/Shootout-C++/objinst: 10.00% (0.7000 => 0.7700)
  MultiSource/Benchmarks/FreeBench/neural/neural: 9.82% (0.5600 => 0.6150)
  MultiSource/Applications/spiff/spiff: 9.77% (3.4300 => 3.7650)
  MultiSource/Benchmarks/Prolangs-C/football/football: 9.76% (2.8700 => 3.1500)
  MultiSource/Applications/treecc/treecc: 9.75% (8.8700 => 9.7350)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 9.68% (0.1550 => 0.1700)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 9.68% (0.1550 => 0.1700)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 9.68% (0.1550 => 0.1700)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.66% (4.8650 => 5.3350)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 9.56% (0.6800 => 0.7450)
  SingleSource/Benchmarks/Stanford/Quicksort: 9.52% (0.1050 => 0.1150)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 9.49% (3.6900 => 4.0400)
  MultiSource/Benchmarks/McCat/18-imp/imp: 9.48% (1.0550 => 1.1550)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 9.29% (0.7000 => 0.7650)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 9.23% (0.3250 => 0.3550)
  MultiSource/Applications/ClamAV/clamscan: 9.22% (52.1300 => 56.9350)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 9.09% (0.1650 => 0.1800)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.91% (0.5050 => 0.5500)
  MultiSource/Benchmarks/McCat/09-vor/vor: 8.85% (0.9600 => 1.0450)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 8.80% (0.6250 => 0.6800)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 8.70% (0.2300 => 0.2500)
  SingleSource/Benchmarks/Shootout/matrix: 8.51% (0.2350 => 0.2550)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 8.50% (16.2300 => 17.6100)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.47% (0.8850 => 0.9600)
  SingleSource/UnitTests/Vector/constpool: 8.40% (155.3200 => 168.3600)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 8.33% (0.2400 => 0.2600)
  SingleSource/Benchmarks/Shootout-C++/matrix: 8.28% (0.7850 => 0.8500)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.18% (4.0950 => 4.4300)
  SingleSource/Benchmarks/Shootout-C++/hello: 8.09% (0.6800 => 0.7350)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 8.09% (3.2150 => 3.4750)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.08% (3.6500 => 3.9450)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 8.03% (1.8050 => 1.9500)
  SingleSource/Benchmarks/Stanford/Treesort: 8.00% (0.1250 => 0.1350)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.97% (4.0800 => 4.4050)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 7.79% (0.7700 => 0.8300)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.61% (1.4450 => 1.5550)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.59% (1.5800 => 1.7000)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 7.53% (0.7300 => 0.7850)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 7.53% (3.9850 => 4.2850)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 7.51% (15.7850 => 16.9700)
  SingleSource/Benchmarks/Shootout-C++/hash: 7.50% (1.4000 => 1.5050)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.47% (3.9500 => 4.2450)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.35% (3.6050 => 3.8700)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 7.19% (0.7650 => 0.8200)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 7.14% (0.2100 => 0.2250)
  MultiSource/Applications/lambda-0_1_3/lambda: 7.04% (2.0600 => 2.2050)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 6.94% (0.3600 => 0.3850)
  MultiSource/Applications/kimwitu++/kc: 6.93% (48.6150 => 51.9850)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.93% (4.1850 => 4.4750)
  SingleSource/Benchmarks/Stanford/Towers: 6.90% (0.1450 => 0.1550)
  MultiSource/Applications/JM/ldecod/ldecod: 6.83% (23.8550 => 25.4850)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 6.76% (3.2550 => 3.4750)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.68% (3.8950 => 4.1550)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.67% (0.9000 => 0.9600)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.44% (2.2500 => 2.3950)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 6.39% (2.8150 => 2.9950)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.36% (1.1000 => 1.1700)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.29% (3.9750 => 4.2250)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 6.25% (0.2400 => 0.2550)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 6.12% (0.2450 => 0.2600)
  SingleSource/Benchmarks/CoyoteBench/almabench: 6.12% (0.2450 => 0.2600)
  MultiSource/Applications/lua/lua: 6.10% (12.0500 => 12.7850)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.03% (3.8950 => 4.1300)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.99% (3.7550 => 3.9800)
  MultiSource/Applications/JM/lencod/lencod: 5.97% (50.2100 => 53.2100)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 5.97% (4.5200 => 4.7900)
  SingleSource/Benchmarks/Shootout-C++/lists1: 5.96% (1.0900 => 1.1550)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 5.88% (0.3400 => 0.3600)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.88% (0.6800 => 0.7200)
  SingleSource/Benchmarks/McGill/chomp: 5.83% (0.6000 => 0.6350)
  MultiSource/Benchmarks/McCat/15-trie/trie: 5.71% (0.1750 => 0.1850)
  SingleSource/Benchmarks/Dhrystone/dry: 5.71% (0.1750 => 0.1850)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 5.50% (3.9100 => 4.1250)
  MultiSource/Benchmarks/Olden/bh/bh: 5.49% (0.9100 => 0.9600)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.36% (0.2800 => 0.2950)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 5.29% (1.0400 => 1.0950)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 5.23% (1.7200 => 1.8100)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 5.23% (0.7650 => 0.8050)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.11% (0.6850 => 0.7200)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.93% (4.0600 => 4.2600)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.73% (6.1350 => 6.4250)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.72% (3.8100 => 3.9900)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 4.72% (0.5300 => 0.5550)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.71% (3.9300 => 4.1150)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.59% (4.0300 => 4.2150)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 4.41% (1.1350 => 1.1850)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 4.35% (0.3450 => 0.3600)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.20% (4.0500 => 4.2200)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.98% (138.9550 => 144.4900)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 3.97% (4.6600 => 4.8450)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.92% (3.9550 => 4.1100)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.79% (12.6750 => 13.1550)
  MultiSource/Benchmarks/Olden/health/health: 3.57% (0.4200 => 0.4350)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.47% (15.9850 => 16.5400)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 3.23% (0.7750 => 0.8000)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 3.06% (0.4900 => 0.5050)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.05% (0.9850 => 1.0150)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 3.05% (0.9850 => 1.0150)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.01% (31.8800 => 32.8400)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 2.59% (5.4150 => 5.5550)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.56% (3.3150 => 3.4000)
  MultiSource/Applications/SPASS/SPASS: 2.55% (67.9400 => 69.6700)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 2.38% (0.4200 => 0.4300)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 2.26% (0.6650 => 0.6800)
  SingleSource/Benchmarks/Misc/oourafft: 2.04% (0.7350 => 0.7500)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 1.97% (26.6150 => 27.1400)
  MultiSource/Benchmarks/Olden/em3d/em3d: 1.92% (0.5200 => 0.5300)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.81% (1.9300 => 1.9650)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.74% (8.6150 => 8.7650)
  MultiSource/Benchmarks/nbench/nbench: 1.29% (4.6600 => 4.7200)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.20% (3.7400 => 3.7850)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/life/life: 149.82% (8.4200 => 21.0350)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 57.14% (0.0350 => 0.0550)
  MultiSource/Applications/kimwitu++/kc: 50.00% (0.1100 => 0.1650)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 48.50% (11.3300 => 16.8250)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 42.86% (0.0350 => 0.0500)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 35.69% (12.3300 => 16.7300)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 33.33% (0.0300 => 0.0400)
  MultiSource/Applications/sqlite3/sqlite3: 32.97% (12.7550 => 16.9600)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 31.43% (0.1750 => 0.2300)
  MultiSource/Applications/aha/aha: 30.35% (5.5850 => 7.2800)
  MultiSource/Applications/siod/siod: 26.32% (6.3650 => 8.0400)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 26.14% (1.2050 => 1.5200)
  MultiSource/Benchmarks/FreeBench/neural/neural: 25.81% (0.3100 => 0.3900)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 25.27% (20.2800 => 25.4050)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 25.00% (0.0400 => 0.0500)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 22.94% (18.9150 => 23.2550)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 22.46% (4.1850 => 5.1250)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.82% (8.6850 => 10.5800)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 19.23% (0.1300 => 0.1550)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 18.70% (16.1200 => 19.1350)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 18.36% (14.7350 => 17.4400)
  MultiSource/Applications/viterbi/viterbi: 18.29% (10.1400 => 11.9950)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 18.22% (67.3550 => 79.6300)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 17.96% (1.4200 => 1.6750)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 17.72% (129.1150 => 152.0000)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 17.44% (12.0700 => 14.1750)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 17.00% (14.1200 => 16.5200)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 16.84% (0.4750 => 0.5550)
  MultiSource/Benchmarks/Olden/tsp/tsp: 16.81% (9.7850 => 11.4300)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.67% (0.3000 => 0.3500)
  SingleSource/Benchmarks/Shootout/random: 16.60% (3.7350 => 4.3550)
  MultiSource/Applications/JM/lencod/lencod: 16.55% (18.2800 => 21.3050)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 16.52% (4.6300 => 5.3950)
  SingleSource/Benchmarks/Shootout/methcall: 16.51% (8.6300 => 10.0550)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 16.12% (4.8400 => 5.6200)
  SingleSource/Benchmarks/Misc-C++/bigfib: 16.03% (0.6550 => 0.7600)
  MultiSource/Benchmarks/Olden/mst/mst: 15.91% (0.2200 => 0.2550)
  MultiSource/Applications/lambda-0_1_3/lambda: 15.70% (12.1950 => 14.1100)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 15.24% (0.8200 => 0.9450)
  SingleSource/Benchmarks/Shootout/fib2: 15.17% (8.2750 => 9.5300)
  SingleSource/Benchmarks/Shootout/nestedloop: 15.15% (0.1650 => 0.1900)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 14.95% (42.4800 => 48.8300)
  SingleSource/Benchmarks/Shootout-C++/sieve: 14.54% (6.5700 => 7.5250)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 14.53% (6.1250 => 7.0150)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 14.16% (20.6950 => 23.6250)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 13.95% (13.0500 => 14.8700)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 13.46% (17.6450 => 20.0200)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 13.33% (0.0750 => 0.0850)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 13.33% (0.1500 => 0.1700)
  SingleSource/Benchmarks/Misc/pi: 13.23% (1.5500 => 1.7550)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 12.93% (3.3250 => 3.7550)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 12.83% (2.0650 => 2.3300)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 12.78% (18.3550 => 20.7000)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.39% (24.1750 => 27.1700)
  MultiSource/Benchmarks/FreeBench/distray/distray: 12.05% (0.8300 => 0.9300)
  SingleSource/Benchmarks/Shootout-C++/methcall: 12.04% (12.2950 => 13.7750)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 12.04% (3.9050 => 4.3750)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 11.76% (0.1700 => 0.1900)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 11.56% (12.8850 => 14.3750)
  SingleSource/Benchmarks/Misc/ReedSolomon: 11.41% (20.9850 => 23.3800)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 11.17% (8.7250 => 9.7000)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.02% (16.2900 => 18.0850)
  MultiSource/Applications/d/make_dparser: 10.81% (0.1850 => 0.2050)
  SingleSource/Benchmarks/Shootout/hash: 10.81% (16.7450 => 18.5550)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 10.75% (5.3000 => 5.8700)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.75% (14.6550 => 16.2300)
  MultiSource/Applications/minisat/minisat: 10.61% (24.6350 => 27.2500)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 10.58% (12.8100 => 14.1650)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 10.50% (10.9500 => 12.1000)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 10.31% (32.7400 => 36.1150)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 10.29% (5.2950 => 5.8400)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 10.09% (26.6700 => 29.3600)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 9.89% (193.9050 => 213.0800)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 9.82% (25.2950 => 27.7800)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 9.75% (13.1800 => 14.4650)
  MultiSource/Applications/spiff/spiff: 9.72% (16.4150 => 18.0100)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 9.68% (0.1550 => 0.1700)
  MultiSource/Benchmarks/Olden/power/power: 9.57% (8.1000 => 8.8750)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.53% (8.7650 => 9.6000)
  SingleSource/Benchmarks/Stanford/Bubblesort: 9.52% (0.1050 => 0.1150)
  SingleSource/Benchmarks/Shootout-C++/hash2: 9.42% (9.9250 => 10.8600)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 9.30% (0.2150 => 0.2350)
  SingleSource/Benchmarks/McGill/misr: 9.26% (0.5400 => 0.5900)
  SingleSource/Benchmarks/Shootout/matrix: 9.10% (6.4850 => 7.0750)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.05% (9.0650 => 9.8850)
  SingleSource/Benchmarks/Shootout/ary3: 8.92% (6.6700 => 7.2650)
  MultiSource/Benchmarks/NPB-serial/is/is: 8.92% (27.9750 => 30.4700)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 8.89% (22.4300 => 24.4250)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.82% (5.1000 => 5.5500)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.79% (1.5350 => 1.6700)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 8.70% (4.1950 => 4.5600)
  SingleSource/Benchmarks/Shootout/strcat: 8.70% (0.4600 => 0.5000)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.68% (8.5800 => 9.3250)
  SingleSource/Benchmarks/SmallPT/smallpt: 8.68% (60.3850 => 65.6250)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.65% (16.3600 => 17.7750)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.63% (14.4250 => 15.6700)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 8.62% (2.7850 => 3.0250)
  SingleSource/Benchmarks/Shootout-C++/ary3: 8.56% (6.6000 => 7.1650)
  MultiSource/Applications/lua/lua: 8.43% (64.8500 => 70.3200)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 8.33% (1.0800 => 1.1700)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.30% (8.1300 => 8.8050)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 8.27% (1.9350 => 2.0950)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.24% (14.5100 => 15.7050)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.23% (6.9850 => 7.5600)
  MultiSource/Benchmarks/sim/sim: 8.20% (12.9200 => 13.9800)
  SingleSource/Benchmarks/Shootout-C++/random: 8.20% (4.0250 => 4.3550)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 8.20% (0.3050 => 0.3300)
  SingleSource/Benchmarks/Misc/mandel: 8.18% (4.2800 => 4.6300)
  SingleSource/Benchmarks/Misc/richards_benchmark: 8.17% (2.8150 => 3.0450)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 8.14% (0.8600 => 0.9300)
  MultiSource/Benchmarks/Olden/bh/bh: 8.13% (7.1950 => 7.7800)
  SingleSource/Benchmarks/Misc/whetstone: 8.10% (5.5550 => 6.0050)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 8.09% (0.6800 => 0.7350)
  MultiSource/Benchmarks/VersaBench/8b10b/8b10b: 8.05% (14.8500 => 16.0450)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 8.05% (3.4800 => 3.7600)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 8.00% (2.8750 => 3.1050)
  MultiSource/Applications/hexxagon/hexxagon: 7.94% (29.4800 => 31.8200)
  SingleSource/Benchmarks/CoyoteBench/almabench: 7.92% (43.6950 => 47.1550)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 7.91% (134.5050 => 145.1500)
  SingleSource/Benchmarks/Stanford/FloatMM: 7.83% (1.0850 => 1.1700)
  SingleSource/UnitTests/Vector/build2: 7.78% (4.3050 => 4.6400)
  SingleSource/Benchmarks/Misc/flops-7: 7.76% (10.1100 => 10.8950)
  SingleSource/Benchmarks/Misc/flops: 7.76% (17.9750 => 19.3700)
  SingleSource/Benchmarks/Shootout-C++/matrix: 7.73% (8.2750 => 8.9150)
  MultiSource/Applications/SPASS/SPASS: 7.72% (36.1950 => 38.9900)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 7.72% (2.8500 => 3.0700)
  SingleSource/Benchmarks/Shootout-C++/lists1: 7.71% (1.7500 => 1.8850)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.71% (99.2600 => 106.9150)
  SingleSource/Benchmarks/McGill/queens: 7.71% (4.7350 => 5.1000)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 7.68% (3.4500 => 3.7150)
  SingleSource/Benchmarks/Misc/flops-2: 7.66% (4.0450 => 4.3550)
  SingleSource/Regression/C/uint64_to_float: 7.65% (1.7650 => 1.9000)
  SingleSource/Benchmarks/Misc/flops-5: 7.64% (5.6250 => 6.0550)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 7.63% (12.9700 => 13.9600)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 7.61% (0.4600 => 0.4950)
  SingleSource/Benchmarks/Misc/flops-8: 7.59% (5.7300 => 6.1650)
  SingleSource/Benchmarks/Dhrystone/dry: 7.59% (4.8100 => 5.1750)
  SingleSource/Benchmarks/Misc/flops-3: 7.58% (7.1900 => 7.7350)
  SingleSource/Benchmarks/Dhrystone/fldry: 7.53% (5.2450 => 5.6400)
  MultiSource/Benchmarks/FreeBench/mason/mason: 7.50% (0.4000 => 0.4300)
  SingleSource/Benchmarks/Misc/flops-1: 7.49% (6.7400 => 7.2450)
  SingleSource/Benchmarks/BenchmarkGame/n-body: 7.48% (7.3550 => 7.9050)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 7.43% (4.9100 => 5.2750)
  SingleSource/Benchmarks/Misc/flops-6: 7.41% (5.3950 => 5.7950)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.40% (21.0950 => 22.6550)
  SingleSource/Benchmarks/Misc/flops-4: 7.39% (3.3150 => 3.5600)
  SingleSource/Benchmarks/Misc/mandel-2: 7.37% (2.0350 => 2.1850)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.32% (15.1600 => 16.2700)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 7.32% (1.6400 => 1.7600)
  MultiSource/Benchmarks/McCat/18-imp/imp: 7.32% (0.2050 => 0.2200)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 7.31% (23.4000 => 25.1100)
  MultiSource/Applications/obsequi/Obsequi: 7.31% (4.9950 => 5.3600)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.29% (2.4700 => 2.6500)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.27% (11.0000 => 11.8000)
  SingleSource/Benchmarks/Misc/fp-convert: 7.24% (4.6950 => 5.0350)
  SingleSource/Benchmarks/Shootout/lists: 7.22% (22.5850 => 24.2150)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.12% (2.6000 => 2.7850)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 7.06% (0.8500 => 0.9100)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 6.90% (15.5150 => 16.5850)
  SingleSource/Benchmarks/Shootout/sieve: 6.86% (15.2400 => 16.2850)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.80% (9.2600 => 9.8900)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.77% (26.0750 => 27.8400)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 6.67% (0.2250 => 0.2400)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 6.62% (6.4200 => 6.8450)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.32% (11.3950 => 12.1150)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.22% (9.8000 => 10.4100)
  SingleSource/Benchmarks/McGill/chomp: 6.09% (2.4650 => 2.6150)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.95% (0.4200 => 0.4450)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 5.94% (1.6000 => 1.6950)
  SingleSource/UnitTests/Vector/multiplies: 5.92% (1.7750 => 1.8800)
  SingleSource/Benchmarks/Shootout-C++/lists: 5.74% (62.2450 => 65.8200)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.57% (36.3550 => 38.3800)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.48% (5.8350 => 6.1550)
  MultiSource/Applications/sgefa/sgefa: 5.45% (0.8250 => 0.8700)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.32% (182.4700 => 192.1750)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 5.16% (2.2300 => 2.3450)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 5.15% (3.5950 => 3.7800)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 5.06% (0.3950 => 0.4150)
  MultiSource/Benchmarks/mafft/pairlocalalign: 4.92% (62.5550 => 65.6300)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.91% (52.1050 => 54.6650)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.88% (2.4600 => 2.5800)
  SingleSource/Benchmarks/Shootout-C++/moments: 4.88% (0.2050 => 0.2150)
  SingleSource/Benchmarks/Misc/fbench: 4.79% (6.7900 => 7.1150)
  SingleSource/Benchmarks/Misc/oourafft: 4.73% (14.1550 => 14.8250)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 4.64% (7.0000 => 7.3250)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.62% (10.2850 => 10.7600)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 4.42% (28.4850 => 29.7450)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.29% (0.3500 => 0.3650)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.23% (14.7650 => 15.3900)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.11% (4.3800 => 4.5600)
  MultiSource/Applications/ClamAV/clamscan: 3.90% (0.3850 => 0.4000)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 3.77% (6.2400 => 6.4750)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.65% (12.6000 => 13.0600)
  MultiSource/Benchmarks/Olden/bisort/bisort: 3.58% (1.5350 => 1.5900)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 3.50% (4.2850 => 4.4350)
  SingleSource/Benchmarks/Stanford/Puzzle: 3.45% (0.4350 => 0.4500)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.43% (20.7100 => 21.4200)
  MultiSource/Benchmarks/Bullet/bullet: 3.30% (24.1200 => 24.9150)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 3.18% (17.2800 => 17.8300)
  SingleSource/Benchmarks/Shootout/heapsort: 2.94% (13.7950 => 14.2000)
  MultiSource/Applications/oggenc/oggenc: 2.78% (0.3600 => 0.3700)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.71% (1.1050 => 1.1350)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.66% (3.5700 => 3.6650)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 2.52% (27.7900 => 28.4900)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 2.42% (0.6200 => 0.6350)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 2.22% (0.9000 => 0.9200)
  MultiSource/Benchmarks/Olden/health/health: 2.13% (1.6450 => 1.6800)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.10% (7.1450 => 7.2950)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 1.63% (0.6150 => 0.6250)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.58% (0.9500 => 0.9650)
  SingleSource/Benchmarks/Misc/salsa20: 1.54% (22.0900 => 22.4300)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.36% (12.1150 => 12.2800)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 1.20% (1.6700 => 1.6900)
  MultiSource/Benchmarks/Olden/em3d/em3d: 1.17% (8.9800 => 9.0850)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 1.02% (9.8500 => 9.9500)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/global_type: -60.00% (0.0250 => 0.0100)
  SingleSource/Regression/C++/2003-06-08-VirtualFunctions: -50.00% (0.0200 => 0.0100)
  SingleSource/Regression/C/2003-06-16-InvalidInitializer: -50.00% (0.0300 => 0.0150)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: -50.00% (0.0800 => 0.0400)
  SingleSource/UnitTests/2005-11-29-LongSwitch: -46.15% (0.0650 => 0.0350)
  SingleSource/UnitTests/2002-08-02-CastTest: -45.45% (0.0550 => 0.0300)
  SingleSource/Benchmarks/Shootout/hello: -44.44% (0.0450 => 0.0250)
  SingleSource/Regression/C/PR1386: -44.44% (0.0450 => 0.0250)
  SingleSource/Regression/C/2003-05-21-UnionTest: -42.86% (0.0350 => 0.0200)
  SingleSource/UnitTests/Vector/sumarray: -41.67% (0.0600 => 0.0350)
  SingleSource/UnitTests/2002-05-02-CastTest3: -40.00% (0.0250 => 0.0150)
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: -37.50% (0.0400 => 0.0250)
  SingleSource/UnitTests/conditional-gnu-ext: -37.50% (0.0400 => 0.0250)
  SingleSource/UnitTests/2003-04-22-Switch: -33.33% (0.0450 => 0.0300)
  SingleSource/Regression/C++/pointer_member: -30.77% (0.0650 => 0.0450)
  SingleSource/UnitTests/2002-08-19-CodegenBug: -30.77% (0.0650 => 0.0450)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -30.56% (0.1800 => 0.1250)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -30.19% (0.2650 => 0.1850)
  SingleSource/Regression/C++/2003-08-20-EnumSizeProblem: -28.57% (0.0350 => 0.0250)
  SingleSource/Regression/C/pointer_arithmetic: -28.57% (0.0350 => 0.0250)
  SingleSource/UnitTests/2008-07-13-InlineSetjmp: -28.57% (0.0350 => 0.0250)
  SingleSource/UnitTests/StructModifyTest: -28.57% (0.0350 => 0.0250)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -27.45% (0.2550 => 0.1850)
  SingleSource/UnitTests/2003-09-18-BitFieldTest: -27.27% (0.0550 => 0.0400)
  SingleSource/UnitTests/2007-01-04-KNR-Args: -27.27% (0.0550 => 0.0400)
  SingleSource/UnitTests/TestLoop: -27.27% (0.0550 => 0.0400)
  SingleSource/UnitTests/Vector/multiplies: -26.32% (0.0950 => 0.0700)
  MultiSource/Applications/lemon/lemon: -25.36% (5.6000 => 4.1800)
  SingleSource/Benchmarks/Misc-C++/mandel-text: -25.00% (0.0600 => 0.0450)
  SingleSource/Regression/C/2004-02-03-AggregateCopy: -25.00% (0.0600 => 0.0450)
  SingleSource/Benchmarks/Misc/flops-4: -24.00% (0.1250 => 0.0950)
  SingleSource/Benchmarks/Shootout/nestedloop: -23.81% (0.1050 => 0.0800)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -22.39% (0.3350 => 0.2600)
  SingleSource/Benchmarks/Misc/pi: -21.43% (0.0700 => 0.0550)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -21.37% (0.6550 => 0.5150)
  SingleSource/Regression/C/casts: -20.83% (0.1200 => 0.0950)
  SingleSource/Benchmarks/Misc/fp-convert: -20.00% (0.1000 => 0.0800)
  SingleSource/UnitTests/2006-01-23-UnionInit: -20.00% (0.1000 => 0.0800)
  SingleSource/Benchmarks/Shootout/random: -19.05% (0.1050 => 0.0850)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -18.75% (0.0800 => 0.0650)
  SingleSource/Benchmarks/Misc/lowercase: -18.75% (0.0800 => 0.0650)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -18.64% (0.2950 => 0.2400)
  SingleSource/Benchmarks/Misc/flops-7: -18.18% (0.1100 => 0.0900)
  SingleSource/UnitTests/2002-05-02-ManyArguments: -18.18% (0.0550 => 0.0450)
  SingleSource/UnitTests/2003-05-26-Shorts: -18.18% (0.0550 => 0.0450)
  SingleSource/Regression/C++/pointer_method2: -17.65% (0.0850 => 0.0700)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: -17.24% (0.1450 => 0.1200)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -16.07% (0.2800 => 0.2350)
  SingleSource/UnitTests/Vector/simple: -15.38% (0.0650 => 0.0550)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -15.15% (0.3300 => 0.2800)
  SingleSource/Benchmarks/Shootout/ackermann: -14.29% (0.0700 => 0.0600)
  SingleSource/UnitTests/2003-05-31-CastToBool: -14.29% (0.0700 => 0.0600)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: -14.29% (0.0700 => 0.0600)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -13.95% (0.2150 => 0.1850)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -13.83% (0.4700 => 0.4050)
  SingleSource/Benchmarks/Misc/dt: -13.64% (0.1100 => 0.0950)
  MultiSource/Applications/obsequi/Obsequi: -12.95% (4.1700 => 3.6300)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.24% (0.2450 => 0.2150)
  SingleSource/Benchmarks/Misc/salsa20: -11.76% (0.1700 => 0.1500)
  SingleSource/UnitTests/2003-05-07-VarArgs: -11.76% (0.0850 => 0.0750)
  SingleSource/Benchmarks/Misc/richards_benchmark: -11.76% (0.2550 => 0.2250)
  MultiSource/Benchmarks/llubenchmark/llu: -10.34% (0.1450 => 0.1300)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -10.34% (0.2900 => 0.2600)
  SingleSource/Benchmarks/Misc/perlin: -10.26% (0.1950 => 0.1750)
  SingleSource/UnitTests/SignlessTypes/div: -10.00% (0.1000 => 0.0900)
  MultiSource/Benchmarks/NPB-serial/is/is: -9.30% (0.2150 => 0.1950)
  MultiSource/Benchmarks/McCat/08-main/main: -8.72% (0.9750 => 0.8900)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -8.60% (6.2800 => 5.7400)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -8.27% (0.6650 => 0.6100)
  MultiSource/Benchmarks/BitBench/five11/five11: -8.11% (0.1850 => 0.1700)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -8.00% (0.5000 => 0.4600)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.87% (1.3350 => 1.2300)
  SingleSource/Benchmarks/Misc/fbench: -6.52% (0.2300 => 0.2150)
  MultiSource/Benchmarks/McCat/05-eks/eks: -6.42% (1.6350 => 1.5300)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -6.15% (0.3250 => 0.3050)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -6.13% (0.8150 => 0.7650)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -6.12% (0.4900 => 0.4600)
  SingleSource/Benchmarks/Misc/ReedSolomon: -5.80% (0.6900 => 0.6500)
  SingleSource/Benchmarks/SmallPT/smallpt: -5.71% (0.5250 => 0.4950)
  SingleSource/Benchmarks/Misc/flops: -5.48% (0.3650 => 0.3450)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.42% (2.7650 => 2.6150)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -5.36% (0.2800 => 0.2650)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -5.33% (4.9750 => 4.7100)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -5.26% (0.1900 => 0.1800)
  MultiSource/Benchmarks/Olden/bisort/bisort: -5.13% (0.1950 => 0.1850)
  SingleSource/Benchmarks/McGill/misr: -5.00% (0.2000 => 0.1900)
  SingleSource/Benchmarks/Misc-C++/bigfib: -4.95% (2.1200 => 2.0150)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -4.65% (0.2150 => 0.2050)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -4.65% (0.2150 => 0.2050)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.52% (0.9950 => 0.9500)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.52% (19.0200 => 18.1600)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -4.13% (2.0600 => 1.9750)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -4.04% (1.9800 => 1.9000)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -3.86% (1.1650 => 1.1200)
  SingleSource/Benchmarks/Misc/whetstone: -3.70% (0.2700 => 0.2600)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.37% (2.0800 => 2.0100)
  MultiSource/Benchmarks/Prolangs-C++/objects/objects: -3.23% (0.3100 => 0.3000)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -3.23% (0.4650 => 0.4500)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.12% (3.8450 => 3.7250)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -3.04% (2.6350 => 2.5550)
  MultiSource/Benchmarks/Bullet/bullet: -3.00% (117.8850 => 114.3500)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.54% (0.5900 => 0.5750)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -1.38% (6.5350 => 6.4450)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.32% (4.5350 => 4.4750)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.30% (3.8450 => 3.7950)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -71.43% (0.0700 => 0.0200)
  MultiSource/Benchmarks/BitBench/five11/five11: -67.38% (60.4450 => 19.7200)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -36.59% (0.4100 => 0.2600)
  SingleSource/Benchmarks/Stanford/Treesort: -33.33% (0.3450 => 0.2300)
  MultiSource/Applications/lemon/lemon: -25.06% (3.8700 => 2.9000)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -25.00% (0.1000 => 0.0750)
  MultiSource/Benchmarks/McCat/08-main/main: -25.00% (0.1200 => 0.0900)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -16.84% (16.6550 => 13.8500)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.45% (4.4300 => 3.7900)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -14.29% (0.0700 => 0.0600)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -14.29% (0.3500 => 0.3000)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -13.76% (22.8950 => 19.7450)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -13.59% (28.1750 => 24.3450)
  MultiSource/Applications/JM/ldecod/ldecod: -12.90% (0.1550 => 0.1350)
  SingleSource/Benchmarks/Misc/ffbench: -12.15% (4.3200 => 3.7950)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -10.82% (17.6950 => 15.7800)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.29% (8.4000 => 7.6200)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -9.04% (0.8300 => 0.7550)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -7.53% (16.9300 => 15.6550)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.02% (2.3250 => 2.1850)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.98% (13.3750 => 12.5750)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.73% (18.6650 => 17.5950)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.56% (0.3600 => 0.3400)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -4.58% (0.6550 => 0.6250)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.24% (21.3600 => 20.4550)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.86% (8.5400 => 8.2100)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.73% (19.9700 => 19.2250)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.24% (13.7400 => 13.2950)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -2.97% (1.0100 => 0.9800)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.06% (2.1800 => 2.1350)
  MultiSource/Benchmarks/nbench/nbench: -1.26% (39.7400 => 39.2400)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.19% (39.7700 => 39.2950)

Report Time: 0.93s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140108/cdfb8639/attachment.html>


More information about the llvm-testresults mailing list