[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 12 20:19:05 PST 2013


http://llvm.org/perf/db_default/v4/nts/18346?compare_to=18341&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18346, Order: 197199, Start Time: 2013-12-13 02:42:29, End Time: 2013-12-13 04:23:20
      To: 18341, Order: 197187, Start Time: 2013-12-13 00:30:21, End Time: 2013-12-13 02:20:03
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 31 (30 on baseline)
Performance Improvements: 132 (31 on baseline)
Unchanged Tests: 947 (1049 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 53.70% (1.6986 => 2.6107, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 39.26% (2.8803 => 4.0112, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 29.55% (0.1523 => 0.1973, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/sieve: 20.53% (6.7421 => 8.1264, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/em3d/em3d: 20.05% (4.5394 => 5.4496, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/matrix: 15.54% (1.8274 => 2.1113, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.40% (8.5465 => 9.7768, std.dev.: 0.0009)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.41% (2.8404 => 3.0509, std.dev.: 0.0100)
  SingleSource/Benchmarks/McGill/misr: 6.53% (0.3846 => 0.4097, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.09% (1.9675 => 2.0874, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/fp-convert: 5.98% (7.3302 => 7.7684, std.dev.: 0.0148)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.89% (0.3750 => 0.3971, std.dev.: 0.0008)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.87% (1.8073 => 1.8954, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.46% (4.2188 => 4.4068, std.dev.: 0.0028)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.09% (0.6241 => 0.6496, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.35% (0.3670 => 0.3793, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.81% (2.4823 => 2.5520, std.dev.: 0.0034)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.76% (1.6480 => 1.6935, std.dev.: 0.0002)
  MultiSource/Benchmarks/sim/sim: 2.68% (3.9018 => 4.0064, std.dev.: 0.0189)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 2.44% (0.4794 => 0.4911, std.dev.: 0.0045)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.43% (0.7030 => 0.7201, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.40% (5.9312 => 6.0734, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout/methcall: 2.32% (8.4795 => 8.6762, std.dev.: 0.0052)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.12% (51.1296 => 52.2140, std.dev.: 0.2599)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.73% (3.1666 => 3.2213, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout/fib2: 1.71% (3.5911 => 3.6526, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.64% (6.0190 => 6.1179, std.dev.: 0.0050)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.42% (2.4906 => 2.5259, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/oourafft: 1.32% (3.6774 => 3.7260, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.26% (3.8185 => 3.8668, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.16% (2.9294 => 2.9633, std.dev.: 0.0044)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/conditional-gnu-ext: -77.41% (0.0239 => 0.0054, std.dev.: 0.0036)
  SingleSource/UnitTests/2002-05-02-ManyArguments: -52.71% (0.0258 => 0.0122, std.dev.: 0.0022)
  SingleSource/UnitTests/2008-04-20-LoopBug2: -50.00% (0.0304 => 0.0152, std.dev.: 0.0007)
  SingleSource/UnitTests/2002-05-02-CastTest3: -49.76% (0.0205 => 0.0103, std.dev.: 0.0003)
  SingleSource/Regression/C/PR1386: -44.81% (0.0270 => 0.0149, std.dev.: 0.0000)
  SingleSource/UnitTests/2002-10-09-ArrayResolution: -44.41% (0.0295 => 0.0164, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: -43.88% (0.0294 => 0.0165, std.dev.: 0.0004)
  SingleSource/UnitTests/2003-05-26-Shorts: -42.93% (0.0382 => 0.0218, std.dev.: 0.0002)
  SingleSource/Regression/C++/short_circuit_dtor: -42.51% (0.0327 => 0.0188, std.dev.: 0.0006)
  SingleSource/UnitTests/byval-alignment: -42.01% (0.0319 => 0.0185, std.dev.: 0.0000)
  SingleSource/UnitTests/member-function-pointers: -41.69% (0.0367 => 0.0214, std.dev.: 0.0006)
  SingleSource/Regression/C++/2003-05-14-array-init: -41.67% (0.0252 => 0.0147, std.dev.: 0.0008)
  SingleSource/Regression/C/2008-01-07-LongDouble: -41.53% (0.0248 => 0.0145, std.dev.: 0.0006)
  SingleSource/UnitTests/stmtexpr: -41.16% (0.0294 => 0.0173, std.dev.: 0.0006)
  SingleSource/UnitTests/2003-04-22-Switch: -40.71% (0.0312 => 0.0185, std.dev.: 0.0001)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -36.85% (0.0787 => 0.0497, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -35.86% (0.0806 => 0.0517, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-05-31-CastToBool: -35.56% (0.0405 => 0.0261, std.dev.: 0.0001)
  SingleSource/UnitTests/Threads/tls: -35.31% (0.0286 => 0.0185, std.dev.: 0.0023)
  SingleSource/Regression/C/PR10189: -35.06% (0.0385 => 0.0250, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -33.31% (0.3272 => 0.2182, std.dev.: 0.0023)
  SingleSource/UnitTests/2003-05-07-VarArgs: -32.81% (0.0381 => 0.0256, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -32.61% (0.2349 => 0.1583, std.dev.: 0.0070)
  SingleSource/UnitTests/initp1: -26.64% (0.0672 => 0.0493, std.dev.: 0.0005)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -25.53% (0.1136 => 0.0846, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -23.58% (0.3516 => 0.2687, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C++/office/office: -21.36% (0.2758 => 0.2169, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/constpool: -19.93% (11.0604 => 8.8565, std.dev.: 0.1418)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -19.20% (0.0625 => 0.0505, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/richards_benchmark: -18.41% (0.0994 => 0.0811, std.dev.: 0.0004)
  MultiSource/Applications/treecc/treecc: -17.90% (2.7499 => 2.2578, std.dev.: 0.0981)
  MultiSource/Applications/spiff/spiff: -17.56% (1.0834 => 0.8932, std.dev.: 0.0559)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -17.10% (5.8538 => 4.8526, std.dev.: 0.0938)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -16.71% (0.4334 => 0.3610, std.dev.: 0.0104)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -14.38% (8.5424 => 7.3143, std.dev.: 0.0882)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -14.20% (0.3036 => 0.2605, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -13.16% (0.3335 => 0.2896, std.dev.: 0.0010)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.32% (0.1157 => 0.1026, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -10.89% (0.0964 => 0.0859, std.dev.: 0.0002)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -10.84% (0.4068 => 0.3627, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -10.34% (0.1547 => 0.1387, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -10.06% (0.2474 => 0.2225, std.dev.: 0.0074)
  SingleSource/Benchmarks/SmallPT/smallpt: -9.74% (0.1560 => 0.1408, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops: -9.66% (0.1232 => 0.1113, std.dev.: 0.0009)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -9.62% (1.4242 => 1.2872, std.dev.: 0.0140)
  MultiSource/Applications/JM/ldecod/ldecod: -9.11% (8.3363 => 7.5770, std.dev.: 0.1707)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.76% (0.3083 => 0.2813, std.dev.: 0.0010)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.73% (48.3750 => 44.1531, std.dev.: 0.0368)
  MultiSource/Benchmarks/Olden/tsp/tsp: -8.16% (0.1422 => 0.1306, std.dev.: 0.0034)
  MultiSource/Benchmarks/Olden/em3d/em3d: -8.02% (0.2119 => 0.1949, std.dev.: 0.0040)
  MultiSource/Benchmarks/McCat/18-imp/imp: -7.66% (0.4231 => 0.3907, std.dev.: 0.0083)
  MultiSource/Benchmarks/Olden/mst/mst: -7.57% (0.1413 => 0.1306, std.dev.: 0.0019)
  MultiSource/Benchmarks/PAQ8p/paq8p: -7.48% (2.7305 => 2.5263, std.dev.: 0.0135)
  MultiSource/Benchmarks/McCat/05-eks/eks: -7.41% (0.5642 => 0.5224, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.89% (1.3772 => 1.2823, std.dev.: 0.0250)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -6.86% (0.3382 => 0.3150, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -6.44% (1.1496 => 1.0756, std.dev.: 0.0216)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.32% (5.8778 => 5.5061, std.dev.: 0.0201)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -6.25% (1.4171 => 1.3285, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.94% (1.3013 => 1.2240, std.dev.: 0.0280)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -5.77% (0.9608 => 0.9054, std.dev.: 0.0203)
  SingleSource/Benchmarks/Linpack/linpack-pc: -5.72% (0.3304 => 0.3115, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/bh/bh: -5.17% (0.3482 => 0.3302, std.dev.: 0.0024)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.09% (10.6196 => 10.0791, std.dev.: 0.0418)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.97% (1.5280 => 1.4521, std.dev.: 0.0294)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -4.95% (0.6511 => 0.6189, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/oourafft: -4.92% (0.2579 => 0.2452, std.dev.: 0.0027)
  MultiSource/Benchmarks/MallocBench/gs/gs: -4.88% (4.8882 => 4.6496, std.dev.: 0.0539)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.87% (1.2884 => 1.2257, std.dev.: 0.0101)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.71% (0.2783 => 0.2652, std.dev.: 0.0050)
  MultiSource/Applications/oggenc/oggenc: -4.67% (5.7462 => 5.4780, std.dev.: 0.0559)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.33% (1.3869 => 1.3268, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.05% (1.3150 => 1.2617, std.dev.: 0.0198)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.68% (0.5491 => 0.5289, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.64% (0.2778 => 0.2677, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.57% (1.1331 => 1.0926, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.54% (5.6125 => 5.4137, std.dev.: 0.0221)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.97% (1.4498 => 1.4068, std.dev.: 0.0107)
  MultiSource/Applications/obsequi/Obsequi: -2.83% (1.1736 => 1.1404, std.dev.: 0.0082)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.47% (2.0138 => 1.9640, std.dev.: 0.0104)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.38% (0.7095 => 0.6926, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.28% (1.4013 => 1.3693, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.26% (1.3097 => 1.2801, std.dev.: 0.0050)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.11% (2.7915 => 2.7326, std.dev.: 0.0160)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.85% (1.1218 => 1.1011, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.72% (0.9015 => 0.8860, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.26% (4.3225 => 4.2679, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -29.41% (0.1897 => 0.1339, std.dev.: 0.0045)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -24.11% (1.0102 => 0.7666, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -24.08% (0.0947 => 0.0719, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/08-main/main: -22.14% (0.0935 => 0.0728, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/heapsort: -21.24% (3.6599 => 2.8826, std.dev.: 0.0243)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -18.87% (1.7993 => 1.4597, std.dev.: 0.0740)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -18.21% (4.8181 => 3.9407, std.dev.: 0.0492)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -17.53% (3.4082 => 2.8109, std.dev.: 0.0798)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -15.12% (2.8757 => 2.4410, std.dev.: 0.0242)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -12.35% (0.1465 => 0.1284, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -12.14% (5.1749 => 4.5469, std.dev.: 0.0609)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -12.01% (2.3835 => 2.0973, std.dev.: 0.0033)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -11.76% (32.3836 => 28.5759, std.dev.: 0.1131)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -10.89% (0.4803 => 0.4280, std.dev.: 0.0060)
  MultiSource/Benchmarks/FreeBench/neural/neural: -8.74% (0.4841 => 0.4418, std.dev.: 0.0058)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -8.38% (2.5309 => 2.3189, std.dev.: 0.0346)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.89% (10.3353 => 9.5197, std.dev.: 0.1797)
  SingleSource/Benchmarks/Shootout-C++/ary3: -6.48% (5.1574 => 4.8234, std.dev.: 0.0833)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.17% (37.8900 => 35.5535, std.dev.: 0.8613)
  SingleSource/Benchmarks/Shootout-C++/fibo: -6.15% (5.3530 => 5.0238, std.dev.: 0.0047)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.77% (0.3624 => 0.3415, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.56% (4.8456 => 4.5760, std.dev.: 0.0899)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -5.08% (64.1382 => 60.8779, std.dev.: 0.1179)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -4.87% (3.9978 => 3.8033, std.dev.: 0.0467)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.75% (0.3240 => 0.3086, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.64% (4.3007 => 4.1011, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.43% (6.1729 => 5.8997, std.dev.: 0.0070)
  MultiSource/Benchmarks/llubenchmark/llu: -3.77% (2.0569 => 1.9793, std.dev.: 0.0182)
  MultiSource/Benchmarks/Bullet/bullet: -3.74% (7.2205 => 6.9504, std.dev.: 0.0503)
  SingleSource/Benchmarks/Dhrystone/dry: -2.78% (0.5000 => 0.4861, std.dev.: 0.0002)
  SingleSource/Regression/C/uint64_to_float: -2.70% (1.5087 => 1.4679, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.56% (3.2835 => 3.1996, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.52% (22.1988 => 21.6388, std.dev.: 0.1597)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -2.33% (0.6531 => 0.6379, std.dev.: 0.0008)
  SingleSource/Benchmarks/Dhrystone/fldry: -2.23% (0.6820 => 0.6668, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/flops-7: -2.04% (1.7449 => 1.7093, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout/hash: -1.99% (5.2226 => 5.1186, std.dev.: 0.0302)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.87% (35.7760 => 35.1085, std.dev.: 0.1032)
  SingleSource/Benchmarks/Misc/richards_benchmark: -1.76% (1.3784 => 1.3542, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/flops-4: -1.70% (1.7599 => 1.7299, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/tsp/tsp: -1.58% (1.5604 => 1.5357, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc/ffbench: -1.52% (1.4130 => 1.3915, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.18% (4.9742 => 4.9155, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.16% (3.5806 => 3.5390, std.dev.: 0.0124)
  MultiSource/Benchmarks/Olden/power/power: -1.04% (1.1873 => 1.1750, std.dev.: 0.0039)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.47% (1.6685 => 2.6107, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.22% (2.8607 => 4.0112, std.dev.: 0.0071)
  SingleSource/Benchmarks/Shootout/sieve: 20.47% (6.7454 => 8.1264, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/em3d/em3d: 18.15% (4.6123 => 5.4496, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/matrix: 17.56% (1.7960 => 2.1113, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.01% (8.5010 => 9.7768, std.dev.: 0.0009)
  SingleSource/Benchmarks/Stanford/Puzzle: 11.03% (0.1668 => 0.1852, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.33% (0.3534 => 0.3793, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.79% (2.8568 => 3.0509, std.dev.: 0.0100)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.80% (1.9729 => 2.0874, std.dev.: 0.0042)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.33% (4.1840 => 4.4068, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/fp-convert: 5.13% (7.3892 => 7.7684, std.dev.: 0.0148)
  MultiSource/Benchmarks/FreeBench/neural/neural: 4.69% (0.4220 => 0.4418, std.dev.: 0.0058)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.46% (1.1019 => 1.1510, std.dev.: 0.0180)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.78% (0.6939 => 0.7201, std.dev.: 0.0041)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.75% (0.6261 => 0.6496, std.dev.: 0.0002)
  MultiSource/Applications/sgefa/sgefa: 3.52% (0.8745 => 0.9053, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.47% (5.9126 => 6.1179, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.96% (1.8409 => 1.8954, std.dev.: 0.0027)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.54% (0.5112 => 0.5242, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.50% (1.5797 => 1.6192, std.dev.: 0.0104)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.45% (50.9650 => 52.2140, std.dev.: 0.2599)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 2.39% (2.8940 => 2.9633, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.15% (5.9456 => 6.0734, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.11% (3.1547 => 3.2213, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/oourafft: 2.08% (3.6501 => 3.7260, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.98% (2.5025 => 2.5520, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/fib2: 1.57% (3.5960 => 3.6526, std.dev.: 0.0012)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.41% (1.6699 => 1.6935, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.30% (3.1455 => 3.1865, std.dev.: 0.0049)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.60% (0.0688 => 0.0505, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -13.73% (0.1938 => 0.1672, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.30% (0.3247 => 0.2945, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.85% (5.8749 => 5.4137, std.dev.: 0.0221)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.41% (0.3402 => 0.3150, std.dev.: 0.0062)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.43% (1.5034 => 1.4068, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.40% (1.3676 => 1.2801, std.dev.: 0.0050)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.31% (0.6882 => 0.6448, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.09% (2.0207 => 1.8976, std.dev.: 0.0261)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.06% (1.3505 => 1.2822, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.92% (1.4277 => 1.3574, std.dev.: 0.0191)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.23% (1.1409 => 1.0926, std.dev.: 0.0021)
  MultiSource/Applications/obsequi/Obsequi: -4.21% (1.1905 => 1.1404, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.89% (1.3127 => 1.2617, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.35% (1.2544 => 1.2124, std.dev.: 0.0031)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.90% (1.3256 => 1.2872, std.dev.: 0.0140)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.24% (10.3096 => 10.0791, std.dev.: 0.0418)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.10% (0.6322 => 0.6189, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.79% (1.3510 => 1.3268, std.dev.: 0.0050)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -1.70% (44.9186 => 44.1531, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.03% (1.3551 => 1.3411, std.dev.: 0.0052)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -21.53% (23.4696 => 18.4175, std.dev.: 1.9072)
  MultiSource/Benchmarks/Bullet/bullet: -6.36% (7.4226 => 6.9504, std.dev.: 0.0503)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.01% (10.0217 => 9.5197, std.dev.: 0.1797)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.50% (2.5559 => 2.4410, std.dev.: 0.0242)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.50% (6.0535 => 5.8415, std.dev.: 0.0271)
  SingleSource/Benchmarks/Shootout/heapsort: -2.26% (2.9492 => 2.8826, std.dev.: 0.0243)
  MultiSource/Applications/lua/lua: -2.18% (29.1357 => 28.5015, std.dev.: 0.2115)
  SingleSource/Benchmarks/Misc/ffbench: -1.33% (1.4103 => 1.3915, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.18% (3.5813 => 3.5390, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.09% (4.1462 => 4.1011, std.dev.: 0.0019)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131212/dcfa8bb4/attachment.html>


More information about the llvm-testresults mailing list