[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 5 17:43:35 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14121?compare_to=14117&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14121, Order: 187747, Start Time: 2013-08-05 22:49:39, End Time: 2013-08-06 00:45:24
      To: 14117, Order: 187736, Start Time: 2013-08-05 20:18:12, End Time: 2013-08-05 22:13:06
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 106 (120 on baseline)
Performance Improvements: 29 (22 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 970 (963 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/FloatMM: 74.52% (0.0471 => 0.0822, std.dev.: 0.0031)
  SingleSource/Regression/C++/EH/ConditionalExpr: 73.48% (0.0230 => 0.0399, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops-7: 67.44% (0.0301 => 0.0504, std.dev.: 0.0027)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 65.95% (0.1069 => 0.1774, std.dev.: 0.0079)
  MultiSource/Benchmarks/FreeBench/distray/distray: 65.59% (0.1238 => 0.2050, std.dev.: 0.0091)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 65.37% (0.0205 => 0.0339, std.dev.: 0.0008)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 63.82% (0.0293 => 0.0480, std.dev.: 0.0026)
  MultiSource/Benchmarks/FreeBench/mason/mason: 60.28% (0.0705 => 0.1130, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/flops-5: 59.82% (0.0336 => 0.0537, std.dev.: 0.0024)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 59.17% (0.0169 => 0.0269, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/ackermann: 58.30% (0.0235 => 0.0372, std.dev.: 0.0052)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 53.11% (0.0273 => 0.0418, std.dev.: 0.0024)
  SingleSource/Regression/C++/EH/simple_rethrow: 49.11% (0.0224 => 0.0334, std.dev.: 0.0020)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 49.00% (0.1098 => 0.1636, std.dev.: 0.0122)
  SingleSource/Benchmarks/Misc/mandel-2: 48.70% (0.0347 => 0.0516, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 48.65% (0.1406 => 0.2090, std.dev.: 0.0043)
  MultiSource/Benchmarks/McCat/08-main/main: 48.01% (0.3041 => 0.4501, std.dev.: 0.0302)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 47.99% (0.0746 => 0.1104, std.dev.: 0.0101)
  SingleSource/Benchmarks/Misc/flops-1: 47.80% (0.0318 => 0.0470, std.dev.: 0.0039)
  MultiSource/Applications/spiff/spiff: 47.16% (0.9506 => 1.3989, std.dev.: 0.0374)
  SingleSource/Regression/C/testtrace: 46.88% (0.0256 => 0.0376, std.dev.: 0.0036)
  MultiSource/Applications/hbd/hbd: 46.25% (1.6892 => 2.4704, std.dev.: 0.0855)
  MultiSource/Applications/hexxagon/hexxagon: 28.84% (1.1245 => 1.4488, std.dev.: 0.0278)
  MultiSource/Applications/sgefa/sgefa: 26.76% (0.4242 => 0.5377, std.dev.: 0.0360)
  MultiSource/Benchmarks/McCat/09-vor/vor: 25.71% (0.3835 => 0.4821, std.dev.: 0.0239)
  MultiSource/Applications/lua/lua: 25.00% (4.4851 => 5.6062, std.dev.: 0.4143)
  MultiSource/Applications/treecc/treecc: 24.71% (2.3822 => 2.9708, std.dev.: 0.1178)
  MultiSource/Benchmarks/McCat/18-imp/imp: 24.16% (0.4301 => 0.5340, std.dev.: 0.0307)
  MultiSource/Applications/lambda-0_1_3/lambda: 23.57% (0.8397 => 1.0376, std.dev.: 0.0735)
  MultiSource/Applications/viterbi/viterbi: 23.14% (0.1906 => 0.2347, std.dev.: 0.0147)
  MultiSource/Applications/JM/lencod/lencod: 17.73% (17.3519 => 20.4278, std.dev.: 0.4868)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 17.37% (1.6671 => 1.9566, std.dev.: 0.1042)
  MultiSource/Applications/JM/ldecod/ldecod: 16.52% (7.6536 => 8.9181, std.dev.: 0.3457)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 14.96% (1.4475 => 1.6640, std.dev.: 0.0339)
  MultiSource/Applications/ClamAV/clamscan: 13.74% (17.1827 => 19.5442, std.dev.: 0.4484)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 13.14% (1.5017 => 1.6990, std.dev.: 0.0237)
  SingleSource/Benchmarks/Shootout-C++/sieve: 13.07% (0.3174 => 0.3589, std.dev.: 0.0042)
  MultiSource/Applications/lemon/lemon: 12.90% (1.2421 => 1.4023, std.dev.: 0.0131)
  MultiSource/Applications/minisat/minisat: 12.82% (0.7855 => 0.8862, std.dev.: 0.0081)
  MultiSource/Applications/oggenc/oggenc: 12.79% (5.7889 => 6.5294, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 12.45% (1.5247 => 1.7145, std.dev.: 0.0099)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 12.39% (0.2316 => 0.2603, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.17% (1.4824 => 1.6628, std.dev.: 0.0229)
  MultiSource/Applications/sqlite3/sqlite3: 12.09% (17.9977 => 20.1733, std.dev.: 0.1575)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 11.91% (0.3627 => 0.4059, std.dev.: 0.0149)
  MultiSource/Applications/SPASS/SPASS: 11.81% (17.6856 => 19.7742, std.dev.: 0.5928)
  MultiSource/Applications/kimwitu++/kc: 11.62% (20.2498 => 22.6023, std.dev.: 0.2393)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.52% (1.3988 => 1.5600, std.dev.: 0.0454)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.52% (2.5364 => 2.8033, std.dev.: 0.0579)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.71% (0.3305 => 0.3626, std.dev.: 0.0102)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 9.71% (0.9942 => 1.0907, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 9.54% (1.4201 => 1.5556, std.dev.: 0.0420)
  SingleSource/Benchmarks/Shootout-C++/lists1: 9.40% (0.3478 => 0.3805, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.64% (1.4170 => 1.5252, std.dev.: 0.0396)
  SingleSource/Benchmarks/Shootout-C++/ary: 7.09% (0.2935 => 0.3143, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.98% (1.4282 => 1.5279, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.91% (1.4006 => 1.4974, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.81% (1.4130 => 1.4951, std.dev.: 0.0201)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 104.44% (0.0180 => 0.0368, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/ary3: 81.19% (5.7954 => 10.5005, std.dev.: 0.4822)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 70.84% (2.9356 => 5.0152, std.dev.: 0.1023)
  SingleSource/Benchmarks/Shootout/heapsort: 60.64% (3.0142 => 4.8419, std.dev.: 0.2216)
  SingleSource/Benchmarks/Stanford/Bubblesort: 51.36% (0.0331 => 0.0501, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/Perm: 43.77% (0.0329 => 0.0473, std.dev.: 0.0021)
  MultiSource/Applications/d/make_dparser: 43.19% (0.0382 => 0.0547, std.dev.: 0.0033)
  MultiSource/Applications/lemon/lemon: 42.68% (0.9117 => 1.3008, std.dev.: 0.0667)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 42.28% (0.0246 => 0.0350, std.dev.: 0.0014)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 40.76% (3.6248 => 5.1024, std.dev.: 0.2632)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 38.07% (1.3536 => 1.8689, std.dev.: 0.0142)
  MultiSource/Applications/minisat/minisat: 35.90% (6.6648 => 9.0573, std.dev.: 0.1530)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 33.43% (0.1361 => 0.1816, std.dev.: 0.0139)
  MultiSource/Benchmarks/Olden/mst/mst: 31.77% (0.2049 => 0.2700, std.dev.: 0.0121)
  MultiSource/Applications/SPASS/SPASS: 30.92% (8.5159 => 11.1488, std.dev.: 0.4922)
  MultiSource/Benchmarks/FreeBench/mason/mason: 27.88% (0.2981 => 0.3812, std.dev.: 0.0009)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 24.65% (1.2903 => 1.6084, std.dev.: 0.0407)
  MultiSource/Benchmarks/McCat/18-imp/imp: 24.23% (0.1065 => 0.1323, std.dev.: 0.0031)
  MultiSource/Benchmarks/McCat/08-main/main: 22.91% (0.0755 => 0.0928, std.dev.: 0.0063)
  MultiSource/Benchmarks/llubenchmark/llu: 19.76% (2.0643 => 2.4723, std.dev.: 0.0428)
  SingleSource/Benchmarks/Shootout-C++/ary: 18.77% (0.0602 => 0.0715, std.dev.: 0.0031)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.56% (0.2392 => 0.2812, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.08% (4.1306 => 4.8363, std.dev.: 0.0202)
  MultiSource/Applications/oggenc/oggenc: 15.73% (0.1672 => 0.1935, std.dev.: 0.0095)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.06% (2.0294 => 2.2133, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.23% (4.0181 => 4.2686, std.dev.: 0.0383)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 5.86% (2.4158 => 2.5574, std.dev.: 0.0477)
  SingleSource/Benchmarks/Misc/salsa20: 5.47% (8.5332 => 8.9998, std.dev.: 0.0408)
  MultiSource/Benchmarks/Olden/bh/bh: 4.97% (2.4676 => 2.5902, std.dev.: 0.0137)
  MultiSource/Applications/lua/lua: 4.96% (29.1481 => 30.5930, std.dev.: 0.2203)
  SingleSource/Benchmarks/Misc/flops: 4.86% (9.5012 => 9.9634, std.dev.: 0.0065)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.40% (95.0975 => 99.2831, std.dev.: 0.4044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.35% (0.2712 => 0.2830, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 4.11% (0.3016 => 0.3140, std.dev.: 0.0020)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 3.10% (20.8538 => 21.5013, std.dev.: 0.1600)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 2.33% (4.2512 => 4.3504, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.32% (16.4192 => 16.8002, std.dev.: 0.1369)
  SingleSource/Benchmarks/Shootout/methcall: 2.24% (8.3069 => 8.4927, std.dev.: 0.0293)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.22% (40.4074 => 41.3027, std.dev.: 0.1169)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.16% (5.1339 => 5.2447, std.dev.: 0.0268)
  SingleSource/Benchmarks/Shootout/sieve: 1.73% (7.7810 => 7.9157, std.dev.: 0.0487)
  MultiSource/Benchmarks/sim/sim: 1.67% (3.8757 => 3.9405, std.dev.: 0.0199)
  MultiSource/Benchmarks/Olden/em3d/em3d: 1.45% (5.1794 => 5.2543, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.38% (3.6057 => 3.6555, std.dev.: 0.0181)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 1.09% (3.2003 => 3.2352, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.07% (5.9643 => 6.0283, std.dev.: 0.0226)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.06% (5.6261 => 5.6860, std.dev.: 0.0059)
  SingleSource/Benchmarks/Shootout/lists: 1.05% (7.2717 => 7.3484, std.dev.: 0.0086)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -30.84% (6.9676 => 4.8191, std.dev.: 0.1799)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -27.22% (0.2024 => 0.1473, std.dev.: 0.0164)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -25.77% (2.6519 => 1.9686, std.dev.: 0.1045)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -23.65% (0.2216 => 0.1692, std.dev.: 0.0085)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -23.55% (1.3409 => 1.0251, std.dev.: 0.1114)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -22.95% (0.1329 => 0.1024, std.dev.: 0.0081)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -22.66% (0.9334 => 0.7219, std.dev.: 0.0264)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -20.75% (0.4968 => 0.3937, std.dev.: 0.0232)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -20.16% (6.4658 => 5.1625, std.dev.: 0.3812)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -19.35% (0.2140 => 0.1726, std.dev.: 0.0148)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -19.22% (1.4159 => 1.1437, std.dev.: 0.0227)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -18.66% (1.1135 => 0.9057, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -18.46% (0.3640 => 0.2968, std.dev.: 0.0163)
  MultiSource/Benchmarks/Prolangs-C/fixoutput/fixoutput: -18.07% (0.0952 => 0.0780, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -17.83% (0.4319 => 0.3549, std.dev.: 0.0098)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -17.55% (0.7132 => 0.5880, std.dev.: 0.0122)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -16.97% (1.8239 => 1.5143, std.dev.: 0.0994)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -16.48% (6.7772 => 5.6602, std.dev.: 0.1800)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -15.84% (0.8112 => 0.6827, std.dev.: 0.0060)
  MultiSource/Benchmarks/Bullet/bullet: -15.35% (42.8594 => 36.2825, std.dev.: 0.8076)
  MultiSource/Benchmarks/Prolangs-C/football/football: -13.62% (1.1993 => 1.0360, std.dev.: 0.0332)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -11.77% (7.3114 => 6.4507, std.dev.: 0.2570)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.69% (29.6277 => 28.2395, std.dev.: 0.4274)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -27.44% (0.2121 => 0.1539, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -25.62% (0.0765 => 0.0569, std.dev.: 0.0049)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.03% (3.2992 => 2.7372, std.dev.: 0.1694)
  MultiSource/Benchmarks/Bullet/bullet: -12.58% (8.1070 => 7.0873, std.dev.: 0.1031)
  MultiSource/Benchmarks/MallocBench/gs/gs: -12.49% (0.0969 => 0.0848, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -9.09% (3.2957 => 2.9961, std.dev.: 0.0777)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 1.57% (0.1339 => 0.1360, std.dev.: 0.0149)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 1.78% (0.2699 => 0.2747, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 8.63% (0.0255 => 0.0277, std.dev.: 0.0068)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.35% (0.2813 => 0.2747, std.dev.: 0.0014)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.71% (0.0345 => 0.0277, std.dev.: 0.0068)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 98.45% (0.1033 => 0.2050, std.dev.: 0.0091)
  SingleSource/Regression/C++/EH/dead_try_block: 78.32% (0.0143 => 0.0255, std.dev.: 0.0007)
  SingleSource/Benchmarks/Stanford/FloatMM: 75.27% (0.0469 => 0.0822, std.dev.: 0.0031)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 74.78% (0.1015 => 0.1774, std.dev.: 0.0079)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 73.85% (0.0195 => 0.0339, std.dev.: 0.0008)
  SingleSource/Regression/C++/EH/ConditionalExpr: 72.73% (0.0231 => 0.0399, std.dev.: 0.0010)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 70.25% (0.0158 => 0.0269, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/mason/mason: 63.77% (0.0690 => 0.1130, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 62.65% (0.0257 => 0.0418, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/flops-7: 60.51% (0.0314 => 0.0504, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/flops-5: 59.82% (0.0336 => 0.0537, std.dev.: 0.0024)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 58.94% (0.0302 => 0.0480, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/mandel-2: 55.89% (0.0331 => 0.0516, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 54.63% (0.1058 => 0.1636, std.dev.: 0.0122)
  SingleSource/Regression/C++/EH/simple_rethrow: 54.63% (0.0216 => 0.0334, std.dev.: 0.0020)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 53.81% (0.0197 => 0.0303, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: 53.76% (0.0718 => 0.1104, std.dev.: 0.0101)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 50.25% (0.1391 => 0.2090, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/flops-1: 48.73% (0.0316 => 0.0470, std.dev.: 0.0039)
  SingleSource/Regression/C/testtrace: 48.62% (0.0253 => 0.0376, std.dev.: 0.0036)
  MultiSource/Benchmarks/McCat/08-main/main: 48.11% (0.3039 => 0.4501, std.dev.: 0.0302)
  MultiSource/Applications/spiff/spiff: 46.05% (0.9578 => 1.3989, std.dev.: 0.0374)
  MultiSource/Benchmarks/McCat/09-vor/vor: 31.36% (0.3670 => 0.4821, std.dev.: 0.0239)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 31.33% (0.9407 => 1.2354, std.dev.: 0.1077)
  MultiSource/Benchmarks/McCat/18-imp/imp: 28.58% (0.4153 => 0.5340, std.dev.: 0.0307)
  MultiSource/Applications/treecc/treecc: 25.61% (2.3651 => 2.9708, std.dev.: 0.1178)
  MultiSource/Applications/viterbi/viterbi: 23.20% (0.1905 => 0.2347, std.dev.: 0.0147)
  MultiSource/Applications/hbd/hbd: 22.34% (2.0193 => 2.4704, std.dev.: 0.0855)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 21.95% (0.0966 => 0.1178, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 17.56% (1.6643 => 1.9566, std.dev.: 0.1042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 15.12% (0.0787 => 0.0906, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/sieve: 14.01% (0.3148 => 0.3589, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 12.87% (1.4732 => 1.6628, std.dev.: 0.0229)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 12.62% (0.3604 => 0.4059, std.dev.: 0.0149)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 12.30% (0.2318 => 0.2603, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 12.03% (1.4853 => 1.6640, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 11.90% (1.3630 => 1.5252, std.dev.: 0.0396)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.74% (0.9761 => 1.0907, std.dev.: 0.0210)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.57% (0.3250 => 0.3626, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 11.49% (1.5239 => 1.6990, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 11.17% (1.3993 => 1.5556, std.dev.: 0.0420)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 11.13% (1.4037 => 1.5600, std.dev.: 0.0454)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.76% (1.5479 => 1.7145, std.dev.: 0.0099)
  SingleSource/Benchmarks/Shootout-C++/lists1: 10.58% (0.3441 => 0.3805, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 10.51% (1.3826 => 1.5279, std.dev.: 0.0092)
  MultiSource/Applications/JM/lencod/lencod: 10.40% (18.5029 => 20.4278, std.dev.: 0.4868)
  MultiSource/Applications/SPASS/SPASS: 10.40% (17.9111 => 19.7742, std.dev.: 0.5928)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 9.86% (1.4179 => 1.5577, std.dev.: 0.0362)
  SingleSource/Benchmarks/Shootout-C++/ary: 9.78% (0.2863 => 0.3143, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 9.54% (1.3649 => 1.4951, std.dev.: 0.0201)
  MultiSource/Applications/hexxagon/hexxagon: 9.06% (1.3285 => 1.4488, std.dev.: 0.0278)
  MultiSource/Applications/lemon/lemon: 8.07% (1.2976 => 1.4023, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.29% (1.4783 => 1.5861, std.dev.: 0.0396)
  MultiSource/Applications/kimwitu++/kc: 7.24% (21.0770 => 22.6023, std.dev.: 0.2393)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.23% (1.4940 => 1.6020, std.dev.: 0.0329)
  MultiSource/Applications/minisat/minisat: 7.05% (0.8278 => 0.8862, std.dev.: 0.0081)
  MultiSource/Applications/oggenc/oggenc: 6.83% (6.1121 => 6.5294, std.dev.: 0.0345)
  MultiSource/Applications/sqlite3/sqlite3: 5.27% (19.1635 => 20.1733, std.dev.: 0.1575)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.17% (1.4514 => 1.4974, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 80.55% (5.8158 => 10.5005, std.dev.: 0.4822)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.33% (3.7285 => 6.4625, std.dev.: 0.0299)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 72.74% (2.9033 => 5.0152, std.dev.: 0.1023)
  SingleSource/Benchmarks/Shootout/heapsort: 66.26% (2.9123 => 4.8419, std.dev.: 0.2216)
  MultiSource/Applications/d/make_dparser: 56.73% (0.0349 => 0.0547, std.dev.: 0.0033)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 48.82% (1.2558 => 1.8689, std.dev.: 0.0142)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.80% (2.8867 => 4.2954, std.dev.: 0.0268)
  SingleSource/Benchmarks/Shootout/hash: 39.82% (4.1846 => 5.8508, std.dev.: 0.4099)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.84% (0.3171 => 0.4371, std.dev.: 0.0172)
  MultiSource/Benchmarks/FreeBench/mason/mason: 36.19% (0.2799 => 0.3812, std.dev.: 0.0009)
  MultiSource/Benchmarks/McCat/18-imp/imp: 33.91% (0.0988 => 0.1323, std.dev.: 0.0031)
  SingleSource/Benchmarks/Stanford/Bubblesort: 31.84% (0.0380 => 0.0501, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/Perm: 31.39% (0.0360 => 0.0473, std.dev.: 0.0021)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 31.02% (0.1386 => 0.1816, std.dev.: 0.0139)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 27.63% (3.9978 => 5.1024, std.dev.: 0.2632)
  MultiSource/Benchmarks/Olden/mst/mst: 26.52% (0.2134 => 0.2700, std.dev.: 0.0121)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.69% (1.5030 => 1.8891, std.dev.: 0.0313)
  MultiSource/Benchmarks/llubenchmark/llu: 22.47% (2.0187 => 2.4723, std.dev.: 0.0428)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.33% (1.3148 => 1.6084, std.dev.: 0.0407)
  MultiSource/Benchmarks/FreeBench/distray/distray: 21.31% (0.2318 => 0.2812, std.dev.: 0.0088)
  MultiSource/Applications/SPASS/SPASS: 20.89% (9.2220 => 11.1488, std.dev.: 0.4922)
  MultiSource/Applications/siod/siod: 17.02% (3.3761 => 3.9507, std.dev.: 0.0235)
  SingleSource/Benchmarks/McGill/chomp: 16.69% (1.0051 => 1.1729, std.dev.: 0.0612)
  MultiSource/Applications/oggenc/oggenc: 14.50% (0.1690 => 0.1935, std.dev.: 0.0095)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.15% (7.0762 => 8.0064, std.dev.: 0.0304)
  MultiSource/Applications/minisat/minisat: 12.99% (8.0162 => 9.0573, std.dev.: 0.1530)
  MultiSource/Applications/JM/lencod/lencod: 11.48% (7.1799 => 8.0045, std.dev.: 0.1717)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 10.23% (14.9584 => 16.4887, std.dev.: 0.1323)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 10.02% (0.2854 => 0.3140, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.79% (5.4910 => 6.0283, std.dev.: 0.0226)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.41% (2.0229 => 2.2133, std.dev.: 0.0407)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 9.13% (1.2557 => 1.3704, std.dev.: 0.0099)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.22% (0.3649 => 0.3949, std.dev.: 0.0060)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.17% (48.3256 => 52.2746, std.dev.: 0.4253)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.68% (3.2027 => 3.4487, std.dev.: 0.0632)
  SingleSource/Benchmarks/Shootout-C++/hash2: 7.55% (3.3877 => 3.6436, std.dev.: 0.0300)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.25% (3.4085 => 3.6555, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 7.20% (5.3042 => 5.6860, std.dev.: 0.0059)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.03% (2.3894 => 2.5574, std.dev.: 0.0477)
  SingleSource/Benchmarks/Misc/flops-7: 6.11% (1.7330 => 1.8389, std.dev.: 0.0297)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.99% (93.6732 => 99.2831, std.dev.: 0.4044)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.95% (5.5008 => 5.8280, std.dev.: 0.0411)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.51% (3.3384 => 3.5223, std.dev.: 0.0395)
  SingleSource/Benchmarks/Misc/whetstone: 4.79% (3.4559 => 3.6216, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.79% (5.1471 => 5.3938, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.58% (4.3151 => 4.5129, std.dev.: 0.0194)
  MultiSource/Benchmarks/Olden/bh/bh: 4.11% (2.4879 => 2.5902, std.dev.: 0.0137)
  MultiSource/Applications/spiff/spiff: 3.40% (2.7609 => 2.8549, std.dev.: 0.0325)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.37% (4.8739 => 5.0381, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.73% (12.8625 => 13.2131, std.dev.: 0.0452)
  SingleSource/Benchmarks/Misc/pi: 2.24% (1.9835 => 2.0279, std.dev.: 0.0168)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.07% (3.4566 => 3.5283, std.dev.: 0.0262)
  SingleSource/Benchmarks/Misc/flops: 2.02% (9.7664 => 9.9634, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.94% (4.9089 => 5.0042, std.dev.: 0.0345)
  MultiSource/Benchmarks/Olden/em3d/em3d: 1.92% (5.1555 => 5.2543, std.dev.: 0.0048)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.75% (1.4398 => 1.4650, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.66% (4.2794 => 4.3504, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout/lists: 1.62% (7.2315 => 7.3484, std.dev.: 0.0086)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.55% (1.1618 => 1.1798, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc/dt: 1.25% (0.9776 => 0.9898, std.dev.: 0.0040)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.07% (1.8144 => 1.8338, std.dev.: 0.0064)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -20.92% (6.0938 => 4.8191, std.dev.: 0.1799)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.83% (2.1022 => 1.4330, std.dev.: 0.0532)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.27% (0.0816 => 0.0569, std.dev.: 0.0049)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.68% (0.1189 => 0.0848, std.dev.: 0.0033)
  MultiSource/Applications/viterbi/viterbi: -25.99% (3.4923 => 2.5847, std.dev.: 0.1472)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.33% (6.9552 => 5.2632, std.dev.: 0.0123)
  SingleSource/Benchmarks/Misc/perlin: -20.83% (4.5989 => 3.6410, std.dev.: 0.0417)
  SingleSource/Benchmarks/Misc/mandel: -13.43% (1.1996 => 1.0385, std.dev.: 0.0383)
  MultiSource/Applications/sgefa/sgefa: -12.14% (1.4030 => 1.2327, std.dev.: 0.0170)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.68% (0.5173 => 0.4724, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.30% (3.8119 => 3.6481, std.dev.: 0.0276)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.16% (47.2250 => 45.2600, std.dev.: 0.0921)
  SingleSource/Benchmarks/Misc/fbench: -3.83% (4.9602 => 4.7702, std.dev.: 0.0608)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.68% (1.7207 => 1.6573, std.dev.: 0.0051)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.33% (0.7355 => 0.7110, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.97% (6.0444 => 5.8647, std.dev.: 0.0269)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.73% (2.7049 => 2.6311, std.dev.: 0.0262)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.92% (8.6172 => 8.4520, std.dev.: 0.0077)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.90% (34.8438 => 34.1833, std.dev.: 0.1003)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.84% (6.1482 => 6.0351, std.dev.: 0.0174)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.42% (2.1343 => 2.1039, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.34% (5.8810 => 5.8023, std.dev.: 0.0300)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.31% (0.1378 => 0.1360, std.dev.: 0.0149)

Report Time: 0.80s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130805/7ce888db/attachment.html>


More information about the llvm-testresults mailing list