[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Apr 15 11:23:30 PDT 2013


http://llvm.org/perf/db_default/v4/nts/10667?compare_to=10663&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 10667, Order: 179532, Start Time: 2013-04-15 16:34:39, End Time: 2013-04-15 18:24:42
      To: 10663, Order: 179523, Start Time: 2013-04-15 14:23:32, End Time: 2013-04-15 16:11:56
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Passes: 0 (13 on baseline)
Performance Regressions: 23 (108 on baseline)
Performance Improvements: 10 (50 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 19 (19 on baseline)
Unchanged Tests: 1056 (912 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 47.28% (0.1379 => 0.2031, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 42.13% (0.2364 => 0.3360, std.dev.: 0.0080)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 39.74% (0.1009 => 0.1410, std.dev.: 0.0148)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 34.76% (0.1801 => 0.2427, std.dev.: 0.0176)
  MultiSource/Applications/spiff/spiff: 22.57% (0.9100 => 1.1154, std.dev.: 0.0779)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 12.03% (0.1056 => 0.1183, std.dev.: 0.0031)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 11.98% (1.1629 => 1.3022, std.dev.: 0.0456)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 9.49% (1.1627 => 1.2730, std.dev.: 0.0067)
  MultiSource/Applications/SPASS/SPASS: 7.22% (16.7346 => 17.9435, std.dev.: 0.1851)
  MultiSource/Applications/sqlite3/sqlite3: 6.65% (16.4572 => 17.5508, std.dev.: 0.3263)
  MultiSource/Applications/JM/lencod/lencod: 4.80% (16.6190 => 17.4164, std.dev.: 0.1869)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.10% (1.5362 => 1.5531, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 51.88% (0.0453 => 0.0688, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 25.09% (0.0829 => 0.1037, std.dev.: 0.0072)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 17.88% (2.4664 => 2.9073, std.dev.: 0.0308)
  SingleSource/Benchmarks/Shootout/heapsort: 16.69% (3.9000 => 4.5510, std.dev.: 0.1469)
  SingleSource/Benchmarks/Stanford/Puzzle: 15.38% (0.1430 => 0.1650, std.dev.: 0.0028)
  MultiSource/Applications/SPASS/SPASS: 11.00% (8.3120 => 9.2262, std.dev.: 0.3146)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.81% (22.4753 => 23.3317, std.dev.: 0.0290)
  MultiSource/Applications/lua/lua: 3.19% (29.3535 => 30.2900, std.dev.: 0.0647)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.94% (4.1637 => 4.2860, std.dev.: 0.0343)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 1.64% (1.2496 => 1.2701, std.dev.: 0.0075)
  MultiSource/Applications/siod/siod: 1.18% (3.6040 => 3.6467, std.dev.: 0.0116)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/perlin: -37.73% (0.0872 => 0.0543, std.dev.: 0.0078)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -7.69% (0.2431 => 0.2244, std.dev.: 0.0049)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -5.54% (1.7885 => 1.6894, std.dev.: 0.0276)
  SingleSource/Benchmarks/Shootout-C++/lists: -4.23% (0.2884 => 0.2762, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -4.18% (1.0198 => 0.9772, std.dev.: 0.0066)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -26.42% (1.2428 => 0.9145, std.dev.: 0.1250)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -10.79% (0.9405 => 0.8390, std.dev.: 0.0376)
  SingleSource/Benchmarks/Misc/ffbench: -4.67% (1.4466 => 1.3791, std.dev.: 0.0193)
  SingleSource/Benchmarks/Misc/pi: -3.64% (1.9901 => 1.9177, std.dev.: 0.0143)
  SingleSource/Benchmarks/Shootout-C++/methcall: -1.07% (11.6640 => 11.5387, std.dev.: 0.0456)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 5.38% (1.1685 => 1.2314, std.dev.: 0.0525)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -2.26% (0.0221 => 0.0216, std.dev.: 0.0008)
  MultiSource/Applications/ClamAV/clamscan: -1.89% (0.1538 => 0.1509, std.dev.: 0.0275)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 9.13% (0.1073 => 0.1171, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0009 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.18% (0.0595 => 0.0588, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 0.78% (0.0257 => 0.0259, std.dev.: 0.0025)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0032 => 0.0032, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0028 => 0.0028, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -0.94% (0.0635 => 0.0629, std.dev.: 0.0091)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 22.77% (0.0224 => 0.0275, std.dev.: 0.0062)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: -87.50% (0.0008 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 72.92% (0.0048 => 0.0083, std.dev.: 0.0011)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.07% (24.0470 => 24.3049, std.dev.: 0.1304)

================================
Run-Over-Baseline Changes Detail
================================

New Passes - Execution Time
---------------------------
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/lemon/lemon
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  MultiSource/Applications/Burg/burg: 7.69% (0.0013 => 0.0014, std.dev.: 0.0002)
  MultiSource/Applications/lemon/lemon: -23.39% (1.1794 => 0.9035, std.dev.: 0.3072)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 9.70% (0.4125 => 0.4525, std.dev.: 0.0751)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.30% (0.0663 => 0.0608, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 0.48% (1.1660 => 1.1716, std.dev.: 0.0006)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -24.41% (1.6803 => 1.2701, std.dev.: 0.0075)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 900.00% (0.0001 => 0.0010)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 7.12% (29.7937 => 31.9144, std.dev.: 1.1600)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1400.00% (0.0001 => 0.0015, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0005)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/NP/np: 63.11% (0.0206 => 0.0336, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 53.75% (0.1321 => 0.2031, std.dev.: 0.0044)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 52.94% (0.2197 => 0.3360, std.dev.: 0.0080)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 49.03% (0.0206 => 0.0307, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 47.64% (0.0955 => 0.1410, std.dev.: 0.0148)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 43.95% (0.1686 => 0.2427, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 39.86% (1.0951 => 1.5316, std.dev.: 0.1629)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 34.96% (1.1023 => 1.4877, std.dev.: 0.0219)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 34.94% (0.7074 => 0.9546, std.dev.: 0.0905)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 33.56% (1.2270 => 1.6388, std.dev.: 0.0923)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 33.53% (1.0890 => 1.4541, std.dev.: 0.0468)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 32.44% (1.1727 => 1.5531, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 32.09% (1.1626 => 1.5357, std.dev.: 0.0651)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 31.94% (1.0617 => 1.4008, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 31.32% (1.2835 => 1.6855, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 31.12% (1.0864 => 1.4245, std.dev.: 0.1082)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 30.47% (1.1209 => 1.4624, std.dev.: 0.0370)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 30.43% (1.0507 => 1.3704, std.dev.: 0.0261)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 29.80% (1.1744 => 1.5244, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 29.57% (1.0528 => 1.3641, std.dev.: 0.0276)
  MultiSource/Benchmarks/McCat/05-eks/eks: 28.78% (0.4798 => 0.6179, std.dev.: 0.0465)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 28.21% (1.3638 => 1.7485, std.dev.: 0.0119)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 27.98% (1.0526 => 1.3471, std.dev.: 0.0420)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 26.31% (1.2723 => 1.6071, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 25.60% (1.3692 => 1.7197, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 25.39% (1.3313 => 1.6693, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 25.08% (1.3491 => 1.6874, std.dev.: 0.0385)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 24.92% (0.0947 => 0.1183, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 24.91% (1.2925 => 1.6145, std.dev.: 0.0597)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 24.86% (1.3046 => 1.6289, std.dev.: 0.0962)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 24.43% (1.2853 => 1.5993, std.dev.: 0.0363)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 24.42% (1.2566 => 1.5634, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 24.35% (1.2537 => 1.5590, std.dev.: 0.0378)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 24.22% (1.4622 => 1.8163, std.dev.: 0.0358)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 23.84% (1.2704 => 1.5732, std.dev.: 0.0424)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 22.97% (1.3451 => 1.6541, std.dev.: 0.0807)
  MultiSource/Applications/spiff/spiff: 22.46% (0.9108 => 1.1154, std.dev.: 0.0779)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 22.40% (1.3357 => 1.6349, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 21.11% (1.4005 => 1.6962, std.dev.: 0.0259)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 15.04% (1.1320 => 1.3022, std.dev.: 0.0456)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 14.33% (23.8286 => 27.2424, std.dev.: 0.6035)
  SingleSource/Benchmarks/Misc/whetstone: 13.53% (0.0828 => 0.0940, std.dev.: 0.0011)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 12.88% (1.1277 => 1.2730, std.dev.: 0.0067)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 12.81% (0.1374 => 0.1550, std.dev.: 0.0065)
  MultiSource/Applications/minisat/minisat: 10.51% (0.7554 => 0.8348, std.dev.: 0.0278)
  MultiSource/Applications/lua/lua: 9.95% (4.1835 => 4.5997, std.dev.: 0.1392)
  MultiSource/Applications/SPASS/SPASS: 9.88% (16.3304 => 17.9435, std.dev.: 0.1851)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 9.54% (1.5423 => 1.6894, std.dev.: 0.0276)
  MultiSource/Benchmarks/Bullet/bullet: 9.34% (33.9296 => 37.0991, std.dev.: 0.4366)
  MultiSource/Applications/SIBsim4/SIBsim4: 8.49% (1.4195 => 1.5400, std.dev.: 0.0282)
  MultiSource/Applications/sqlite3/sqlite3: 8.41% (16.1895 => 17.5508, std.dev.: 0.3263)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 7.50% (0.2479 => 0.2665, std.dev.: 0.0024)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 6.93% (0.3348 => 0.3580, std.dev.: 0.0072)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.78% (14.7643 => 15.7658, std.dev.: 0.3037)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.41% (0.2950 => 0.3139, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/ReedSolomon: 5.27% (0.2086 => 0.2196, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/oourafft: 5.20% (0.2192 => 0.2306, std.dev.: 0.0012)
  MultiSource/Applications/JM/ldecod/ldecod: 5.12% (7.2467 => 7.6177, std.dev.: 0.1308)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.19% (0.9379 => 0.9772, std.dev.: 0.0066)
  MultiSource/Applications/JM/lencod/lencod: 4.16% (16.7203 => 17.4164, std.dev.: 0.1869)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 54.26% (0.0446 => 0.0688, std.dev.: 0.0044)
  SingleSource/Benchmarks/Shootout-C++/ary: 46.14% (0.0505 => 0.0738, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/heapsort: 44.92% (3.1404 => 4.5510, std.dev.: 0.1469)
  SingleSource/Benchmarks/Misc/fp-convert: 40.36% (5.6800 => 7.9726, std.dev.: 0.0090)
  SingleSource/Benchmarks/Stanford/Bubblesort: 38.28% (0.0290 => 0.0401, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/methcall: 33.88% (8.6184 => 11.5387, std.dev.: 0.0456)
  SingleSource/Benchmarks/Shootout/hash: 33.06% (4.1780 => 5.5592, std.dev.: 0.1776)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 23.35% (12.6632 => 15.6200, std.dev.: 0.3045)
  SingleSource/Benchmarks/Shootout-C++/matrix: 21.87% (2.8804 => 3.5103, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 20.51% (3.7569 => 4.5274, std.dev.: 0.0324)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.18% (2.4191 => 2.9073, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.94% (4.8478 => 5.6692, std.dev.: 0.0166)
  MultiSource/Benchmarks/Olden/tsp/tsp: 14.50% (1.4232 => 1.6295, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 14.17% (4.5865 => 5.2364, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.15% (8.7510 => 9.9890, std.dev.: 0.0148)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.13% (2.5283 => 2.8351, std.dev.: 0.0374)
  SingleSource/Benchmarks/Shootout/sieve: 11.92% (6.8087 => 7.6202, std.dev.: 0.1836)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.00% (4.8642 => 5.3995, std.dev.: 0.0187)
  SingleSource/Benchmarks/Shootout-C++/ary3: 10.79% (2.0100 => 2.2268, std.dev.: 0.0635)
  SingleSource/Benchmarks/Shootout/matrix: 10.69% (1.5499 => 1.7156, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops: 8.25% (9.3754 => 10.1491, std.dev.: 0.0204)
  SingleSource/Benchmarks/Misc/flops-7: 8.06% (1.9399 => 2.0962, std.dev.: 0.0381)
  MultiSource/Benchmarks/nbench/nbench: 8.00% (20.6711 => 22.3241, std.dev.: 0.5549)
  MultiSource/Applications/lua/lua: 7.52% (28.1709 => 30.2900, std.dev.: 0.0647)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.03% (2.5458 => 2.7247, std.dev.: 0.0159)
  MultiSource/Applications/siod/siod: 6.81% (3.4143 => 3.6467, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.49% (4.7982 => 5.1095, std.dev.: 0.0062)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 6.27% (1.8732 => 1.9907, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.73% (5.0818 => 5.3728, std.dev.: 0.0113)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.69% (22.0762 => 23.3317, std.dev.: 0.0290)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.53% (3.3943 => 3.5819, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 4.80% (5.1346 => 5.3810, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/salsa20: 4.78% (9.1513 => 9.5889, std.dev.: 0.1662)
  MultiSource/Applications/hexxagon/hexxagon: 4.62% (14.4795 => 15.1489, std.dev.: 0.0296)
  SingleSource/Benchmarks/Misc/whetstone: 4.60% (3.4590 => 3.6182, std.dev.: 0.0188)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.17% (4.1146 => 4.2860, std.dev.: 0.0343)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.06% (59.5643 => 61.9810, std.dev.: 0.8215)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.82% (5.1006 => 5.2956, std.dev.: 0.0157)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.37% (6.1397 => 6.3466, std.dev.: 0.0086)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.33% (1.0374 => 1.0719, std.dev.: 0.0040)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.65% (2.4484 => 2.5132, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc/richards_benchmark: 2.47% (1.3414 => 1.3745, std.dev.: 0.0044)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2248 => 1.2540, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.27% (9.6958 => 9.9156, std.dev.: 0.0320)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.12% (2.0956 => 2.1401, std.dev.: 0.0019)
  MultiSource/Applications/spiff/spiff: 1.70% (2.7749 => 2.8220, std.dev.: 0.0112)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.22% (2.3310 => 2.3595, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/lists: 1.15% (7.2055 => 7.2881, std.dev.: 0.0239)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -52.35% (0.0810 => 0.0386, std.dev.: 0.0137)
  MultiSource/Benchmarks/FreeBench/neural/neural: -22.15% (0.2542 => 0.1979, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -15.31% (0.0895 => 0.0758, std.dev.: 0.0045)
  SingleSource/Benchmarks/McGill/chomp: -9.50% (0.1957 => 0.1771, std.dev.: 0.0067)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -66.54% (1.0845 => 0.3629, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.39% (0.3861 => 0.1375, std.dev.: 0.0010)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -56.89% (3.4380 => 1.4821, std.dev.: 0.0163)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.78% (3.8940 => 1.6830, std.dev.: 0.0092)
  MultiSource/Benchmarks/FreeBench/mason/mason: -45.04% (0.5213 => 0.2865, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.45% (0.3091 => 0.1779, std.dev.: 0.0319)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -33.24% (6.8267 => 4.5577, std.dev.: 0.0179)
  MultiSource/Applications/viterbi/viterbi: -26.75% (3.4506 => 2.5277, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -25.60% (0.4520 => 0.3363, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -23.99% (0.4368 => 0.3320, std.dev.: 0.0258)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -22.93% (0.1871 => 0.1442, std.dev.: 0.0048)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -21.13% (0.1789 => 0.1411, std.dev.: 0.0135)
  SingleSource/Benchmarks/Misc/perlin: -20.64% (4.5691 => 3.6260, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.30% (0.3279 => 0.2646, std.dev.: 0.0007)
  SingleSource/Benchmarks/McGill/misr: -19.26% (0.4729 => 0.3818, std.dev.: 0.0066)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.74% (0.0950 => 0.0772, std.dev.: 0.0030)
  MultiSource/Benchmarks/mafft/pairlocalalign: -17.82% (57.5400 => 47.2867, std.dev.: 0.5014)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.57% (6.0446 => 5.0431, std.dev.: 0.0556)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.53% (6.4626 => 5.3944, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -14.38% (3.5506 => 3.0401, std.dev.: 0.0471)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -13.97% (6.7010 => 5.7649, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.55% (6.0602 => 5.2994, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/mandel: -11.29% (1.0882 => 0.9653, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -10.83% (5.6245 => 5.0151, std.dev.: 0.2005)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -10.05% (5.8948 => 5.3024, std.dev.: 0.1312)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.64% (5.0816 => 4.6423, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.55% (3.3978 => 3.1414, std.dev.: 0.0068)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -7.41% (4.2970 => 3.9786, std.dev.: 0.1128)
  MultiSource/Benchmarks/NPB-serial/is/is: -7.40% (13.2022 => 12.2249, std.dev.: 0.0400)
  SingleSource/Benchmarks/McGill/queens: -7.34% (1.7928 => 1.6612, std.dev.: 0.0104)
  SingleSource/Benchmarks/Misc/pi: -6.51% (2.0512 => 1.9177, std.dev.: 0.0143)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.85% (3.9434 => 3.7129, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.47% (5.7666 => 5.5091, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.38% (4.4289 => 4.2348, std.dev.: 0.0743)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.38% (3.3618 => 3.2145, std.dev.: 0.0311)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.37% (9.0356 => 8.6409, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc/fbench: -4.23% (4.9661 => 4.7561, std.dev.: 0.0199)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -3.39% (3.3922 => 3.2773, std.dev.: 0.0079)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.24% (4.3713 => 4.2296, std.dev.: 0.0075)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.31% (35.0623 => 34.2541, std.dev.: 0.0276)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.87% (89.3093 => 87.6362, std.dev.: 0.0287)
  MultiSource/Applications/JM/lencod/lencod: -1.84% (7.1542 => 7.0227, std.dev.: 0.0374)
  SingleSource/Benchmarks/Misc/flops-3: -1.47% (2.0809 => 2.0503, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.47% (3.8286 => 3.7724, std.dev.: 0.0039)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.24% (5.6426 => 5.5726, std.dev.: 0.0227)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.07% (2.5864 => 2.5586, std.dev.: 0.0046)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 9.09% (1.1288 => 1.2314, std.dev.: 0.0525)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -12.90% (0.0248 => 0.0216, std.dev.: 0.0008)
  MultiSource/Applications/ClamAV/clamscan: 2.17% (0.1477 => 0.1509, std.dev.: 0.0275)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.54% (0.1309 => 0.1171, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.08% (0.0613 => 0.0588, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.16% (0.0276 => 0.0259, std.dev.: 0.0025)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 10.34% (0.0029 => 0.0032, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 3.70% (0.0027 => 0.0028, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 5.89% (0.0594 => 0.0629, std.dev.: 0.0091)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.82% (0.0361 => 0.0275, std.dev.: 0.0062)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0005)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -9.78% (0.0092 => 0.0083, std.dev.: 0.0011)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.72% (26.9213 => 24.3049, std.dev.: 0.1304)

Report Time: 1.08s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130415/883a948f/attachment.html>


More information about the llvm-testresults mailing list