[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Mar 25 23:40:50 PDT 2013


http://llvm.org/perf/db_default/v4/nts/9830?compare_to=9827&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11

Comparing:
     Run: 9830, Order: 177989, Start Time: 2013-03-26 05:00:39, End Time: 2013-03-26 06:41:40
      To: 9827, Order: 177968, Start Time: 2013-03-26 02:56:26, End Time: 2013-03-26 04:41:54
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00

===============
Tests Summary
===============

New Failures: 0 (1 on baseline)
New Passes: 0 (3 on baseline)
Performance Regressions: 49 (105 on baseline)
Performance Improvements: 12 (56 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 30 (29 on baseline)
Unchanged Tests: 1017 (908 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 25.51% (1.0349 => 1.2989, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 25.34% (1.0441 => 1.3087, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 24.81% (1.0491 => 1.3094, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 24.56% (1.0695 => 1.3322, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 24.43% (1.0466 => 1.3023, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 23.99% (1.0823 => 1.3419, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 23.95% (1.0872 => 1.3476, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 23.79% (1.0910 => 1.3505, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 23.70% (1.0917 => 1.3504, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 23.62% (1.1147 => 1.3780, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 23.55% (1.1069 => 1.3676, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 22.92% (1.1641 => 1.4309, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 22.61% (1.1373 => 1.3945, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 22.42% (1.1661 => 1.4275, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 22.28% (1.1560 => 1.4135, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 22.26% (1.1813 => 1.4442, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 21.22% (1.1878 => 1.4398, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 20.89% (1.2405 => 1.4997, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 19.08% (1.2671 => 1.5089, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 18.94% (1.2548 => 1.4925, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 18.65% (1.3430 => 1.5935, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 18.57% (1.2684 => 1.5040, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.55% (1.2689 => 1.5043, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 18.49% (1.2962 => 1.5359, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 18.05% (1.3071 => 1.5430, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 17.90% (1.3464 => 1.5874, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.61% (1.3936 => 1.6390, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 17.34% (1.3629 => 1.5992, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.21% (1.3711 => 1.6070, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 17.14% (1.3852 => 1.6226, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 17.02% (1.3152 => 1.5391, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 16.97% (1.3668 => 1.5988, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 16.74% (1.3343 => 1.5576, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 16.22% (1.3240 => 1.5388, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 16.08% (1.4771 => 1.7146, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 14.93% (1.3212 => 1.5184, std.dev.: 0.0102)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.07% (1.4372 => 1.4670, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 2.01% (0.7610 => 0.7763, std.dev.: 0.0029)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.66% (10.7402 => 10.9189, std.dev.: 0.0350)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.49% (1.0738 => 1.0898, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 1.22% (0.8550 => 0.8654, std.dev.: 0.0039)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 1.11% (1.1297 => 1.1422, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/mandel: 12.07% (1.0541 => 1.1813, std.dev.: 0.0106)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 11.73% (1.4958 => 1.6713, std.dev.: 0.0345)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.34% (0.5206 => 0.5484, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/ffbench: 3.06% (1.3903 => 1.4329, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/fp-convert: 2.38% (6.9753 => 7.1410, std.dev.: 0.0323)
  SingleSource/Benchmarks/Linpack/linpack-pc: 1.26% (52.2239 => 52.8807, std.dev.: 0.0321)
  SingleSource/Benchmarks/Shootout/fib2: 1.24% (4.8947 => 4.9553, std.dev.: 0.0030)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.59% (0.9473 => 0.9228, std.dev.: 0.0082)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.24% (1.3434 => 1.3267, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: -18.92% (3.8466 => 3.1189, std.dev.: 0.1255)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.79% (0.3594 => 0.3278, std.dev.: 0.0119)
  SingleSource/Benchmarks/Misc/flops-7: -5.31% (2.0390 => 1.9308, std.dev.: 0.0087)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.77% (1.0931 => 1.0628, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -2.16% (42.0172 => 41.1077, std.dev.: 0.2722)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -1.99% (44.1719 => 43.2916, std.dev.: 0.1830)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -1.63% (3.1064 => 3.0559, std.dev.: 0.0089)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.54% (39.9375 => 39.3218, std.dev.: 0.0604)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.07% (2.7799 => 2.7501, std.dev.: 0.0053)
  MultiSource/Applications/aha/aha: -1.02% (3.5033 => 3.4675, std.dev.: 0.0106)

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.49% (1.1252 => 1.1420, std.dev.: 0.0040)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vector/sumarray-dbl
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.53% (0.0261 => 0.0257, std.dev.: 0.0003)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013)
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1522 => 0.1521, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: 1.19% (1.1182 => 1.1315, std.dev.: 0.0454)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 2.72% (0.1104 => 0.1134, std.dev.: 0.0077)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.53% (0.0633 => 0.0598, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -0.77% (0.0259 => 0.0257, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -0.23% (1.2888 => 1.2858, std.dev.: 0.0649)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -3.78% (0.0582 => 0.0560, std.dev.: 0.0024)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -0.84% (0.0239 => 0.0237, std.dev.: 0.0022)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0007 => 0.0007)
  SingleSource/UnitTests/2006-01-23-UnionInit: 133.33% (0.0003 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0007 => 0.0007)
  SingleSource/UnitTests/SignlessTypes/Large/cast: 54.72% (0.0053 => 0.0082, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -0.74% (29.6507 => 29.4316, std.dev.: 0.1376)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0009 => 0.0009, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 2450.00% (0.0002 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/test1: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/sumarray-dbl: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -8.48% (27.1250 => 24.8261, std.dev.: 0.8983)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl
  SingleSource/UnitTests/Vector/sumarray-dbl: - (0.0001 => 0.0001, std.dev.: 0.0003)

New Passes - Execution Time
---------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
  SingleSource/Benchmarks/BenchmarkGame/puzzle
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 5.36% (0.4125 => 0.4346, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -19.76% (0.0663 => 0.0532, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -18.69% (1.6803 => 1.3663, std.dev.: 0.0115)

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 25.69% (1.0418 => 1.3094, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 25.56% (1.0687 => 1.3419, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 25.48% (1.0617 => 1.3322, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 25.01% (1.1023 => 1.3780, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 24.80% (1.0958 => 1.3676, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 24.41% (1.1209 => 1.3945, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 24.31% (1.0528 => 1.3087, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 24.22% (1.1626 => 1.4442, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 24.04% (1.0864 => 1.3476, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 24.00% (1.0890 => 1.3504, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 23.95% (1.0507 => 1.3023, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 23.69% (1.1428 => 1.4135, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 23.40% (1.0526 => 1.2989, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 23.32% (1.0951 => 1.3505, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 22.60% (1.1744 => 1.4398, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 22.22% (1.2270 => 1.4997, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 22.02% (1.1699 => 1.4275, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 22.02% (1.1727 => 1.4309, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 20.36% (1.2537 => 1.5089, std.dev.: 0.0079)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.18% (1.2419 => 1.4925, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 19.89% (1.2835 => 1.5388, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 19.69% (1.2566 => 1.5040, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 19.50% (1.2853 => 1.5359, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 19.39% (1.3046 => 1.5576, std.dev.: 0.0129)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 19.34% (1.2929 => 1.5430, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 19.34% (1.2723 => 1.5184, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 19.30% (1.3357 => 1.5935, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 19.24% (1.3313 => 1.5874, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 19.08% (1.2925 => 1.5391, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 18.89% (1.3451 => 1.5992, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 18.51% (1.3491 => 1.5988, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 18.51% (1.3692 => 1.6226, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 18.41% (1.2704 => 1.5043, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 17.83% (1.3638 => 1.6070, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 17.26% (1.4622 => 1.7146, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 17.03% (1.4005 => 1.6390, std.dev.: 0.0112)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.29% (23.8286 => 26.7563, std.dev.: 0.0738)
  MultiSource/Benchmarks/Olden/tsp/tsp: 10.06% (0.1292 => 0.1422, std.dev.: 0.0008)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.91% (7.0997 => 7.5192, std.dev.: 0.0469)
  MultiSource/Applications/d/make_dparser: 5.61% (3.5353 => 3.7336, std.dev.: 0.0033)
  MultiSource/Benchmarks/sim/sim: 5.52% (0.3567 => 0.3764, std.dev.: 0.0030)
  MultiSource/Benchmarks/McCat/09-vor/vor: 5.36% (0.3358 => 0.3538, std.dev.: 0.0010)
  MultiSource/Applications/JM/ldecod/ldecod: 4.80% (7.2467 => 7.5945, std.dev.: 0.0451)
  MultiSource/Applications/JM/lencod/lencod: 4.67% (16.7203 => 17.5013, std.dev.: 0.1120)
  MultiSource/Applications/sqlite3/sqlite3: 4.60% (16.1895 => 16.9345, std.dev.: 0.1036)
  MultiSource/Applications/SPASS/SPASS: 4.04% (16.3304 => 16.9900, std.dev.: 0.0670)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 4.01% (0.7182 => 0.7470, std.dev.: 0.0049)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.90% (2.4999 => 2.5974, std.dev.: 0.0152)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.58% (0.4051 => 0.4196, std.dev.: 0.0016)
  MultiSource/Applications/hbd/hbd: 3.50% (1.5307 => 1.5842, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 3.37% (1.8668 => 1.9298, std.dev.: 0.0194)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.35% (1.4195 => 1.4670, std.dev.: 0.0018)
  MultiSource/Applications/ClamAV/clamscan: 3.21% (16.1821 => 16.7009, std.dev.: 0.0308)
  MultiSource/Benchmarks/Bullet/bullet: 3.04% (33.9296 => 34.9615, std.dev.: 0.0836)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.04% (0.9184 => 0.9463, std.dev.: 0.0016)
  MultiSource/Applications/lua/lua: 3.01% (4.1835 => 4.3093, std.dev.: 0.0336)
  MultiSource/Applications/kimwitu++/kc: 2.99% (18.4474 => 18.9988, std.dev.: 0.0267)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 2.89% (4.8288 => 4.9682, std.dev.: 0.0076)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.88% (10.6134 => 10.9189, std.dev.: 0.0350)
  MultiSource/Applications/minisat/minisat: 2.61% (0.7554 => 0.7751, std.dev.: 0.0024)
  MultiSource/Applications/lambda-0_1_3/lambda: 2.50% (0.7996 => 0.8196, std.dev.: 0.0006)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.47% (0.5064 => 0.5189, std.dev.: 0.0001)
  MultiSource/Applications/siod/siod: 2.41% (2.4196 => 2.4780, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.33% (14.7643 => 15.1082, std.dev.: 0.0947)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.30% (0.6481 => 0.6630, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 2.28% (4.8791 => 4.9901, std.dev.: 0.0274)
  MultiSource/Applications/treecc/treecc: 1.83% (2.2217 => 2.2624, std.dev.: 0.0112)
  SingleSource/UnitTests/Vector/constpool: 1.55% (8.5132 => 8.6452, std.dev.: 0.0456)
  MultiSource/Applications/oggenc/oggenc: 1.43% (5.4527 => 5.5308, std.dev.: 0.0251)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.03% (1.4308 => 1.4456, std.dev.: 0.0049)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary2: 41.08% (0.0314 => 0.0443, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/fp-convert: 25.72% (5.6800 => 7.1410, std.dev.: 0.0323)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 15.81% (2.5458 => 2.9483, std.dev.: 0.0463)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 15.54% (4.7906 => 5.5350, std.dev.: 0.0864)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 14.32% (4.4289 => 5.0632, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 12.18% (4.1182 => 4.6196, std.dev.: 0.0555)
  SingleSource/Benchmarks/Misc/pi: 10.38% (2.0512 => 2.2642, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.42% (5.1006 => 5.5812, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 9.20% (4.0968 => 4.4737, std.dev.: 0.0106)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.73% (12.6632 => 13.7687, std.dev.: 0.2762)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 8.70% (4.8642 => 5.2876, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/mandel: 8.56% (1.0882 => 1.1813, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.89% (2.9511 => 3.1543, std.dev.: 0.0294)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.72% (8.6184 => 9.1974, std.dev.: 0.0022)
  MultiSource/Applications/hexxagon/hexxagon: 6.59% (14.4795 => 15.4331, std.dev.: 0.0016)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 6.45% (1.5701 => 1.6713, std.dev.: 0.0345)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.83% (0.5182 => 0.5484, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/lists: 5.50% (7.2055 => 7.6017, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.34% (4.7982 => 5.0542, std.dev.: 0.0247)
  SingleSource/Benchmarks/Dhrystone/fldry: 5.25% (0.6480 => 0.6820, std.dev.: 0.0021)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.63% (6.9897 => 7.3132, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.65% (3.7569 => 3.8942, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc/richards_benchmark: 3.27% (1.3414 => 1.3852, std.dev.: 0.0057)
  MultiSource/Applications/siod/siod: 3.15% (3.4143 => 3.5219, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.13% (6.0602 => 6.2501, std.dev.: 0.0459)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.94% (9.6958 => 9.9805, std.dev.: 0.0707)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.87% (1.0331 => 1.0628, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.79% (5.0054 => 5.1453, std.dev.: 0.0331)
  SingleSource/Benchmarks/McGill/queens: 2.28% (1.7928 => 1.8336, std.dev.: 0.0015)
  SingleSource/Benchmarks/Shootout/methcall: 2.12% (8.4644 => 8.6441, std.dev.: 0.0229)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.10% (4.5865 => 4.6828, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/neural/neural: 1.83% (1.0845 => 1.1044, std.dev.: 0.0019)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.65% (89.3093 => 90.7812, std.dev.: 0.0271)
  SingleSource/Benchmarks/Shootout/fib2: 1.05% (4.9040 => 4.9553, std.dev.: 0.0030)
  MultiSource/Applications/sgefa/sgefa: 1.00% (1.2184 => 1.2306, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/sumarraymalloc: -51.85% (0.0810 => 0.0390, std.dev.: 0.0003)
  MultiSource/Benchmarks/FreeBench/neural/neural: -20.85% (0.2542 => 0.2012, std.dev.: 0.0028)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -17.43% (0.1176 => 0.0971, std.dev.: 0.0018)
  MultiSource/Benchmarks/FreeBench/mason/mason: -16.77% (0.0817 => 0.0680, std.dev.: 0.0015)
  SingleSource/Benchmarks/McGill/chomp: -9.40% (0.1957 => 0.1773, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -9.12% (0.1151 => 0.1046, std.dev.: 0.0008)
  SingleSource/Benchmarks/Linpack/linpack-pc: -8.14% (0.2751 => 0.2527, std.dev.: 0.0004)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -7.27% (0.3990 => 0.3700, std.dev.: 0.0018)
  MultiSource/Applications/lemon/lemon: -6.02% (1.2932 => 1.2154, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.43% (6.9229 => 6.6165, std.dev.: 0.0124)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.79% (0.5161 => 0.5017, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.78% (0.4280 => 0.4161, std.dev.: 0.0027)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -2.19% (46.1715 => 45.1596, std.dev.: 0.1727)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -2.18% (1.5423 => 1.5087, std.dev.: 0.0064)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.79% (1.6187 => 1.5898, std.dev.: 0.0084)
  MultiSource/Benchmarks/nbench/nbench: -1.68% (1.2881 => 1.2664, std.dev.: 0.0079)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.52% (1.5284 => 1.5052, std.dev.: 0.0087)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/mason/mason: -40.63% (0.5213 => 0.3095, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/ary3: -30.26% (2.0100 => 1.4018, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -27.25% (0.0756 => 0.0550, std.dev.: 0.0020)
  SingleSource/Benchmarks/Shootout/ary3: -25.57% (8.2895 => 6.1701, std.dev.: 0.0165)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -23.68% (0.0950 => 0.0725, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -20.94% (6.4626 => 5.1095, std.dev.: 0.1685)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -19.27% (0.3279 => 0.2647, std.dev.: 0.0024)
  SingleSource/Benchmarks/McGill/misr: -17.68% (0.4729 => 0.3893, std.dev.: 0.0020)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -12.40% (4.7243 => 4.1387, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.20% (7.1548 => 6.2816, std.dev.: 0.3195)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -10.97% (1.3761 => 1.2252, std.dev.: 0.0261)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -10.91% (5.6245 => 5.0107, std.dev.: 0.0912)
  MultiSource/Benchmarks/Olden/bisort/bisort: -8.39% (0.6971 => 0.6386, std.dev.: 0.0033)
  SingleSource/Benchmarks/Dhrystone/dry: -7.96% (0.5278 => 0.4858, std.dev.: 0.0037)
  SingleSource/Benchmarks/Stanford/Puzzle: -6.97% (0.1650 => 0.1535, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -6.83% (4.2970 => 4.0035, std.dev.: 0.0197)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -5.92% (3.2482 => 3.0559, std.dev.: 0.0089)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.34% (3.9434 => 3.7329, std.dev.: 0.0472)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.91% (3.4205 => 3.2526, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -3.56% (4.8478 => 4.6752, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.48% (3.0513 => 2.9452, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.26% (6.2349 => 6.0319, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/flops: -3.22% (9.3754 => 9.0736, std.dev.: 0.0009)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -3.20% (1.1586 => 1.1215, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.16% (3.3978 => 3.2905, std.dev.: 0.0073)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.06% (4.3713 => 4.2374, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -2.62% (3.5506 => 3.4576, std.dev.: 0.0012)
  SingleSource/Benchmarks/McGill/chomp: -2.58% (1.0339 => 1.0072, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.35% (5.0818 => 4.9624, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.28% (3.3922 => 3.3149, std.dev.: 0.0030)
  MultiSource/Benchmarks/Olden/bh/bh: -2.21% (2.3749 => 2.3223, std.dev.: 0.0021)
  MultiSource/Applications/lua/lua: -2.20% (28.1709 => 27.5510, std.dev.: 0.0767)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.11% (9.0122 => 8.8220, std.dev.: 0.0674)
  MultiSource/Applications/SPASS/SPASS: -2.10% (8.4733 => 8.2957, std.dev.: 0.0434)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.89% (40.0804 => 39.3218, std.dev.: 0.0604)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -1.64% (1.9660 => 1.9337, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc/flops-3: -1.60% (2.0809 => 2.0477, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.34% (8.7510 => 8.6335, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/salsa20: -1.10% (9.1513 => 9.0508, std.dev.: 0.0137)

Removed Tests - Compile Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Removed Tests - Execution Time
------------------------------
  SingleSource/Benchmarks/Shootout-C++/except

Added Tests - Compile Time
--------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Added Tests - Execution Time
----------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except
  SingleSource/Regression/C++/EH/recursive-throw

Existing Failures - Compile Time
--------------------------------
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Applications/obsequi/Obsequi: 1.17% (1.1288 => 1.1420, std.dev.: 0.0040)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode
  MultiSource/Applications/Burg/burg
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/lemon/lemon
  MultiSource/Applications/obsequi/Obsequi
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
  MultiSource/Benchmarks/MiBench/security-sha/security-sha
  MultiSource/Benchmarks/Ptrdist/anagram/anagram
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  SingleSource/Regression/C/2003-05-21-UnionBitfields
  SingleSource/Regression/C/2003-05-21-UnionTest
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI
  SingleSource/UnitTests/2006-01-23-UnionInit
  SingleSource/UnitTests/2007-04-10-BitfieldTest
  SingleSource/UnitTests/SignlessTypes/Large/cast
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft
  SingleSource/UnitTests/Vector/Altivec/alti_isamax
  SingleSource/UnitTests/Vector/Altivec/alti_sdot
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft
  SingleSource/UnitTests/Vector/Altivec/casts
  SingleSource/UnitTests/Vector/Altivec/test1
  SingleSource/UnitTests/Vectorizer/gcc-loops
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.63% (0.0248 => 0.0257, std.dev.: 0.0003)
  MultiSource/Applications/Burg/burg: - (0.0013 => 0.0013)
  MultiSource/Applications/ClamAV/clamscan: 2.98% (0.1477 => 0.1521, std.dev.: 0.0006)
  MultiSource/Applications/lemon/lemon: -4.06% (1.1794 => 1.1315, std.dev.: 0.0454)
  MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0001)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -13.37% (0.1309 => 0.1134, std.dev.: 0.0077)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: - (0.0008 => 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.45% (0.0613 => 0.0598, std.dev.: 0.0034)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -6.88% (0.0276 => 0.0257, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.27% (1.1660 => 1.2858, std.dev.: 0.0649)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: - (0.0029 => 0.0029)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: - (0.0027 => 0.0027, std.dev.: 0.0000)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.72% (0.0594 => 0.0560, std.dev.: 0.0024)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.35% (0.0361 => 0.0237, std.dev.: 0.0022)
  SingleSource/Regression/C/2003-05-21-UnionBitfields: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-15-Bitfield-ABI: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/2006-01-23-UnionInit: 600.00% (0.0001 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/SignlessTypes/Large/cast: -10.87% (0.0092 => 0.0082, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.22% (29.7937 => 29.4316, std.dev.: 0.1376)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: - (0.0009 => 0.0009, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: 1000.00% (0.0001 => 0.0011)
  SingleSource/UnitTests/Vector/Altivec/alti_stepfft: 75.86% (0.0029 => 0.0051, std.dev.: 0.0000)
  SingleSource/UnitTests/Vector/Altivec/casts: 600.00% (0.0001 => 0.0007)
  SingleSource/UnitTests/Vector/Altivec/test1: 16.67% (0.0006 => 0.0007, std.dev.: 0.0000)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -7.78% (26.9213 => 24.8261, std.dev.: 0.8983)

Report Time: 0.90s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130326/c2207476/attachment.html>


More information about the llvm-testresults mailing list