[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 28 05:13:55 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14875?compare_to=14871&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14875, Order: 189464, Start Time: 2013-08-28 10:21:17, End Time: 2013-08-28 12:16:11
      To: 14871, Order: 189450, Start Time: 2013-08-28 08:01:09, End Time: 2013-08-28 09:54:28
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 21 (67 on baseline)
Performance Improvements: 18 (48 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1068 (992 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 60.19% (0.0741 => 0.1187, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 42.30% (0.0851 => 0.1211, std.dev.: 0.0090)
  MultiSource/Applications/hbd/hbd: 34.55% (1.6864 => 2.2691, std.dev.: 0.0161)
  MultiSource/Applications/hexxagon/hexxagon: 20.37% (1.1369 => 1.3685, std.dev.: 0.0581)
  SingleSource/Benchmarks/Shootout-C++/ary: 14.06% (0.2931 => 0.3343, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.75% (0.4388 => 0.4816, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 8.81% (2.9199 => 3.1772, std.dev.: 0.0369)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.26% (2.6799 => 2.9012, std.dev.: 0.0170)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.00% (2.1901 => 2.3652, std.dev.: 0.0401)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 51.03% (1.6707 => 2.5232, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout-C++/ary2: 33.78% (0.0370 => 0.0495, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/ary: 17.49% (0.0606 => 0.0712, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 14.88% (62.4006 => 71.6852, std.dev.: 2.1907)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 12.95% (42.2124 => 47.6783, std.dev.: 1.4474)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.90% (31.4380 => 35.1783, std.dev.: 0.7616)
  MultiSource/Benchmarks/McCat/18-imp/imp: 10.63% (0.1063 => 0.1176, std.dev.: 0.0009)
  MultiSource/Benchmarks/Bullet/bullet: 8.16% (7.0409 => 7.6152, std.dev.: 0.1162)
  MultiSource/Applications/lua/lua: 2.18% (29.9272 => 30.5795, std.dev.: 0.1464)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.30% (1.3531 => 1.3707, std.dev.: 0.0061)
  SingleSource/Regression/C/uint64_to_float: 1.27% (1.4768 => 1.4956, std.dev.: 0.0057)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.26% (4.9517 => 5.0140, std.dev.: 0.0122)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Dhrystone/dry: -40.47% (0.1060 => 0.0631, std.dev.: 0.0144)
  SingleSource/Regression/C/PR640: -39.49% (0.0395 => 0.0239, std.dev.: 0.0057)
  SingleSource/Regression/C/sumarraymalloc: -36.85% (0.0711 => 0.0449, std.dev.: 0.0074)
  SingleSource/UnitTests/Threads/tls: -31.00% (0.0400 => 0.0276, std.dev.: 0.0004)
  SingleSource/Regression/C/uint64_to_float: -29.64% (0.0631 => 0.0444, std.dev.: 0.0035)
  SingleSource/Benchmarks/CoyoteBench/almabench: -16.51% (0.0969 => 0.0809, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/sumcol: -13.46% (0.3128 => 0.2707, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -12.55% (1.6181 => 1.4150, std.dev.: 0.0776)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -9.91% (1.5424 => 1.3895, std.dev.: 0.0395)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -9.44% (1.4944 => 1.3534, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -9.19% (1.5215 => 1.3817, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.48% (7.3965 => 6.7695, std.dev.: 0.1424)
  MultiSource/Applications/viterbi/viterbi: -4.32% (0.2636 => 0.2522, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -25.87% (0.1121 => 0.0831, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -10.00% (0.5269 => 0.4742, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.59% (3.2611 => 3.1765, std.dev.: 0.0327)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.43% (5.9297 => 5.8448, std.dev.: 0.0234)
  MultiSource/Applications/viterbi/viterbi: -1.12% (2.5962 => 2.5670, std.dev.: 0.0010)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -10.41% (0.1528 => 0.1369, std.dev.: 0.0294)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 63.72% (0.0725 => 0.1187, std.dev.: 0.0051)
  SingleSource/Regression/C/bigstack: 51.07% (0.0466 => 0.0704, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 43.48% (0.0844 => 0.1211, std.dev.: 0.0090)
  MultiSource/Applications/viterbi/viterbi: 32.39% (0.1905 => 0.2522, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 22.44% (1.9317 => 2.3652, std.dev.: 0.0401)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 20.39% (2.6390 => 3.1772, std.dev.: 0.0369)
  SingleSource/Benchmarks/Shootout-C++/ary2: 18.77% (0.2952 => 0.3506, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout-C++/ary: 16.77% (0.2863 => 0.3343, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 13.48% (0.0987 => 0.1120, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 12.42% (0.3592 => 0.4038, std.dev.: 0.0149)
  MultiSource/Applications/hbd/hbd: 12.37% (2.0193 => 2.2691, std.dev.: 0.0161)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 11.77% (0.4309 => 0.4816, std.dev.: 0.0053)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 10.65% (4.2444 => 4.6963, std.dev.: 0.1385)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.04% (2.6853 => 2.9012, std.dev.: 0.0170)
  SingleSource/Benchmarks/Misc/oourafft: 7.88% (0.2284 => 0.2464, std.dev.: 0.0006)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 78.21% (3.7285 => 6.6445, std.dev.: 0.0172)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 61.09% (2.9033 => 4.6769, std.dev.: 0.2170)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 40.02% (3.9978 => 5.5978, std.dev.: 0.0375)
  MultiSource/Benchmarks/FreeBench/neural/neural: 33.90% (0.3171 => 0.4246, std.dev.: 0.0191)
  SingleSource/Benchmarks/Shootout-C++/hash: 31.45% (0.6295 => 0.8275, std.dev.: 0.0560)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 29.23% (0.0366 => 0.0473, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/pi: 27.21% (1.9835 => 2.5232, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout/hash: 26.79% (4.1846 => 5.3057, std.dev.: 0.2882)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.24% (1.5030 => 1.8823, std.dev.: 0.0145)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 24.90% (0.0526 => 0.0657, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.84% (9.6817 => 11.6997, std.dev.: 0.0502)
  MultiSource/Benchmarks/McCat/18-imp/imp: 19.03% (0.0988 => 0.1176, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 18.79% (60.3477 => 71.6852, std.dev.: 2.1907)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 18.00% (29.8131 => 35.1783, std.dev.: 0.7616)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 17.72% (40.5028 => 47.6783, std.dev.: 1.4474)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 16.61% (3.0680 => 3.5776, std.dev.: 0.0089)
  MultiSource/Applications/sgefa/sgefa: 13.75% (1.4030 => 1.5959, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.71% (4.6576 => 5.2962, std.dev.: 0.0213)
  MultiSource/Applications/JM/lencod/lencod: 12.24% (7.1799 => 8.0587, std.dev.: 0.0701)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 11.86% (0.1678 => 0.1877, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.77% (2.3304 => 2.6046, std.dev.: 0.0729)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.58% (4.9231 => 5.4933, std.dev.: 0.0407)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.86% (7.0762 => 7.8445, std.dev.: 0.1845)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.95% (14.9584 => 16.4468, std.dev.: 0.3963)
  SingleSource/Benchmarks/Shootout/ary3: 9.78% (5.8158 => 6.3848, std.dev.: 0.1427)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 8.83% (2.9962 => 3.2607, std.dev.: 0.0498)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.45% (1.2557 => 1.3618, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 8.43% (2.9467 => 3.1950, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.35% (5.4910 => 5.9494, std.dev.: 0.0070)
  MultiSource/Applications/siod/siod: 7.14% (3.3761 => 3.6173, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.14% (5.3042 => 5.6300, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.00% (3.4085 => 3.6130, std.dev.: 0.0180)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.63% (5.5008 => 5.8107, std.dev.: 0.0190)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.44% (4.9040 => 5.1709, std.dev.: 0.0337)
  MultiSource/Benchmarks/Olden/tsp/tsp: 5.38% (1.5339 => 1.6165, std.dev.: 0.0037)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 4.71% (1.4398 => 1.5076, std.dev.: 0.0224)
  MultiSource/Benchmarks/Bullet/bullet: 4.32% (7.2995 => 7.6152, std.dev.: 0.1162)
  SingleSource/Benchmarks/McGill/queens: 4.25% (1.6536 => 1.7239, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3653, std.dev.: 0.0382)
  SingleSource/Benchmarks/Misc/whetstone: 3.71% (3.4559 => 3.5840, std.dev.: 0.0264)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (6.1245 => 6.3468, std.dev.: 0.0308)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.59% (25.0200 => 25.9174, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.08% (4.8739 => 5.0241, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.90% (4.4624 => 4.5916, std.dev.: 0.0186)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.43% (1.3104 => 1.3423, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.40% (12.8625 => 13.1718, std.dev.: 0.0565)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 2.14% (4.9089 => 5.0140, std.dev.: 0.0122)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.88% (3.4566 => 3.5215, std.dev.: 0.0168)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.82% (4.7360 => 4.8220, std.dev.: 0.0307)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.62% (1.3489 => 1.3707, std.dev.: 0.0061)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.57% (1.4813 => 1.5045, std.dev.: 0.0067)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.52% (1.1618 => 1.1795, std.dev.: 0.0060)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.53% (0.2237 => 0.1487, std.dev.: 0.0133)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.78% (0.1072 => 0.0742, std.dev.: 0.0051)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.99% (0.1818 => 0.1400, std.dev.: 0.0082)
  MultiSource/Benchmarks/Olden/health/health: -21.07% (0.1993 => 0.1573, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.01% (0.1114 => 0.0880, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -20.89% (0.0675 => 0.0534, std.dev.: 0.0024)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -19.86% (1.5228 => 1.2204, std.dev.: 0.0808)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -17.37% (0.3576 => 0.2955, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -6.27% (0.1947 => 0.1825, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.94% (1.5345 => 1.4587, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.80% (1.4514 => 1.3817, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.43% (1.4333 => 1.3842, std.dev.: 0.0115)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.94% (2.1022 => 1.4307, std.dev.: 0.0069)
  MultiSource/Benchmarks/MallocBench/gs/gs: -30.11% (0.1189 => 0.0831, std.dev.: 0.0093)
  MultiSource/Applications/viterbi/viterbi: -26.50% (3.4923 => 2.5670, std.dev.: 0.0010)
  MultiSource/Benchmarks/Olden/bisort/bisort: -25.97% (0.9545 => 0.7066, std.dev.: 0.0329)
  SingleSource/Benchmarks/Misc/perlin: -21.39% (4.5989 => 3.6152, std.dev.: 0.0074)
  MultiSource/Applications/obsequi/Obsequi: -17.62% (2.6081 => 2.1486, std.dev.: 0.1626)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -15.67% (5.3098 => 4.4778, std.dev.: 0.0160)
  SingleSource/Benchmarks/Misc/mandel: -14.03% (1.1996 => 1.0313, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.95% (0.3557 => 0.3132, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/matrix: -11.53% (2.8867 => 2.5540, std.dev.: 0.0226)
  MultiSource/Benchmarks/nbench/nbench: -9.09% (22.0083 => 20.0088, std.dev.: 0.7031)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.37% (6.9552 => 6.3728, std.dev.: 0.1165)
  SingleSource/Benchmarks/Misc/fp-convert: -7.78% (8.0730 => 7.4447, std.dev.: 0.0742)
  MultiSource/Benchmarks/Olden/health/health: -6.24% (0.3556 => 0.3334, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.22% (0.3773 => 0.3576, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.65% (0.7355 => 0.7013, std.dev.: 0.0078)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.57% (0.4969 => 0.4742, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/fbench: -4.45% (4.9602 => 4.7393, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.30% (3.8119 => 3.6479, std.dev.: 0.0089)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.17% (1.1032 => 1.0572, std.dev.: 0.0068)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.65% (0.7806 => 0.7521, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -3.32% (5.0417 => 4.8741, std.dev.: 0.0589)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.30% (6.0444 => 5.8448, std.dev.: 0.0234)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.30% (1.7207 => 1.6639, std.dev.: 0.0147)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.89% (21.6864 => 21.0587, std.dev.: 0.1201)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.84% (6.1482 => 5.9737, std.dev.: 0.0239)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.68% (0.4783 => 0.4655, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.56% (0.6480 => 0.6314, std.dev.: 0.0008)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.35% (47.2250 => 46.1129, std.dev.: 0.0571)
  SingleSource/Benchmarks/Misc/oourafft: -2.07% (3.7891 => 3.7107, std.dev.: 0.0282)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.95% (8.6172 => 8.4489, std.dev.: 0.0190)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.87% (34.8438 => 34.1930, std.dev.: 0.0728)
  MultiSource/Applications/lua/lua: -1.58% (31.0707 => 30.5795, std.dev.: 0.1464)
  SingleSource/Regression/C/uint64_to_float: -1.50% (1.5184 => 1.4956, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.41% (2.1343 => 2.1043, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.27% (5.0180 => 4.9545, std.dev.: 0.0238)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.65% (0.1378 => 0.1369, std.dev.: 0.0294)

Report Time: 1.42s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130828/3c4e8255/attachment.html>


More information about the llvm-testresults mailing list