[LLVMbugs] [Bug 900] NEW: llvm-testresults email needs significant improvement

[bugzilla-daemon at cs.uiuc.edu]

http://llvm.org/bugs/show_bug.cgi?id=900

           Summary: llvm-testresults email needs significant improvement
           Product: Test Suite
           Version: trunk
          Platform: All
        OS/Version: All
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Nightly Tester
        AssignedTo: unassignedbugs at nondot.org
        ReportedBy: sabre at nondot.org


Zero'th:  Showstopper.
 1. The test does not correctly list newly passing and newly failing llvm-test and dejagnu results 
correctly.  This is a critical broken aspect.  For example, see here:
http://lists.cs.uiuc.edu/pipermail/llvm-testresults/2006-September/004047.html
  Note: "Benchmarks/Stanford/Treesort (JIT*) changed %100.00 (0.91 => )"

First: Major functionality problems.

1. "Significant changes in test results:" doesn't list file size changes.
2. In http://lists.cs.uiuc.edu/pipermail/llvm-testresults/2006-September/004035.html , what is the ":" 
catagory (with tag ())??
3. In the same, what is JIT*?
4. http://lists.cs.uiuc.edu/pipermail/llvm-testresults/2006-September/004037.html what is GCCAS*, 
Bytecode*?


Second, minor weirdness:

1. See http://lists.cs.uiuc.edu/pipermail/llvm-testresults/2006-September/004032.html
  There is no "None" after "New Test Passes", why?
  There should be no blank lines between the None lines to make it more compact.

2. Formatting issues:
    http://lists.cs.uiuc.edu/pipermail/llvm-testresults/2006-September/004030.html
  The first line in a section has the tag (e.g. "(LLC)") removed and the % in the right place.  Later entries 
in each section have the redundant tag and have the % in the wrong place.

3. http://lists.cs.uiuc.edu/pipermail/llvm-testresults/2006-September/004040.html : "Significant 
changes in test results:" should print 'none' when appropriate.


Since no-one "owns" the nightly tester anymore, I thought I would file this to see if anyone is interested 
in tackling these issues.

-Chris



------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.