[LLVMbugs] [Bug 318] NEW: [spec] Should diff against SPEC reference outputs, not results from native run

[bugzilla-daemon at cs.uiuc.edu]

http://llvm.cs.uiuc.edu/bugs/show_bug.cgi?id=318

           Summary: [spec] Should diff against SPEC reference outputs, not
                    results from native run
           Product: Test Suite
           Version: trunk
          Platform: PC
        OS/Version: Linux
            Status: NEW
          Severity: normal
          Priority: P2
         Component: Programs Tests
        AssignedTo: unassignedbugs at nondot.org
        ReportedBy: brukman+bugs at uiuc.edu


Currently, we diff out JIT/LLC/CBE results against the native results for
correctness. As I have noticed, some of our Makefiles have incorrect options,
and some benchmarks are misconfigured, so we may actually be missing some places
where there *could* be bugs but those code paths aren't being executed.

The solution would be to diff native/JIT/LLC/CBE output against SPEC-provided
reference outputs, instead of relying on the native compiler to be correct.



------- You are receiving this mail because: -------
You are on the CC list for the bug, or are watching someone who is.