[Lldb-commits] [lldb] r212762 - Flipped intermittent test failures from skip to XFAIL.

[Todd Fiala]

Author: tfiala
Date: Thu Jul 10 15:52:08 2014
New Revision: 212762

URL: http://llvm.org/viewvc/llvm-project?rev=212762&view=rev
Log:
Flipped intermittent test failures from skip to XFAIL.

The following intermittently-failing tests have been flipped from
skip to XFAIL on some combo of Linux and MacOSX:

TestCallStopAndContinue.py (Linux, MacOSX)
TestCallWithTimeout.py (Linux)
TestConvenienceVariables.py (Linux)
TestStopHookMultipleThreads.py (Linux)

The following new tests have been marked XFAIL but are just
intermittently failing:

TestMultipleDebug.py (definitely intermittent on MacOSX, not sure I've seen
it pass yet on Linux)

Modified:
    lldb/trunk/test/api/multiple-debuggers/TestMultipleDebuggers.py
    lldb/trunk/test/expression_command/call-function/TestCallStopAndContinue.py
    lldb/trunk/test/expression_command/timeout/TestCallWithTimeout.py
    lldb/trunk/test/functionalities/embedded_interpreter/TestConvenienceVariables.py
    lldb/trunk/test/functionalities/stop-hook/multiple_threads/TestStopHookMultipleThreads.py

Modified: lldb/trunk/test/api/multiple-debuggers/TestMultipleDebuggers.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/test/api/multiple-debuggers/TestMultipleDebuggers.py?rev=212762&r1=212761&r2=212762&view=diff
==============================================================================
--- lldb/trunk/test/api/multiple-debuggers/TestMultipleDebuggers.py (original)
+++ lldb/trunk/test/api/multiple-debuggers/TestMultipleDebuggers.py Thu Jul 10 15:52:08 2014
@@ -16,6 +16,8 @@ class TestMultipleSimultaneousDebuggers(
         self.lib_dir = os.environ["LLDB_LIB_DIR"]
 
     @skipIfi386
+    @expectedFailureDarwin("llvm.org/pr20282") # intermittent
+    @expectedFailureLinux("llvm.org/pr20282")
     def test_multiple_debuggers(self):
 
         self.driver_exe = os.path.join(os.getcwd(), "multi-process-driver")

Modified: lldb/trunk/test/expression_command/call-function/TestCallStopAndContinue.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/test/expression_command/call-function/TestCallStopAndContinue.py?rev=212762&r1=212761&r2=212762&view=diff
==============================================================================
--- lldb/trunk/test/expression_command/call-function/TestCallStopAndContinue.py (original)
+++ lldb/trunk/test/expression_command/call-function/TestCallStopAndContinue.py Thu Jul 10 15:52:08 2014
@@ -22,15 +22,15 @@ class ExprCommandCallStopContinueTestCas
 
     @unittest2.skipUnless(sys.platform.startswith("darwin"), "requires Darwin")
     @dsym_test
-    @skipIfDarwin  # see llvm.org/pr20274 - intermittent failure on MacOSX
+    @expectedFailureDarwin("llvm.org/pr20274") # intermittent failure on MacOSX
     def test_with_dsym(self):
         """Test gathering result from interrupted function call."""
         self.buildDsym()
         self.call_function()
 
     @dwarf_test
-    @skipIfDarwin  # see llvm.org/pr20274 - intermittent failure on MacOSX
-    @skipIfLinux   # see llvm.org/pr20274 - intermittent failure on Linux
+    @expectedFailureDarwin("llvm.org/pr20274") # intermittent failure on MacOSX
+    @expectedFailureLinux("llvm.org/pr20274") # intermittent failure on Linux
     def test_with_dwarf(self):
         """Test gathering result from interrupted function call."""
         self.buildDwarf()

Modified: lldb/trunk/test/expression_command/timeout/TestCallWithTimeout.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/test/expression_command/timeout/TestCallWithTimeout.py?rev=212762&r1=212761&r2=212762&view=diff
==============================================================================
--- lldb/trunk/test/expression_command/timeout/TestCallWithTimeout.py (original)
+++ lldb/trunk/test/expression_command/timeout/TestCallWithTimeout.py Thu Jul 10 15:52:08 2014
@@ -27,7 +27,7 @@ class ExprCommandWithTimeoutsTestCase(Te
         self.call_function()
 
     @expectedFailureFreeBSD("llvm.org/pr19605") # fails on buildbot
-    @skipIfLinux # llvm.org/pr20275 - fails intermittently on Linux
+    @expectedFailureLinux("llvm.org/pr20275") # fails intermittently on Linux
     @dwarf_test
     def test_with_dwarf(self):
         """Test calling std::String member function."""

Modified: lldb/trunk/test/functionalities/embedded_interpreter/TestConvenienceVariables.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/test/functionalities/embedded_interpreter/TestConvenienceVariables.py?rev=212762&r1=212761&r2=212762&view=diff
==============================================================================
--- lldb/trunk/test/functionalities/embedded_interpreter/TestConvenienceVariables.py (original)
+++ lldb/trunk/test/functionalities/embedded_interpreter/TestConvenienceVariables.py Thu Jul 10 15:52:08 2014
@@ -19,7 +19,7 @@ class ConvenienceVariablesCase(TestBase)
 
     @dwarf_test
     @skipIfFreeBSD # llvm.org/pr17228
-    @skipIfLinux   # llvm.org/pr20276
+    @expectedFailureLinux("llvm.org/pr20276") # intermittent failure on Linux
     def test_with_dwarf_and_run_commands(self):
         """Test convenience variables lldb.debugger, lldb.target, lldb.process, lldb.thread, and lldb.frame."""
         self.buildDwarf()

Modified: lldb/trunk/test/functionalities/stop-hook/multiple_threads/TestStopHookMultipleThreads.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/test/functionalities/stop-hook/multiple_threads/TestStopHookMultipleThreads.py?rev=212762&r1=212761&r2=212762&view=diff
==============================================================================
--- lldb/trunk/test/functionalities/stop-hook/multiple_threads/TestStopHookMultipleThreads.py (original)
+++ lldb/trunk/test/functionalities/stop-hook/multiple_threads/TestStopHookMultipleThreads.py Thu Jul 10 15:52:08 2014
@@ -21,7 +21,7 @@ class StopHookForMultipleThreadsTestCase
         self.stop_hook_multiple_threads()
 
     @dwarf_test
-    @skipIfLinux # llvm.org/pr15037 stop hooks sometimes fail to fire on Linux (cannot mark XFAIL, sometimes it passes)
+    @expectedFailureLinux("llvm.org/pr15037") # stop hooks sometimes fail to fire on Linux
     def test_stop_hook_multiple_threads_with_dwarf(self):
         """Test that lldb stop-hook works for multiple threads."""
         self.buildDwarf(dictionary=self.d)