[Lldb-commits] [lldb] r255131 - create 3 issues for testbots: FAIL, ERROR (exceptional), and TIMEOUT

[Todd Fiala via lldb-commits]

Author: tfiala
Date: Wed Dec  9 12:01:19 2015
New Revision: 255131

URL: http://llvm.org/viewvc/llvm-project?rev=255131&view=rev
Log:
create 3 issues for testbots: FAIL, ERROR (exceptional), and TIMEOUT

This change is a trial balloon to verify that the default test summary
output sends the right output for the buildbot issue detection script.

The effect of this change will be reverted after verifying the testbot
behavior.  This change will not stay in as is and will knowingly create
noise, see this thread:

http://lists.llvm.org/pipermail/lldb-dev/2015-December/009048.html

Added:
    lldb/trunk/packages/Python/lldbsuite/test/issue_verification/
    lldb/trunk/packages/Python/lldbsuite/test/issue_verification/README.txt
    lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestFail.py
    lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestSignal.py
    lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestTimeout.py

Added: lldb/trunk/packages/Python/lldbsuite/test/issue_verification/README.txt
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/packages/Python/lldbsuite/test/issue_verification/README.txt?rev=255131&view=auto
==============================================================================
--- lldb/trunk/packages/Python/lldbsuite/test/issue_verification/README.txt (added)
+++ lldb/trunk/packages/Python/lldbsuite/test/issue_verification/README.txt Wed Dec  9 12:01:19 2015
@@ -0,0 +1,5 @@
+Tests in this directory are intentionally setup to
+fail, error, timeout, etc. to verify that the buildbots
+pick up errors.  The tests in this directory will be
+parked/removed/renamed after verifying they trigger
+as expected.

Added: lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestFail.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestFail.py?rev=255131&view=auto
==============================================================================
--- lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestFail.py (added)
+++ lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestFail.py Wed Dec  9 12:01:19 2015
@@ -0,0 +1,16 @@
+"""Tests that a FAIL is detected by the testbot."""
+
+from __future__ import print_function
+
+import lldbsuite.test.lldbtest as lldbtest
+
+
+class FailTestCase(lldbtest.TestBase):
+    """Forces test failure."""
+    mydir = lldbtest.TestBase.compute_mydir(__file__)
+
+    def test_buildbot_catches_failure(self):
+        """Issues a failing test assertion."""
+        self.assertTrue(
+            False,
+            "This will always fail, buildbot should flag this.")

Added: lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestSignal.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestSignal.py?rev=255131&view=auto
==============================================================================
--- lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestSignal.py (added)
+++ lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestSignal.py Wed Dec  9 12:01:19 2015
@@ -0,0 +1,26 @@
+"""Tests that an exceptional exit is detected by the testbot."""
+
+from __future__ import print_function
+
+import os
+import signal
+import time
+
+import lldbsuite.test.lldbtest as lldbtest
+
+
+class ExceptionalExitTestCase(lldbtest.TestBase):
+    """Forces exceptional exit."""
+    mydir = lldbtest.TestBase.compute_mydir(__file__)
+
+    @lldbtest.skipIfWindows
+    def test_buildbot_catches_exceptional_exit(self):
+        """Force process to die with exceptional exit."""
+
+        # Sleep for a couple seconds
+        try:
+            time.sleep(5)
+        except:
+            pass
+
+        os.kill(os.getpid(), signal.SIGKILL)

Added: lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestTimeout.py
URL: http://llvm.org/viewvc/llvm-project/lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestTimeout.py?rev=255131&view=auto
==============================================================================
--- lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestTimeout.py (added)
+++ lldb/trunk/packages/Python/lldbsuite/test/issue_verification/TestTimeout.py Wed Dec  9 12:01:19 2015
@@ -0,0 +1,19 @@
+"""Tests that a timeout is detected by the testbot."""
+from __future__ import print_function
+
+import time
+
+import lldbsuite.test.lldbtest as lldbtest
+
+
+class TimeoutTestCase(lldbtest.TestBase):
+    """Forces test timeout."""
+    mydir = lldbtest.TestBase.compute_mydir(__file__)
+
+    def test_buildbot_catches_timeout(self):
+        """Tests that timeout logic kicks in and is picked up."""
+        while True:
+            try:
+                time.sleep(1)
+            except:
+                print("ignoring exception during sleep")