[llvm-dev] Many LLDB test failures in 13.0.0-rc1 on macOS

[Tobias Hieta via llvm-dev]

Hello,

While testing LLVM 13.0.0-rc1 on macOS I noticed many lldb test
failures that are regressions from 12.0.1.

I was going to post this to lldb-dev - but I was not subscribed and
the process seems manual still. So forgive me for posting it here. Let
me know if I can share anymore information about these test failures
with the team.

List of failing tests:
FAIL: lldb-shell :: Commands/command-thread-select.test (94817 of 96071)
FAIL: lldb-shell :: Breakpoint/jit-loader_jitlink_elf.test (94818 of 96071)
FAIL: lldb-shell :: Breakpoint/jit-loader_rtdyld_elf.test (94819 of 96071)
FAIL: lldb-shell :: ExecControl/StopHook/stop-hook.test (94823 of 96071)
FAIL: lldb-shell :: Host/TestCustomShell.test (94842 of 96071)
FAIL: lldb-shell :: Expr/TestIRMemoryMap.test (94849 of 96071)
FAIL: lldb-shell :: Process/Optimization.test (94852 of 96071)
FAIL: lldb-shell :: Process/UnsupportedLanguage.test (94853 of 96071)
FAIL: lldb-shell :: Process/TestEnvironment.test (94854 of 96071)
FAIL: lldb-shell :: Register/x86-64-gp-read.test (94855 of 96071)
FAIL: lldb-shell :: Register/x86-64-read.test (94862 of 96071)
FAIL: lldb-shell :: Register/x86-64-ymm-read.test (94866 of 96071)
FAIL: lldb-shell :: Register/x86-multithread-read.test (94873 of 96071)
FAIL: lldb-shell :: Register/x86-multithread-write.test (94876 of 96071)
FAIL: lldb-shell :: Reproducer/Functionalities/TestImageList.test
(94879 of 96071)
FAIL: lldb-shell :: Reproducer/Functionalities/TestDataFormatter.test
(94880 of 96071)
FAIL: lldb-shell ::
Reproducer/Functionalities/TestExpressionEvaluation.test (94882 of
96071)
FAIL: lldb-shell :: Reproducer/Functionalities/TestStepping.test
(94883 of 96071)
FAIL: lldb-shell :: Reproducer/Modules/TestModuleCXX.test (94884 of 96071)
FAIL: lldb-shell :: Reproducer/TestDSYM.test (94902 of 96071)
FAIL: lldb-shell :: Reproducer/TestDump.test (94922 of 96071)
FAIL: lldb-shell :: Reproducer/TestFileRepro.test (94924 of 96071)
FAIL: lldb-shell :: Reproducer/TestGDBRemoteRepro.test (94931 of 96071)
FAIL: lldb-shell :: Reproducer/TestMultipleTargets.test (94932 of 96071)
FAIL: lldb-shell :: Reproducer/TestRelativePath.test (94934 of 96071)
FAIL: lldb-shell :: Reproducer/TestReuseDirectory.test (94946 of 96071)
FAIL: lldb-shell :: Reproducer/TestVersionCheck.test (94947 of 96071)
FAIL: lldb-shell :: Reproducer/TestVerify.test (94948 of 96071)
FAIL: lldb-shell :: Reproducer/TestWorkingDir.test (94950 of 96071)
FAIL: lldb-shell :: Settings/TestFrameFormatColor.test (94957 of 96071)
FAIL: lldb-shell :: Settings/TestFrameFormatMangling.test (94961 of 96071)
FAIL: lldb-shell :: Settings/TestFrameFormatNoColor.test (94969 of 96071)
FAIL: lldb-shell :: Settings/TestLineMarkerColor.test (94975 of 96071)
FAIL: lldb-shell :: Subprocess/fork-follow-parent-wp.test (95010 of 96071)
FAIL: lldb-shell :: Subprocess/fork-follow-parent.test (95032 of 96071)
FAIL: lldb-shell :: Subprocess/vfork-follow-parent.test (95045 of 96071)
FAIL: lldb-shell :: SymbolFile/DWARF/deterministic-build.cpp (95046 of 96071)
FAIL: lldb-shell :: Unwind/eh-frame-dwarf-unwind.test (95219 of 96071)
FAIL: lldb-shell :: Unwind/thread-step-out-ret-addr-check.test (96063 of 96071)
FAIL: lldb-shell :: Unwind/trap_frame_sym_ctx.test (96066 of 96071)
FAIL: lldb-shell :: Watchpoint/SetErrorCases.test (96067 of 96071)
FAIL: lldb-unit ::
tools/lldb-server/tests/./LLDBServerTests/StandardStartupTest.TestStopReplyContainsThreadPcs
(96068 of 96071)

-- Tobias