<table border="1" cellspacing="0" cellpadding="8">
<tr>
<th>Issue</th>
<td>
<a href=https://github.com/llvm/llvm-project/issues/116041>116041</a>
</td>
</tr>
<tr>
<th>Summary</th>
<td>
[lldb-dap] TestDAP_evaluate.py test is flakey
</td>
</tr>
<tr>
<th>Labels</th>
<td>
new issue
</td>
</tr>
<tr>
<th>Assignees</th>
<td>
</td>
</tr>
<tr>
<th>Reporter</th>
<td>
Michael137
</td>
</tr>
</table>
<pre>
This has been failing occasionally on Linux during PR testing. E.g., most recently in https://github.com/llvm/llvm-project/pull/115517: https://buildkite.com/llvm-project/github-pull-requests/builds/118902#0193226e-5c0a-42ad-93ad-a29d91edbe26
Example failure:
```
FAIL: LLDB (/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/build/bin/clang-x86_64) :: test_repl_evaluate_expressions (TestDAP_evaluate.TestDAP_evaluate)
FAIL: LLDB (/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/build/bin/clang-x86_64) :: test_repl_evaluate_expressions (TestDAP_evaluate.TestDAP_evaluate)
PASS: LLDB (/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/build/bin/clang-x86_64) :: test_variable_evaluate_expressions (TestDAP_evaluate.TestDAP_evaluate)
PASS: LLDB (/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/build/bin/clang-x86_64) :: test_watch_evaluate_expressions (TestDAP_evaluate.TestDAP_evaluate)
======================================================================
ERROR: test_repl_evaluate_expressions (TestDAP_evaluate.TestDAP_evaluate)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/test/API/tools/lldb-dap/evaluate/TestDAP_evaluate.py", line 220, in test_repl_evaluate_expressions
self.run_test_evaluate_expressions("repl", enableAutoVariableSummaries=False)
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/test/API/tools/lldb-dap/evaluate/TestDAP_evaluate.py", line 104, in run_test_evaluate_expressions
self.assertEvaluate("var", r"\(lldb\) var\n.*")
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/test/API/tools/lldb-dap/evaluate/TestDAP_evaluate.py", line 17, in assertEvaluate
self.dap_server.request_evaluate(expression, context=self.context)["body"][
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/tools/lldb-dap/dap_server.py", line 721, in request_evaluate
return self.send_recv(command_dict)
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/tools/lldb-dap/dap_server.py", line 326, in send_recv
raise ValueError(desc)
ValueError: no response for "evaluate"
Config=x86_64-/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/build/bin/clang
======================================================================
ERROR: test_repl_evaluate_expressions (TestDAP_evaluate.TestDAP_evaluate)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 2030, in tearDown
Base.tearDown(self)
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/lldbtest.py", line 1100, in tearDown
hook() # try the plain call and hope it works
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/tools/lldb-dap/lldbdap_testcase.py", line 401, in cleanup
self.dap_server.request_disconnect(terminateDebuggee=True)
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/tools/lldb-dap/dap_server.py", line 674, in request_disconnect
return self.send_recv(command_dict)
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/tools/lldb-dap/dap_server.py", line 320, in send_recv
self.send_packet(command)
File "/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/lldb/packages/Python/lldbsuite/test/tools/lldb-dap/dap_server.py", line 275, in send_packet
self.send.flush()
BrokenPipeError: [Errno 32] Broken pipe
Config=x86_64-/var/lib/buildkite-agent/builds/linux-56-59b8f5d88-chnxh-1/llvm-project/github-pull-requests/build/bin/clang
----------------------------------------------------------------------
Ran 5 tests in 884.999s
```
The last couple of failures I looked at all fail when running `self.assertEvaluate("var", r"\(lldb\) var\n.*")`.
Just going off of the git log CCing @ashgti @walter-erquinigo. Mind taking a look? We really don't want to be flakey on the pre-commit CI
</pre>
<img width="1px" height="1px" alt="" src="http://email.email.llvm.org/o/eJzsmdFvozgTwP8a52UEAgMBHvKQJo3UT119Vbfa7zFyYAB_cWzWNk37359skibb7d1q73p33e5WUTGMsWd-tmfGhhnDW4k4I9kFyZYTNthO6dkHXnUMRZzkk42qH2d3HTfQMQMbRAkN44LLFlRVMcOVZEI8gpJwzeXwAPWgnfDmFiway2UbwmXYhoQuYKeMBY0VSisegUvorO0NSeaErghdtdx2wyas1I7QlRD3x0vQa_V_rCyhq34QgtBVHGdZnJNk_qyFzcBFveUWzxo5e3vsIHCNBBo_D2isOb5lfLNFGVFCkyguE0qnGGRVxIKUsjooE1YHjJZ1GWO9QTol0ZJE8_H_5QPb9QI9mUGj02eUTqPDz9-u5lfXTunr6-UFEFoQurpn2unJN-faB6xFac81Ew5tkE2DrNwUTVYXRVB18qEL4u-z0l25JHRVCSbb4KGYrqcpoSU4lZO5H7K1xl6s8Z6JgVlc40Ov0bhxNk7nOzR2Ob95kofPHxBa_ozW3sw_fvwBrL1nmrONwJ_H4j2zVfcK5pJk-d5-o--6vf3v7WuvhuBV_sa27jSrcMOqrVPhLIRAxYQAwYx13R5dLsCKCwRC6T86H4WoXSeOIaGr-c2Vu1FKHGVBzXpCVydQq69g9o9e6QUILhEojVyZy2-My8Fqg6IJ9SDXvvaLFd0Kpa6dQzconSOYD1Z9OjiFj8NuxzRHQ5LliglzGs_3QjWO0gPVP2Z1BpUZg9pePnXhKHoCvlV_zRaEFl5XVyrBibOFDAmd-2rvDWJ-YPgMzRm0mvVrg_oedXjQ5MxHFCfSrqFKSYsPliRL_-rxlpYuJ6XUJaAe8tLdvwGQPau2rEX35ObRds4ILzID9_QOoF9AfEblS6I5jY_T8jmtg8EAGu2g5YjXoKzXGqt7QotK7XZM1uuaV_Y01d4ZoIROD4BOpp_IMG4QPjEx4KXWShNa1GiqJxhnkmQOUoFG0ytpEBqlHaTT1KTjGwslG96SZDmmFMG_ndr8ykB-ZSCvu_jcI1d8nnVEySntYHqp9vK0zi6YwfDpMS2cK3ojwe2vWR3H0e9b3Sm19VG_BCA0AasfwXYIvWBcjjOAyRo61SNwC3ult-YHQvKCF3ZF54ldjcqN-Ze00ugYrCqBTA79NwJ_zU2lpPQ6Fxb1jktmcYmboW0RSbK808NbyTT_htA1zdNnsf0MyJ-M7u-NUfK02XkhvJ-YuJ7Rnqi8XyA0z86BHAz_GknYiMF0o3saxRdabVHe8P6U8ZDs4lJrqSBxWTSMNaDnPb7lbOc1A_gtk5D59MI4pkWRhmVZmhcPaQ8hv0Mf2KFSQy8QVHM83DVwBUKpLdbALDj37wSw79BvKiWXLZBp9Hp7x2kUnmv2n8FYaJU_gG8ap5iLRi23IFQLi4UTAEkjZrrWclfaM2FRB6g_D1zyVoXwgcsaLNu6usxbQ5IV_A9Boz_Mr90czi3smbRgFWwQGsG26I_5ffDTGLhFyC0srib1LKnLpGQTnMV5EmcRLdJi0s2mTR43rCgQWZ4kTYxFNs2jqErrjCYlyyd8RiOaxnGcxEkUpXmYNFlOp3VdpFGU07ogaYQ7xkXoJlOodDvhxgw4i-NplMYTwTYozGzcKErcg5eOu8WJnvkZuBlaQ9JIcGPNqRnLrfBfPZ5WY7aEF_a9ftIANwf7J4MWs-_-auG1Gj8weLXvZ_S3AAAA__-gbwEQ">