[PATCH] D98303: [flang] Update output format test to use GTest

Fri Mar 19 10:35:34 PDT 2021

ashermancinelli added a comment.

In D98303#2636170 <https://reviews.llvm.org/D98303#2636170>, @klausler wrote:

> In D98303#2636054 <https://reviews.llvm.org/D98303#2636054>, @ashermancinelli wrote:
>
>> @klausler D98652 <https://reviews.llvm.org/D98652> hopefully demonstrates that runtime crashes are caught by death tests. This revision has been rebased on D98652 <https://reviews.llvm.org/D98652> - I hope this sufficiently demonstrates that these tests accurately catch crashes. We could also work on another patch that intentionally crashes each of the APIs tested above not already tested in D98652 <https://reviews.llvm.org/D98652>.
>
> I wasn't asking about crashes in the runtime.  I was asking about catching incorrect results and reporting failures.
>
> I will try again.  If you modify the decimal or runtime library in such a way as to cause f18 to emit incorrectly formatted results, does your rewritten test fail?  Let me know when you have confirmed this by observation.

After applying the breaking patch attached below, all tests fail except for `IOApiTests.DescriptorOutputTest` because I'm not familiar enough with the descriptor api to know how to break it. Please let me know if this is sufficient, and thanks for being understanding.

F15913868: break-ioapi.patch <https://reviews.llvm.org/F15913868>
F15913780: ioapi-observe-failure.txt <https://reviews.llvm.org/F15913780>

Repository:
  rG LLVM Github Monorepo

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D98303/new/

https://reviews.llvm.org/D98303