[flang-commits] [flang] [llvm] [flang] [flang-rt] Addition of the Fortran 2023 TOKENIZE intrinsic. (PR #181030)

[Tom Eccles via flang-commits]

https://github.com/tblah commented:

Thank you for updating the lowering test. A few more comments from me

- Please could you add unittests in flang-rt/unittests/Runtime/CharacterTest.cpp.
- On my reading of the standard, an empty string should return one zero-length token, whereas I think this implementation gives zero tokens.



https://github.com/llvm/llvm-project/pull/181030