[all-commits] [llvm/llvm-project] 2d01ac: [pseudo] Strip comments for TokenStream.

[Haojian Wu via All-commits]

  Branch: refs/heads/main
  Home:   https://github.com/llvm/llvm-project
  Commit: 2d01ac18df93f2f8dd925888aabb7681224fb670
      https://github.com/llvm/llvm-project/commit/2d01ac18df93f2f8dd925888aabb7681224fb670
  Author: Haojian Wu <hokein.wu at gmail.com>
  Date:   2022-03-07 (Mon, 07 Mar 2022)

  Changed paths:
    M clang/include/clang/Tooling/Syntax/Pseudo/Token.h
    M clang/lib/Tooling/Syntax/Pseudo/Token.cpp
    M clang/unittests/Tooling/Syntax/Pseudo/TokenTest.cpp

  Log Message:
  -----------
  [pseudo] Strip comments for TokenStream.

Add a utility function to strip comments from a "raw" tokenstream. The
derived stream will be fed to the GLR parser (for early testing).

Differential Revision: https://reviews.llvm.org/D121092