[PATCH] D59887: [Syntax] Introduce TokenBuffer, start clangToolingSyntax library

[Nathan Ridge via Phabricator via cfe-commits]

nridge added inline comments.


================
Comment at: include/clang/Tooling/Syntax/Tokens.h:206
+  ///     DECL(a);
+  /// spelledTokens() returns {"#", "define", "DECL", "(", "name", ")", "eof"}.
+  /// FIXME: we do not yet store tokens of directives, like #include, #define,
----------------
Is this comment correct?

If so:
  * Why are the tokens "int", "name", "=", "10" not included?
  * Why are the tokens `"DECL", "(", "a", ")" not included?



Repository:
  rC Clang

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D59887/new/

https://reviews.llvm.org/D59887