[PATCH] Don't remove unknown tokens that are not whitespace (PR17215).

[Alexander Kornienko]

Hi djasper,

Clang-format currently considers all unknown tokens whitespace. It
turns out, that unknown tokens occur in valid code inside macro definitions or
parameters. This patch tries to distinguish between them and whitespace.

http://llvm-reviews.chandlerc.com/D1858

Files:
  lib/Format/Format.cpp
  lib/Format/TokenAnnotator.cpp
  unittests/Format/FormatTest.cpp
-------------- next part --------------
A non-text attachment was scrubbed...
Name: D1858.1.patch
Type: text/x-patch
Size: 11461 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/cfe-commits/attachments/20131008/19b8e693/attachment.bin>