[PATCH] Don't remove unknown tokens that are not whitespace (PR17215).

[Alexander Kornienko]

  Merged if's in readRawToken.

Hi djasper,

http://llvm-reviews.chandlerc.com/D1858

CHANGE SINCE LAST DIFF
  http://llvm-reviews.chandlerc.com/D1858?vs=4734&id=4735#toc

Files:
  lib/Format/Format.cpp
  lib/Format/TokenAnnotator.cpp
  unittests/Format/FormatTest.cpp
-------------- next part --------------
A non-text attachment was scrubbed...
Name: D1858.2.patch
Type: text/x-patch
Size: 12155 bytes
Desc: not available
URL: <http://lists.llvm.org/pipermail/cfe-commits/attachments/20131008/96ffbccc/attachment.bin>