[cfe-dev] libclang: Get tokens after preprocessing ("as the compiler sees it")

[Manuel Holtgrewe]

Dear all,

I would like to tokenize a C++ file "as the compiler sees it", i.e. 
after the preprocessor.

For example, given the following simple C++ program, I would like to get 
the tokens from the line with "MYASSERT(1 > 2)" after expanding the 
precompiler macros.

I guess that this is not possible with same API, but I might be wrong. 
How hard would it be to write such a tokenization function for libclang? 
What would the necessary steps be?

Bests,
Manuel

#include <cstdlib>
#include <cstdio>

#define MYASSERT(x) do { if (!(x)) { fprintf(stderr, "ASSERTION 
FAILED!\n"); exit(1); }} while (false)

int main()
{
     MYASSERT(1 > 2);
     return 0;
}