Re: Internationalization

["nshmyrev" <nshmyrev yandex ru>]

>One thinkable approach would be to extend the token list to include all
>translated versions of the tokens, but I don't like that much. Write
>your own scanner :)


By the way, there are known problems with flex - it still can't handle utf8 keywords without patch, and patch is not always included and distributions, it is sometimes hard to apply it. 

See http://www.freedesktop.org/Software/BadSoftware

So, write your own flex :)