Improve the Tokenizer

[jeanbern]

I can probably draw from some existing code online. Also, try to make it work on a stream rather than a giant string.