I think I implemented this in one of the decoders (for debugging?) but this should be everywhere.
- I may have put it in a different high level library
- Will error if you then start providing data with frames other than 0
- Need to be careful about un-timed SPS/PPS/Headers
- Frame numbers dictated by output rather than input
- We should never ever output a frame with a duplicated frame number unless it IS the same frame (eg. double decode keyframe - or some kinda meta frame - though that should be in the peek meta)