Add token/s on dashboard and reporting token/s in the metrics endpoint

[ndragon798]

Added reporting tokens per second in the dashboard and total tokens per second in metrics

From the metrics endpoint

# HELP paddler_tokens_per_second Combined generation throughput across all agents
# TYPE paddler_tokens_per_second gauge
paddler_tokens_per_second 60.199918546700225

This is done by counting the amount of generation in the SampleTokenPhase then its sent off to a throughput meter which is just a rolling 1 second window. This is sent from the agent via the status snapshot that the agent sends once per second. Lots of this was done by Claude with me fixing issues that it had with building the binaries and testing. I only was able to test this on 3 machines that are amd/cpu based. I don't think there will be any issues with nvidia but please test if you have an nvidia gpu. Also tested with the desktop app which only seems to do cpu and not vulkan?

Let me know if you have any questions or run into any issues.

Thanks,
Nathan

[mcharytoniuk]

@ndragon798 Hey! Thanks a lot, at a frst glance looks good. :) We will test it with @malzag on a few devices, and will likely merge it if nothing comes up.

[ndragon798]

Didn't realize I made the pr with my main branch let me close this and remake it with a proper branch so my other changes don't keep get added.