How to check which expert is being activated when doing model inference

[Tizzzzy]

Hi author,
Thank you for this wonderful work.
When we do model inference, how can I check for each token, which expert is being activated at each moe layer?
Thank you so much for your help!