async fd issue

[frostyplanet]

tokio-rs/tokio#7563

The issue said we should not close the AsyncFd before dropping,
should review our code, especially when we do close early logic