Convert Flask LLM Serve Code to FastAPI for Asynchronous Support

[Himanshu-Yadav-0]

Currently, the codebase uses Python Flask for serving the LLM. I propose migrating this implementation to FastAPI, which is a more advanced library and provides better asynchronous support. This change will improve scalability, performance, and modernize the API architecture.

[herin7]

We can do this, but first we need to solve #14 & observe the user response. If everything goes well we can go for this issue..

[Himanshu-Yadav-0]

Recently I've been really busy with some personal problems, soon I'll be back on the track.

[srinivas-batthula]

Hello @herin7 @Himanshu-Yadav-0 ,
I'd like to contribute to this issue.
Is this issue still open?
If yes, Please assign this to me!

[sibnarayanm3-maker]

Request ID: 5737:348B0D:83994B:95FE7B:68EFD1ED

[Himanshu-Yadav-0]

@sibnarayanm3-maker ???