[Discussion] High-level API #14
Description
Just some random ideas for the ggml-python high-level api.
- Automatic memory / context management
- Simplify backend offloading
- Immediate mode(?)
- File loaders
- On-the-fly Quantization
{{ message }}
Just some random ideas for the ggml-python high-level api.