how to use offload and threads #181

Open

opened

Hello, if I want to use NVIDIA GPU acceleration for specific layers in the network and run rwkv.cpp with a specified number of threads, how should I run the program? Or what command should I use?thank you.

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests