torch
ninja
tokenizers
rwkv==0.6.2
pynvml
huggingface_hub
gradio>=3.17.1
transformers