VPTQ-demo / README.md
OpenSourceRonin's picture
initial commit
d39b1cd verified
|
raw
history blame
409 Bytes
metadata
title: LLM 2Bit
emoji: 💬
colorFrom: yellow
colorTo: purple
sdk: gradio
sdk_version: 4.36.1
app_file: app.py
pinned: false
license: mit
short_description: 2bit infer for llm

An example chatbot using Gradio, huggingface_hub, and the Hugging Face Inference API.