webpolis
/

zenos-gpt-j-6B-instruct-4bit

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Nicolas Iglesias commited on Sep 25, 2023

Commit

ffc0e1d

•

1 Parent(s): 856675e

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -14,6 +14,10 @@
 Zenos GPT-J 6B Alpaca Evol 4-bit is a Spanish Instruction capable model based on the GPT-J architecture with 6 billion parameters. It has been fine-tuned on the Alpaca Spanish and Evol Instruct datasets, making it particularly suitable for natural language understanding and generation tasks in Spanish.
 ## Usage
 You can use this model for various natural language processing tasks such as text generation, translation, summarization, and more. Below is an example of how to use it in Python with the Transformers library:

 Zenos GPT-J 6B Alpaca Evol 4-bit is a Spanish Instruction capable model based on the GPT-J architecture with 6 billion parameters. It has been fine-tuned on the Alpaca Spanish and Evol Instruct datasets, making it particularly suitable for natural language understanding and generation tasks in Spanish.
+### Requirements
+Since this is a compressed version (4 bits), it can fit into ~7GB of VRAM.
 ## Usage
 You can use this model for various natural language processing tasks such as text generation, translation, summarization, and more. Below is an example of how to use it in Python with the Transformers library: