File size: 546 Bytes
3a8fb22
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
# Falcon-7B-Instruct 8-bit Model

This repository is home to the Falcon-7B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit mode.

# Usage

You can use this model directly with a pipeline for tasks such as text generation and instruction following:

```python
from transformers import pipeline

generator = pipeline('text-generation', model='tensorcat/falcon-7b-instruct-8bit')
print(generator("Generate a story about a spaceship traveling through space.", max_length=200))

```