echarlaix HF staff commited on
Commit
f24ea7c
1 Parent(s): d9a1547

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +42 -0
README.md ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: echarlaix/distilgpt2-openvino
3
+ datasets:
4
+ - openwebtext
5
+ language: en
6
+ license: apache-2.0
7
+ tags:
8
+ - exbert
9
+ - openvino
10
+ - openvino
11
+ co2_eq_emissions: 149200
12
+ model-index:
13
+ - name: distilgpt2
14
+ results:
15
+ - task:
16
+ type: text-generation
17
+ name: Text Generation
18
+ dataset:
19
+ name: WikiText-103
20
+ type: wikitext
21
+ metrics:
22
+ - type: perplexity
23
+ value: 21.1
24
+ name: Perplexity
25
+ ---
26
+
27
+ This model is a quantized version of [`echarlaix/distilgpt2-openvino`](https://huggingface.co/echarlaix/distilgpt2-openvino) and was exported to the OpenVINO format using [optimum-intel](https://github.com/huggingface/optimum-intel) via the [nncf-quantization](https://huggingface.co/spaces/echarlaix/nncf-quantization) space.
28
+
29
+ First make sure you have optimum-intel installed:
30
+
31
+ ```bash
32
+ pip install optimum[openvino]
33
+ ```
34
+
35
+ To load your model you can do as follows:
36
+
37
+ ```python
38
+ from optimum.intel import OVModelForCausalLM
39
+
40
+ model_id = "echarlaix/distilgpt2-openvino-int4"
41
+ model = OVModelForCausalLM.from_pretrained(model_id)
42
+ ```