emmacall commited on
Commit
66900ad
1 Parent(s): 5c634c0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: microsoft/Phi-3-mini-4k-instruct
3
+ language:
4
+ - en
5
+ license: mit
6
+ license_link: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct/resolve/main/LICENSE
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - nlp
10
+ - code
11
+ - openvino
12
+ - openvino-export
13
+ inference:
14
+ parameters:
15
+ temperature: 0.0
16
+ widget:
17
+ - messages:
18
+ - role: user
19
+ content: Can you provide ways to eat combinations of bananas and dragonfruits?
20
+ ---
21
+
22
+ This model was converted to OpenVINO from [`microsoft/Phi-3-mini-4k-instruct`](https://huggingface.co/microsoft/Phi-3-mini-4k-instruct) using [optimum-intel](https://github.com/huggingface/optimum-intel)
23
+ via the [export](https://huggingface.co/spaces/echarlaix/openvino-export) space.
24
+
25
+ First make sure you have optimum-intel installed:
26
+
27
+ ```bash
28
+ pip install optimum[openvino]
29
+ ```
30
+
31
+ To load your model you can do as follows:
32
+
33
+ ```python
34
+ from optimum.intel import OVModelForCausalLM
35
+
36
+ model_id = "emmacall/Phi-3-mini-4k-instruct-openvino"
37
+ model = OVModelForCausalLM.from_pretrained(model_id)
38
+ ```