rizerphe commited on
Commit
ea84a10
1 Parent(s): 1cbbfb7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +96 -1
README.md CHANGED
@@ -8,4 +8,99 @@ datasets:
8
  ---
9
  # CodeLlama-7b Instruct finetuned on 6320 function calling and generic chat examples - GGUF
10
 
11
- CodeLlama-7b Instruct, fine-tuned with LoRA on a small fraction of the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset and a formatted (and slightly cleaned) version of [sharegpt-hyperfiltered-3k](https://huggingface.co/datasets/totally-not-an-llm/sharegpt-hyperfiltered-3k), in GGUF format.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  ---
9
  # CodeLlama-7b Instruct finetuned on 6320 function calling and generic chat examples - GGUF
10
 
11
+ CodeLlama-7b Instruct, fine-tuned with LoRA on a small fraction of the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset and a formatted (and slightly cleaned) version of [sharegpt-hyperfiltered-3k](https://huggingface.co/datasets/totally-not-an-llm/sharegpt-hyperfiltered-3k), in GGUF format.
12
+
13
+ [Original model](https://huggingface.co/rizerphe/CodeLlama-function-calling-6320-7b-Instruct-hf)
14
+
15
+ ## Examples
16
+
17
+ Prompt example:
18
+
19
+ ```
20
+ [INST] <<SYS>>
21
+ <function>Available functions:
22
+ <function>{
23
+ "name": "generate_password",
24
+ "description": "Generate a random password with specified criteria",
25
+ "parameters": {
26
+ "type": "object",
27
+ "properties": {
28
+ "length": {
29
+ "type": "integer",
30
+ "description": "The length of the password"
31
+ },
32
+ "include_numbers": {
33
+ "type": "boolean",
34
+ "description": "Include numbers in the password"
35
+ },
36
+ "include_special_characters": {
37
+ "type": "boolean",
38
+ "description": "Include special characters in the password"
39
+ }
40
+ },
41
+ "required": [
42
+ "length"
43
+ ]
44
+ }
45
+ }
46
+ <</SYS>>
47
+
48
+ I need a new password. Can you generate one for me? [/INST]
49
+ ```
50
+
51
+ The model then generates (note the leading space):
52
+
53
+ ```
54
+ Of course! How long would you like your password to be? And would you like it to include numbers and special characters?
55
+ ```
56
+
57
+ If you extend the prompt to be:
58
+
59
+ ```
60
+ [INST] <<SYS>>
61
+ <function>Available functions:
62
+ <function>{
63
+ "name": "generate_password",
64
+ "description": "Generate a random password with specified criteria",
65
+ "parameters": {
66
+ "type": "object",
67
+ "properties": {
68
+ "length": {
69
+ "type": "integer",
70
+ "description": "The length of the password"
71
+ },
72
+ "include_numbers": {
73
+ "type": "boolean",
74
+ "description": "Include numbers in the password"
75
+ },
76
+ "include_special_characters": {
77
+ "type": "boolean",
78
+ "description": "Include special characters in the password"
79
+ }
80
+ },
81
+ "required": [
82
+ "length"
83
+ ]
84
+ }
85
+ }
86
+ <</SYS>>
87
+
88
+ I need a new password. Can you generate one for me? [/INST] Of course! How long would you like your password to be? And would you like it to include numbers and special characters?</s><s>[INST] I'd like it to be 12 characters long. [/INST]
89
+ ```
90
+
91
+ The model will generate (without the leading space):
92
+
93
+ ```
94
+ <function>generate_password
95
+ {
96
+ "length": 12
97
+ }
98
+ ```
99
+
100
+ It can also answer questions based on a prompt without any functions:
101
+
102
+ ```
103
+ [INST] In one sentence, what is a large language model? [/INST] A large language model is a type of artificial intelligence model that is trained on vast amounts of text data to generate human-like language and understand natural language input. [/INST] That's correct! Large language models are trained on large datasets of text to generate human-like language and understand natural language input. They are often used in applications such as chatbots, language translation, and text summarization.
104
+ ```
105
+
106
+ A quick manual test shows that it's still able to follow a system prompt provided alongside any functions provided, including in multi-turn conversations. None of this was tested comprehensively, though, your results may vary.