Update README.md
Browse files
README.md
CHANGED
@@ -8,4 +8,99 @@ datasets:
|
|
8 |
---
|
9 |
# CodeLlama-7b Instruct finetuned on 6320 function calling and generic chat examples - GGUF
|
10 |
|
11 |
-
CodeLlama-7b Instruct, fine-tuned with LoRA on a small fraction of the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset and a formatted (and slightly cleaned) version of [sharegpt-hyperfiltered-3k](https://huggingface.co/datasets/totally-not-an-llm/sharegpt-hyperfiltered-3k), in GGUF format.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
8 |
---
|
9 |
# CodeLlama-7b Instruct finetuned on 6320 function calling and generic chat examples - GGUF
|
10 |
|
11 |
+
CodeLlama-7b Instruct, fine-tuned with LoRA on a small fraction of the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset and a formatted (and slightly cleaned) version of [sharegpt-hyperfiltered-3k](https://huggingface.co/datasets/totally-not-an-llm/sharegpt-hyperfiltered-3k), in GGUF format.
|
12 |
+
|
13 |
+
[Original model](https://huggingface.co/rizerphe/CodeLlama-function-calling-6320-7b-Instruct-hf)
|
14 |
+
|
15 |
+
## Examples
|
16 |
+
|
17 |
+
Prompt example:
|
18 |
+
|
19 |
+
```
|
20 |
+
[INST] <<SYS>>
|
21 |
+
<function>Available functions:
|
22 |
+
<function>{
|
23 |
+
"name": "generate_password",
|
24 |
+
"description": "Generate a random password with specified criteria",
|
25 |
+
"parameters": {
|
26 |
+
"type": "object",
|
27 |
+
"properties": {
|
28 |
+
"length": {
|
29 |
+
"type": "integer",
|
30 |
+
"description": "The length of the password"
|
31 |
+
},
|
32 |
+
"include_numbers": {
|
33 |
+
"type": "boolean",
|
34 |
+
"description": "Include numbers in the password"
|
35 |
+
},
|
36 |
+
"include_special_characters": {
|
37 |
+
"type": "boolean",
|
38 |
+
"description": "Include special characters in the password"
|
39 |
+
}
|
40 |
+
},
|
41 |
+
"required": [
|
42 |
+
"length"
|
43 |
+
]
|
44 |
+
}
|
45 |
+
}
|
46 |
+
<</SYS>>
|
47 |
+
|
48 |
+
I need a new password. Can you generate one for me? [/INST]
|
49 |
+
```
|
50 |
+
|
51 |
+
The model then generates (note the leading space):
|
52 |
+
|
53 |
+
```
|
54 |
+
Of course! How long would you like your password to be? And would you like it to include numbers and special characters?
|
55 |
+
```
|
56 |
+
|
57 |
+
If you extend the prompt to be:
|
58 |
+
|
59 |
+
```
|
60 |
+
[INST] <<SYS>>
|
61 |
+
<function>Available functions:
|
62 |
+
<function>{
|
63 |
+
"name": "generate_password",
|
64 |
+
"description": "Generate a random password with specified criteria",
|
65 |
+
"parameters": {
|
66 |
+
"type": "object",
|
67 |
+
"properties": {
|
68 |
+
"length": {
|
69 |
+
"type": "integer",
|
70 |
+
"description": "The length of the password"
|
71 |
+
},
|
72 |
+
"include_numbers": {
|
73 |
+
"type": "boolean",
|
74 |
+
"description": "Include numbers in the password"
|
75 |
+
},
|
76 |
+
"include_special_characters": {
|
77 |
+
"type": "boolean",
|
78 |
+
"description": "Include special characters in the password"
|
79 |
+
}
|
80 |
+
},
|
81 |
+
"required": [
|
82 |
+
"length"
|
83 |
+
]
|
84 |
+
}
|
85 |
+
}
|
86 |
+
<</SYS>>
|
87 |
+
|
88 |
+
I need a new password. Can you generate one for me? [/INST] Of course! How long would you like your password to be? And would you like it to include numbers and special characters?</s><s>[INST] I'd like it to be 12 characters long. [/INST]
|
89 |
+
```
|
90 |
+
|
91 |
+
The model will generate (without the leading space):
|
92 |
+
|
93 |
+
```
|
94 |
+
<function>generate_password
|
95 |
+
{
|
96 |
+
"length": 12
|
97 |
+
}
|
98 |
+
```
|
99 |
+
|
100 |
+
It can also answer questions based on a prompt without any functions:
|
101 |
+
|
102 |
+
```
|
103 |
+
[INST] In one sentence, what is a large language model? [/INST] A large language model is a type of artificial intelligence model that is trained on vast amounts of text data to generate human-like language and understand natural language input. [/INST] That's correct! Large language models are trained on large datasets of text to generate human-like language and understand natural language input. They are often used in applications such as chatbots, language translation, and text summarization.
|
104 |
+
```
|
105 |
+
|
106 |
+
A quick manual test shows that it's still able to follow a system prompt provided alongside any functions provided, including in multi-turn conversations. None of this was tested comprehensively, though, your results may vary.
|