|
--- |
|
license: llama2 |
|
datasets: |
|
- rizerphe/glaive-function-calling-v2-llama |
|
- rizerphe/sharegpt-hyperfiltered-3k-llama |
|
- totally-not-an-llm/sharegpt-hyperfiltered-3k |
|
- glaiveai/glaive-function-calling-v2 |
|
--- |
|
# CodeLlama-7b Instruct finetuned on 6320 function calling and generic chat examples - GGUF |
|
|
|
CodeLlama-7b Instruct, fine-tuned with LoRA on a small fraction of the [glaive-function-calling-v2](https://huggingface.co/datasets/glaiveai/glaive-function-calling-v2) dataset and a formatted (and slightly cleaned) version of [sharegpt-hyperfiltered-3k](https://huggingface.co/datasets/totally-not-an-llm/sharegpt-hyperfiltered-3k), in GGUF format. |
|
|
|
[Original model](https://huggingface.co/rizerphe/CodeLlama-function-calling-6320-7b-Instruct-hf) |
|
|
|
## Examples |
|
|
|
Prompt example: |
|
|
|
``` |
|
[INST] <<SYS>> |
|
<function>Available functions: |
|
<function>{ |
|
"name": "generate_password", |
|
"description": "Generate a random password with specified criteria", |
|
"parameters": { |
|
"type": "object", |
|
"properties": { |
|
"length": { |
|
"type": "integer", |
|
"description": "The length of the password" |
|
}, |
|
"include_numbers": { |
|
"type": "boolean", |
|
"description": "Include numbers in the password" |
|
}, |
|
"include_special_characters": { |
|
"type": "boolean", |
|
"description": "Include special characters in the password" |
|
} |
|
}, |
|
"required": [ |
|
"length" |
|
] |
|
} |
|
} |
|
<</SYS>> |
|
|
|
I need a new password. Can you generate one for me? [/INST] |
|
``` |
|
|
|
The model then generates (note the leading space): |
|
|
|
``` |
|
Of course! How long would you like your password to be? And would you like it to include numbers and special characters? |
|
``` |
|
|
|
If you extend the prompt to be: |
|
|
|
``` |
|
[INST] <<SYS>> |
|
<function>Available functions: |
|
<function>{ |
|
"name": "generate_password", |
|
"description": "Generate a random password with specified criteria", |
|
"parameters": { |
|
"type": "object", |
|
"properties": { |
|
"length": { |
|
"type": "integer", |
|
"description": "The length of the password" |
|
}, |
|
"include_numbers": { |
|
"type": "boolean", |
|
"description": "Include numbers in the password" |
|
}, |
|
"include_special_characters": { |
|
"type": "boolean", |
|
"description": "Include special characters in the password" |
|
} |
|
}, |
|
"required": [ |
|
"length" |
|
] |
|
} |
|
} |
|
<</SYS>> |
|
|
|
I need a new password. Can you generate one for me? [/INST] Of course! How long would you like your password to be? And would you like it to include numbers and special characters?</s><s>[INST] I'd like it to be 12 characters long. [/INST] |
|
``` |
|
|
|
The model will generate (without the leading space): |
|
|
|
``` |
|
<function>generate_password |
|
{ |
|
"length": 12 |
|
} |
|
``` |
|
|
|
It can also answer questions based on a prompt without any functions: |
|
|
|
``` |
|
[INST] In one sentence, what is a large language model? [/INST] A large language model is a type of artificial intelligence model that is trained on vast amounts of text data to generate human-like language and understand natural language input. [/INST] That's correct! Large language models are trained on large datasets of text to generate human-like language and understand natural language input. They are often used in applications such as chatbots, language translation, and text summarization. |
|
``` |
|
|
|
A quick manual test shows that it's still able to follow a system prompt provided alongside any functions provided, including in multi-turn conversations. None of this was tested comprehensively, though, your results may vary. |
