|
--- |
|
license: cc-by-nc-4.0 |
|
|
|
base_model: [mistralai/Mixtral-8x7B-Instruct-v0.1] |
|
|
|
tags: |
|
- dpo |
|
--- |
|
# rizla been cooking while singing |
|
# This is an experimental model that I made by merging two 2expmixtrals The mergekitty is a tool that lets me mix and match different models into one big model, keeping all the smarts and skills of the original models. The llama70b is a huge language model that can make words for all kinds of things and ways, based on the GPT-4 thingy. |
|
|
|
The merged model has 19 billion parraraameters and was made trained on 640GB of vram cluster |
|
|
|
## Merge me baby one more time |
|
### Sending this contraption out straight to mergeland, would be hilarious if it gets 1st |
