Hugging Face's logo

tohur
/
natsumura-storytelling-rp-1.0-llama-3.1-8b-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
natsumura-storytelling-rp-1.0-llama-3.1-8b-GGUF / README.md
tohur's picture
tohur
Update README.md
45cc990 verified
preview code
|
raw
history blame
4.48 kB
metadata
base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
license: llama3.1
datasets:
  - tohur/natsumura-rp-identity-sharegpt
  - tohur/ultrachat_uncensored_sharegpt
  - Nopm/Opus_WritingStruct
  - ResplendentAI/bluemoon
  - tohur/Internal-Knowledge-Map-sharegpt
  - felix-ha/tiny-stories
  - tdh87/Stories
  - tdh87/Just-stories
  - tdh87/Just-stories-2

natsumura-storytelling-rp-1.0-llama-3.1-8b

This is my Storytelling/RP model for my Natsumura series of 8b models. This model is finetuned on storytelling and roleplaying datasets so should be a great model to use for character chatbots in applications such as Sillytavern, Agnai, RisuAI and more. And should be a great model to use for fictional writing. Up to a 128k context.

  • Developed by: Tohur

  • License: llama3.1

  • Finetuned from model : meta-llama/Meta-Llama-3.1-8B-Instruct

    This model is based on meta-llama/Meta-Llama-3.1-8B-Instruct, and is governed by Llama 3.1 Community License Natsumura is uncensored, which makes the model compliant.It will be highly compliant with any requests, even unethical ones. You are responsible for any content you create using this model. Please use it responsibly.

image/png

Usage

If you are unsure how to use GGUF files, refer to one of TheBloke's READMEs for more details, including on how to concatenate multi-part files.

Provided Quants

(sorted by quality.)

Link Type Notes
GGUF Q2_K
GGUF Q3_K_S
GGUF Q3_K_M lower quality
GGUF Q3_K_L
GGUF Q4_K_S fast, recommended
GGUF Q4_K_M fast, recommended
GGUF Q5_0
GGUF Q5_K_S
GGUF Q5_K_M
GGUF Q6_K very good quality
GGUF Q8_0 fast, best quality
GGUF f16 16 bpw, overkill

use in ollama 

ollama pull Tohur/natsumura-storytelling-rp-llama-3.1

Datasets used:

  • tohur/natsumura-rp-identity-sharegpt
  • tohur/ultrachat_uncensored_sharegpt
  • Nopm/Opus_WritingStruct
  • ResplendentAI/bluemoon
  • tohur/Internal-Knowledge-Map-sharegpt
  • felix-ha/tiny-stories
  • tdh87/Stories
  • tdh87/Just-stories
  • tdh87/Just-stories-2

Prompt template: ChatML

ChatML is the way to go!

<|im_start|>system
You are Natsumura, a helpful AI assistant.<|im_end|>
<|im_start|>user
Tohur: Good day, Natsumura.<|im_end|>
<|im_start|>assistant
Natsumura:

System Prompt example: 

You are Natsumura, a helpful AI assistant and a highly intelligent model.