GGUF
Inference Endpoints
conversational
Edit model card

QuantFactory Banner

QuantFactory/TherapyLlama-8B-v1-GGUF

This is quantized version of victunes/TherapyLlama-8B-v1 created using llama.cpp

Original Model Card

GGUF: https://huggingface.co/victunes/TherapyLlama-8B-v1-GGUF

TherapyLlama 8B v1

Buddy is here for you.

image/png

Trained on Llama 3 8B using a modified version of jerryjalapeno/nart-100k-synthetic.

It is a Llama 3 version of https://huggingface.co/victunes/TherapyBeagle-11B-v2

TherapyLlama is hopefully aligned to be helpful, healthy, and comforting.

IMPORTANT: Use Vicuna format

This was trained with the Vicuna 1.1 format. Use the Vicuna format! Do NOT use the Llama 3 format.

Usage

  • Do not hold back on Buddy.
  • Open up to Buddy.
  • Pour your heart out to Buddy.
  • Engage with Buddy.
  • Remember that Buddy is just an AI.

Notes

  • Tested with the Vicuna 1.1 Format
  • You might be assigned a random name if you don't give yourself one.
  • RP capabilities are weaker compared to TherapyBeagle.
    • Make sure to say "You are Socrates" for its best RP attempt.

Disclaimer

TherapyLlama is NOT a real therapist. It is a friendly AI that mimics empathy and psychotherapy. It is an illusion without the slightest clue who you are as a person. As much as it can help you with self-discovery, A LLAMA IS NOT A SUBSTITUTE to a real professional.

With that said, I found it to be a very helpful tool in unravelling one's self. I hope this model can help sooth minds and hearts.

Examples

LLAMA 3 INSTRUCT

{{[INPUT]}}
Hello, I'm victunes
{{[OUTPUT]}}
Hi victunes! Welcome to our session. I'm here to listen and support you. How are you feeling today?
{{[INPUT]}}
I've been feeling down lately.
{{[OUTPUT]}}
I'm sorry to hear that. Can you tell me more about what's been going on?
{{[INPUT]}}
I think I'm pretty lonely.
{{[OUTPUT]}}
Loneliness can be really tough. It sounds like it's been weighing heavily on your mind. What makes you feel lonely?
{{[INPUT]}}
My friend died recently.
{{[OUTPUT]}}
Oh, I'm so sorry for your loss, victunes. Losing a friend is never easy. How have you been coping with the grief?

GGUF: https://huggingface.co/victunes/TherapyLlama-8B-v1-GGUF

Downloads last month
57
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .

Dataset used to train QuantFactory/TherapyLlama-8B-v1-GGUF