File size: 2,308 Bytes
85acbcf e85fd67 85acbcf eb2f969 e85fd67 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 |
---
license: apache-2.0
datasets:
- Samsung/samsum
language:
- en
library_name: transformers
pipeline_tag: summarization
---
# Dialog summarization model
The `llama_3.1_8b_dialog_summarization_model` model is a dialog summarization model fine-tuned on the `llama-3.1-8b` architecture using LORA. This powerful model excels at generating abstractive summaries from input text. It has been fine-tuned on samsum dataset.
## Intended Uses & Limitations
### Intended Uses
- Dialog summarization: The model is well-suited for summarizing lengthy dialogs, making it valuable for tasks that needs to capture lengthy dialog in few lines.
### Limitations
- Domain-specific content: While it performs well on general text summarization tasks, its performance may vary when applied to domain-specific content.
## Training and Evaluation Data
The model has been trained on the Samsum dataset. These datasets provide a wide range of dialog summarization examples.
### Training hyperparameters
The following hyperparameters were used during training:
- num_epochs: 1
- model_name = "meta-llama/Meta-Llama-3.1-8B"
- num_epochs = 1
- gradient_accumulation_steps = 4
- batch_size_training = 1
- lr = 3e-4
- use_fp16 = True
- context_length = 1024
### Example results
Summarize this dialog:
A: Hi Tom, are you busy tomorrow’s afternoon?
B: I’m pretty sure I am. What’s up?
A: Can you go with me to the animal shelter?.
B: What do you want to do?
A: I want to get a puppy for my son.
B: That will make him so happy.
A: Yeah, we’ve discussed it many times. I think he’s ready now.
B: That’s good. Raising a dog is a tough issue. Like having a baby ;-)
A: I'll get him one of those little dogs.
B: One that won't grow up too big;-)
A: And eat too much;-))
B: Do you know which one he would like?
A: Oh, yes, I took him there last Monday. He showed me one that he really liked.
B: I bet you had to drag him away.
A: He wanted to take it home right away ;-).
B: I wonder what he'll name it.
A: He said he’d name it after his dead hamster – Lemmy - he's a great Motorhead fan :-)))
Summary:
A wants to get a puppy for her son. A took him to the animal shelter last Monday and he showed her a dog he liked. A wants to get a small dog. A son wants to name it Lemmy. |