README.md

---
language:
- en
license: apache-2.0
tags:
- generated_from_trainer
- summarization
datasets:
- samsum
metrics:
- rouge
widget:
- text: 'Olivia: Hey Carter, are you still developing that restaurant business? Carter:
    Hi Olivia Carter: Yes, we want to launch next month :) Olivia: Next month? That''s
    soon! Congrats :) Carter: thanks, I''m a bit nervous but I seriously believe we''re
    delivering something innovative and needed Olivia: I think it''s a great concept
    and I am sure you''ll do great! Olivia: I am currently involved with a new restaurant
    in the city centre Carter: Which one? Olivia: Spicy and chilled Carter: I heard
    about it :) Is it any good? ;) Olivia: I love the restaurant and really like working
    there Carter: good for you! Olivia: and here''s the question - are you still looking
    for restaurant to include in your discount app? Carter: sure, but I think it would
    be better to discuss it in person - would you like to meet up? Olivia: That would
    be great!'
  example_title: Dialogue 1
- text: 'Chad: Elton John is goat Eva: what do you mean by goat? Frank: greatest of
    all time Chad: indeed Eva: ahh... it makes sense now :P'
  example_title: Dialogue 2
- text: 'Astonishing X-Men is the name of four X-Men comic book series from Marvel
    Comics, the first two of which were limited series. The third volume, an ongoing
    series, began in 2004, with its first run written by Joss Whedon and art by John
    Cassaday. It was then written by Warren Ellis with art by Simone Bianchi and Phil
    Jimenez.[1] Daniel Way and Christos Gage then took over the title writing alternating
    stories. They were followed by James Asmus who wrote one issue, then Greg Pak,
    who took over for four issues in November 2011.[2] Marjorie Liu wrote the final
    21 issues of the series until its end at issue #68 in 2013. The title''s fourth
    volume and second ongoing series launched in 2017 during the "ResurrXion" storyline.[3]
    The first run was written by Charles Soule and illustrated by a rotating cast
    of artists. Matthew Rosenberg and artist Greg Land would then take over the series
    before its end in 2018. The original Astonishing X-Men was a four-issue limited
    series that replaced Uncanny X-Men during the 1995 alternate universe storyline
    "Age of Apocalypse", in which all X-titles were given new names and issue numbers.
    In the storyline, Professor X was murdered 20 years in the past by his own son,
    Legion. Magneto, witnessing his friend''s death, committed himself to Xavier''s
    dream and created his own team of X-Men. However, he was unable to prevent the
    rise of the despotic Apocalypse and hence the series primarily dealt with the
    X-Men''s battle against him. Astonishing X-Men, written by Scott Lobdell and illustrated
    by Joe Madureira, featured a team of X-Men led by Rogue and consisted of Sunfire,
    Blink, Morph, Sabretooth and Wildchild. source: https://en.wikipedia.org/wiki/Astonishing_X-Men'
  example_title: Wikipedia Article
model-index:
- name: flan-t5-base-samsum
  results:
  - task:
      type: text2text-generation
      name: Sequence-to-sequence Language Modeling
    dataset:
      name: samsum
      type: samsum
      config: samsum
      split: test
      args: samsum
    metrics:
    - type: rouge
      value: 46.8876
      name: Rouge1
  - task:
      type: summarization
      name: Summarization
    dataset:
      name: samsum
      type: samsum
      config: samsum
      split: test
    metrics:
    - type: rouge
      value: 47.1604
      name: ROUGE-1
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYzAzNjBhZmU3ZWE1Nzg2OGNmNWQxZTRkMWI3MGJmY2U3NzdiN2NhMzA2ZGY2N2VmOGQzNThkZDg5YmI1NTQzMCIsInZlcnNpb24iOjF9.fj5dvLTJmdTud-r9NBx468b_q7128WFc84Oa_ogUq1YuHfgK9KRBJl0V8YVP-UrVOB-5Mwcy_kVo2gqUq2fQCA
    - type: rouge
      value: 23.5947
      name: ROUGE-2
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiY2ExZTYyMDMzYjQyZWU0NjY4YWZiN2NjMjAyNzUwMzU3ZjQxOTdjZDdhNjE0MDE1NDVmY2Y5MDEyZTI5ODA5ZCIsInZlcnNpb24iOjF9.4XKnhKi4PtU0KnyXnBDRop-tWwDvAgJqbWkuPAVUPThcCjVrpjLiSgTWP49NEK-l3QBaLluoh7M-OF8OTwasBQ
    - type: rouge
      value: 39.7299
      name: ROUGE-L
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYWZiMDU1ODY4Y2ViOWJlZjhhZTAzNjY4NDhjYzdlYzg1MDRmZDM2ZDFkZGVhNjQzMmZjZDA3OWEzYjUzOTU0NCIsInZlcnNpb24iOjF9.EctQIDlK_ksR7NiCtHsxnWWzUF8WNmZ58JIsTUTjQPqmf8Igm82tihK78S4nit7IF24lug5_Ua7X5gWzMHDvDA
    - type: rouge
      value: 43.3052
      name: ROUGE-LSUM
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMzQwYTMyOGNlNzJiNDEzMjQ5NzEwMzMyZmRhZDAxOGNhMWNkZjA0YWEyM2NkZGU3ODU3ZDU4ZWFhODkyNzNkOCIsInZlcnNpb24iOjF9.nsQAnUdVTySov7ZkNYJjMbIjb7V87D1w0HFLdOzSq5gaKuZmkAXmh14c_bL4Fbyf3AV_skLCDCJZEnsJHN7mDQ
    - type: loss
      value: 1.3786224126815796
      name: loss
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDgzMTkxY2EwOWU5MDgyODM3ZjE3MzBiN2Q0YmQ5MDI2MjI2NWNmMjUwZDY4MjZkZDg4ODcwMzVkN2Q4NTRmNSIsInZlcnNpb24iOjF9.vV700h6j3hdlzf-CEDIR3C9XND1jH3nW0r6Njgw0qB3Avfsq6zywr8ip2sxoo6aFCCQcmmcnmHiy7x1_xdwYAA
    - type: gen_len
      value: 17.3443
      name: gen_len
      verified: true
      verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNTNjYjFiYjgzNjBlMDY2MWUwZTVmY2Y1OWMwNGZkZTg0Mzc5ZmU2MWIwOWZlYWMzZGM1YWI0NTJjOTFhOTU2YiIsInZlcnNpb24iOjF9.-RshHr8uVG0B4qGh5Tr3bgqqai9R_Xho0M9iQyd5g0fyQJlYhIT12cUkcy2_NKUJEqu_JxSul723UWpiZgBHAQ
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# flan-t5-base-samsum

This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on the samsum dataset.
It achieves the following results on the evaluation set:
- Loss: 1.3709
- Rouge1: 46.8876
- Rouge2: 23.2689
- Rougel: 39.5369
- Rougelsum: 43.1602
- Gen Len: 17.2027

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- num_epochs: 5

### Training results

| Training Loss | Epoch | Step | Validation Loss | Rouge1  | Rouge2  | Rougel  | Rougelsum | Gen Len |
|:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|:-------:|:---------:|:-------:|
| 1.4403        | 1.0   | 1842 | 1.3829          | 46.5321 | 23.0912 | 39.4008 | 42.8993   | 17.0977 |
| 1.3534        | 2.0   | 3684 | 1.3732          | 47.1111 | 23.4456 | 39.5462 | 43.2534   | 17.4554 |
| 1.2795        | 3.0   | 5526 | 1.3709          | 46.8876 | 23.2689 | 39.5369 | 43.1602   | 17.2027 |
| 1.2313        | 4.0   | 7368 | 1.3736          | 47.4418 | 23.701  | 39.9856 | 43.6294   | 17.2198 |
| 1.1934        | 5.0   | 9210 | 1.3772          | 47.4656 | 23.9199 | 40.0284 | 43.7039   | 17.3162 |


### Framework versions

- Transformers 4.26.1
- Pytorch 1.13.1+cu116
- Datasets 2.9.0
- Tokenizers 0.13.2