---
license: apache-2.0
tags:
- generated_from_trainer
metrics:
- accuracy
model-index:
- name: wav2vec2-base-EMOPIA
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# wav2vec2-base-EMOPIA

This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the None dataset.
It achieves the following results on the evaluation set:
- Loss: 1.0626
- Accuracy: 0.6800

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- gradient_accumulation_steps: 3
- total_train_batch_size: 12
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 300
- num_epochs: 20
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch | Step | Validation Loss | Accuracy |
|:-------------:|:-----:|:----:|:---------------:|:--------:|
| 1.4068        | 0.98  | 41   | 1.3707          | 0.3000   |
| 1.3568        | 1.98  | 82   | 1.3093          | 0.3200   |
| 1.2503        | 2.98  | 123  | 1.1783          | 0.4600   |
| 1.1088        | 3.98  | 164  | 1.1606          | 0.4200   |
| 0.9996        | 4.98  | 205  | 1.0271          | 0.5400   |
| 0.924         | 5.98  | 246  | 1.0093          | 0.5800   |
| 0.8449        | 6.98  | 287  | 0.9613          | 0.5800   |
| 0.7559        | 7.98  | 328  | 0.9370          | 0.6000   |
| 0.7744        | 8.98  | 369  | 1.0094          | 0.5600   |
| 0.6745        | 9.98  | 410  | 0.9141          | 0.6400   |
| 0.6245        | 10.98 | 451  | 1.1952          | 0.5      |
| 0.5174        | 11.98 | 492  | 0.9249          | 0.6600   |
| 0.5091        | 12.98 | 533  | 0.9293          | 0.7200   |
| 0.391         | 13.98 | 574  | 0.9356          | 0.6600   |
| 0.3689        | 14.98 | 615  | 1.0245          | 0.6200   |
| 0.2816        | 15.98 | 656  | 1.0421          | 0.6600   |
| 0.3003        | 16.98 | 697  | 1.0427          | 0.6400   |
| 0.2495        | 17.98 | 738  | 1.0957          | 0.6600   |
| 0.2269        | 18.98 | 779  | 1.0539          | 0.6600   |
| 0.2055        | 19.98 | 820  | 1.0626          | 0.6800   |


### Framework versions

- Transformers 4.18.0
- Pytorch 1.10.1+cu102
- Datasets 2.4.0
- Tokenizers 0.12.1