smalll fixes
Browse files
README.md
CHANGED
@@ -207,7 +207,7 @@ We start from the base IDEFICS models and fine-tune the models by unfreezing all
|
|
207 |
|
208 |
We note that all these datasets were obtained by using ChatGPT/GPT-4 in one way or another.
|
209 |
|
210 |
-
Additionally, we found it beneficial to include the pre-training data in the fine-tuning with the following sampling ratios: 5.1% of image-text pairs and
|
211 |
|
212 |
The training objective is the standard next token prediction. We use the following hyper and training parameters:
|
213 |
| Parameters | | IDEFICS-80b-instruct | IDEFICS-9b-instruct |
|
@@ -229,7 +229,7 @@ The training objective is the standard next token prediction. We use the followi
|
|
229 |
|
230 |
# Evaluation
|
231 |
|
232 |
-
## IDEFICS
|
233 |
|
234 |
We follow the evaluation protocol of Flamingo and evaluate IDEFICS on a suite of downstream image-text benchmarks ranging from visual question answering to image captioning.
|
235 |
|
|
|
207 |
|
208 |
We note that all these datasets were obtained by using ChatGPT/GPT-4 in one way or another.
|
209 |
|
210 |
+
Additionally, we found it beneficial to include the pre-training data in the fine-tuning with the following sampling ratios: 5.1% of image-text pairs and 30.7% of OBELICS multimodal web documents.
|
211 |
|
212 |
The training objective is the standard next token prediction. We use the following hyper and training parameters:
|
213 |
| Parameters | | IDEFICS-80b-instruct | IDEFICS-9b-instruct |
|
|
|
229 |
|
230 |
# Evaluation
|
231 |
|
232 |
+
## IDEFICS
|
233 |
|
234 |
We follow the evaluation protocol of Flamingo and evaluate IDEFICS on a suite of downstream image-text benchmarks ranging from visual question answering to image captioning.
|
235 |
|