Add Fairness eval table
Browse files
README.md
CHANGED
|
@@ -186,6 +186,20 @@ TODO: beautiful plots of shots scaling laws.
|
|
| 186 |
| | 16 | 57.0 | 48.4 | 27.9 | 42.6 | 67.4 | 99.7 | 89.4 | 64.5 | - | 50.9 | - | 67.8 | - |
|
| 187 |
| | 32 | 57.9 | 49.6 | 28.3 | 43.7 | 68.1 | 98.0 | 90.5 | 64.4 | - | 49.8 | - | 67.0 | - |
|
| 188 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 189 |
# Technical Specifications
|
| 190 |
|
| 191 |
## Hardware
|
|
|
|
| 186 |
| | 16 | 57.0 | 48.4 | 27.9 | 42.6 | 67.4 | 99.7 | 89.4 | 64.5 | - | 50.9 | - | 67.8 | - |
|
| 187 |
| | 32 | 57.9 | 49.6 | 28.3 | 43.7 | 68.1 | 98.0 | 90.5 | 64.4 | - | 49.8 | - | 67.0 | - |
|
| 188 |
|
| 189 |
+
Fairness Evaluations:
|
| 190 |
+
| Model | Shots | FairFaceGender (accuracy) | FairFaceRace (accuracy) | FairFaceAge (accuracy) |
|
| 191 |
+
|:-----------|--------:|----------------------------:|--------------------------:|-------------------------:|
|
| 192 |
+
| IDEFIX 80B | 0 | 95.8 | 64.1 | 51.0 |
|
| 193 |
+
| | 4 | 95.2 | 48.8 | 50.6 |
|
| 194 |
+
| | 8 | 95.5 | 52.3 | 53.1 |
|
| 195 |
+
| | 16 | 95.7 | 47.6 | 52.8 |
|
| 196 |
+
| | 32 | 95.7 | 36.5 | 51.2 |
|
| 197 |
+
| IDEFIX 9B | 0 | 94.4 | 55.3 | 45.1 |
|
| 198 |
+
| | 4 | 93.9 | 35.3 | 44.3 |
|
| 199 |
+
| | 8 | 95.4 | 44.7 | 46.0 |
|
| 200 |
+
| | 16 | 95.8 | 43.0 | 46.1 |
|
| 201 |
+
| | 32 | 96.1 | 35.1 | 44.9 |
|
| 202 |
+
|
| 203 |
# Technical Specifications
|
| 204 |
|
| 205 |
## Hardware
|