metadata
license: apache-2.0
base_model: bert-base-multilingual-cased
tags:
- generated_from_trainer
model-index:
- name: bert-base-multilingual-cased-iob2-20240814115522
results: []
bert-base-multilingual-cased-iob2-20240814115522
This model is a fine-tuned version of bert-base-multilingual-cased on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 0.2753
- Overall Strict Precision: 0.7682
- Overall Strict Recall: 0.7397
- Overall Strict F1: 0.7537
- Overall Ent Type Precision: 0.8497
- Overall Ent Type Recall: 0.8181
- Overall Ent Type F1: 0.8336
- Overall Partial Precision: 0.8211
- Overall Partial Recall: 0.7906
- Overall Partial F1: 0.8056
- Overall Exact Precision: 0.7780
- Overall Exact Recall: 0.7491
- Overall Exact F1: 0.7633
- Hotelphonenumber Strict Precision: 0.1618
- Hotelphonenumber Strict Recall: 0.7613
- Hotelphonenumber Strict F1: 0.2669
- Hotelphonenumber Ent Type Precision: 0.1942
- Hotelphonenumber Ent Type Recall: 0.9134
- Hotelphonenumber Ent Type F1: 0.3203
- Hotelphonenumber Partial Precision: 0.1783
- Hotelphonenumber Partial Recall: 0.8387
- Hotelphonenumber Partial F1: 0.2941
- Hotelphonenumber Exact Precision: 0.1621
- Hotelphonenumber Exact Recall: 0.7625
- Hotelphonenumber Exact F1: 0.2674
- Externalreservationnumber Strict Precision: 0.0053
- Externalreservationnumber Strict Recall: 0.3534
- Externalreservationnumber Strict F1: 0.0104
- Externalreservationnumber Ent Type Precision: 0.0056
- Externalreservationnumber Ent Type Recall: 0.3777
- Externalreservationnumber Ent Type F1: 0.0111
- Externalreservationnumber Partial Precision: 0.0093
- Externalreservationnumber Partial Recall: 0.6259
- Externalreservationnumber Partial F1: 0.0184
- Externalreservationnumber Exact Precision: 0.0088
- Externalreservationnumber Exact Recall: 0.5908
- Externalreservationnumber Exact F1: 0.0173
- Pagenumber Strict Precision: 0.1285
- Pagenumber Strict Recall: 0.8322
- Pagenumber Strict F1: 0.2226
- Pagenumber Ent Type Precision: 0.1295
- Pagenumber Ent Type Recall: 0.8386
- Pagenumber Ent Type F1: 0.2243
- Pagenumber Partial Precision: 0.1290
- Pagenumber Partial Recall: 0.8358
- Pagenumber Partial F1: 0.2236
- Pagenumber Exact Precision: 0.1285
- Pagenumber Exact Recall: 0.8324
- Pagenumber Exact F1: 0.2226
- Currencycode Strict Precision: 0.0977
- Currencycode Strict Recall: 0.5191
- Currencycode Strict F1: 0.1645
- Currencycode Ent Type Precision: 0.0982
- Currencycode Ent Type Recall: 0.5220
- Currencycode Ent Type F1: 0.1654
- Currencycode Partial Precision: 0.0980
- Currencycode Partial Recall: 0.5209
- Currencycode Partial F1: 0.1650
- Currencycode Exact Precision: 0.0978
- Currencycode Exact Recall: 0.5194
- Currencycode Exact F1: 0.1646
- Hotelfaxnumber Strict Precision: 0.1187
- Hotelfaxnumber Strict Recall: 0.7892
- Hotelfaxnumber Strict F1: 0.2063
- Hotelfaxnumber Ent Type Precision: 0.1358
- Hotelfaxnumber Ent Type Recall: 0.9028
- Hotelfaxnumber Ent Type F1: 0.2360
- Hotelfaxnumber Partial Precision: 0.1274
- Hotelfaxnumber Partial Recall: 0.8470
- Hotelfaxnumber Partial F1: 0.2215
- Hotelfaxnumber Exact Precision: 0.1188
- Hotelfaxnumber Exact Recall: 0.7900
- Hotelfaxnumber Exact F1: 0.2066
- Hotelzipcode Strict Precision: 0.1827
- Hotelzipcode Strict Recall: 0.7164
- Hotelzipcode Strict F1: 0.2912
- Hotelzipcode Ent Type Precision: 0.1935
- Hotelzipcode Ent Type Recall: 0.7586
- Hotelzipcode Ent Type F1: 0.3083
- Hotelzipcode Partial Precision: 0.1896
- Hotelzipcode Partial Recall: 0.7433
- Hotelzipcode Partial F1: 0.3021
- Hotelzipcode Exact Precision: 0.1837
- Hotelzipcode Exact Recall: 0.7202
- Hotelzipcode Exact F1: 0.2927
- Hoteltaxcode Strict Precision: 0.0348
- Hoteltaxcode Strict Recall: 0.5297
- Hoteltaxcode Strict F1: 0.0653
- Hoteltaxcode Ent Type Precision: 0.0369
- Hoteltaxcode Ent Type Recall: 0.5607
- Hoteltaxcode Ent Type F1: 0.0692
- Hoteltaxcode Partial Precision: 0.0403
- Hoteltaxcode Partial Recall: 0.6123
- Hoteltaxcode Partial F1: 0.0755
- Hoteltaxcode Exact Precision: 0.0390
- Hoteltaxcode Exact Recall: 0.5930
- Hoteltaxcode Exact F1: 0.0732
- Roomno Strict Precision: 0.2420
- Roomno Strict Recall: 0.8486
- Roomno Strict F1: 0.3766
- Roomno Ent Type Precision: 0.2438
- Roomno Ent Type Recall: 0.8548
- Roomno Ent Type F1: 0.3794
- Roomno Partial Precision: 0.2454
- Roomno Partial Recall: 0.8605
- Roomno Partial F1: 0.3819
- Roomno Exact Precision: 0.2442
- Roomno Exact Recall: 0.8564
- Roomno Exact F1: 0.3800
- Hotelvatnumber Strict Precision: 0.1279
- Hotelvatnumber Strict Recall: 0.6967
- Hotelvatnumber Strict F1: 0.2161
- Hotelvatnumber Ent Type Precision: 0.1362
- Hotelvatnumber Ent Type Recall: 0.7421
- Hotelvatnumber Ent Type F1: 0.2302
- Hotelvatnumber Partial Precision: 0.1397
- Hotelvatnumber Partial Recall: 0.7611
- Hotelvatnumber Partial F1: 0.2361
- Hotelvatnumber Exact Precision: 0.1351
- Hotelvatnumber Exact Recall: 0.7363
- Hotelvatnumber Exact F1: 0.2284
- Hotelbankaccount Strict Precision: 0.0
- Hotelbankaccount Strict Recall: 0.0
- Hotelbankaccount Strict F1: 0
- Hotelbankaccount Ent Type Precision: 0.0
- Hotelbankaccount Ent Type Recall: 0.0
- Hotelbankaccount Ent Type F1: 0
- Hotelbankaccount Partial Precision: 0.0
- Hotelbankaccount Partial Recall: 0.0
- Hotelbankaccount Partial F1: 0
- Hotelbankaccount Exact Precision: 0.0
- Hotelbankaccount Exact Recall: 0.0
- Hotelbankaccount Exact F1: 0
- Companyname Strict Precision: 0.1855
- Companyname Strict Recall: 0.7075
- Companyname Strict F1: 0.2939
- Companyname Ent Type Precision: 0.2305
- Companyname Ent Type Recall: 0.8792
- Companyname Ent Type F1: 0.3652
- Companyname Partial Precision: 0.2103
- Companyname Partial Recall: 0.8023
- Companyname Partial F1: 0.3333
- Companyname Exact Precision: 0.1864
- Companyname Exact Recall: 0.7110
- Companyname Exact F1: 0.2953
- Netamount Strict Precision: 0.0941
- Netamount Strict Recall: 0.7579
- Netamount Strict F1: 0.1674
- Netamount Ent Type Precision: 0.1059
- Netamount Ent Type Recall: 0.8532
- Netamount Ent Type F1: 0.1884
- Netamount Partial Precision: 0.1015
- Netamount Partial Recall: 0.8181
- Netamount Partial F1: 0.1807
- Netamount Exact Precision: 0.0954
- Netamount Exact Recall: 0.7683
- Netamount Exact F1: 0.1697
- Companyaddress Strict Precision: 0.1969
- Companyaddress Strict Recall: 0.7624
- Companyaddress Strict F1: 0.3130
- Companyaddress Ent Type Precision: 0.2354
- Companyaddress Ent Type Recall: 0.9114
- Companyaddress Ent Type F1: 0.3742
- Companyaddress Partial Precision: 0.2189
- Companyaddress Partial Recall: 0.8474
- Companyaddress Partial F1: 0.3479
- Companyaddress Exact Precision: 0.1980
- Companyaddress Exact Recall: 0.7664
- Companyaddress Exact F1: 0.3147
- Documenttype Strict Precision: 0.1951
- Documenttype Strict Recall: 0.7799
- Documenttype Strict F1: 0.3121
- Documenttype Ent Type Precision: 0.2122
- Documenttype Ent Type Recall: 0.8483
- Documenttype Ent Type F1: 0.3395
- Documenttype Partial Precision: 0.2039
- Documenttype Partial Recall: 0.8152
- Documenttype Partial F1: 0.3262
- Documenttype Exact Precision: 0.1953
- Documenttype Exact Recall: 0.7806
- Documenttype Exact F1: 0.3124
- Invoicenumber Strict Precision: 0.2172
- Invoicenumber Strict Recall: 0.8703
- Invoicenumber Strict F1: 0.3477
- Invoicenumber Ent Type Precision: 0.2294
- Invoicenumber Ent Type Recall: 0.9191
- Invoicenumber Ent Type F1: 0.3672
- Invoicenumber Partial Precision: 0.2252
- Invoicenumber Partial Recall: 0.9020
- Invoicenumber Partial F1: 0.3604
- Invoicenumber Exact Precision: 0.2189
- Invoicenumber Exact Recall: 0.8769
- Invoicenumber Exact F1: 0.3503
- Hotelcountry Strict Precision: 0.0529
- Hotelcountry Strict Recall: 0.7588
- Hotelcountry Strict F1: 0.0988
- Hotelcountry Ent Type Precision: 0.0537
- Hotelcountry Ent Type Recall: 0.7713
- Hotelcountry Ent Type F1: 0.1005
- Hotelcountry Partial Precision: 0.0550
- Hotelcountry Partial Recall: 0.7897
- Hotelcountry Partial F1: 0.1029
- Hotelcountry Exact Precision: 0.0545
- Hotelcountry Exact Recall: 0.7821
- Hotelcountry Exact F1: 0.1019
- Invoicedate Strict Precision: 0.2272
- Invoicedate Strict Recall: 0.9110
- Invoicedate Strict F1: 0.3637
- Invoicedate Ent Type Precision: 0.2332
- Invoicedate Ent Type Recall: 0.9349
- Invoicedate Ent Type F1: 0.3733
- Invoicedate Partial Precision: 0.2315
- Invoicedate Partial Recall: 0.9283
- Invoicedate Partial F1: 0.3706
- Invoicedate Exact Precision: 0.2285
- Invoicedate Exact Recall: 0.9162
- Invoicedate Exact F1: 0.3658
- Reservationnumber Strict Precision: 0.0306
- Reservationnumber Strict Recall: 0.5252
- Reservationnumber Strict F1: 0.0578
- Reservationnumber Ent Type Precision: 0.0318
- Reservationnumber Ent Type Recall: 0.5458
- Reservationnumber Ent Type F1: 0.0601
- Reservationnumber Partial Precision: 0.0381
- Reservationnumber Partial Recall: 0.6552
- Reservationnumber Partial F1: 0.0721
- Reservationnumber Exact Precision: 0.0369
- Reservationnumber Exact Recall: 0.6346
- Reservationnumber Exact F1: 0.0698
- Companycountry Strict Precision: 0.1476
- Companycountry Strict Recall: 0.8819
- Companycountry Strict F1: 0.2529
- Companycountry Ent Type Precision: 0.1487
- Companycountry Ent Type Recall: 0.8882
- Companycountry Ent Type F1: 0.2547
- Companycountry Partial Precision: 0.1512
- Companycountry Partial Recall: 0.9031
- Companycountry Partial F1: 0.2590
- Companycountry Exact Precision: 0.1505
- Companycountry Exact Recall: 0.8990
- Companycountry Exact F1: 0.2578
- Companyzipcode Strict Precision: 0.2304
- Companyzipcode Strict Recall: 0.9216
- Companyzipcode Strict F1: 0.3686
- Companyzipcode Ent Type Precision: 0.2364
- Companyzipcode Ent Type Recall: 0.9456
- Companyzipcode Ent Type F1: 0.3782
- Companyzipcode Partial Precision: 0.2354
- Companyzipcode Partial Recall: 0.9415
- Companyzipcode Partial F1: 0.3766
- Companyzipcode Exact Precision: 0.2317
- Companyzipcode Exact Recall: 0.9270
- Companyzipcode Exact F1: 0.3708
- Companycity Strict Precision: 0.2146
- Companycity Strict Recall: 0.8448
- Companycity Strict F1: 0.3423
- Companycity Ent Type Precision: 0.2292
- Companycity Ent Type Recall: 0.9022
- Companycity Ent Type F1: 0.3655
- Companycity Partial Precision: 0.2267
- Companycity Partial Recall: 0.8923
- Companycity Partial F1: 0.3615
- Companycity Exact Precision: 0.2185
- Companycity Exact Recall: 0.8600
- Companycity Exact F1: 0.3484
- Checkout Strict Precision: 0.2520
- Checkout Strict Recall: 0.9189
- Checkout Strict F1: 0.3955
- Checkout Ent Type Precision: 0.2559
- Checkout Ent Type Recall: 0.9331
- Checkout Ent Type F1: 0.4016
- Checkout Partial Precision: 0.2557
- Checkout Partial Recall: 0.9325
- Checkout Partial F1: 0.4014
- Checkout Exact Precision: 0.2536
- Checkout Exact Recall: 0.9250
- Checkout Exact F1: 0.3981
- Companyvatnumber Strict Precision: 0.0540
- Companyvatnumber Strict Recall: 0.6463
- Companyvatnumber Strict F1: 0.0998
- Companyvatnumber Ent Type Precision: 0.0574
- Companyvatnumber Ent Type Recall: 0.6867
- Companyvatnumber Ent Type F1: 0.1060
- Companyvatnumber Partial Precision: 0.0629
- Companyvatnumber Partial Recall: 0.7526
- Companyvatnumber Partial F1: 0.1162
- Companyvatnumber Exact Precision: 0.0609
- Companyvatnumber Exact Recall: 0.7279
- Companyvatnumber Exact F1: 0.1123
- Cardtype Strict Precision: 0.0471
- Cardtype Strict Recall: 0.5351
- Cardtype Strict F1: 0.0866
- Cardtype Ent Type Precision: 0.0526
- Cardtype Ent Type Recall: 0.5973
- Cardtype Ent Type F1: 0.0967
- Cardtype Partial Precision: 0.0500
- Cardtype Partial Recall: 0.5680
- Cardtype Partial F1: 0.0920
- Cardtype Exact Precision: 0.0473
- Cardtype Exact Recall: 0.5369
- Cardtype Exact F1: 0.0869
- Hotelcity Strict Precision: 0.1769
- Hotelcity Strict Recall: 0.6819
- Hotelcity Strict F1: 0.2809
- Hotelcity Ent Type Precision: 0.1901
- Hotelcity Ent Type Recall: 0.7331
- Hotelcity Ent Type F1: 0.3019
- Hotelcity Partial Precision: 0.1869
- Hotelcity Partial Recall: 0.7207
- Hotelcity Partial F1: 0.2968
- Hotelcity Exact Precision: 0.1793
- Hotelcity Exact Recall: 0.6914
- Hotelcity Exact F1: 0.2848
- Taxamount Strict Precision: 0.0831
- Taxamount Strict Recall: 0.7934
- Taxamount Strict F1: 0.1505
- Taxamount Ent Type Precision: 0.0931
- Taxamount Ent Type Recall: 0.8892
- Taxamount Ent Type F1: 0.1686
- Taxamount Partial Precision: 0.0884
- Taxamount Partial Recall: 0.8442
- Taxamount Partial F1: 0.1601
- Taxamount Exact Precision: 0.0834
- Taxamount Exact Recall: 0.7959
- Taxamount Exact F1: 0.1509
- Bookingnumber Strict Precision: 0.0260
- Bookingnumber Strict Recall: 0.5263
- Bookingnumber Strict F1: 0.0496
- Bookingnumber Ent Type Precision: 0.0288
- Bookingnumber Ent Type Recall: 0.5834
- Bookingnumber Ent Type F1: 0.0549
- Bookingnumber Partial Precision: 0.0332
- Bookingnumber Partial Recall: 0.6726
- Bookingnumber Partial F1: 0.0633
- Bookingnumber Exact Precision: 0.0314
- Bookingnumber Exact Recall: 0.6360
- Bookingnumber Exact F1: 0.0599
- Grossamount Strict Precision: 0.1599
- Grossamount Strict Recall: 0.6725
- Grossamount Strict F1: 0.2584
- Grossamount Ent Type Precision: 0.1749
- Grossamount Ent Type Recall: 0.7354
- Grossamount Ent Type F1: 0.2826
- Grossamount Partial Precision: 0.1690
- Grossamount Partial Recall: 0.7106
- Grossamount Partial F1: 0.2731
- Grossamount Exact Precision: 0.1611
- Grossamount Exact Recall: 0.6773
- Grossamount Exact F1: 0.2603
- Hotelname Strict Precision: 0.1053
- Hotelname Strict Recall: 0.3620
- Hotelname Strict F1: 0.1631
- Hotelname Ent Type Precision: 0.1637
- Hotelname Ent Type Recall: 0.5626
- Hotelname Ent Type F1: 0.2536
- Hotelname Partial Precision: 0.1361
- Hotelname Partial Recall: 0.4678
- Hotelname Partial F1: 0.2108
- Hotelname Exact Precision: 0.1055
- Hotelname Exact Recall: 0.3626
- Hotelname Exact F1: 0.1634
- Checkin Strict Precision: 0.2516
- Checkin Strict Recall: 0.9184
- Checkin Strict F1: 0.3949
- Checkin Ent Type Precision: 0.2564
- Checkin Ent Type Recall: 0.9359
- Checkin Ent Type F1: 0.4025
- Checkin Partial Precision: 0.2562
- Checkin Partial Recall: 0.9352
- Checkin Partial F1: 0.4022
- Checkin Exact Precision: 0.2533
- Checkin Exact Recall: 0.9249
- Checkin Exact F1: 0.3977
- Cardnumber Strict Precision: 0.0074
- Cardnumber Strict Recall: 0.3289
- Cardnumber Strict F1: 0.0144
- Cardnumber Ent Type Precision: 0.0097
- Cardnumber Ent Type Recall: 0.4344
- Cardnumber Ent Type F1: 0.0191
- Cardnumber Partial Precision: 0.0087
- Cardnumber Partial Recall: 0.3859
- Cardnumber Partial F1: 0.0169
- Cardnumber Exact Precision: 0.0075
- Cardnumber Exact Recall: 0.3327
- Cardnumber Exact F1: 0.0146
- Travellername Strict Precision: 0.1720
- Travellername Strict Recall: 0.5559
- Travellername Strict F1: 0.2627
- Travellername Ent Type Precision: 0.2337
- Travellername Ent Type Recall: 0.7556
- Travellername Ent Type F1: 0.3570
- Travellername Partial Precision: 0.2044
- Travellername Partial Recall: 0.6609
- Travellername Partial F1: 0.3123
- Travellername Exact Precision: 0.1728
- Travellername Exact Recall: 0.5586
- Travellername Exact F1: 0.2639
- Hoteladdress Strict Precision: 0.1260
- Hoteladdress Strict Recall: 0.4648
- Hoteladdress Strict F1: 0.1983
- Hoteladdress Ent Type Precision: 0.1910
- Hoteladdress Ent Type Recall: 0.7042
- Hoteladdress Ent Type F1: 0.3004
- Hoteladdress Partial Precision: 0.1602
- Hoteladdress Partial Recall: 0.5907
- Hoteladdress Partial F1: 0.2520
- Hoteladdress Exact Precision: 0.1264
- Hoteladdress Exact Recall: 0.4663
- Hoteladdress Exact F1: 0.1989
- Hotelemail Strict Precision: 0.1728
- Hotelemail Strict Recall: 0.8926
- Hotelemail Strict F1: 0.2895
- Hotelemail Ent Type Precision: 0.1795
- Hotelemail Ent Type Recall: 0.9275
- Hotelemail Ent Type F1: 0.3008
- Hotelemail Partial Precision: 0.1762
- Hotelemail Partial Recall: 0.9104
- Hotelemail Partial F1: 0.2953
- Hotelemail Exact Precision: 0.1728
- Hotelemail Exact Recall: 0.8929
- Hotelemail Exact F1: 0.2896
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 5e-05
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- gradient_accumulation_steps: 16
- total_train_batch_size: 128
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_ratio: 0.0625
- num_epochs: 8
Training results
| Training Loss | Epoch | Step | Validation Loss | Overall Strict Precision | Overall Strict Recall | Overall Strict F1 | Overall Ent Type Precision | Overall Ent Type Recall | Overall Ent Type F1 | Overall Partial Precision | Overall Partial Recall | Overall Partial F1 | Overall Exact Precision | Overall Exact Recall | Overall Exact F1 | Hotelphonenumber Strict Precision | Hotelphonenumber Strict Recall | Hotelphonenumber Strict F1 | Hotelphonenumber Ent Type Precision | Hotelphonenumber Ent Type Recall | Hotelphonenumber Ent Type F1 | Hotelphonenumber Partial Precision | Hotelphonenumber Partial Recall | Hotelphonenumber Partial F1 | Hotelphonenumber Exact Precision | Hotelphonenumber Exact Recall | Hotelphonenumber Exact F1 | Externalreservationnumber Strict Precision | Externalreservationnumber Strict Recall | Externalreservationnumber Strict F1 | Externalreservationnumber Ent Type Precision | Externalreservationnumber Ent Type Recall | Externalreservationnumber Ent Type F1 | Externalreservationnumber Partial Precision | Externalreservationnumber Partial Recall | Externalreservationnumber Partial F1 | Externalreservationnumber Exact Precision | Externalreservationnumber Exact Recall | Externalreservationnumber Exact F1 | Pagenumber Strict Precision | Pagenumber Strict Recall | Pagenumber Strict F1 | Pagenumber Ent Type Precision | Pagenumber Ent Type Recall | Pagenumber Ent Type F1 | Pagenumber Partial Precision | Pagenumber Partial Recall | Pagenumber Partial F1 | Pagenumber Exact Precision | Pagenumber Exact Recall | Pagenumber Exact F1 | Currencycode Strict Precision | Currencycode Strict Recall | Currencycode Strict F1 | Currencycode Ent Type Precision | Currencycode Ent Type Recall | Currencycode Ent Type F1 | Currencycode Partial Precision | Currencycode Partial Recall | Currencycode Partial F1 | Currencycode Exact Precision | Currencycode Exact Recall | Currencycode Exact F1 | Hotelfaxnumber Strict Precision | Hotelfaxnumber Strict Recall | Hotelfaxnumber Strict F1 | Hotelfaxnumber Ent Type Precision | Hotelfaxnumber Ent Type Recall | Hotelfaxnumber Ent Type F1 | Hotelfaxnumber Partial Precision | Hotelfaxnumber Partial Recall | Hotelfaxnumber Partial F1 | Hotelfaxnumber Exact Precision | Hotelfaxnumber Exact Recall | Hotelfaxnumber Exact F1 | Hotelzipcode Strict Precision | Hotelzipcode Strict Recall | Hotelzipcode Strict F1 | Hotelzipcode Ent Type Precision | Hotelzipcode Ent Type Recall | Hotelzipcode Ent Type F1 | Hotelzipcode Partial Precision | Hotelzipcode Partial Recall | Hotelzipcode Partial F1 | Hotelzipcode Exact Precision | Hotelzipcode Exact Recall | Hotelzipcode Exact F1 | Hoteltaxcode Strict Precision | Hoteltaxcode Strict Recall | Hoteltaxcode Strict F1 | Hoteltaxcode Ent Type Precision | Hoteltaxcode Ent Type Recall | Hoteltaxcode Ent Type F1 | Hoteltaxcode Partial Precision | Hoteltaxcode Partial Recall | Hoteltaxcode Partial F1 | Hoteltaxcode Exact Precision | Hoteltaxcode Exact Recall | Hoteltaxcode Exact F1 | Roomno Strict Precision | Roomno Strict Recall | Roomno Strict F1 | Roomno Ent Type Precision | Roomno Ent Type Recall | Roomno Ent Type F1 | Roomno Partial Precision | Roomno Partial Recall | Roomno Partial F1 | Roomno Exact Precision | Roomno Exact Recall | Roomno Exact F1 | Hotelvatnumber Strict Precision | Hotelvatnumber Strict Recall | Hotelvatnumber Strict F1 | Hotelvatnumber Ent Type Precision | Hotelvatnumber Ent Type Recall | Hotelvatnumber Ent Type F1 | Hotelvatnumber Partial Precision | Hotelvatnumber Partial Recall | Hotelvatnumber Partial F1 | Hotelvatnumber Exact Precision | Hotelvatnumber Exact Recall | Hotelvatnumber Exact F1 | Hotelbankaccount Strict Precision | Hotelbankaccount Strict Recall | Hotelbankaccount Strict F1 | Hotelbankaccount Ent Type Precision | Hotelbankaccount Ent Type Recall | Hotelbankaccount Ent Type F1 | Hotelbankaccount Partial Precision | Hotelbankaccount Partial Recall | Hotelbankaccount Partial F1 | Hotelbankaccount Exact Precision | Hotelbankaccount Exact Recall | Hotelbankaccount Exact F1 | Companyname Strict Precision | Companyname Strict Recall | Companyname Strict F1 | Companyname Ent Type Precision | Companyname Ent Type Recall | Companyname Ent Type F1 | Companyname Partial Precision | Companyname Partial Recall | Companyname Partial F1 | Companyname Exact Precision | Companyname Exact Recall | Companyname Exact F1 | Netamount Strict Precision | Netamount Strict Recall | Netamount Strict F1 | Netamount Ent Type Precision | Netamount Ent Type Recall | Netamount Ent Type F1 | Netamount Partial Precision | Netamount Partial Recall | Netamount Partial F1 | Netamount Exact Precision | Netamount Exact Recall | Netamount Exact F1 | Companyaddress Strict Precision | Companyaddress Strict Recall | Companyaddress Strict F1 | Companyaddress Ent Type Precision | Companyaddress Ent Type Recall | Companyaddress Ent Type F1 | Companyaddress Partial Precision | Companyaddress Partial Recall | Companyaddress Partial F1 | Companyaddress Exact Precision | Companyaddress Exact Recall | Companyaddress Exact F1 | Documenttype Strict Precision | Documenttype Strict Recall | Documenttype Strict F1 | Documenttype Ent Type Precision | Documenttype Ent Type Recall | Documenttype Ent Type F1 | Documenttype Partial Precision | Documenttype Partial Recall | Documenttype Partial F1 | Documenttype Exact Precision | Documenttype Exact Recall | Documenttype Exact F1 | Invoicenumber Strict Precision | Invoicenumber Strict Recall | Invoicenumber Strict F1 | Invoicenumber Ent Type Precision | Invoicenumber Ent Type Recall | Invoicenumber Ent Type F1 | Invoicenumber Partial Precision | Invoicenumber Partial Recall | Invoicenumber Partial F1 | Invoicenumber Exact Precision | Invoicenumber Exact Recall | Invoicenumber Exact F1 | Hotelcountry Strict Precision | Hotelcountry Strict Recall | Hotelcountry Strict F1 | Hotelcountry Ent Type Precision | Hotelcountry Ent Type Recall | Hotelcountry Ent Type F1 | Hotelcountry Partial Precision | Hotelcountry Partial Recall | Hotelcountry Partial F1 | Hotelcountry Exact Precision | Hotelcountry Exact Recall | Hotelcountry Exact F1 | Invoicedate Strict Precision | Invoicedate Strict Recall | Invoicedate Strict F1 | Invoicedate Ent Type Precision | Invoicedate Ent Type Recall | Invoicedate Ent Type F1 | Invoicedate Partial Precision | Invoicedate Partial Recall | Invoicedate Partial F1 | Invoicedate Exact Precision | Invoicedate Exact Recall | Invoicedate Exact F1 | Reservationnumber Strict Precision | Reservationnumber Strict Recall | Reservationnumber Strict F1 | Reservationnumber Ent Type Precision | Reservationnumber Ent Type Recall | Reservationnumber Ent Type F1 | Reservationnumber Partial Precision | Reservationnumber Partial Recall | Reservationnumber Partial F1 | Reservationnumber Exact Precision | Reservationnumber Exact Recall | Reservationnumber Exact F1 | Companycountry Strict Precision | Companycountry Strict Recall | Companycountry Strict F1 | Companycountry Ent Type Precision | Companycountry Ent Type Recall | Companycountry Ent Type F1 | Companycountry Partial Precision | Companycountry Partial Recall | Companycountry Partial F1 | Companycountry Exact Precision | Companycountry Exact Recall | Companycountry Exact F1 | Companyzipcode Strict Precision | Companyzipcode Strict Recall | Companyzipcode Strict F1 | Companyzipcode Ent Type Precision | Companyzipcode Ent Type Recall | Companyzipcode Ent Type F1 | Companyzipcode Partial Precision | Companyzipcode Partial Recall | Companyzipcode Partial F1 | Companyzipcode Exact Precision | Companyzipcode Exact Recall | Companyzipcode Exact F1 | Companycity Strict Precision | Companycity Strict Recall | Companycity Strict F1 | Companycity Ent Type Precision | Companycity Ent Type Recall | Companycity Ent Type F1 | Companycity Partial Precision | Companycity Partial Recall | Companycity Partial F1 | Companycity Exact Precision | Companycity Exact Recall | Companycity Exact F1 | Checkout Strict Precision | Checkout Strict Recall | Checkout Strict F1 | Checkout Ent Type Precision | Checkout Ent Type Recall | Checkout Ent Type F1 | Checkout Partial Precision | Checkout Partial Recall | Checkout Partial F1 | Checkout Exact Precision | Checkout Exact Recall | Checkout Exact F1 | Companyvatnumber Strict Precision | Companyvatnumber Strict Recall | Companyvatnumber Strict F1 | Companyvatnumber Ent Type Precision | Companyvatnumber Ent Type Recall | Companyvatnumber Ent Type F1 | Companyvatnumber Partial Precision | Companyvatnumber Partial Recall | Companyvatnumber Partial F1 | Companyvatnumber Exact Precision | Companyvatnumber Exact Recall | Companyvatnumber Exact F1 | Cardtype Strict Precision | Cardtype Strict Recall | Cardtype Strict F1 | Cardtype Ent Type Precision | Cardtype Ent Type Recall | Cardtype Ent Type F1 | Cardtype Partial Precision | Cardtype Partial Recall | Cardtype Partial F1 | Cardtype Exact Precision | Cardtype Exact Recall | Cardtype Exact F1 | Hotelcity Strict Precision | Hotelcity Strict Recall | Hotelcity Strict F1 | Hotelcity Ent Type Precision | Hotelcity Ent Type Recall | Hotelcity Ent Type F1 | Hotelcity Partial Precision | Hotelcity Partial Recall | Hotelcity Partial F1 | Hotelcity Exact Precision | Hotelcity Exact Recall | Hotelcity Exact F1 | Taxamount Strict Precision | Taxamount Strict Recall | Taxamount Strict F1 | Taxamount Ent Type Precision | Taxamount Ent Type Recall | Taxamount Ent Type F1 | Taxamount Partial Precision | Taxamount Partial Recall | Taxamount Partial F1 | Taxamount Exact Precision | Taxamount Exact Recall | Taxamount Exact F1 | Bookingnumber Strict Precision | Bookingnumber Strict Recall | Bookingnumber Strict F1 | Bookingnumber Ent Type Precision | Bookingnumber Ent Type Recall | Bookingnumber Ent Type F1 | Bookingnumber Partial Precision | Bookingnumber Partial Recall | Bookingnumber Partial F1 | Bookingnumber Exact Precision | Bookingnumber Exact Recall | Bookingnumber Exact F1 | Grossamount Strict Precision | Grossamount Strict Recall | Grossamount Strict F1 | Grossamount Ent Type Precision | Grossamount Ent Type Recall | Grossamount Ent Type F1 | Grossamount Partial Precision | Grossamount Partial Recall | Grossamount Partial F1 | Grossamount Exact Precision | Grossamount Exact Recall | Grossamount Exact F1 | Hotelname Strict Precision | Hotelname Strict Recall | Hotelname Strict F1 | Hotelname Ent Type Precision | Hotelname Ent Type Recall | Hotelname Ent Type F1 | Hotelname Partial Precision | Hotelname Partial Recall | Hotelname Partial F1 | Hotelname Exact Precision | Hotelname Exact Recall | Hotelname Exact F1 | Checkin Strict Precision | Checkin Strict Recall | Checkin Strict F1 | Checkin Ent Type Precision | Checkin Ent Type Recall | Checkin Ent Type F1 | Checkin Partial Precision | Checkin Partial Recall | Checkin Partial F1 | Checkin Exact Precision | Checkin Exact Recall | Checkin Exact F1 | Cardnumber Strict Precision | Cardnumber Strict Recall | Cardnumber Strict F1 | Cardnumber Ent Type Precision | Cardnumber Ent Type Recall | Cardnumber Ent Type F1 | Cardnumber Partial Precision | Cardnumber Partial Recall | Cardnumber Partial F1 | Cardnumber Exact Precision | Cardnumber Exact Recall | Cardnumber Exact F1 | Travellername Strict Precision | Travellername Strict Recall | Travellername Strict F1 | Travellername Ent Type Precision | Travellername Ent Type Recall | Travellername Ent Type F1 | Travellername Partial Precision | Travellername Partial Recall | Travellername Partial F1 | Travellername Exact Precision | Travellername Exact Recall | Travellername Exact F1 | Hoteladdress Strict Precision | Hoteladdress Strict Recall | Hoteladdress Strict F1 | Hoteladdress Ent Type Precision | Hoteladdress Ent Type Recall | Hoteladdress Ent Type F1 | Hoteladdress Partial Precision | Hoteladdress Partial Recall | Hoteladdress Partial F1 | Hoteladdress Exact Precision | Hoteladdress Exact Recall | Hoteladdress Exact F1 | Hotelemail Strict Precision | Hotelemail Strict Recall | Hotelemail Strict F1 | Hotelemail Ent Type Precision | Hotelemail Ent Type Recall | Hotelemail Ent Type F1 | Hotelemail Partial Precision | Hotelemail Partial Recall | Hotelemail Partial F1 | Hotelemail Exact Precision | Hotelemail Exact Recall | Hotelemail Exact F1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0.5721 | 0.9998 | 576 | 0.2043 | 0.7403 | 0.7252 | 0.7327 | 0.8263 | 0.8094 | 0.8178 | 0.7964 | 0.7801 | 0.7882 | 0.7507 | 0.7354 | 0.7429 | 0.1452 | 0.7731 | 0.2444 | 0.1715 | 0.9133 | 0.2888 | 0.1586 | 0.8447 | 0.2671 | 0.1453 | 0.7739 | 0.2447 | 0.0 | 0.0 | 0 | 0.0002 | 0.1010 | 0.0004 | 0.0007 | 0.3636 | 0.0013 | 0.0 | 0.0 | 0 | 0.1120 | 0.8268 | 0.1972 | 0.1129 | 0.8334 | 0.1988 | 0.1125 | 0.8309 | 0.1982 | 0.1121 | 0.8274 | 0.1974 | 0.0499 | 0.6102 | 0.0923 | 0.0499 | 0.6104 | 0.0923 | 0.0499 | 0.6106 | 0.0923 | 0.0499 | 0.6104 | 0.0923 | 0.1056 | 0.8089 | 0.1868 | 0.1189 | 0.9111 | 0.2104 | 0.1123 | 0.8601 | 0.1986 | 0.1056 | 0.8091 | 0.1868 | 0.1476 | 0.6951 | 0.2436 | 0.1578 | 0.7429 | 0.2603 | 0.1538 | 0.7240 | 0.2537 | 0.1484 | 0.6985 | 0.2448 | 0.0302 | 0.5380 | 0.0571 | 0.0327 | 0.5829 | 0.0619 | 0.0341 | 0.6084 | 0.0646 | 0.0325 | 0.5804 | 0.0616 | 0.2158 | 0.8195 | 0.3417 | 0.2200 | 0.8353 | 0.3483 | 0.2196 | 0.8336 | 0.3476 | 0.2174 | 0.8254 | 0.3442 | 0.1124 | 0.6815 | 0.1930 | 0.1212 | 0.7344 | 0.2080 | 0.1237 | 0.7498 | 0.2124 | 0.1187 | 0.7192 | 0.2037 | 0.0 | 0 | 0 | 0.0 | 0 | 0 | 0.0 | 0 | 0 | 0.0 | 0 | 0 | 0.1615 | 0.7010 | 0.2625 | 0.2026 | 0.8796 | 0.3294 | 0.1837 | 0.7973 | 0.2985 | 0.1621 | 0.7037 | 0.2635 | 0.0700 | 0.6381 | 0.1262 | 0.0832 | 0.7579 | 0.1499 | 0.0801 | 0.7297 | 0.1443 | 0.0728 | 0.6634 | 0.1312 | 0.1760 | 0.7626 | 0.2860 | 0.2091 | 0.9058 | 0.3397 | 0.1949 | 0.8445 | 0.3167 | 0.1773 | 0.7683 | 0.2881 | 0.1685 | 0.7727 | 0.2767 | 0.1834 | 0.8408 | 0.3011 | 0.1762 | 0.8080 | 0.2894 | 0.1687 | 0.7734 | 0.2770 | 0.1926 | 0.8461 | 0.3137 | 0.2065 | 0.9071 | 0.3364 | 0.2013 | 0.8845 | 0.3280 | 0.1942 | 0.8532 | 0.3163 | 0.0434 | 0.7572 | 0.0821 | 0.0443 | 0.7719 | 0.0837 | 0.0453 | 0.7902 | 0.0857 | 0.0448 | 0.7815 | 0.0848 | 0.2037 | 0.8776 | 0.3307 | 0.2102 | 0.9056 | 0.3412 | 0.2093 | 0.9016 | 0.3397 | 0.2058 | 0.8868 | 0.3341 | 0.0290 | 0.4624 | 0.0545 | 0.0306 | 0.4890 | 0.0577 | 0.0406 | 0.6476 | 0.0764 | 0.0389 | 0.6213 | 0.0733 | 0.1305 | 0.8409 | 0.2260 | 0.1314 | 0.8466 | 0.2275 | 0.1355 | 0.8730 | 0.2346 | 0.1349 | 0.8691 | 0.2336 | 0.2039 | 0.9002 | 0.3326 | 0.2096 | 0.9252 | 0.3418 | 0.2099 | 0.9263 | 0.3422 | 0.2061 | 0.9095 | 0.3360 | 0.1911 | 0.8290 | 0.3106 | 0.2032 | 0.8815 | 0.3303 | 0.2020 | 0.8765 | 0.3284 | 0.1951 | 0.8463 | 0.3171 | 0.2300 | 0.8990 | 0.3663 | 0.2335 | 0.9127 | 0.3719 | 0.2328 | 0.9100 | 0.3708 | 0.2310 | 0.9027 | 0.3678 | 0.0394 | 0.6611 | 0.0743 | 0.0434 | 0.7298 | 0.0820 | 0.0451 | 0.7579 | 0.0852 | 0.0425 | 0.7138 | 0.0802 | 0.0371 | 0.5319 | 0.0694 | 0.0412 | 0.5903 | 0.0771 | 0.0392 | 0.5616 | 0.0733 | 0.0372 | 0.5324 | 0.0695 | 0.1429 | 0.6321 | 0.2331 | 0.1584 | 0.7006 | 0.2584 | 0.1541 | 0.6814 | 0.2513 | 0.1454 | 0.6429 | 0.2371 | 0.0649 | 0.6322 | 0.1177 | 0.0790 | 0.7697 | 0.1434 | 0.0747 | 0.7274 | 0.1355 | 0.0670 | 0.6522 | 0.1215 | 0.0224 | 0.4624 | 0.0427 | 0.0285 | 0.5886 | 0.0543 | 0.0291 | 0.6017 | 0.0555 | 0.0256 | 0.5283 | 0.0488 | 0.1045 | 0.6625 | 0.1805 | 0.1172 | 0.7431 | 0.2025 | 0.1119 | 0.7093 | 0.1933 | 0.1054 | 0.6684 | 0.1821 | 0.0789 | 0.3257 | 0.1270 | 0.1331 | 0.5494 | 0.2143 | 0.1073 | 0.4430 | 0.1728 | 0.0791 | 0.3264 | 0.1273 | 0.2307 | 0.8917 | 0.3666 | 0.2354 | 0.9097 | 0.3740 | 0.2350 | 0.9081 | 0.3734 | 0.2323 | 0.8978 | 0.3691 | 0.0066 | 0.4123 | 0.0131 | 0.0085 | 0.5296 | 0.0168 | 0.0076 | 0.4738 | 0.0150 | 0.0067 | 0.4146 | 0.0131 | 0.1545 | 0.5096 | 0.2371 | 0.2144 | 0.7073 | 0.3291 | 0.1860 | 0.6137 | 0.2855 | 0.1553 | 0.5122 | 0.2383 | 0.1008 | 0.4545 | 0.1649 | 0.1554 | 0.7012 | 0.2545 | 0.1293 | 0.5833 | 0.2117 | 0.1010 | 0.4559 | 0.1654 | 0.1506 | 0.8732 | 0.2569 | 0.1574 | 0.9126 | 0.2685 | 0.1540 | 0.8932 | 0.2628 | 0.1506 | 0.8735 | 0.2570 |
| 0.1328 | 1.9996 | 1152 | 0.2222 | 0.7537 | 0.7424 | 0.7480 | 0.8339 | 0.8214 | 0.8276 | 0.8059 | 0.7937 | 0.7997 | 0.7632 | 0.7517 | 0.7574 | 0.1500 | 0.7686 | 0.2510 | 0.1779 | 0.9113 | 0.2977 | 0.1644 | 0.8421 | 0.2750 | 0.1503 | 0.7699 | 0.2515 | 0.0018 | 0.2044 | 0.0035 | 0.0034 | 0.3868 | 0.0067 | 0.0050 | 0.5736 | 0.0099 | 0.0039 | 0.4440 | 0.0077 | 0.1170 | 0.8386 | 0.2053 | 0.1180 | 0.8461 | 0.2072 | 0.1176 | 0.8431 | 0.2064 | 0.1171 | 0.8393 | 0.2055 | 0.0717 | 0.5446 | 0.1267 | 0.0724 | 0.5497 | 0.1279 | 0.0721 | 0.5478 | 0.1275 | 0.0717 | 0.5448 | 0.1268 | 0.1091 | 0.8025 | 0.1921 | 0.1238 | 0.9104 | 0.2179 | 0.1166 | 0.8575 | 0.2053 | 0.1092 | 0.8029 | 0.1922 | 0.1669 | 0.6940 | 0.2691 | 0.1773 | 0.7375 | 0.2859 | 0.1738 | 0.7227 | 0.2802 | 0.1682 | 0.6994 | 0.2711 | 0.0313 | 0.5428 | 0.0592 | 0.0341 | 0.5918 | 0.0645 | 0.0358 | 0.6208 | 0.0677 | 0.0342 | 0.5928 | 0.0646 | 0.2085 | 0.8908 | 0.3379 | 0.2100 | 0.8971 | 0.3403 | 0.2109 | 0.9011 | 0.3418 | 0.2100 | 0.8973 | 0.3404 | 0.1144 | 0.6941 | 0.1965 | 0.1221 | 0.7405 | 0.2096 | 0.1240 | 0.7523 | 0.2130 | 0.1199 | 0.7272 | 0.2058 | 0.0 | 0 | 0 | 0.0 | 0 | 0 | 0.0 | 0 | 0 | 0.0 | 0 | 0 | 0.1715 | 0.7168 | 0.2767 | 0.2120 | 0.8862 | 0.3421 | 0.1940 | 0.8113 | 0.3132 | 0.1723 | 0.7205 | 0.2781 | 0.0784 | 0.7601 | 0.1421 | 0.0901 | 0.8741 | 0.1634 | 0.0855 | 0.8295 | 0.1551 | 0.0795 | 0.7711 | 0.1442 | 0.1829 | 0.7685 | 0.2955 | 0.2163 | 0.9088 | 0.3494 | 0.2017 | 0.8474 | 0.3258 | 0.1839 | 0.7726 | 0.2970 | 0.1787 | 0.7774 | 0.2906 | 0.1941 | 0.8446 | 0.3157 | 0.1868 | 0.8125 | 0.3037 | 0.1789 | 0.7784 | 0.2910 | 0.1987 | 0.8581 | 0.3227 | 0.2122 | 0.9161 | 0.3445 | 0.2071 | 0.8943 | 0.3363 | 0.2002 | 0.8643 | 0.3250 | 0.0471 | 0.7737 | 0.0888 | 0.0477 | 0.7833 | 0.0899 | 0.0487 | 0.8002 | 0.0918 | 0.0484 | 0.7945 | 0.0912 | 0.2078 | 0.9062 | 0.3380 | 0.2138 | 0.9325 | 0.3478 | 0.2122 | 0.9254 | 0.3452 | 0.2091 | 0.9119 | 0.3402 | 0.0292 | 0.5340 | 0.0554 | 0.0313 | 0.5720 | 0.0593 | 0.0380 | 0.6954 | 0.0721 | 0.0362 | 0.6614 | 0.0686 | 0.1347 | 0.8697 | 0.2333 | 0.1365 | 0.8814 | 0.2365 | 0.1391 | 0.8978 | 0.2408 | 0.1380 | 0.8905 | 0.2389 | 0.2115 | 0.9066 | 0.3429 | 0.2173 | 0.9318 | 0.3524 | 0.2172 | 0.9311 | 0.3522 | 0.2133 | 0.9146 | 0.3459 | 0.1988 | 0.8479 | 0.3221 | 0.2101 | 0.8963 | 0.3404 | 0.2087 | 0.8904 | 0.3382 | 0.2025 | 0.8636 | 0.3280 | 0.2308 | 0.9172 | 0.3688 | 0.2344 | 0.9315 | 0.3746 | 0.2341 | 0.9303 | 0.3741 | 0.2322 | 0.9228 | 0.3711 | 0.0489 | 0.6232 | 0.0907 | 0.0540 | 0.6875 | 0.1001 | 0.0585 | 0.7444 | 0.1084 | 0.0551 | 0.7022 | 0.1023 | 0.0396 | 0.5531 | 0.0738 | 0.0437 | 0.6114 | 0.0816 | 0.0417 | 0.5828 | 0.0778 | 0.0396 | 0.5536 | 0.0739 | 0.1591 | 0.6490 | 0.2556 | 0.1728 | 0.7047 | 0.2775 | 0.1698 | 0.6926 | 0.2727 | 0.1619 | 0.6606 | 0.2601 | 0.0724 | 0.8014 | 0.1328 | 0.0812 | 0.8984 | 0.1489 | 0.0773 | 0.8553 | 0.1417 | 0.0728 | 0.8057 | 0.1335 | 0.0240 | 0.5646 | 0.0460 | 0.0285 | 0.6714 | 0.0547 | 0.0295 | 0.6949 | 0.0566 | 0.0268 | 0.6318 | 0.0515 | 0.1351 | 0.6769 | 0.2253 | 0.1499 | 0.7506 | 0.2498 | 0.1439 | 0.7209 | 0.2399 | 0.1364 | 0.6831 | 0.2274 | 0.0901 | 0.3395 | 0.1424 | 0.1411 | 0.5318 | 0.2230 | 0.1176 | 0.4431 | 0.1858 | 0.0904 | 0.3406 | 0.1428 | 0.2317 | 0.9155 | 0.3698 | 0.2363 | 0.9339 | 0.3772 | 0.2358 | 0.9317 | 0.3763 | 0.2331 | 0.9210 | 0.3720 | 0.0057 | 0.3271 | 0.0112 | 0.0079 | 0.4559 | 0.0156 | 0.0069 | 0.3943 | 0.0135 | 0.0057 | 0.3293 | 0.0112 | 0.1480 | 0.5711 | 0.2351 | 0.1997 | 0.7704 | 0.3172 | 0.1749 | 0.6745 | 0.2777 | 0.1486 | 0.5732 | 0.2360 | 0.1177 | 0.4732 | 0.1886 | 0.1736 | 0.6978 | 0.2781 | 0.1477 | 0.5938 | 0.2366 | 0.1183 | 0.4754 | 0.1894 | 0.1579 | 0.8760 | 0.2676 | 0.1640 | 0.9101 | 0.2780 | 0.1610 | 0.8934 | 0.2729 | 0.1579 | 0.8763 | 0.2676 |
| 0.1048 | 2.9993 | 1728 | 0.2277 | 0.7761 | 0.7260 | 0.7502 | 0.8574 | 0.8020 | 0.8287 | 0.8304 | 0.7767 | 0.8027 | 0.7872 | 0.7364 | 0.7610 | 0.1738 | 0.7657 | 0.2833 | 0.2068 | 0.9109 | 0.3370 | 0.1905 | 0.8394 | 0.3106 | 0.1739 | 0.7664 | 0.2835 | 0.0083 | 0.3355 | 0.0161 | 0.0090 | 0.3641 | 0.0175 | 0.0147 | 0.5966 | 0.0287 | 0.0137 | 0.5555 | 0.0267 | 0.1374 | 0.8319 | 0.2359 | 0.1386 | 0.8388 | 0.2378 | 0.1381 | 0.8362 | 0.2371 | 0.1376 | 0.8327 | 0.2361 | 0.1088 | 0.4961 | 0.1784 | 0.1093 | 0.4985 | 0.1793 | 0.1091 | 0.4976 | 0.1790 | 0.1088 | 0.4964 | 0.1785 | 0.1283 | 0.7935 | 0.2209 | 0.1452 | 0.8980 | 0.2500 | 0.1369 | 0.8470 | 0.2358 | 0.1285 | 0.7945 | 0.2212 | 0.1914 | 0.72 | 0.3025 | 0.2030 | 0.7637 | 0.3208 | 0.1990 | 0.7484 | 0.3144 | 0.1927 | 0.7248 | 0.3045 | 0.0407 | 0.5048 | 0.0753 | 0.0432 | 0.5362 | 0.0800 | 0.0467 | 0.5789 | 0.0864 | 0.0453 | 0.5618 | 0.0838 | 0.2577 | 0.8083 | 0.3908 | 0.2592 | 0.8131 | 0.3931 | 0.2617 | 0.8209 | 0.3969 | 0.2605 | 0.8172 | 0.3951 | 0.1382 | 0.6711 | 0.2292 | 0.1474 | 0.7156 | 0.2444 | 0.1517 | 0.7368 | 0.2517 | 0.1465 | 0.7115 | 0.2430 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.1977 | 0.7163 | 0.3098 | 0.2433 | 0.8817 | 0.3814 | 0.2226 | 0.8069 | 0.3490 | 0.1985 | 0.7193 | 0.3111 | 0.0984 | 0.7252 | 0.1733 | 0.1116 | 0.8223 | 0.1965 | 0.1077 | 0.7940 | 0.1897 | 0.1006 | 0.7417 | 0.1772 | 0.2108 | 0.7746 | 0.3314 | 0.2485 | 0.9134 | 0.3907 | 0.2320 | 0.8526 | 0.3647 | 0.2120 | 0.7793 | 0.3334 | 0.2066 | 0.7723 | 0.3260 | 0.2241 | 0.8378 | 0.3536 | 0.2157 | 0.8064 | 0.3404 | 0.2069 | 0.7732 | 0.3264 | 0.2308 | 0.8487 | 0.3629 | 0.2454 | 0.9022 | 0.3858 | 0.2401 | 0.8828 | 0.3775 | 0.2325 | 0.8550 | 0.3656 | 0.0561 | 0.7626 | 0.1046 | 0.0571 | 0.7753 | 0.1063 | 0.0586 | 0.7962 | 0.1092 | 0.0581 | 0.7888 | 0.1082 | 0.2409 | 0.9111 | 0.3810 | 0.2464 | 0.9320 | 0.3897 | 0.2454 | 0.9282 | 0.3882 | 0.2426 | 0.9175 | 0.3837 | 0.0377 | 0.4647 | 0.0698 | 0.0391 | 0.4822 | 0.0724 | 0.0506 | 0.6236 | 0.0936 | 0.0487 | 0.5998 | 0.0901 | 0.1576 | 0.8772 | 0.2672 | 0.1589 | 0.8846 | 0.2694 | 0.1614 | 0.8983 | 0.2736 | 0.1606 | 0.8939 | 0.2723 | 0.2433 | 0.9185 | 0.3846 | 0.2492 | 0.9409 | 0.3940 | 0.2484 | 0.9379 | 0.3928 | 0.2446 | 0.9237 | 0.3868 | 0.2268 | 0.8352 | 0.3567 | 0.2424 | 0.8928 | 0.3813 | 0.2399 | 0.8833 | 0.3773 | 0.2309 | 0.8503 | 0.3632 | 0.2679 | 0.9031 | 0.4132 | 0.2711 | 0.9138 | 0.4181 | 0.2716 | 0.9156 | 0.4189 | 0.2698 | 0.9097 | 0.4162 | 0.0578 | 0.6447 | 0.1060 | 0.0613 | 0.6841 | 0.1125 | 0.0665 | 0.7424 | 0.1221 | 0.0643 | 0.7178 | 0.1180 | 0.0526 | 0.5024 | 0.0952 | 0.0586 | 0.5595 | 0.1061 | 0.0557 | 0.5320 | 0.1009 | 0.0527 | 0.5034 | 0.0954 | 0.1842 | 0.6696 | 0.2890 | 0.1988 | 0.7225 | 0.3118 | 0.1953 | 0.7099 | 0.3064 | 0.1870 | 0.6795 | 0.2933 | 0.0873 | 0.7812 | 0.1570 | 0.0986 | 0.8822 | 0.1773 | 0.0934 | 0.8359 | 0.1680 | 0.0877 | 0.7846 | 0.1577 | 0.0362 | 0.5138 | 0.0677 | 0.0394 | 0.5594 | 0.0737 | 0.0448 | 0.635 | 0.0836 | 0.0426 | 0.6044 | 0.0796 | 0.1684 | 0.6586 | 0.2682 | 0.1842 | 0.7205 | 0.2934 | 0.1779 | 0.6957 | 0.2833 | 0.1697 | 0.6637 | 0.2703 | 0.1115 | 0.3385 | 0.1677 | 0.1791 | 0.5438 | 0.2694 | 0.1471 | 0.4469 | 0.2214 | 0.1116 | 0.3390 | 0.1680 | 0.2663 | 0.9089 | 0.4119 | 0.2709 | 0.9248 | 0.4191 | 0.2708 | 0.9244 | 0.4189 | 0.2681 | 0.9149 | 0.4146 | 0.0085 | 0.3272 | 0.0166 | 0.0114 | 0.4395 | 0.0223 | 0.0101 | 0.3890 | 0.0197 | 0.0086 | 0.3316 | 0.0168 | 0.1833 | 0.5214 | 0.2712 | 0.2524 | 0.7178 | 0.3735 | 0.2195 | 0.6242 | 0.3248 | 0.1841 | 0.5236 | 0.2724 | 0.1399 | 0.4976 | 0.2184 | 0.2019 | 0.7176 | 0.3151 | 0.1733 | 0.6160 | 0.2704 | 0.1408 | 0.5007 | 0.2198 | 0.1820 | 0.8862 | 0.3019 | 0.1895 | 0.9230 | 0.3145 | 0.1858 | 0.9049 | 0.3083 | 0.1820 | 0.8864 | 0.3020 |
| 0.0892 | 3.9991 | 2304 | 0.2383 | 0.7649 | 0.7433 | 0.7539 | 0.8457 | 0.8218 | 0.8336 | 0.8171 | 0.7940 | 0.8054 | 0.7743 | 0.7525 | 0.7632 | 0.1590 | 0.7660 | 0.2634 | 0.1898 | 0.9143 | 0.3144 | 0.1746 | 0.8410 | 0.2892 | 0.1592 | 0.7667 | 0.2636 | 0.0028 | 0.2935 | 0.0055 | 0.0032 | 0.3348 | 0.0063 | 0.0054 | 0.5663 | 0.0107 | 0.0050 | 0.5283 | 0.0100 | 0.1243 | 0.8401 | 0.2166 | 0.1253 | 0.8471 | 0.2184 | 0.1249 | 0.8442 | 0.2176 | 0.1244 | 0.8405 | 0.2167 | 0.0811 | 0.5389 | 0.1410 | 0.0815 | 0.5417 | 0.1418 | 0.0814 | 0.5406 | 0.1415 | 0.0811 | 0.5390 | 0.1411 | 0.1166 | 0.7975 | 0.2034 | 0.1321 | 0.9036 | 0.2305 | 0.1246 | 0.8522 | 0.2174 | 0.1167 | 0.7986 | 0.2037 | 0.1807 | 0.7243 | 0.2892 | 0.1912 | 0.7665 | 0.3061 | 0.1875 | 0.7514 | 0.3000 | 0.1817 | 0.7285 | 0.2909 | 0.0283 | 0.4699 | 0.0533 | 0.0306 | 0.5097 | 0.0578 | 0.0339 | 0.5632 | 0.0639 | 0.0324 | 0.5388 | 0.0611 | 0.2348 | 0.8509 | 0.3680 | 0.2363 | 0.8565 | 0.3704 | 0.2379 | 0.8621 | 0.3729 | 0.2369 | 0.8588 | 0.3714 | 0.1237 | 0.7047 | 0.2105 | 0.1315 | 0.7492 | 0.2238 | 0.1342 | 0.7642 | 0.2283 | 0.1297 | 0.7386 | 0.2206 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.1817 | 0.7193 | 0.2901 | 0.2248 | 0.8900 | 0.3589 | 0.2052 | 0.8125 | 0.3277 | 0.1825 | 0.7226 | 0.2914 | 0.0921 | 0.7552 | 0.1641 | 0.1030 | 0.8451 | 0.1837 | 0.0993 | 0.8145 | 0.1770 | 0.0936 | 0.7679 | 0.1669 | 0.1942 | 0.7740 | 0.3105 | 0.2299 | 0.9162 | 0.3675 | 0.2144 | 0.8545 | 0.3428 | 0.1953 | 0.7783 | 0.3122 | 0.1911 | 0.7710 | 0.3063 | 0.2082 | 0.8400 | 0.3337 | 0.2000 | 0.8068 | 0.3206 | 0.1914 | 0.7720 | 0.3067 | 0.2091 | 0.8677 | 0.3370 | 0.2212 | 0.9177 | 0.3565 | 0.2170 | 0.9002 | 0.3497 | 0.2108 | 0.8744 | 0.3396 | 0.0515 | 0.7767 | 0.0965 | 0.0521 | 0.7862 | 0.0977 | 0.0533 | 0.8047 | 0.1000 | 0.0530 | 0.7993 | 0.0993 | 0.2227 | 0.9151 | 0.3583 | 0.2281 | 0.9374 | 0.3670 | 0.2267 | 0.9315 | 0.3647 | 0.2240 | 0.9202 | 0.3603 | 0.0287 | 0.5599 | 0.0546 | 0.0303 | 0.5912 | 0.0576 | 0.0361 | 0.7052 | 0.0687 | 0.0345 | 0.6735 | 0.0656 | 0.1440 | 0.8842 | 0.2476 | 0.1451 | 0.8914 | 0.2496 | 0.1476 | 0.9064 | 0.2538 | 0.1468 | 0.9018 | 0.2525 | 0.2252 | 0.9211 | 0.3619 | 0.2306 | 0.9431 | 0.3705 | 0.2299 | 0.9404 | 0.3695 | 0.2266 | 0.9270 | 0.3642 | 0.2096 | 0.8447 | 0.3359 | 0.2237 | 0.9013 | 0.3584 | 0.2213 | 0.8919 | 0.3546 | 0.2134 | 0.8600 | 0.3420 | 0.2440 | 0.9226 | 0.3859 | 0.2480 | 0.9379 | 0.3923 | 0.2476 | 0.9361 | 0.3916 | 0.2455 | 0.9281 | 0.3882 | 0.0516 | 0.6581 | 0.0957 | 0.0555 | 0.7070 | 0.1028 | 0.0598 | 0.7623 | 0.1109 | 0.0574 | 0.7321 | 0.1065 | 0.0471 | 0.5220 | 0.0864 | 0.0534 | 0.5915 | 0.0979 | 0.0505 | 0.5593 | 0.0926 | 0.0473 | 0.5242 | 0.0867 | 0.1734 | 0.6746 | 0.2759 | 0.1874 | 0.7291 | 0.2982 | 0.1838 | 0.7151 | 0.2924 | 0.1757 | 0.6838 | 0.2796 | 0.0812 | 0.7673 | 0.1469 | 0.0912 | 0.8614 | 0.1649 | 0.0866 | 0.8176 | 0.1565 | 0.0815 | 0.7700 | 0.1474 | 0.0278 | 0.5455 | 0.0529 | 0.0306 | 0.6006 | 0.0582 | 0.0357 | 0.7005 | 0.0679 | 0.0337 | 0.6621 | 0.0642 | 0.1469 | 0.6850 | 0.2420 | 0.1620 | 0.7553 | 0.2668 | 0.1559 | 0.7266 | 0.2567 | 0.1480 | 0.6900 | 0.2438 | 0.1025 | 0.3514 | 0.1588 | 0.1612 | 0.5523 | 0.2495 | 0.1335 | 0.4574 | 0.2067 | 0.1028 | 0.3523 | 0.1592 | 0.2452 | 0.9181 | 0.3870 | 0.2503 | 0.9374 | 0.3952 | 0.2501 | 0.9363 | 0.3947 | 0.2470 | 0.9250 | 0.3899 | 0.0059 | 0.2951 | 0.0115 | 0.0081 | 0.4088 | 0.0159 | 0.0071 | 0.3561 | 0.0138 | 0.0059 | 0.2982 | 0.0116 | 0.1675 | 0.5620 | 0.2581 | 0.2269 | 0.7614 | 0.3497 | 0.1985 | 0.6661 | 0.3059 | 0.1682 | 0.5642 | 0.2591 | 0.1291 | 0.4844 | 0.2039 | 0.1887 | 0.7082 | 0.2980 | 0.1609 | 0.6036 | 0.2540 | 0.1296 | 0.4862 | 0.2046 | 0.1680 | 0.8842 | 0.2824 | 0.1750 | 0.9211 | 0.2942 | 0.1716 | 0.9030 | 0.2884 | 0.1681 | 0.8845 | 0.2825 |
| 0.0792 | 4.9989 | 2880 | 0.2490 | 0.7688 | 0.7417 | 0.7550 | 0.8497 | 0.8197 | 0.8345 | 0.8213 | 0.7923 | 0.8066 | 0.7784 | 0.7509 | 0.7644 | 0.1619 | 0.7628 | 0.2671 | 0.1940 | 0.9141 | 0.3201 | 0.1781 | 0.8393 | 0.2939 | 0.1620 | 0.7634 | 0.2673 | 0.0038 | 0.3496 | 0.0076 | 0.0046 | 0.4199 | 0.0091 | 0.0070 | 0.6416 | 0.0139 | 0.0064 | 0.5820 | 0.0126 | 0.1289 | 0.8354 | 0.2233 | 0.1299 | 0.8421 | 0.2252 | 0.1295 | 0.8393 | 0.2244 | 0.1290 | 0.8357 | 0.2234 | 0.0896 | 0.5243 | 0.1531 | 0.0902 | 0.5275 | 0.1540 | 0.0900 | 0.5262 | 0.1536 | 0.0897 | 0.5246 | 0.1532 | 0.1185 | 0.7943 | 0.2062 | 0.1357 | 0.9097 | 0.2362 | 0.1272 | 0.8528 | 0.2214 | 0.1186 | 0.7949 | 0.2063 | 0.1850 | 0.7209 | 0.2944 | 0.1954 | 0.7617 | 0.3111 | 0.1917 | 0.7470 | 0.3051 | 0.1859 | 0.7244 | 0.2959 | 0.0354 | 0.5296 | 0.0664 | 0.0376 | 0.5620 | 0.0705 | 0.0405 | 0.6048 | 0.0758 | 0.0391 | 0.5851 | 0.0734 | 0.2432 | 0.8434 | 0.3776 | 0.2450 | 0.8495 | 0.3803 | 0.2464 | 0.8543 | 0.3824 | 0.2452 | 0.8501 | 0.3806 | 0.1294 | 0.6787 | 0.2174 | 0.1381 | 0.7243 | 0.2320 | 0.1430 | 0.7499 | 0.2402 | 0.1379 | 0.7233 | 0.2317 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.1877 | 0.7246 | 0.2982 | 0.2304 | 0.8893 | 0.3660 | 0.2111 | 0.8147 | 0.3353 | 0.1886 | 0.7278 | 0.2995 | 0.0956 | 0.7459 | 0.1696 | 0.1074 | 0.8375 | 0.1904 | 0.1033 | 0.8057 | 0.1831 | 0.0971 | 0.7573 | 0.1721 | 0.2003 | 0.7756 | 0.3184 | 0.2356 | 0.9125 | 0.3745 | 0.2213 | 0.8570 | 0.3518 | 0.2021 | 0.7826 | 0.3212 | 0.1938 | 0.7758 | 0.3102 | 0.2116 | 0.8470 | 0.3386 | 0.2030 | 0.8125 | 0.3249 | 0.1940 | 0.7766 | 0.3105 | 0.2179 | 0.8622 | 0.3479 | 0.2306 | 0.9125 | 0.3682 | 0.2261 | 0.8945 | 0.3609 | 0.2195 | 0.8685 | 0.3504 | 0.0521 | 0.7835 | 0.0976 | 0.0529 | 0.7960 | 0.0992 | 0.0540 | 0.8132 | 0.1013 | 0.0536 | 0.8064 | 0.1005 | 0.2266 | 0.9083 | 0.3627 | 0.2325 | 0.9319 | 0.3722 | 0.2308 | 0.9253 | 0.3695 | 0.2279 | 0.9133 | 0.3647 | 0.0284 | 0.5494 | 0.0540 | 0.0299 | 0.5795 | 0.0569 | 0.0353 | 0.6832 | 0.0671 | 0.0339 | 0.6565 | 0.0645 | 0.1475 | 0.8796 | 0.2527 | 0.1487 | 0.8865 | 0.2546 | 0.1517 | 0.9044 | 0.2598 | 0.1509 | 0.8999 | 0.2585 | 0.2305 | 0.9143 | 0.3681 | 0.2362 | 0.9371 | 0.3773 | 0.2359 | 0.9358 | 0.3768 | 0.2324 | 0.9220 | 0.3712 | 0.2159 | 0.8461 | 0.3440 | 0.2290 | 0.8977 | 0.3650 | 0.2274 | 0.8912 | 0.3623 | 0.2199 | 0.8619 | 0.3504 | 0.2505 | 0.9155 | 0.3934 | 0.2548 | 0.9312 | 0.4001 | 0.2545 | 0.9300 | 0.3996 | 0.2521 | 0.9214 | 0.3959 | 0.0482 | 0.6763 | 0.0901 | 0.0517 | 0.7252 | 0.0966 | 0.0541 | 0.7587 | 0.1010 | 0.0522 | 0.7312 | 0.0974 | 0.0464 | 0.5379 | 0.0855 | 0.0528 | 0.6120 | 0.0973 | 0.0498 | 0.5764 | 0.0916 | 0.0466 | 0.5393 | 0.0857 | 0.1787 | 0.6763 | 0.2827 | 0.1928 | 0.7294 | 0.3049 | 0.1893 | 0.7162 | 0.2994 | 0.1812 | 0.6857 | 0.2867 | 0.0835 | 0.7683 | 0.1506 | 0.0946 | 0.8701 | 0.1706 | 0.0893 | 0.8220 | 0.1612 | 0.0838 | 0.7706 | 0.1511 | 0.0284 | 0.5371 | 0.0540 | 0.0314 | 0.5926 | 0.0596 | 0.0367 | 0.6932 | 0.0697 | 0.0348 | 0.6570 | 0.0661 | 0.1599 | 0.6728 | 0.2584 | 0.1759 | 0.7402 | 0.2843 | 0.1695 | 0.7135 | 0.2740 | 0.1612 | 0.6782 | 0.2604 | 0.1064 | 0.3655 | 0.1648 | 0.1637 | 0.5626 | 0.2537 | 0.1365 | 0.4691 | 0.2115 | 0.1065 | 0.3661 | 0.1651 | 0.2491 | 0.9161 | 0.3917 | 0.2544 | 0.9358 | 0.4001 | 0.2537 | 0.9329 | 0.3989 | 0.2506 | 0.9216 | 0.3940 | 0.0076 | 0.3266 | 0.0148 | 0.0101 | 0.4351 | 0.0197 | 0.0089 | 0.3845 | 0.0174 | 0.0076 | 0.3293 | 0.0149 | 0.1737 | 0.5635 | 0.2655 | 0.2348 | 0.7617 | 0.3589 | 0.2061 | 0.6687 | 0.3151 | 0.1746 | 0.5665 | 0.2669 | 0.1314 | 0.4809 | 0.2065 | 0.1943 | 0.7109 | 0.3052 | 0.1648 | 0.6028 | 0.2588 | 0.1318 | 0.4822 | 0.2070 | 0.1702 | 0.8927 | 0.2859 | 0.1778 | 0.9326 | 0.2987 | 0.1741 | 0.9129 | 0.2924 | 0.1703 | 0.8929 | 0.2860 |
| 0.0716 | 5.9987 | 3456 | 0.2608 | 0.7657 | 0.7377 | 0.7514 | 0.8483 | 0.8173 | 0.8325 | 0.8192 | 0.7892 | 0.8039 | 0.7755 | 0.7472 | 0.7611 | 0.1574 | 0.7419 | 0.2597 | 0.1928 | 0.9085 | 0.3180 | 0.1753 | 0.8263 | 0.2892 | 0.1576 | 0.7426 | 0.2600 | 0.0057 | 0.3692 | 0.0113 | 0.0064 | 0.4128 | 0.0126 | 0.0096 | 0.6172 | 0.0188 | 0.0090 | 0.5817 | 0.0177 | 0.1274 | 0.8275 | 0.2208 | 0.1284 | 0.8339 | 0.2225 | 0.1280 | 0.8315 | 0.2219 | 0.1275 | 0.8281 | 0.2210 | 0.0954 | 0.5189 | 0.1612 | 0.0958 | 0.5209 | 0.1619 | 0.0957 | 0.5203 | 0.1616 | 0.0955 | 0.5193 | 0.1613 | 0.1160 | 0.7708 | 0.2017 | 0.1346 | 0.8943 | 0.2340 | 0.1255 | 0.8339 | 0.2182 | 0.1161 | 0.7714 | 0.2019 | 0.1808 | 0.7125 | 0.2885 | 0.1918 | 0.7556 | 0.3059 | 0.1879 | 0.7403 | 0.2997 | 0.1818 | 0.7164 | 0.2900 | 0.0334 | 0.5176 | 0.0627 | 0.0357 | 0.5533 | 0.0671 | 0.0394 | 0.6106 | 0.0740 | 0.0379 | 0.5878 | 0.0713 | 0.2403 | 0.8544 | 0.3751 | 0.2418 | 0.8598 | 0.3774 | 0.2434 | 0.8656 | 0.3800 | 0.2424 | 0.8620 | 0.3784 | 0.1230 | 0.7023 | 0.2094 | 0.1319 | 0.7531 | 0.2245 | 0.1338 | 0.7638 | 0.2277 | 0.1290 | 0.7366 | 0.2196 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.1792 | 0.6894 | 0.2845 | 0.2273 | 0.8744 | 0.3608 | 0.2051 | 0.7889 | 0.3255 | 0.1800 | 0.6924 | 0.2857 | 0.0940 | 0.7492 | 0.1670 | 0.1054 | 0.8407 | 0.1873 | 0.1013 | 0.8077 | 0.1800 | 0.0953 | 0.7597 | 0.1693 | 0.1942 | 0.7647 | 0.3098 | 0.2329 | 0.9171 | 0.3715 | 0.2159 | 0.8500 | 0.3443 | 0.1953 | 0.7691 | 0.3115 | 0.1939 | 0.7712 | 0.3099 | 0.2114 | 0.8406 | 0.3378 | 0.2030 | 0.8071 | 0.3243 | 0.1941 | 0.7720 | 0.3102 | 0.2131 | 0.8641 | 0.3419 | 0.2257 | 0.9153 | 0.3622 | 0.2209 | 0.8956 | 0.3544 | 0.2144 | 0.8694 | 0.3440 | 0.0525 | 0.7565 | 0.0982 | 0.0532 | 0.7669 | 0.0996 | 0.0545 | 0.7847 | 0.1019 | 0.0540 | 0.7782 | 0.1010 | 0.2252 | 0.9082 | 0.3609 | 0.2318 | 0.9350 | 0.3715 | 0.2297 | 0.9265 | 0.3681 | 0.2263 | 0.9128 | 0.3627 | 0.0289 | 0.4839 | 0.0546 | 0.0302 | 0.5051 | 0.0569 | 0.0374 | 0.6261 | 0.0706 | 0.0360 | 0.6025 | 0.0679 | 0.1456 | 0.8837 | 0.2500 | 0.1468 | 0.8911 | 0.2520 | 0.1494 | 0.9070 | 0.2565 | 0.1486 | 0.9022 | 0.2552 | 0.2285 | 0.9256 | 0.3665 | 0.2338 | 0.9471 | 0.3751 | 0.2331 | 0.9443 | 0.3739 | 0.2299 | 0.9313 | 0.3688 | 0.2119 | 0.8433 | 0.3386 | 0.2268 | 0.9029 | 0.3626 | 0.2241 | 0.8921 | 0.3582 | 0.2156 | 0.8581 | 0.3446 | 0.2534 | 0.9170 | 0.3971 | 0.2572 | 0.9305 | 0.4029 | 0.2569 | 0.9297 | 0.4026 | 0.2549 | 0.9222 | 0.3994 | 0.0532 | 0.6422 | 0.0983 | 0.0568 | 0.6862 | 0.1050 | 0.0625 | 0.7546 | 0.1155 | 0.0602 | 0.7266 | 0.1112 | 0.0423 | 0.5444 | 0.0785 | 0.0474 | 0.6104 | 0.0880 | 0.0450 | 0.5790 | 0.0835 | 0.0424 | 0.5460 | 0.0787 | 0.1753 | 0.6763 | 0.2784 | 0.1882 | 0.7261 | 0.2989 | 0.1851 | 0.7144 | 0.2940 | 0.1776 | 0.6855 | 0.2822 | 0.0829 | 0.7808 | 0.1499 | 0.0930 | 0.8763 | 0.1682 | 0.0883 | 0.8317 | 0.1596 | 0.0832 | 0.7836 | 0.1504 | 0.0285 | 0.5313 | 0.0540 | 0.0317 | 0.5921 | 0.0602 | 0.0365 | 0.6820 | 0.0693 | 0.0344 | 0.6430 | 0.0654 | 0.1615 | 0.6681 | 0.2601 | 0.1768 | 0.7317 | 0.2848 | 0.1707 | 0.7064 | 0.2750 | 0.1626 | 0.6730 | 0.2620 | 0.1039 | 0.3646 | 0.1617 | 0.1603 | 0.5622 | 0.2494 | 0.1334 | 0.4680 | 0.2076 | 0.1041 | 0.3652 | 0.1620 | 0.2535 | 0.9078 | 0.3964 | 0.2580 | 0.9239 | 0.4034 | 0.2587 | 0.9263 | 0.4044 | 0.2560 | 0.9166 | 0.4002 | 0.0063 | 0.3322 | 0.0123 | 0.0084 | 0.4489 | 0.0166 | 0.0074 | 0.3939 | 0.0145 | 0.0063 | 0.3356 | 0.0124 | 0.1689 | 0.5677 | 0.2603 | 0.2281 | 0.7666 | 0.3516 | 0.1999 | 0.6720 | 0.3082 | 0.1696 | 0.5701 | 0.2615 | 0.1251 | 0.4658 | 0.1973 | 0.1888 | 0.7030 | 0.2977 | 0.1588 | 0.5911 | 0.2503 | 0.1256 | 0.4674 | 0.1979 | 0.1706 | 0.8868 | 0.2861 | 0.1776 | 0.9236 | 0.2980 | 0.1742 | 0.9055 | 0.2921 | 0.1706 | 0.8871 | 0.2862 |
| 0.0606 | 6.9985 | 4032 | 0.2684 | 0.7611 | 0.7409 | 0.7509 | 0.8437 | 0.8213 | 0.8323 | 0.8141 | 0.7925 | 0.8032 | 0.7706 | 0.7501 | 0.7602 | 0.1558 | 0.7580 | 0.2585 | 0.1872 | 0.9107 | 0.3105 | 0.1718 | 0.8356 | 0.2849 | 0.1560 | 0.7592 | 0.2589 | 0.0045 | 0.3510 | 0.0088 | 0.0048 | 0.3766 | 0.0094 | 0.0081 | 0.6394 | 0.0160 | 0.0076 | 0.6010 | 0.0151 | 0.1232 | 0.8324 | 0.2146 | 0.1241 | 0.8391 | 0.2163 | 0.1237 | 0.8363 | 0.2156 | 0.1232 | 0.8328 | 0.2147 | 0.0872 | 0.5301 | 0.1497 | 0.0876 | 0.5327 | 0.1505 | 0.0875 | 0.5318 | 0.1502 | 0.0872 | 0.5304 | 0.1498 | 0.1141 | 0.7875 | 0.1994 | 0.1303 | 0.8988 | 0.2275 | 0.1224 | 0.8446 | 0.2138 | 0.1143 | 0.7883 | 0.1996 | 0.1760 | 0.7189 | 0.2828 | 0.1867 | 0.7627 | 0.3000 | 0.1829 | 0.7469 | 0.2938 | 0.1770 | 0.7227 | 0.2843 | 0.0339 | 0.5373 | 0.0638 | 0.0358 | 0.5663 | 0.0673 | 0.0389 | 0.6153 | 0.0731 | 0.0377 | 0.5969 | 0.0709 | 0.2311 | 0.8686 | 0.3651 | 0.2323 | 0.8729 | 0.3669 | 0.2341 | 0.8797 | 0.3698 | 0.2332 | 0.8765 | 0.3684 | 0.1243 | 0.6905 | 0.2107 | 0.1327 | 0.7370 | 0.2248 | 0.1361 | 0.7560 | 0.2306 | 0.1314 | 0.7302 | 0.2228 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.1765 | 0.6993 | 0.2819 | 0.2220 | 0.8794 | 0.3545 | 0.2012 | 0.7970 | 0.3213 | 0.1773 | 0.7024 | 0.2831 | 0.0899 | 0.7619 | 0.1608 | 0.1009 | 0.8550 | 0.1805 | 0.0969 | 0.8211 | 0.1733 | 0.0912 | 0.7726 | 0.1631 | 0.1896 | 0.7634 | 0.3038 | 0.2270 | 0.9139 | 0.3637 | 0.2107 | 0.8482 | 0.3375 | 0.1908 | 0.7679 | 0.3056 | 0.1855 | 0.7727 | 0.2991 | 0.2028 | 0.8450 | 0.3271 | 0.1944 | 0.8099 | 0.3135 | 0.1856 | 0.7735 | 0.2994 | 0.2087 | 0.8682 | 0.3365 | 0.2207 | 0.9178 | 0.3558 | 0.2163 | 0.8996 | 0.3487 | 0.2102 | 0.8741 | 0.3388 | 0.0508 | 0.7398 | 0.0951 | 0.0516 | 0.7506 | 0.0965 | 0.0531 | 0.7728 | 0.0993 | 0.0526 | 0.7656 | 0.0984 | 0.2193 | 0.9100 | 0.3534 | 0.2250 | 0.9337 | 0.3626 | 0.2234 | 0.9271 | 0.3601 | 0.2205 | 0.9151 | 0.3554 | 0.0261 | 0.5303 | 0.0497 | 0.0274 | 0.5573 | 0.0522 | 0.0326 | 0.6640 | 0.0622 | 0.0315 | 0.6400 | 0.0600 | 0.1414 | 0.8795 | 0.2437 | 0.1427 | 0.8870 | 0.2458 | 0.1453 | 0.9035 | 0.2504 | 0.1444 | 0.8979 | 0.2488 | 0.2216 | 0.9243 | 0.3574 | 0.2276 | 0.9494 | 0.3672 | 0.2265 | 0.9447 | 0.3654 | 0.2229 | 0.9297 | 0.3596 | 0.2065 | 0.8479 | 0.3321 | 0.2204 | 0.9051 | 0.3545 | 0.2178 | 0.8945 | 0.3504 | 0.2101 | 0.8627 | 0.3379 | 0.2414 | 0.9221 | 0.3826 | 0.2451 | 0.9364 | 0.3885 | 0.2447 | 0.9349 | 0.3879 | 0.2427 | 0.9271 | 0.3847 | 0.0509 | 0.6552 | 0.0945 | 0.0542 | 0.6976 | 0.1006 | 0.0587 | 0.7549 | 0.1089 | 0.0565 | 0.7274 | 0.1049 | 0.0421 | 0.5547 | 0.0782 | 0.0466 | 0.6148 | 0.0867 | 0.0445 | 0.5868 | 0.0827 | 0.0422 | 0.5568 | 0.0785 | 0.1700 | 0.6822 | 0.2722 | 0.1832 | 0.7352 | 0.2933 | 0.1799 | 0.7218 | 0.2880 | 0.1723 | 0.6913 | 0.2758 | 0.0798 | 0.8030 | 0.1452 | 0.0889 | 0.8946 | 0.1617 | 0.0846 | 0.8515 | 0.1539 | 0.0800 | 0.8053 | 0.1456 | 0.0251 | 0.5206 | 0.0478 | 0.0278 | 0.5774 | 0.0530 | 0.0324 | 0.6732 | 0.0618 | 0.0308 | 0.6392 | 0.0587 | 0.1476 | 0.6785 | 0.2424 | 0.1619 | 0.7441 | 0.2659 | 0.1559 | 0.7169 | 0.2562 | 0.1484 | 0.6824 | 0.2438 | 0.1017 | 0.3549 | 0.1581 | 0.1582 | 0.5522 | 0.2459 | 0.1314 | 0.4585 | 0.2042 | 0.1018 | 0.3555 | 0.1583 | 0.2422 | 0.9188 | 0.3834 | 0.2471 | 0.9372 | 0.3910 | 0.2467 | 0.9360 | 0.3905 | 0.2439 | 0.9251 | 0.3860 | 0.0062 | 0.3411 | 0.0123 | 0.0084 | 0.4578 | 0.0165 | 0.0074 | 0.4039 | 0.0145 | 0.0063 | 0.3456 | 0.0124 | 0.1611 | 0.5538 | 0.2496 | 0.2219 | 0.7630 | 0.3438 | 0.1929 | 0.6633 | 0.2989 | 0.1619 | 0.5566 | 0.2508 | 0.1194 | 0.4565 | 0.1893 | 0.1840 | 0.7032 | 0.2916 | 0.1531 | 0.5851 | 0.2427 | 0.1198 | 0.4578 | 0.1899 | 0.1661 | 0.8890 | 0.2799 | 0.1729 | 0.9250 | 0.2913 | 0.1695 | 0.9073 | 0.2857 | 0.1662 | 0.8893 | 0.2800 |
| 0.0573 | 7.9983 | 4608 | 0.2753 | 0.7682 | 0.7397 | 0.7537 | 0.8497 | 0.8181 | 0.8336 | 0.8211 | 0.7906 | 0.8056 | 0.7780 | 0.7491 | 0.7633 | 0.1618 | 0.7613 | 0.2669 | 0.1942 | 0.9134 | 0.3203 | 0.1783 | 0.8387 | 0.2941 | 0.1621 | 0.7625 | 0.2674 | 0.0053 | 0.3534 | 0.0104 | 0.0056 | 0.3777 | 0.0111 | 0.0093 | 0.6259 | 0.0184 | 0.0088 | 0.5908 | 0.0173 | 0.1285 | 0.8322 | 0.2226 | 0.1295 | 0.8386 | 0.2243 | 0.1290 | 0.8358 | 0.2236 | 0.1285 | 0.8324 | 0.2226 | 0.0977 | 0.5191 | 0.1645 | 0.0982 | 0.5220 | 0.1654 | 0.0980 | 0.5209 | 0.1650 | 0.0978 | 0.5194 | 0.1646 | 0.1187 | 0.7892 | 0.2063 | 0.1358 | 0.9028 | 0.2360 | 0.1274 | 0.8470 | 0.2215 | 0.1188 | 0.7900 | 0.2066 | 0.1827 | 0.7164 | 0.2912 | 0.1935 | 0.7586 | 0.3083 | 0.1896 | 0.7433 | 0.3021 | 0.1837 | 0.7202 | 0.2927 | 0.0348 | 0.5297 | 0.0653 | 0.0369 | 0.5607 | 0.0692 | 0.0403 | 0.6123 | 0.0755 | 0.0390 | 0.5930 | 0.0732 | 0.2420 | 0.8486 | 0.3766 | 0.2438 | 0.8548 | 0.3794 | 0.2454 | 0.8605 | 0.3819 | 0.2442 | 0.8564 | 0.3800 | 0.1279 | 0.6967 | 0.2161 | 0.1362 | 0.7421 | 0.2302 | 0.1397 | 0.7611 | 0.2361 | 0.1351 | 0.7363 | 0.2284 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.0 | 0.0 | 0 | 0.1855 | 0.7075 | 0.2939 | 0.2305 | 0.8792 | 0.3652 | 0.2103 | 0.8023 | 0.3333 | 0.1864 | 0.7110 | 0.2953 | 0.0941 | 0.7579 | 0.1674 | 0.1059 | 0.8532 | 0.1884 | 0.1015 | 0.8181 | 0.1807 | 0.0954 | 0.7683 | 0.1697 | 0.1969 | 0.7624 | 0.3130 | 0.2354 | 0.9114 | 0.3742 | 0.2189 | 0.8474 | 0.3479 | 0.1980 | 0.7664 | 0.3147 | 0.1951 | 0.7799 | 0.3121 | 0.2122 | 0.8483 | 0.3395 | 0.2039 | 0.8152 | 0.3262 | 0.1953 | 0.7806 | 0.3124 | 0.2172 | 0.8703 | 0.3477 | 0.2294 | 0.9191 | 0.3672 | 0.2252 | 0.9020 | 0.3604 | 0.2189 | 0.8769 | 0.3503 | 0.0529 | 0.7588 | 0.0988 | 0.0537 | 0.7713 | 0.1005 | 0.0550 | 0.7897 | 0.1029 | 0.0545 | 0.7821 | 0.1019 | 0.2272 | 0.9110 | 0.3637 | 0.2332 | 0.9349 | 0.3733 | 0.2315 | 0.9283 | 0.3706 | 0.2285 | 0.9162 | 0.3658 | 0.0306 | 0.5252 | 0.0578 | 0.0318 | 0.5458 | 0.0601 | 0.0381 | 0.6552 | 0.0721 | 0.0369 | 0.6346 | 0.0698 | 0.1476 | 0.8819 | 0.2529 | 0.1487 | 0.8882 | 0.2547 | 0.1512 | 0.9031 | 0.2590 | 0.1505 | 0.8990 | 0.2578 | 0.2304 | 0.9216 | 0.3686 | 0.2364 | 0.9456 | 0.3782 | 0.2354 | 0.9415 | 0.3766 | 0.2317 | 0.9270 | 0.3708 | 0.2146 | 0.8448 | 0.3423 | 0.2292 | 0.9022 | 0.3655 | 0.2267 | 0.8923 | 0.3615 | 0.2185 | 0.8600 | 0.3484 | 0.2520 | 0.9189 | 0.3955 | 0.2559 | 0.9331 | 0.4016 | 0.2557 | 0.9325 | 0.4014 | 0.2536 | 0.9250 | 0.3981 | 0.0540 | 0.6463 | 0.0998 | 0.0574 | 0.6867 | 0.1060 | 0.0629 | 0.7526 | 0.1162 | 0.0609 | 0.7279 | 0.1123 | 0.0471 | 0.5351 | 0.0866 | 0.0526 | 0.5973 | 0.0967 | 0.0500 | 0.5680 | 0.0920 | 0.0473 | 0.5369 | 0.0869 | 0.1769 | 0.6819 | 0.2809 | 0.1901 | 0.7331 | 0.3019 | 0.1869 | 0.7207 | 0.2968 | 0.1793 | 0.6914 | 0.2848 | 0.0831 | 0.7934 | 0.1505 | 0.0931 | 0.8892 | 0.1686 | 0.0884 | 0.8442 | 0.1601 | 0.0834 | 0.7959 | 0.1509 | 0.0260 | 0.5263 | 0.0496 | 0.0288 | 0.5834 | 0.0549 | 0.0332 | 0.6726 | 0.0633 | 0.0314 | 0.6360 | 0.0599 | 0.1599 | 0.6725 | 0.2584 | 0.1749 | 0.7354 | 0.2826 | 0.1690 | 0.7106 | 0.2731 | 0.1611 | 0.6773 | 0.2603 | 0.1053 | 0.3620 | 0.1631 | 0.1637 | 0.5626 | 0.2536 | 0.1361 | 0.4678 | 0.2108 | 0.1055 | 0.3626 | 0.1634 | 0.2516 | 0.9184 | 0.3949 | 0.2564 | 0.9359 | 0.4025 | 0.2562 | 0.9352 | 0.4022 | 0.2533 | 0.9249 | 0.3977 | 0.0074 | 0.3289 | 0.0144 | 0.0097 | 0.4344 | 0.0191 | 0.0087 | 0.3859 | 0.0169 | 0.0075 | 0.3327 | 0.0146 | 0.1720 | 0.5559 | 0.2627 | 0.2337 | 0.7556 | 0.3570 | 0.2044 | 0.6609 | 0.3123 | 0.1728 | 0.5586 | 0.2639 | 0.1260 | 0.4648 | 0.1983 | 0.1910 | 0.7042 | 0.3004 | 0.1602 | 0.5907 | 0.2520 | 0.1264 | 0.4663 | 0.1989 | 0.1728 | 0.8926 | 0.2895 | 0.1795 | 0.9275 | 0.3008 | 0.1762 | 0.9104 | 0.2953 | 0.1728 | 0.8929 | 0.2896 |
Framework versions
- Transformers 4.40.2
- Pytorch 2.3.1+cu121
- Datasets 2.20.0
- Tokenizers 0.19.1