segformer-b2-finetuned-segments-greenhousev3-sep-23

This model is a fine-tuned version of nvidia/mit-b2 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.1322
• Mean Iou: 0.6132
• Mean Accuracy: 0.7450
• Overall Accuracy: 0.9609
• F1 Score: 0.9588
• Recall: 0.9609
• Accuracy Unlabeled: nan
• Accuracy Object: 0.0206
• Accuracy Road: nan
• Accuracy Plant: 0.9558
• Accuracy Iron: 0.6844
• Accuracy Wood: 0.7721
• Accuracy Wall: 0.9074
• Accuracy Raw Road: 0.9928
• Accuracy Bottom Wall: 0.9443
• Accuracy Roof: 0.2718
• Accuracy Grass: 0.6305
• Accuracy Mulch: 0.9225
• Accuracy Person: 0.9763
• Accuracy Tomato: 0.8611
• Iou Unlabeled: 0.0
• Iou Object: 0.0184
• Iou Road: nan
• Iou Plant: 0.9019
• Iou Iron: 0.6258
• Iou Wood: 0.7197
• Iou Wall: 0.8552
• Iou Raw Road: 0.9821
• Iou Bottom Wall: 0.6995
• Iou Roof: 0.2149
• Iou Grass: 0.6173
• Iou Mulch: 0.8751
• Iou Person: 0.7825
• Iou Tomato: 0.6797

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 6e-05
• train_batch_size: 2
• eval_batch_size: 2
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 15

Training results

Training Loss	Epoch	Step	Validation Loss	Mean Iou	Mean Accuracy	Overall Accuracy	F1 Score	Recall	Accuracy Unlabeled	Accuracy Object	Accuracy Road	Accuracy Plant	Accuracy Iron	Accuracy Wood	Accuracy Wall	Accuracy Raw Road	Accuracy Bottom Wall	Accuracy Roof	Accuracy Grass	Accuracy Mulch	Accuracy Person	Accuracy Tomato	Iou Unlabeled	Iou Object	Iou Road	Iou Plant	Iou Iron	Iou Wood	Iou Wall	Iou Raw Road	Iou Bottom Wall	Iou Roof	Iou Grass	Iou Mulch	Iou Person	Iou Tomato
0.4728	0.14	20	0.6655	0.2299	0.2891	0.8798	0.8777	0.8798	nan	0.0	nan	0.9629	0.0	0.0	0.6311	0.9559	0.1394	0.0	0.0	0.7803	0.0	0.0	nan	0.0	0.0	0.7506	0.0	0.0	0.5587	0.9347	0.1283	0.0	0.0	0.6164	0.0	0.0
0.2268	0.29	40	0.3465	0.2906	0.3326	0.9191	0.9169	0.9191	nan	0.0	nan	0.9575	0.0	0.0	0.9650	0.9645	0.2226	0.0	0.0	0.8811	0.0	0.0	nan	0.0	nan	0.8449	0.0	0.0	0.7368	0.9537	0.2068	0.0	0.0	0.7453	0.0	0.0
0.3019	0.43	60	0.2880	0.3198	0.3631	0.9298	0.9275	0.9298	nan	0.0	nan	0.9563	0.0891	0.0	0.9515	0.9770	0.5062	0.0	0.0	0.8765	0.0	0.0	nan	0.0	nan	0.8484	0.0862	0.0	0.7512	0.9642	0.3825	0.0	0.0	0.8051	0.0	0.0
0.1585	0.57	80	0.2347	0.3519	0.3900	0.9370	0.9347	0.9370	nan	0.0	nan	0.9569	0.3653	0.0	0.9044	0.9855	0.3948	0.1606	0.0	0.9130	0.0	0.0	nan	0.0	nan	0.8600	0.2939	0.0	0.7732	0.9692	0.3490	0.1496	0.0	0.8283	0.0	0.0
0.1301	0.71	100	0.2319	0.3482	0.4088	0.9312	0.9289	0.9312	nan	0.0	nan	0.9291	0.2820	0.0	0.7532	0.9864	0.7759	0.2375	0.0	0.9412	0.0	0.0	nan	0.0	nan	0.8606	0.2518	0.0	0.6801	0.9726	0.3958	0.1929	0.0	0.8249	0.0	0.0
0.1759	0.86	120	0.2091	0.3762	0.4338	0.9421	0.9398	0.9421	nan	0.0	nan	0.9526	0.3518	0.0	0.8590	0.9908	0.8850	0.2730	0.0	0.8937	0.0	0.0	nan	0.0	nan	0.8672	0.3154	0.0	0.7874	0.9749	0.5630	0.1681	0.0	0.8384	0.0	0.0
0.2844	1.0	140	0.2082	0.3916	0.4498	0.9450	0.9427	0.9450	nan	0.0	nan	0.9541	0.4831	0.0	0.8960	0.9846	0.9094	0.2606	0.0	0.9101	0.0	0.0	nan	0.0	nan	0.8716	0.3912	0.0	0.8308	0.9738	0.5975	0.1947	0.0	0.8396	0.0	0.0
0.798	1.14	160	0.2097	0.3589	0.4018	0.9399	0.9376	0.9399	nan	0.0	nan	0.9677	0.2508	0.0	0.9451	0.9814	0.6654	0.1253	0.0	0.8856	0.0	0.0	nan	0.0	nan	0.8701	0.2347	0.0	0.8037	0.9701	0.4866	0.1206	0.0	0.8206	0.0	0.0
0.1109	1.29	180	0.1858	0.3963	0.4418	0.9494	0.9471	0.9494	nan	0.0	nan	0.9458	0.4474	0.0	0.9346	0.9883	0.9136	0.1362	0.0	0.9287	0.0	0.0073	nan	0.0	nan	0.8749	0.3894	0.0	0.8578	0.9764	0.6721	0.1314	0.0	0.8462	0.0	0.0073
0.1307	1.43	200	0.1860	0.3877	0.4278	0.9476	0.9453	0.9476	nan	0.0	nan	0.9560	0.3539	0.0	0.9347	0.9919	0.7286	0.2421	0.0	0.9096	0.0135	0.0032	nan	0.0	nan	0.8755	0.3252	0.0	0.8295	0.9770	0.5821	0.1991	0.0	0.8466	0.0135	0.0032
0.084	1.57	220	0.1887	0.4217	0.4708	0.9486	0.9463	0.9486	nan	0.0	nan	0.9582	0.3334	0.0	0.8882	0.9920	0.9166	0.2368	0.0	0.9038	0.0659	0.3552	nan	0.0	nan	0.8801	0.3078	0.0	0.8184	0.9768	0.6100	0.2048	0.0	0.8532	0.0659	0.3430
0.1455	1.71	240	0.1807	0.3972	0.4840	0.9472	0.9449	0.9472	nan	0.0	nan	0.9643	0.6948	0.0	0.9136	0.9910	0.6636	0.2532	0.0	0.8843	0.0879	0.3557	0.0	0.0	nan	0.8765	0.4982	0.0	0.8146	0.9770	0.5113	0.2082	0.0	0.8475	0.0879	0.3424
0.4724	1.86	260	0.1679	0.4540	0.5105	0.9501	0.9478	0.9501	nan	0.0	nan	0.9543	0.4028	0.0	0.8962	0.9915	0.8939	0.2762	0.0	0.9111	0.1767	0.6238	nan	0.0	nan	0.8830	0.3581	0.0	0.8287	0.9775	0.6134	0.1958	0.0	0.8565	0.1767	0.5588
0.0792	2.0	280	0.1651	0.4441	0.5410	0.9538	0.9515	0.9538	nan	0.0125	nan	0.9700	0.6903	0.0	0.9289	0.9895	0.8878	0.1999	0.0	0.8855	0.1589	0.7681	0.0	0.0123	nan	0.8820	0.5481	0.0	0.8666	0.9790	0.6902	0.1844	0.0	0.8517	0.1588	0.6009
0.0818	2.14	300	0.1739	0.4140	0.5109	0.9495	0.9471	0.9495	nan	0.0	nan	0.9603	0.3701	0.0	0.9235	0.9884	0.7417	0.2544	0.0	0.9121	0.1378	0.8426	0.0	0.0	nan	0.8891	0.3379	0.0	0.8072	0.9766	0.5491	0.2107	0.0	0.8581	0.1374	0.6155
0.0728	2.29	320	0.1671	0.4637	0.5572	0.9525	0.9501	0.9525	nan	0.0026	nan	0.9716	0.6449	0.0	0.9063	0.9891	0.8891	0.2794	0.0	0.8892	0.4852	0.6293	0.0	0.0026	nan	0.8801	0.5378	0.0	0.8463	0.9781	0.6695	0.1932	0.0	0.8583	0.4844	0.5772
0.1481	2.43	340	0.1877	0.4361	0.5219	0.9494	0.9471	0.9494	nan	0.0063	nan	0.9537	0.4166	0.0	0.8905	0.9896	0.8297	0.1635	0.0	0.9314	0.5917	0.4900	0.0	0.0063	nan	0.8839	0.3844	0.0	0.8038	0.9790	0.5398	0.1583	0.0	0.8651	0.5728	0.4762
0.0827	2.57	360	0.1997	0.4146	0.5090	0.9432	0.9409	0.9432	nan	0.0011	nan	0.9455	0.3143	0.0	0.7867	0.9907	0.9458	0.0166	0.0	0.9396	0.7194	0.4479	0.0	0.0011	nan	0.8840	0.2966	0.0	0.7427	0.9771	0.4720	0.0166	0.0	0.8598	0.7016	0.4382
0.1107	2.71	380	0.1557	0.5025	0.6047	0.9562	0.9538	0.9562	nan	0.0411	nan	0.9608	0.6180	0.0	0.9320	0.9918	0.8880	0.2753	0.0	0.9107	0.8757	0.7634	0.0	0.0390	nan	0.8895	0.5274	0.0	0.8685	0.9785	0.7030	0.2059	0.0	0.8697	0.8151	0.6354
0.1865	2.86	400	0.1532	0.5085	0.6133	0.9558	0.9535	0.9558	nan	0.0016	nan	0.9343	0.7329	0.0	0.9466	0.9915	0.8648	0.2845	0.0	0.9446	0.8986	0.7599	0.0	0.0016	nan	0.8823	0.5774	0.0	0.8855	0.9790	0.7964	0.1783	0.0	0.8552	0.8196	0.6358
0.0648	3.0	420	0.1680	0.4919	0.5956	0.9542	0.9518	0.9542	nan	0.0034	nan	0.9608	0.7622	0.0	0.8786	0.9924	0.8920	0.2235	0.0	0.9135	0.8478	0.6727	0.0	0.0031	nan	0.8870	0.5533	0.0	0.8376	0.9796	0.6629	0.2034	0.0	0.8659	0.7992	0.6020
0.1125	3.14	440	0.1652	0.4831	0.5817	0.9531	0.9509	0.9531	nan	0.0049	nan	0.9620	0.5142	0.0008	0.9011	0.9885	0.9501	0.2267	0.0	0.9172	0.8749	0.6403	0.0	0.0049	nan	0.8877	0.4584	0.0008	0.8433	0.9791	0.6627	0.2044	0.0	0.8567	0.8086	0.5742
0.0804	3.29	460	0.1550	0.5130	0.6533	0.9556	0.9533	0.9556	nan	0.0454	nan	0.9476	0.6877	0.2668	0.9698	0.9939	0.8789	0.2339	0.0	0.8932	0.9467	0.9758	0.0	0.0259	nan	0.8837	0.5625	0.2668	0.9002	0.9781	0.7943	0.2099	0.0	0.8594	0.7619	0.4256
0.0794	3.43	480	0.1514	0.5133	0.6402	0.9569	0.9546	0.9569	nan	0.0310	nan	0.9438	0.5360	0.3062	0.9648	0.9910	0.9301	0.1980	0.0	0.9286	0.8943	0.9582	0.0	0.0217	nan	0.8848	0.4842	0.3062	0.9028	0.9795	0.7796	0.1869	0.0	0.8671	0.7768	0.4828
0.084	3.57	500	0.1477	0.5099	0.6059	0.9585	0.9561	0.9585	nan	0.0414	nan	0.9662	0.5989	0.0030	0.9685	0.9895	0.9243	0.2221	0.0	0.9085	0.8977	0.7507	0.0	0.0386	nan	0.8863	0.5261	0.0030	0.9040	0.9797	0.7818	0.2055	0.0	0.8675	0.7826	0.6531
0.0648	3.71	520	0.1482	0.5166	0.6114	0.9580	0.9557	0.9580	nan	0.0562	nan	0.9561	0.6569	0.0016	0.9635	0.9953	0.9131	0.1891	0.0	0.8987	0.9307	0.7761	0.0	0.0505	nan	0.8872	0.5528	0.0016	0.9031	0.9766	0.7930	0.1801	0.0	0.8667	0.8335	0.6705
0.0828	3.86	540	0.1759	0.4830	0.5948	0.9501	0.9478	0.9501	nan	0.0214	nan	0.9688	0.5372	0.0005	0.8483	0.9893	0.9405	0.2753	0.0	0.9003	0.8986	0.7577	0.0	0.0185	nan	0.8840	0.4753	0.0005	0.8022	0.9796	0.5658	0.2111	0.0	0.8651	0.8047	0.6722
0.0761	4.0	560	0.1497	0.5129	0.6124	0.9576	0.9552	0.9576	nan	0.0295	nan	0.9642	0.7465	0.0	0.9567	0.9930	0.8100	0.2875	0.0	0.9003	0.8986	0.7630	0.0	0.0243	nan	0.8874	0.6182	0.0	0.8800	0.9804	0.7565	0.1808	0.0	0.8670	0.8102	0.6637
0.0895	4.14	580	0.1404	0.5205	0.6296	0.9588	0.9565	0.9588	nan	0.1097	nan	0.9575	0.6479	0.0	0.9431	0.9914	0.9467	0.2837	0.0	0.9215	0.9315	0.8219	0.0	0.1014	nan	0.8908	0.5544	0.0	0.8916	0.9801	0.7819	0.1955	0.0	0.8729	0.8286	0.6689
0.0934	4.29	600	0.1406	0.5112	0.6070	0.9589	0.9566	0.9589	nan	0.0107	nan	0.9553	0.6079	0.0	0.9781	0.9931	0.8910	0.2657	0.0120	0.9153	0.9560	0.6984	0.0	0.0105	nan	0.8905	0.5319	0.0	0.8901	0.9788	0.8040	0.2210	0.0120	0.8716	0.7811	0.6544
0.0658	4.43	620	0.1400	0.5132	0.6074	0.9595	0.9572	0.9595	nan	0.0068	nan	0.9600	0.6840	0.0	0.9640	0.9920	0.9329	0.2745	0.0003	0.9150	0.9172	0.6422	0.0	0.0065	nan	0.8895	0.5783	0.0	0.9051	0.9798	0.8141	0.2128	0.0003	0.8700	0.7990	0.6158
0.1135	4.57	640	0.1389	0.5163	0.6109	0.9600	0.9577	0.9600	nan	0.0156	nan	0.9587	0.6038	0.0	0.9603	0.9923	0.9510	0.2677	0.0004	0.9205	0.8681	0.7928	0.0	0.0145	nan	0.8908	0.5260	0.0	0.9025	0.9806	0.8119	0.2219	0.0004	0.8738	0.8125	0.6770
0.1132	4.71	660	0.1353	0.5166	0.6113	0.9594	0.9571	0.9594	nan	0.0149	nan	0.9509	0.6262	0.0	0.9600	0.9923	0.9425	0.2831	0.0019	0.9293	0.8859	0.7492	0.0	0.0137	nan	0.8900	0.5444	0.0	0.8979	0.9800	0.8146	0.2003	0.0019	0.8728	0.8226	0.6780
0.0903	4.86	680	0.1719	0.4946	0.5966	0.9534	0.9517	0.9534	nan	0.0008	nan	0.9599	0.6438	0.0100	0.8733	0.9910	0.9136	0.2515	0.0005	0.9209	0.8808	0.7132	0.0	0.0008	nan	0.8898	0.5495	0.0100	0.8217	0.9797	0.6287	0.1963	0.0005	0.8700	0.8192	0.6629
0.0758	5.0	700	0.2187	0.4952	0.6093	0.9462	0.9439	0.9462	nan	0.0	nan	0.9728	0.5681	0.3057	0.7628	0.9894	0.9400	0.2767	0.0001	0.9031	0.8571	0.7364	0.0	0.0	nan	0.8859	0.5139	0.3057	0.7273	0.9796	0.4944	0.2122	0.0001	0.8647	0.7764	0.6771
0.2833	5.14	720	0.1511	0.5013	0.5987	0.9559	0.9536	0.9559	nan	0.0	nan	0.9546	0.7183	0.0672	0.9584	0.9949	0.7175	0.1797	0.0	0.9128	0.9349	0.7464	0.0	0.0	nan	0.8902	0.5909	0.0672	0.8507	0.9786	0.6221	0.1725	0.0	0.8740	0.79	0.6801
0.0744	5.29	740	0.1738	0.5093	0.6309	0.9532	0.9509	0.9532	nan	0.0072	nan	0.9511	0.6715	0.2084	0.8432	0.9937	0.9450	0.2663	0.0008	0.9279	0.9231	0.8322	0.0	0.0062	nan	0.8889	0.5572	0.2084	0.8055	0.9800	0.6161	0.2162	0.0008	0.8746	0.8029	0.6643
0.0714	5.43	760	0.2051	0.4841	0.5921	0.9518	0.9495	0.9518	nan	0.0078	nan	0.9558	0.5927	0.0666	0.8609	0.9926	0.9532	0.1885	0.0	0.9158	0.9467	0.6250	0.0	0.0063	nan	0.8868	0.5174	0.0666	0.8094	0.9794	0.5846	0.1805	0.0	0.8707	0.7915	0.6004
0.0762	5.57	780	0.1650	0.5024	0.6131	0.9540	0.9517	0.9540	nan	0.0296	nan	0.9663	0.6629	0.1665	0.8887	0.9898	0.9290	0.1194	0.0	0.9099	0.9594	0.7358	0.0	0.0205	nan	0.8860	0.5934	0.1665	0.8275	0.9803	0.6486	0.1178	0.0	0.8687	0.7597	0.6628
0.0914	5.71	800	0.1375	0.5537	0.6932	0.9593	0.9572	0.9593	nan	0.4264	nan	0.9544	0.7537	0.2685	0.9521	0.9943	0.9177	0.2634	0.0016	0.9051	0.9653	0.9164	0.0	0.2219	nan	0.8899	0.6534	0.2684	0.8924	0.9802	0.8094	0.2207	0.0016	0.8690	0.7489	0.6419
0.0537	5.86	820	0.1389	0.5551	0.6732	0.9585	0.9567	0.9585	nan	0.2189	nan	0.9630	0.5396	0.4156	0.9667	0.9887	0.9400	0.2719	0.0452	0.9109	0.9324	0.8853	0.0	0.1550	nan	0.8876	0.4992	0.4150	0.8951	0.9809	0.8003	0.2219	0.0450	0.8683	0.7839	0.6644
0.1726	6.0	840	0.1286	0.5929	0.7204	0.9600	0.9578	0.9600	nan	0.2471	nan	0.9490	0.7091	0.7954	0.9417	0.9937	0.9336	0.2915	0.0463	0.9262	0.9383	0.8732	0.0	0.1929	nan	0.8922	0.6262	0.7332	0.8897	0.9804	0.8258	0.1738	0.0463	0.8746	0.8079	0.6650
0.0732	6.14	860	0.2074	0.5566	0.6938	0.9526	0.9504	0.9526	nan	0.1039	nan	0.9418	0.5611	0.8804	0.8588	0.9927	0.9399	0.2823	0.0446	0.9379	0.9417	0.8401	0.0	0.0830	nan	0.8891	0.5225	0.7368	0.8043	0.9794	0.6139	0.2006	0.0446	0.8702	0.8227	0.6683
0.0584	6.29	880	0.2237	0.5399	0.6605	0.9511	0.9493	0.9511	nan	0.0362	nan	0.9621	0.6614	0.7904	0.8164	0.9920	0.9476	0.1184	0.0155	0.9165	0.9332	0.7361	0.0	0.0305	nan	0.8921	0.5800	0.7119	0.7721	0.9807	0.5475	0.1158	0.0155	0.8747	0.8351	0.6629
0.0598	6.43	900	0.1893	0.5424	0.6526	0.9525	0.9507	0.9525	nan	0.0165	nan	0.9732	0.6581	0.7865	0.8772	0.9909	0.8767	0.1914	0.0075	0.8920	0.8893	0.6723	0.0	0.0122	nan	0.8851	0.5830	0.6993	0.8149	0.9805	0.6021	0.1805	0.0075	0.8657	0.7868	0.6341
0.1013	6.57	920	0.1335	0.5780	0.6934	0.9607	0.9585	0.9607	nan	0.0674	nan	0.9545	0.6898	0.7161	0.9552	0.9933	0.9497	0.2721	0.0049	0.9209	0.9307	0.8663	0.0	0.0526	nan	0.8906	0.6059	0.6813	0.8999	0.9806	0.8401	0.2197	0.0049	0.8762	0.8007	0.6615
0.0833	6.71	940	0.1330	0.5692	0.6914	0.9601	0.9580	0.9601	nan	0.0915	nan	0.9456	0.6183	0.6115	0.9549	0.9933	0.9592	0.2653	0.0617	0.9316	0.9501	0.9140	0.0	0.0773	nan	0.8916	0.5659	0.5988	0.8971	0.9806	0.8128	0.2219	0.0617	0.8731	0.8011	0.6171
0.0817	6.86	960	0.1351	0.5724	0.6995	0.9590	0.9569	0.9590	nan	0.1274	nan	0.9576	0.7188	0.5427	0.9152	0.9938	0.9463	0.2705	0.1773	0.9120	0.9560	0.8769	0.0	0.1070	nan	0.8943	0.6327	0.5407	0.8663	0.9805	0.7262	0.2172	0.1771	0.8753	0.7773	0.6464
0.0492	7.0	980	0.1380	0.5820	0.7143	0.9579	0.9556	0.9579	nan	0.0692	nan	0.9352	0.6658	0.6519	0.9142	0.9939	0.9420	0.2785	0.3117	0.9396	0.9510	0.9187	0.0	0.0626	nan	0.8915	0.6026	0.6376	0.8645	0.9790	0.7287	0.2095	0.3117	0.8691	0.7911	0.6179
0.0771	7.14	1000	0.2250	0.5468	0.6883	0.9541	0.9519	0.9541	nan	0.1071	nan	0.9525	0.5593	0.5420	0.8624	0.9921	0.9532	0.2513	0.2243	0.9229	0.9603	0.9321	0.0	0.0847	nan	0.8972	0.5172	0.5370	0.8101	0.9791	0.5957	0.2224	0.2243	0.8759	0.7770	0.5876
0.4058	7.29	1020	0.2183	0.5275	0.6615	0.9536	0.9514	0.9536	nan	0.0732	nan	0.9622	0.6842	0.3845	0.8543	0.9921	0.9101	0.2705	0.0502	0.9120	0.9341	0.9105	0.0	0.0567	nan	0.8933	0.5761	0.3845	0.8099	0.9797	0.6019	0.2205	0.0501	0.8738	0.7984	0.6130
0.0673	7.43	1040	0.2068	0.5394	0.6758	0.9546	0.9524	0.9546	nan	0.0308	nan	0.9477	0.6755	0.4295	0.8634	0.9931	0.9386	0.2778	0.1915	0.9286	0.9763	0.8564	0.0	0.0286	nan	0.8953	0.5905	0.4291	0.8089	0.9797	0.6077	0.2142	0.1915	0.8754	0.7329	0.6587
0.0628	7.57	1060	0.2107	0.5408	0.6630	0.9531	0.9508	0.9531	nan	0.0	nan	0.9430	0.5187	0.5982	0.8544	0.9928	0.9473	0.2830	0.1745	0.9424	0.9653	0.7364	0.0	0.0	nan	0.8886	0.4912	0.5910	0.7967	0.9815	0.5976	0.2031	0.1731	0.8736	0.7644	0.6696
0.0522	7.71	1080	0.1767	0.5347	0.6524	0.9539	0.9517	0.9539	nan	0.0	nan	0.9728	0.7060	0.3845	0.8449	0.9918	0.9290	0.2838	0.1439	0.8983	0.9358	0.7375	0.0	0.0	nan	0.8890	0.6093	0.3845	0.8043	0.9823	0.6071	0.1976	0.1422	0.8701	0.7993	0.6656
0.0869	7.86	1100	0.1538	0.5471	0.6775	0.9556	0.9537	0.9556	nan	0.0184	nan	0.9557	0.7171	0.4018	0.8595	0.9931	0.9393	0.2777	0.2382	0.9206	0.9628	0.8453	0.0	0.0166	nan	0.8951	0.6301	0.4017	0.8126	0.9819	0.6177	0.2101	0.2348	0.8750	0.7691	0.6675
0.045	8.0	1120	0.1356	0.5880	0.7348	0.9583	0.9566	0.9583	nan	0.0194	nan	0.9574	0.6847	0.9394	0.9016	0.9912	0.9424	0.2763	0.3520	0.9199	0.9679	0.8656	0.0	0.0162	nan	0.8967	0.6149	0.7533	0.8535	0.9812	0.6940	0.2156	0.3220	0.8747	0.7598	0.6625
0.0618	8.14	1140	0.1575	0.5853	0.7354	0.9554	0.9536	0.9554	nan	0.0634	nan	0.9565	0.6314	0.9301	0.8496	0.9906	0.9539	0.2834	0.4132	0.9256	0.9484	0.8790	0.0	0.0498	nan	0.8977	0.5787	0.7574	0.8068	0.9810	0.6149	0.2028	0.3951	0.8752	0.7868	0.6631
0.0615	8.29	1160	0.1424	0.5866	0.7214	0.9574	0.9553	0.9574	nan	0.0456	nan	0.9597	0.6568	0.8833	0.8828	0.9914	0.9166	0.2767	0.3445	0.9236	0.9324	0.8438	0.0	0.0361	nan	0.8966	0.6001	0.7273	0.8290	0.9818	0.6538	0.2102	0.3359	0.8758	0.8010	0.6779
0.0496	8.43	1180	0.1609	0.5814	0.7108	0.9553	0.9532	0.9553	nan	0.0041	nan	0.9615	0.5936	0.8529	0.8517	0.9939	0.9439	0.2877	0.4440	0.9077	0.9349	0.7532	0.0	0.0035	nan	0.8968	0.5522	0.7242	0.8041	0.9809	0.6147	0.1959	0.4386	0.8718	0.8003	0.6756
0.079	8.57	1200	0.1332	0.5783	0.6993	0.9588	0.9566	0.9588	nan	0.0	nan	0.9588	0.6555	0.7735	0.9096	0.9939	0.9300	0.2807	0.2037	0.9173	0.9298	0.8383	0.0	0.0	nan	0.8948	0.6018	0.7004	0.8527	0.9813	0.7232	0.1959	0.2032	0.8768	0.8100	0.6777
0.1797	8.71	1220	0.1321	0.6012	0.7096	0.9625	0.9602	0.9625	nan	0.0	nan	0.9639	0.6784	0.9002	0.9735	0.9931	0.9319	0.2638	0.2206	0.9077	0.9146	0.7669	0.0	0.0	nan	0.8948	0.6148	0.7647	0.9027	0.9821	0.8453	0.2218	0.2200	0.8727	0.8154	0.6813
0.0599	8.86	1240	0.1321	0.6013	0.7106	0.9630	0.9607	0.9630	nan	0.0	nan	0.9526	0.7469	0.9123	0.9708	0.9923	0.9355	0.2503	0.1763	0.9337	0.9222	0.7345	0.0	0.0	nan	0.8931	0.6567	0.7621	0.9123	0.9817	0.8493	0.2231	0.1759	0.8777	0.8185	0.6665
0.0607	9.0	1260	0.1580	0.5668	0.7035	0.9543	0.9521	0.9543	nan	0.0003	nan	0.9586	0.7034	0.8816	0.8416	0.9912	0.9499	0.2866	0.1688	0.9238	0.9501	0.7863	0.0	0.0003	nan	0.8923	0.6258	0.7623	0.7997	0.9821	0.6145	0.1791	0.1674	0.8737	0.7955	0.6760
0.1154	9.14	1280	0.1540	0.5738	0.7192	0.9545	0.9524	0.9545	nan	0.0328	nan	0.9600	0.6419	0.9343	0.8468	0.9929	0.9347	0.2908	0.2807	0.9128	0.9611	0.8422	0.0	0.0257	nan	0.8949	0.5996	0.7636	0.7967	0.9817	0.6282	0.1633	0.2772	0.8715	0.7918	0.6655
0.1047	9.29	1300	0.1369	0.5915	0.7342	0.9578	0.9561	0.9578	nan	0.0338	nan	0.9637	0.7150	0.9354	0.8903	0.9908	0.9363	0.3021	0.3361	0.9122	0.9653	0.8297	0.0	0.0263	nan	0.8972	0.6499	0.7643	0.8402	0.9820	0.7037	0.1710	0.3308	0.8717	0.7680	0.6847
0.0709	9.43	1320	0.1469	0.5713	0.6946	0.9572	0.9549	0.9572	nan	0.0074	nan	0.9598	0.7151	0.7399	0.8738	0.9929	0.9244	0.2876	0.1671	0.9238	0.9484	0.7947	0.0	0.0066	nan	0.8932	0.6462	0.6928	0.8263	0.9824	0.6639	0.1928	0.1659	0.8780	0.7918	0.6874
0.128	9.57	1340	0.1526	0.5723	0.6964	0.9561	0.9539	0.9561	nan	0.0307	nan	0.9630	0.7055	0.7236	0.8697	0.9934	0.9387	0.2777	0.1866	0.9069	0.9425	0.8186	0.0	0.0254	nan	0.8924	0.6360	0.6937	0.8228	0.9818	0.6410	0.2121	0.1853	0.8718	0.7976	0.6801
0.1846	9.71	1360	0.1530	0.5663	0.7094	0.9543	0.9522	0.9543	nan	0.0431	nan	0.9614	0.7195	0.7574	0.8589	0.9933	0.9229	0.2874	0.2003	0.9000	0.9459	0.9226	0.0	0.0322	nan	0.8904	0.6401	0.7128	0.8146	0.9811	0.6407	0.1922	0.1990	0.8661	0.7953	0.5974
0.0568	9.86	1380	0.1422	0.6027	0.7368	0.9578	0.9558	0.9578	nan	0.0175	nan	0.9559	0.6483	0.7743	0.8622	0.9927	0.9333	0.2927	0.6505	0.9244	0.9535	0.8366	0.0	0.0154	nan	0.9013	0.6021	0.7331	0.8101	0.9822	0.6514	0.1724	0.6303	0.8759	0.7994	0.6610
0.0544	10.0	1400	0.1463	0.6051	0.7258	0.9591	0.9570	0.9591	nan	0.0096	nan	0.9583	0.6733	0.7330	0.8787	0.9935	0.9501	0.2223	0.6328	0.9187	0.9603	0.7785	0.0	0.0093	nan	0.9019	0.6173	0.7054	0.8276	0.9818	0.6368	0.2051	0.6264	0.8762	0.8034	0.6749
0.0684	10.14	1420	0.1304	0.6195	0.7389	0.9618	0.9597	0.9618	nan	0.0462	nan	0.9591	0.7483	0.7333	0.9231	0.9932	0.9214	0.1927	0.6513	0.9149	0.9544	0.8284	0.0	0.0379	nan	0.9015	0.6571	0.7068	0.8684	0.9818	0.7202	0.1834	0.6422	0.8733	0.8036	0.6769
0.0423	10.29	1440	0.1372	0.6107	0.7373	0.9600	0.9578	0.9600	nan	0.0305	nan	0.9580	0.7269	0.7609	0.8900	0.9932	0.9437	0.1996	0.6322	0.9186	0.9611	0.8324	0.0	0.0262	nan	0.9020	0.6449	0.7228	0.8421	0.9821	0.6603	0.1885	0.6164	0.8748	0.8013	0.6773
0.1508	10.43	1460	0.1904	0.6044	0.7407	0.9573	0.9551	0.9573	nan	0.0254	nan	0.9635	0.6664	0.7753	0.8477	0.9919	0.9476	0.2662	0.6978	0.9138	0.9569	0.8364	0.0	0.0212	nan	0.9022	0.5983	0.7151	0.8069	0.9820	0.6068	0.1991	0.6699	0.8746	0.8091	0.6721
0.1228	10.57	1480	0.2003	0.6049	0.7424	0.9566	0.9545	0.9566	nan	0.0242	nan	0.9493	0.6147	0.7633	0.8507	0.9933	0.9468	0.2698	0.7809	0.9260	0.9645	0.8250	0.0	0.0215	nan	0.9018	0.5640	0.6984	0.8055	0.9810	0.5983	0.1931	0.7457	0.8721	0.8007	0.6816
0.0859	10.71	1500	0.1786	0.5757	0.7060	0.9560	0.9539	0.9560	nan	0.0363	nan	0.9515	0.6417	0.7712	0.8671	0.9937	0.9385	0.2644	0.2720	0.9270	0.9679	0.8406	0.0	0.0323	nan	0.8946	0.5879	0.7126	0.8167	0.9814	0.6171	0.2226	0.2710	0.8761	0.7951	0.6765
0.1141	10.86	1520	0.1791	0.5730	0.7134	0.9553	0.9533	0.9553	nan	0.0281	nan	0.9627	0.7091	0.7951	0.8398	0.9918	0.9464	0.2971	0.2535	0.9179	0.9628	0.8561	0.0	0.0253	nan	0.8946	0.6201	0.7289	0.8019	0.9825	0.6165	0.1905	0.2496	0.8766	0.7910	0.6721
0.0622	11.0	1540	0.1674	0.5833	0.7234	0.9562	0.9542	0.9562	nan	0.0402	nan	0.9567	0.6500	0.8251	0.8575	0.9934	0.9356	0.2835	0.3898	0.9192	0.9620	0.8675	0.0	0.0336	nan	0.8965	0.5980	0.7233	0.8085	0.9822	0.6228	0.1991	0.3849	0.8756	0.7875	0.6708
0.0691	11.14	1560	0.1658	0.5875	0.7260	0.9566	0.9544	0.9566	nan	0.0264	nan	0.9571	0.6727	0.8209	0.8593	0.9937	0.9305	0.2788	0.4145	0.9177	0.9510	0.8891	0.0	0.0224	nan	0.8972	0.6131	0.7279	0.8131	0.9817	0.6249	0.2065	0.4130	0.8750	0.8105	0.6525
0.0529	11.29	1580	0.1686	0.5933	0.7245	0.9571	0.9549	0.9571	nan	0.0144	nan	0.9567	0.6853	0.8211	0.8601	0.9933	0.9421	0.2757	0.4308	0.9218	0.9459	0.8469	0.0	0.0134	nan	0.8986	0.6214	0.7392	0.8140	0.9815	0.6228	0.2140	0.4290	0.8766	0.8228	0.6790
0.0945	11.43	1600	0.1569	0.5896	0.7159	0.9573	0.9551	0.9573	nan	0.0193	nan	0.9603	0.7009	0.8169	0.8682	0.9928	0.9246	0.2761	0.3466	0.9197	0.9315	0.8332	0.0	0.0172	nan	0.8967	0.6319	0.7410	0.8202	0.9821	0.6344	0.2141	0.3448	0.8765	0.8224	0.6829
0.0542	11.57	1620	0.1647	0.5883	0.7243	0.9567	0.9546	0.9567	nan	0.0315	nan	0.9587	0.6831	0.8074	0.8574	0.9921	0.9463	0.2777	0.3887	0.9217	0.9560	0.8708	0.0	0.0282	nan	0.8975	0.6207	0.7421	0.8117	0.9821	0.6199	0.2096	0.3854	0.8762	0.8004	0.6737
0.0433	11.71	1640	0.1679	0.5926	0.7274	0.9563	0.9547	0.9563	nan	0.0180	nan	0.9578	0.6897	0.8191	0.8546	0.9924	0.9493	0.2805	0.4502	0.9180	0.9611	0.8385	0.0	0.0158	nan	0.8986	0.6225	0.7553	0.8091	0.9815	0.6179	0.2026	0.4472	0.8755	0.7923	0.6859
0.0682	11.86	1660	0.1669	0.5896	0.7204	0.9563	0.9545	0.9563	nan	0.0089	nan	0.9535	0.6839	0.7987	0.8583	0.9927	0.9408	0.2789	0.4190	0.9263	0.9594	0.8244	0.0	0.0082	nan	0.8971	0.6198	0.7405	0.8112	0.9815	0.6198	0.2055	0.4170	0.8749	0.8050	0.6839
0.0606	12.0	1680	0.1677	0.5893	0.7194	0.9570	0.9551	0.9570	nan	0.0132	nan	0.9607	0.6806	0.7861	0.8662	0.9927	0.9448	0.2621	0.4212	0.9148	0.9696	0.8211	0.0	0.0125	nan	0.8981	0.6187	0.7325	0.8177	0.9819	0.6193	0.2222	0.4170	0.8747	0.7819	0.6842
0.1011	12.14	1700	0.1670	0.5865	0.7170	0.9571	0.9551	0.9571	nan	0.0184	nan	0.9563	0.7031	0.7381	0.8613	0.9926	0.9501	0.2573	0.3967	0.9251	0.9721	0.8331	0.0	0.0177	nan	0.8977	0.6280	0.7038	0.8175	0.9822	0.6160	0.2230	0.3938	0.8761	0.7839	0.6844
0.1188	12.29	1720	0.1686	0.5793	0.7084	0.9562	0.9540	0.9562	nan	0.0139	nan	0.9631	0.6868	0.6758	0.8630	0.9924	0.9434	0.2647	0.3671	0.9080	0.9662	0.8567	0.0	0.0124	nan	0.8950	0.6190	0.6564	0.8174	0.9820	0.6161	0.2226	0.3647	0.8700	0.8038	0.6721
0.047	12.43	1740	0.1607	0.5739	0.7025	0.9562	0.9541	0.9562	nan	0.0206	nan	0.9568	0.6793	0.7052	0.8636	0.9930	0.9336	0.2676	0.2595	0.9224	0.9620	0.8667	0.0	0.0179	nan	0.8945	0.6143	0.6751	0.8181	0.9819	0.6225	0.2219	0.2588	0.8746	0.8105	0.6707
0.0513	12.57	1760	0.1527	0.5850	0.7180	0.9571	0.9551	0.9571	nan	0.0310	nan	0.9570	0.7189	0.7108	0.8751	0.9935	0.9408	0.2617	0.3651	0.9129	0.9696	0.8801	0.0	0.0270	nan	0.8967	0.6382	0.6866	0.8267	0.9818	0.6316	0.2235	0.3629	0.8721	0.7949	0.6629
2.1943	12.71	1780	0.1521	0.5853	0.7182	0.9571	0.9551	0.9571	nan	0.0280	nan	0.9619	0.6966	0.7361	0.8645	0.9931	0.9419	0.2766	0.3722	0.9119	0.9620	0.8730	0.0	0.0238	nan	0.8969	0.6283	0.6931	0.8200	0.9823	0.6365	0.2114	0.3692	0.8738	0.8042	0.6698
0.0588	12.86	1800	0.1443	0.5943	0.7290	0.9577	0.9558	0.9577	nan	0.0252	nan	0.9513	0.6982	0.7767	0.8719	0.9926	0.9466	0.2799	0.4529	0.9298	0.9730	0.8499	0.0	0.0226	nan	0.8978	0.6323	0.7222	0.8240	0.9821	0.6480	0.2058	0.4497	0.8749	0.7873	0.6797
0.0596	13.0	1820	0.1397	0.5998	0.7289	0.9588	0.9567	0.9588	nan	0.0117	nan	0.9547	0.6907	0.7723	0.8819	0.9934	0.9271	0.2788	0.5085	0.9256	0.9645	0.8377	0.0	0.0105	nan	0.8995	0.6280	0.7109	0.8317	0.9817	0.6622	0.2077	0.5053	0.8758	0.7990	0.6845
0.0483	13.14	1840	0.1472	0.5937	0.7231	0.9577	0.9557	0.9577	nan	0.0049	nan	0.9627	0.6929	0.7769	0.8666	0.9919	0.9469	0.2783	0.4522	0.9173	0.9577	0.8286	0.0	0.0044	nan	0.8987	0.6271	0.7233	0.8223	0.9822	0.6396	0.2066	0.4483	0.8750	0.8070	0.6843
0.0827	13.29	1860	0.1471	0.5911	0.7184	0.9578	0.9557	0.9578	nan	0.0015	nan	0.9599	0.6530	0.7314	0.8711	0.9922	0.9463	0.2737	0.4788	0.9207	0.9603	0.8317	0.0	0.0014	nan	0.8991	0.6024	0.6945	0.8225	0.9821	0.6334	0.2137	0.4739	0.8756	0.8034	0.6821
0.0552	13.43	1880	0.1454	0.5930	0.7223	0.9576	0.9556	0.9576	nan	0.0136	nan	0.9568	0.6701	0.7427	0.8729	0.9930	0.9468	0.2724	0.4850	0.9191	0.9662	0.8290	0.0	0.0119	nan	0.8990	0.6118	0.7012	0.8248	0.9816	0.6347	0.2172	0.4813	0.8737	0.7899	0.6822
0.068	13.57	1900	0.1448	0.5940	0.7236	0.9580	0.9560	0.9580	nan	0.0064	nan	0.9579	0.6975	0.7405	0.8728	0.9928	0.9481	0.2726	0.4839	0.9195	0.9687	0.8222	0.0	0.0059	nan	0.8992	0.6306	0.7038	0.8266	0.9818	0.6366	0.2175	0.4799	0.8743	0.7823	0.6842
0.0591	13.71	1920	0.1427	0.5951	0.7259	0.9584	0.9564	0.9584	nan	0.0080	nan	0.9574	0.7088	0.7468	0.8777	0.9928	0.9485	0.2770	0.4749	0.9209	0.9738	0.8238	0.0	0.0074	nan	0.8995	0.6376	0.7098	0.8306	0.9820	0.6494	0.2104	0.4714	0.8752	0.7779	0.6849
0.053	13.86	1940	0.1340	0.6069	0.7335	0.9602	0.9581	0.9602	nan	0.0129	nan	0.9609	0.7142	0.7513	0.8969	0.9933	0.9277	0.2742	0.5545	0.9155	0.9662	0.8346	0.0	0.0114	nan	0.9008	0.6409	0.7080	0.8474	0.9820	0.6892	0.2118	0.5495	0.8749	0.7883	0.6856
0.0777	14.0	1960	0.1390	0.6075	0.7417	0.9594	0.9573	0.9594	nan	0.0141	nan	0.9607	0.7186	0.7504	0.8801	0.9923	0.9473	0.2735	0.6207	0.9162	0.9755	0.8504	0.0	0.0127	nan	0.9018	0.6429	0.7125	0.8332	0.9822	0.6581	0.2135	0.6064	0.8745	0.7776	0.6819
0.0424	14.14	1980	0.1363	0.6102	0.7436	0.9598	0.9578	0.9598	nan	0.0142	nan	0.9583	0.7215	0.7595	0.8913	0.9920	0.9501	0.2749	0.6195	0.9191	0.9763	0.8471	0.0	0.0127	nan	0.9013	0.6443	0.7191	0.8437	0.9822	0.6749	0.2102	0.6055	0.8739	0.7809	0.6835
0.0791	14.29	2000	0.1346	0.6110	0.7455	0.9599	0.9579	0.9599	nan	0.0127	nan	0.9545	0.7073	0.7649	0.8931	0.9924	0.9514	0.2758	0.6445	0.9238	0.9763	0.8491	0.0	0.0118	nan	0.9016	0.6375	0.7184	0.8445	0.9821	0.6752	0.2085	0.6289	0.8741	0.7767	0.6842
0.0449	14.43	2020	0.1319	0.6103	0.7360	0.9607	0.9587	0.9607	nan	0.0132	nan	0.9594	0.7066	0.7546	0.9082	0.9928	0.9357	0.2743	0.5683	0.9179	0.9645	0.8362	0.0	0.0117	nan	0.9006	0.6371	0.7120	0.8578	0.9821	0.7085	0.2107	0.5602	0.8744	0.7935	0.6850
0.0614	14.57	2040	0.1326	0.6100	0.7397	0.9607	0.9586	0.9607	nan	0.0188	nan	0.9574	0.7049	0.7635	0.9047	0.9927	0.9391	0.2755	0.5764	0.9218	0.9713	0.8499	0.0	0.0165	nan	0.9009	0.6374	0.7156	0.8548	0.9821	0.7039	0.2101	0.5676	0.8751	0.7832	0.6827
0.0683	14.71	2060	0.1343	0.6065	0.7360	0.9603	0.9582	0.9603	nan	0.0137	nan	0.9577	0.6810	0.7431	0.9022	0.9923	0.9469	0.2703	0.5811	0.9213	0.9687	0.8538	0.0	0.0127	nan	0.9011	0.6232	0.7022	0.8507	0.9821	0.6864	0.2155	0.5725	0.8747	0.7823	0.6815
0.0873	14.86	2080	0.1300	0.6133	0.7419	0.9613	0.9593	0.9613	nan	0.0192	nan	0.9577	0.7116	0.7551	0.9125	0.9923	0.9345	0.2737	0.5976	0.9234	0.9687	0.8561	0.0	0.0168	nan	0.9013	0.6418	0.7082	0.8615	0.9823	0.7184	0.2128	0.5865	0.8756	0.7860	0.6811
0.0502	15.0	2100	0.1322	0.6132	0.7450	0.9609	0.9588	0.9609	nan	0.0206	nan	0.9558	0.6844	0.7721	0.9074	0.9928	0.9443	0.2718	0.6305	0.9225	0.9763	0.8611	0.0	0.0184	nan	0.9019	0.6258	0.7197	0.8552	0.9821	0.6995	0.2149	0.6173	0.8751	0.7825	0.6797

Framework versions

• Transformers 4.33.2
• Pytorch 2.0.1
• Datasets 3.0.0
• Tokenizers 0.13.3