vblagoje commited on
Commit
a9cee57
1 Parent(s): 5a7dd73

Bake model with the latest https://huggingface.co/datasets/vblagoje/lfqa_support_docs

Browse files

Using KILT's validation set and eval_downstream.py on model generations created by https://huggingface.co/spaces/lfqa/lfqa/blob/main/util/eval_generate.py we got KILT results:
{ 'downstream': { 'accuracy': 0.0,
'em': 0.0,
'f1': 0.27398557711151644,
'rougel': 0.24341652585508156},
'kilt': { 'KILT-accuracy': 0.0,
'KILT-em': 0.0,
'KILT-f1': 0.02985996249488124,
'KILT-rougel': 0.027306950071259557},
'retrieval': {'Rprec': 0.11235170969993022, 'recall@5': 0.1957431960921145}}

Files changed (1) hide show
  1. pytorch_model.bin +1 -1
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d2408f830125ea691fafb750557ae61303c8d862a4ebc5884701ad002beacd03
3
  size 1625557313
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75eaab4cbd1dac20d21abb3ed2be6464a761983b79aad307ac38c39e7b22296b
3
  size 1625557313