ScarletAce
/

LLaMA2-7B-RoLoRA

Model card Files Files and versions Community

LLaMA2-7B-RoLoRA / boolq,piqa,hellaswag,winogrande,arc_easy,arc_challenge,openbookqa_W4_A4_GPTQ.log

ScarletAce's picture

Upload folder using huggingface_hub

26d4600 verified about 1 month ago

history blame contribute delete

922 Bytes

	\| Tasks \|Version\|Filter\|n-shot\| Metric \|Value \| \|Stderr\|
	\|-------------\|------:\|------\|-----:\|--------\|-----:\|---\|-----:\|
	\|openbookqa \| 1\|none \| 0\|acc \|0.2820\|± \|0.0201\|
	\| \| \|none \| 0\|acc_norm\|0.4040\|± \|0.0220\|
	\|arc_challenge\| 1\|none \| 0\|acc \|0.3976\|± \|0.0143\|
	\| \| \|none \| 0\|acc_norm\|0.4215\|± \|0.0144\|
	\|arc_easy \| 1\|none \| 0\|acc \|0.7184\|± \|0.0092\|
	\| \| \|none \| 0\|acc_norm\|0.6772\|± \|0.0096\|
	\|winogrande \| 1\|none \| 0\|acc \|0.6409\|± \|0.0135\|
	\|hellaswag \| 1\|none \| 0\|acc \|0.5326\|± \|0.0050\|
	\| \| \|none \| 0\|acc_norm\|0.7181\|± \|0.0045\|
	\|piqa \| 1\|none \| 0\|acc \|0.7557\|± \|0.0100\|
	\| \| \|none \| 0\|acc_norm\|0.7622\|± \|0.0099\|
	\|boolq \| 2\|none \| 0\|acc \|0.7349\|± \|0.0077\|