arielnlee commited on
Commit
ff02cd3
1 Parent(s): 167d0d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -4
README.md CHANGED
@@ -51,22 +51,22 @@ Each task was evaluated on a single A100 80GB GPU.
51
 
52
  ARC:
53
  ```
54
- python main.py --model hf-causal-experimental --model_args pretrained=ariellee/SuperPlatty-30B --tasks arc_challenge --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/arc_challenge_25shot.json --device cuda --num_fewshot 25
55
  ```
56
 
57
  HellaSwag:
58
  ```
59
- python main.py --model hf-causal-experimental --model_args pretrained=ariellee/SuperPlatty-30B --tasks hellaswag --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/hellaswag_10shot.json --device cuda --num_fewshot 10
60
  ```
61
 
62
  MMLU:
63
  ```
64
- python main.py --model hf-causal-experimental --model_args pretrained=ariellee/SuperPlatty-30B --tasks hendrycksTest-* --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/mmlu_5shot.json --device cuda --num_fewshot 5
65
  ```
66
 
67
  TruthfulQA:
68
  ```
69
- python main.py --model hf-causal-experimental --model_args pretrained=ariellee/SuperPlatty-30B --tasks truthfulqa_mc --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/truthfulqa_0shot.json --device cuda
70
  ```
71
  ## Limitations and bias
72
 
 
51
 
52
  ARC:
53
  ```
54
+ python main.py --model hf-causal-experimental --model_args pretrained=garage-bAIdnd/SuperPlatty-30B --tasks arc_challenge --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/arc_challenge_25shot.json --device cuda --num_fewshot 25
55
  ```
56
 
57
  HellaSwag:
58
  ```
59
+ python main.py --model hf-causal-experimental --model_args pretrained=garage-bAIdnd/SuperPlatty-30B --tasks hellaswag --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/hellaswag_10shot.json --device cuda --num_fewshot 10
60
  ```
61
 
62
  MMLU:
63
  ```
64
+ python main.py --model hf-causal-experimental --model_args pretrained=garage-bAIdnd/SuperPlatty-30B --tasks hendrycksTest-* --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/mmlu_5shot.json --device cuda --num_fewshot 5
65
  ```
66
 
67
  TruthfulQA:
68
  ```
69
+ python main.py --model hf-causal-experimental --model_args pretrained=garage-bAIdnd/SuperPlatty-30B --tasks truthfulqa_mc --batch_size 1 --no_cache --write_out --output_path results/SuperPlatty-30B/truthfulqa_0shot.json --device cuda
70
  ```
71
  ## Limitations and bias
72