File size: 333 Bytes
8463ad9
 
280f905
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
See our Github repo for more details: https://github.com/hao-ai-lab/Consistency_LLM

AR loss to consistency loss ratio: 10: 1

CodeSearchNet-Python dataset size: 50k (10%)

n-token sequence length: 32

Jacobi trajectory data cleaning: True

Target model: Deepseek-Coder-7B fine-tuned on CodeSearchNet-Python

release date: 02/26/2024