jklj077 commited on
Commit
4dff1cc
1 Parent(s): 7af94c6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -22,7 +22,7 @@ Qwen2.5 is the latest series of Qwen large language models. For Qwen2.5, we rele
22
 
23
  **This repo contains the instruction-tuned 32B Qwen2.5 model**, which has the following features:
24
  - Type: Causal Language Models
25
- - Training Stage: Pretraining, SFT, DRPO
26
  - Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
27
  - Number of Parameters: 32.5B
28
  - Number of Paramaters (Non-Embedding): 31.0B
 
22
 
23
  **This repo contains the instruction-tuned 32B Qwen2.5 model**, which has the following features:
24
  - Type: Causal Language Models
25
+ - Training Stage: Pretraining & Post-training
26
  - Architecture: transformers with RoPE, SwiGLU, RMSNorm, and Attention QKV bias
27
  - Number of Parameters: 32.5B
28
  - Number of Paramaters (Non-Embedding): 31.0B