amezasor commited on
Commit
02aae6f
1 Parent(s): 34aedeb
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -310,8 +310,8 @@ output = tokenizer.batch_decode(output)
310
  print(output)
311
  ```
312
 
313
- **Model Architeture:**
314
- Granite-3.0-8B-Instruct is based on a decoder-only dense transformer architecture. Core components of this architecture are: GQA and RoPE, MLP with SwiGLU, RMSNorm, and shared input/output embbeddings.
315
 
316
  | Model | 2B Dense | 8B Dense | 1B MoE | 3B MoE |
317
  | :-------- | :--------| :-------- | :------| :------|
 
310
  print(output)
311
  ```
312
 
313
+ **Model Architecture:**
314
+ Granite-3.0-8B-Instruct is based on a decoder-only dense transformer architecture. Core components of this architecture are: GQA and RoPE, MLP with SwiGLU, RMSNorm, and shared input/output embeddings.
315
 
316
  | Model | 2B Dense | 8B Dense | 1B MoE | 3B MoE |
317
  | :-------- | :--------| :-------- | :------| :------|