File size: 387 Bytes
c5d8f49 b919e9f c5d8f49 392f7b2 b919e9f c5d8f49 b919e9f c5d8f49 b919e9f c5d8f49 392f7b2 c5d8f49 b919e9f c5d8f49 b919e9f c5d8f49 b919e9f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 |
---
library_name: transformers
license: apache-2.0
base_model:
- allenai/Molmo-7B-D-0924
---
Molmo-7B-D BnB 4bit quant
30GB -> 7GB
approx. 12GB VRAM required
base model for more information:
https://huggingface.co/allenai/Molmo-7B-D-0924
example code:
https://github.com/cyan2k/molmo-7b-bnb-4bit
performance metrics & benchmarks to compare with base will follow over the next week |