enjalot
/

sae-nomic-text-v1.5-FineWeb-edu-100BT

Model card Files Files and versions Community

sae-nomic-text-v1.5-FineWeb-edu-100BT / 128_64 /cfg.json

enjalot's picture

add top-128-k models for 32x and 64x expansion

087898d 3 months ago

109 Bytes

{"expansion_factor": 64, "normalize_decoder": true, "num_latents": 0, "k": 128, "signed": false, "d_in": 768}