nm-testing
/

llama1.1b_0.5_sparse_bitmask

Text Generation

text-generation-inference

Inference Endpoints

compressed-tensors

Model card Files Files and versions Community

llama1.1b_0.5_sparse_bitmask / recipe.yaml

sadkins65's picture

Upload folder using huggingface_hub

7ae97fc verified 5 months ago

132 Bytes

	test_stage:
	sparsity_modifiers:
	SparseGPTModifier:
	sequential_update: false
	ignore: [lm_head]
	sparsity: 0.5