Noam

nsegev's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in TheBloke/Falcon-180B-Chat-GPTQ 12 months ago

Can run on SageMaker g5 instance?

5

#4 opened about 1 year ago by nsegev

New activity in TheBloke/Falcon-180B-Chat-GPTQ about 1 year ago

3bit on single A100 good quality, poor speed

3

#3 opened about 1 year ago by Gian-hf

New activity in tiiuae/falcon-180B-chat about 1 year ago

Error on num_kv_heads when using TGI

2

#5 opened about 1 year ago by nsegev

New activity in TheBloke/Falcon-180B-Chat-GPTQ about 1 year ago

Can run on SageMaker g5 instance?

5

#4 opened about 1 year ago by nsegev

New activity in tiiuae/falcon-180B-chat about 1 year ago

Error on num_kv_heads when using TGI

2

#5 opened about 1 year ago by nsegev