158 34 55

Leandro von Werra

lvwerra

https://github.com/lvwerra

AI & ML interests

NLP and RL

Articles

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 35

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 71

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 272

StarCoder2 and The Stack v2

Feb 28

• 5

Constitutional AI with Open LLMs

Feb 1

• 11

Preference Tuning LLMs with Direct Preference Optimization Methods

Jan 18

• 33

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

Dec 11, 2023

• 9

The N Implementation Details of RLHF with PPO

Oct 24, 2023

• 16

Finetune Stable Diffusion Models with DDPO via TRL

Sep 29, 2023

• 4

Spread Your Wings: Falcon 180B is here

Sep 6, 2023

• 4

Code Llama: Llama 2 learns to code

Aug 25, 2023

• 4

Fine-tune Llama 2 with DPO

Aug 8, 2023

• 25

The Falcon has landed in the Hugging Face ecosystem

Jun 5, 2023

• 8

Creating a Coding Assistant with StarCoder

May 9, 2023

• 2

StarCoder: A State-of-the-Art LLM for Code

May 4, 2023

• 24

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Apr 5, 2023

• 15

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 29

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Dec 9, 2022

• 75

Evaluating Language Model Bias with 🤗 Evaluate

Oct 24, 2022

• 2

Announcing Evaluation on the Hub

Jun 28, 2022

Organizations

lvwerra's activity

New activity in bigcode/starcoderbase-7b 28 days ago

Adding `safetensors` variant of this model

#2 opened 6 months ago by

SFconvertbot

New activity in HuggingFaceTB/SmolLM-1.7B-Instruct about 1 month ago

v0.2 release deleted all files

#13 opened about 1 month ago by

Mxode

New activity in bigcode/README 3 months ago

Fix format & Add BigCodeBench

#10 opened 3 months ago by

terryyz

New activity in bigcode/in-the-stack 6 months ago

re-launch the space to solve the build error

#16 opened 6 months ago by

Tonic

Update app.py

#19 opened 6 months ago by

lvwerra

Update app.py

#18 opened 6 months ago by

lvwerra

New activity in bigcode/starcoder 6 months ago

Update README.md

#110 opened 6 months ago by

lvwerra

New activity in bigcode/the-stack-v2 6 months ago

🚩 Report: Legal issue(s)

#11 opened 6 months ago by

easrng

New activity in bigcode/starcoder2-3b 7 months ago

add dropout

#6 opened 7 months ago by

loubnabnl

New activity in bigcode/starcoder2-7b 7 months ago

add dropout

#7 opened 7 months ago by

loubnabnl

New activity in bigcode/starcoder2-15b 7 months ago

add dropout

#13 opened 7 months ago by

loubnabnl

commented a paper 7 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 132 •

New activity in bigcode/starcoder2-3b 7 months ago

Add architectures field to config.json

#2 opened 7 months ago by

chargoddard

New activity in bigcode/README 7 months ago

add SC2 and stack v2

#6 opened 7 months ago by

loubnabnl

New activity in bigcode/starcoder2-15b 7 months ago

NVIDIA framework and contribution updates.

#3 opened 7 months ago by

Criztov

New activity in bigcode/the-stack-v2 7 months ago

Update README.md

#2 opened 7 months ago by

lvwerra

New activity in bigcode/starcoder2-15b 7 months ago

Update README.md

#2 opened 7 months ago by

lvwerra

New activity in bigcode/starcoder2-7b 7 months ago

Update README.md

#1 opened 7 months ago by

lvwerra

New activity in bigcode/starcoder2-3b 7 months ago

Update README.md

#1 opened 7 months ago by

lvwerra

New activity in bigcode/the-stack-v2 7 months ago

Update README.md

#1 opened 7 months ago by

lvwerra

New activity in bigcode/starcoder2-15b 7 months ago

Update README.md

#1 opened 7 months ago by

lvwerra

New activity in bigcode/starcoder 7 months ago

Added clarifications about the model limitations, usage data, and content detection tools.

#104 opened 7 months ago by

hughesthe1st

New activity in bigcode/bigcode-models-leaderboard 8 months ago

Update README.md

#55 opened 8 months ago by

lvwerra

New activity in bigcode/in-the-stack 11 months ago

Update app.py

#11 opened 11 months ago by

lvwerra

Update app.py

#12 opened 11 months ago by

lvwerra

New activity in HuggingFaceH4/zephyr-7b-beta 11 months ago

Update README.md

#1 opened 11 months ago by

lvwerra

New activity in codellama/CodeLlama-13b-Instruct-hf about 1 year ago

Issues while deploying on AWS SageMaker with TGI

#7 opened about 1 year ago by

rajaswa-postman

New activity in lvwerra/starcoderbase-gsm8k about 1 year ago

Create README.md

#2 opened about 1 year ago by

vwxyzjn

Adding `safetensors` variant of this model

#1 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-13b-Instruct-hf about 1 year ago

Adding `safetensors` variant of this model

#4 opened about 1 year ago by

lvwerra

New activity in codellama/codellama-playground about 1 year ago

Ensure suffix delimiter begins with a space

#2 opened about 1 year ago by

pcuenq

Infilling update (untested)

#1 opened about 1 year ago by

pcuenq

New activity in codellama/CodeLlama-34b-hf about 1 year ago

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-34b-Instruct-hf about 1 year ago

Adding `safetensors` variant of this model

#4 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#5 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-34b-Python-hf about 1 year ago

Adding `safetensors` variant of this model

#2 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-34b-hf about 1 year ago

Adding `safetensors` variant of this model

#4 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-13b-Instruct-hf about 1 year ago

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#2 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-13b-Python-hf about 1 year ago

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#2 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-13b-hf about 1 year ago

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#2 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-7b-Instruct-hf about 1 year ago

Adding `safetensors` variant of this model

#4 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-7b-Python-hf about 1 year ago

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#2 opened about 1 year ago by

lvwerra

New activity in codellama/CodeLlama-7b-hf about 1 year ago

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

Adding `safetensors` variant of this model

#5 opened about 1 year ago by

lvwerra

New activity in codellama/README about 1 year ago

add org card

#1 opened about 1 year ago by

lvwerra

New activity in bigcode/README about 1 year ago

Update README.md

#5 opened about 1 year ago by

Muennighoff

Add OctoPack

#4 opened about 1 year ago by

Muennighoff

New activity in codeparrot/gradio-playground about 1 year ago

Update app.py

#1 opened about 1 year ago by

lvwerra

New activity in safetensors/convert about 1 year ago

fix multi-file conversion

#13 opened about 1 year ago by

lvwerra

New activity in bigcode/octocoder about 1 year ago

Adding `safetensors` variant of this model

#3 opened about 1 year ago by

lvwerra

New activity in trl-lib/stack-llama about 1 year ago

stack-llama-2

#37 opened about 1 year ago by

lvwerra

New activity in bigcode/stack-v2-extensions about 1 year ago

Languages + Extensions in v1.2

#1 opened about 1 year ago by

lvwerra

New activity in bigcode/search about 1 year ago

Add PoC disclaimer

#4 opened about 1 year ago by

christopher

New activity in Salesforce/codegen25-7b-instruct_P about 1 year ago

update metadata

#2 opened about 1 year ago by

lvwerra

Leandro von Werra

AI & ML interests

Articles

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

A failed experiment: Infini-Attention, and why we should keep trying?

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Welcome Llama 3 - Meta's new open LLM

StarCoder2 and The Stack v2

Constitutional AI with Open LLMs

Preference Tuning LLMs with Direct Preference Optimization Methods

Welcome Mixtral - a SOTA Mixture of Experts on Hugging Face

The N Implementation Details of RLHF with PPO

Finetune Stable Diffusion Models with DDPO via TRL

Spread Your Wings: Falcon 180B is here

Code Llama: Llama 2 learns to code

Fine-tune Llama 2 with DPO

The Falcon has landed in the Hugging Face ecosystem

Creating a Coding Assistant with StarCoder

StarCoder: A State-of-the-Art LLM for Code

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Evaluating Language Model Bias with 🤗 Evaluate

Announcing Evaluation on the Hub

Organizations

lvwerra's activity

Adding `safetensors` variant of this model

v0.2 release deleted all files

Fix format & Add BigCodeBench

re-launch the space to solve the build error

Update app.py

Update app.py

Update README.md

🚩 Report: Legal issue(s)

add dropout

add dropout

add dropout

Add architectures field to config.json

add SC2 and stack v2

NVIDIA framework and contribution updates.

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Update README.md

Added clarifications about the model limitations, usage data, and content detection tools.

Update README.md

Update app.py

Update app.py

Update README.md

Issues while deploying on AWS SageMaker with TGI

Create README.md

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Ensure suffix delimiter begins with a space

Infilling update (untested)

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

Adding `safetensors` variant of this model

add org card

Update README.md

Add OctoPack