Direct Preference Optimization Datasets - a davanstrien Collection

ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_instruction_following

Viewer • Updated Jun 12 • 60.9k • 40 • 3

ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized_honesty

Viewer • Updated Jun 12 • 60.9k • 36

HuggingFaceH4/testing_h4

Viewer • Updated Sep 22 • 70 • 86

yitingxie/rlhf-reward-datasets

Viewer • Updated Jan 1, 2023 • 81.4k • 493 • 60

Baidicoot/augmented_advbench_v4

Viewer • Updated May 7 • 4.95k • 40

sfanm/ultrafeedback_llama3_label

Viewer • Updated Jun 13 • 60k • 38

HuggingFaceH4/summarize_from_feedback

Viewer • Updated Mar 11 • 353k • 66 • 2

HuggingFaceH4/orca_dpo_pairs

Viewer • Updated Apr 14 • 12.9k • 149 • 24

zhengr/ultrafeedback_binarized

Viewer • Updated Nov 8, 2023 • 190k • 103 • 2

trl-internal-testing/hh-rlhf-trl-style

Viewer • Updated Mar 13 • 169k • 442 • 10

HuggingFaceH4/cai-conversation-harmless

Viewer • Updated Feb 2 • 44.8k • 208 • 13

HuggingFaceH4/rlaif-v_formatted

Viewer • Updated Jul 2 • 83.1k • 289 • 3

nz/anthropic_hh_rlhf

Viewer • Updated Mar 19 • 169k • 92

trl-internal-testing/sentiment-trl-style

Viewer • Updated Aug 6 • 5.48k • 338

SAGI-1/Greetings_DPO_dataset_V1

Viewer • Updated Dec 18, 2023 • 891 • 41 • 3

trl-internal-testing/tldr-preference-trl-style

Viewer • Updated Jun 25 • 179k • 321 • 3

xinlai/Math-Step-DPO-10K

Viewer • Updated Jul 4 • 10.8k • 657 • 27

ContextualAI/ultrafeedback_binarized_1percent

Viewer • Updated May 13 • 200 • 329

arcee-ai/distilabel-intel-orca-dpo-pairs-binarized

Viewer • Updated May 18 • 12.9k • 715 • 1

Syed-Hasan-8503/orpo-40k-train-test

Viewer • Updated Jun 3 • 44.2k • 42

maywell/ko_Ultrafeedback_binarized

Viewer • Updated Nov 9, 2023 • 62k • 56 • 28

sfanm/ultrafeedback_llama3_pad_rm

Viewer • Updated Jun 9 • 56.4k • 50

mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b

Viewer • Updated Dec 2, 2023 • 97.5k • 63

Synadapt/Orpo_Split_Turns_v1_clean_ready

Viewer • Updated Jun 14 • 8.1k • 38

HuggingFaceH4/h4-tests-format-dpo-dataset

Viewer • Updated Mar 10 • 1 • 42

when2rl/tldr-summarisation-preferences_reformatted

Viewer • Updated May 9 • 177k • 61

alvarobartt/dpo-mix-7k-simplified

Viewer • Updated Mar 26 • 7.5k • 61 • 11

mlabonne/orpo-dpo-mix-40k-flat

Viewer • Updated Jun 7 • 44.2k • 294 • 9

valerielucro/gsm8k_preference_dataset

Viewer • Updated Jun 19 • 895 • 38

cyberagent/chatbot-arena-ja-calm2-7b-chat-experimental

Viewer • Updated Aug 15 • 29.2k • 43 • 16

allenai/preference-test-sets

Viewer • Updated Mar 14 • 43.2k • 788 • 18

pharaouk/ultrafeedback-binarized-preferences-cleaned

Viewer • Updated Apr 5 • 60.9k • 47

smangrul/ultrachat-feedback-10k-chatml

Viewer • Updated Jan 27 • 12k • 45

yuasosnin/imdb-dpo

Viewer • Updated Dec 11, 2023 • 10k • 68

beyond/rlhf-reward-single-round-trans_chinese

Viewer • Updated Jul 5, 2023 • 24.9k • 107 • 37

Katayoon/SELM-Zephyr-7B-dataset

Viewer • Updated Jul 18 • 51.8k • 67

Magpie-Align/Magpie-Pro-DPO-200K

Viewer • Updated Aug 20 • 207k • 38 • 5

trl-internal-testing/mlabonne-chatml-dpo-pairs-copy

Viewer • Updated Jan 11 • 12.9k • 55

gx-ai-architect/HelpSteer2_DPO

Viewer • Updated Jun 24 • 7.59k • 55 • 1

when2rl/UltraFeedback_binarized_cleaned_annotated

Viewer • Updated Apr 17 • 62.7k • 60

youjunhyeok/ko-orca-pair-and-ultrafeedback-dpo

Viewer • Updated May 22 • 72.5k • 91 • 2

xiaodongguaAIGC/awesome-dpo

Viewer • Updated Jul 3 • 302k • 58 • 2

banghua/tldr_reward_model_labeled

Viewer • Updated Sep 21, 2023 • 176k • 49

pythainlp/oasst2_dpo_pairs_enth

Viewer • Updated Jun 16 • 5.28k • 44 • 1

YYYYYYibo/ultrafeedback_binarized_with_response_full_part0

Viewer • Updated Jul 17 • 20k • 39

dinaaaaaa/lima_rand_sel_50_preference

Viewer • Updated Mar 29 • 500 • 36

argilla/OpenHermesPreferences

Viewer • Updated Mar 1 • 989k • 3.58k • 199

kira/math-dpo

Viewer • Updated Jul 2 • 2.42k • 132 • 5

kaist-ai/Multifaceted-Collection-DPO

Viewer • Updated Jul 1 • 65.1k • 66 • 8

YYYYYYibo/ultrafeedback_binarized_with_response_full_part1

Viewer • Updated Jul 17 • 20k • 36

princeton-nlp/llama3-ultrafeedback-armorm

Viewer • Updated Jul 18 • 61.8k • 779 • 14

mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia6.9b

Viewer • Updated Jun 20 • 177k • 58

yaswanthchittepu/ultrafeedback-binarized-standard-margin-data-full

Viewer • Updated Jul 7 • 63.7k • 41

mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_pythia1b

Viewer • Updated May 16 • 177k • 44

nebchi/kor-orpo

Viewer • Updated Jun 18 • 98.1k • 44 • 1

wenbopan/Chinese-dpo-pairs

Viewer • Updated Apr 2 • 10.7k • 98 • 37

abhayesian/augmented_advbench_v5

Viewer • Updated Jul 5 • 4.95k • 34

aklein4/tldr-feedback

Viewer • Updated Jun 26 • 179k • 35

BramVanroy/ultra_feedback_dutch

Viewer • Updated Apr 18 • 53.6k • 79 • 2

yaswanthchittepu/ultrafeedback-binarized-pop-margin-data-full

Viewer • Updated Jul 7 • 63.7k • 35

RAY2L/llama3-ultrafeedback-mini

Viewer • Updated Jun 21 • 1.2k • 36

David-Xu/astronomy-stack-dpo-text

Viewer • Updated Mar 8 • 19.9k • 54 • 1

GitBag/multiturn-hh-turn-1-5

Viewer • Updated Jun 13 • 162k • 61

yhavinga/orpo-dpo-mix-dutch-40k

Viewer • Updated Jul 4 • 43.1k • 67 • 1

HuggingFaceH4/grok-conversation-harmless

Viewer • Updated Feb 2 • 44.8k • 105 • 21

rajj0/god_sent_datav1

Viewer • Updated Jun 5 • 2.84k • 36

GrowingApple/orpo_kor_translated_medical

Viewer • Updated Jun 12 • 10.4k • 41 • 3

trl-internal-testing/Anthropic-hh-rlhf-processed

Viewer • Updated Mar 13 • 3k • 41

GitBag/multiturn-512-hh-turn-1-5

Viewer • Updated Jun 28 • 165k • 61 • 1

snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset

Viewer • Updated Jan 23 • 62.7k • 118 • 42

maywell/ko_Ultrafeedback_binarized_10k

Viewer • Updated Nov 4, 2023 • 10k • 47 • 5

YYYYYYibo/ultrafeedback_binarized_with_response_full_part2

Viewer • Updated Jul 17 • 21.1k • 39

trl-internal-testing/descriptiveness-trl-style

Viewer • Updated Aug 6 • 5.42k • 63 • 1

mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144

Viewer • Updated May 13 • 179k • 57

AlpacaAAR/epfl-synthetic-dpo

Viewer • Updated Jun 12 • 19.6k • 147

justinphan3110/toxic-dpo-v0.2-sft

Viewer • Updated May 29 • 540 • 40

minkyungpark/UFB_test_500

Viewer • Updated Jul 4 • 500 • 44

kaist-ai/Multifaceted-Collection-ORPO

Viewer • Updated Jul 1 • 64.6k • 61 • 9

orpo-explorers/OpenHermesPreferences-10k

Viewer • Updated Mar 30 • 10k • 36 • 2

when2rl/SHP_reformatted

Viewer • Updated May 27 • 386k • 55

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1

Viewer • Updated May 20 • 20k • 38

VictorDCh/spider-dpo-dataset

Viewer • Updated Jul 1 • 901 • 41

when2rl/Nectar_reformatted

Viewer • Updated Jun 5 • 183k • 38

lightblue/mitsu_full_borda

Viewer • Updated May 30 • 2.85k • 57 • 2

ibivibiv/cleaned_orca_math_dpo_pairs

Viewer • Updated May 24 • 200k • 44 • 1

when2rl/PKU-SafeRLHF_reformatted_filtered

Viewer • Updated May 27 • 136k • 40

IlyaGusev/saiga_preferences

Viewer • Updated 12 days ago • 30.6k • 198 • 4

Baidicoot/anthropic-harmless-rlhf

Viewer • Updated May 10 • 42.5k • 83

tasksource/tasksource_dpo_pairs

Viewer • Updated Jul 1 • 5.13M • 301 • 21

reciprocate/ultrafeedback_orca_math_dpo

Viewer • Updated Jan 8 • 73.8k • 40 • 1

zaddyzaddy/randomcrawl

Viewer • Updated Jun 15 • 100k • 37

abacusai/MetaMath_DPO_FewShot

Viewer • Updated Feb 26 • 395k • 120 • 25

Baidicoot/hh-rlhf-golden-harmful

Viewer • Updated May 10 • 7.64k • 52 • 1

We-Want-GPU/Yi-Ko-DPO-dataset

Viewer • Updated Dec 9, 2023 • 4k • 34 • 4

wisenut-nlp-team/dpo_test2

Viewer • Updated Jun 11 • 100 • 39

tasksource/oasst2_pairwise_rlhf_reward

Viewer • Updated Jan 9 • 28.4k • 47 • 2

reciprocate/dpo_ultra-capybara-code_filtered-best

Viewer • Updated Mar 19 • 35.2k • 39

Baidicoot/anthropic-hh-rlhf

Viewer • Updated May 10 • 169k • 75

when2rl/distilabel-intel-orca-dpo-pairs_cleaned_reformatted

Viewer • Updated Apr 17 • 12.8k • 47

JamesSpray/dpo_dataset_hh

Viewer • Updated Jul 14 • 24.2k • 44

kaitchup/UltraFeedback-prompt-chosen-rejected

Viewer • Updated Oct 23, 2023 • 18k • 48 • 6

rajj0/god_sent_data_v2

Viewer • Updated Jun 9 • 2.84k • 35

arham6/dataset3

Viewer • Updated Jun 25 • 258 • 41

gabjp/PKU-safe-dpo

Viewer • Updated Jun 28 • 75.1k • 40

Windy/tmp_output

Viewer • Updated Jun 30 • 60 • 45

Columbia-NLP/DPO-HelpSteer

Viewer • Updated Jul 10 • 9.17k • 40

NobodyExistsOnTheInternet/ToxicDPOqa

Viewer • Updated Apr 26 • 6.87k • 40 • 14

sfanm/ultrafeedback_llama3

Viewer • Updated Jun 12 • 60.2k • 47

when2rl/distilabel-capybara-dpo-7k-binarized_reformatted

Viewer • Updated Apr 17 • 7.56k • 59

when2rl/py-dpo-v0.1_reformatted

Viewer • Updated Apr 17 • 9.47k • 38

ineskoder/KIBRAM_dataset

Viewer • Updated May 29 • 72.2k • 37

alexredna/oasst2_dpo_pairs

Viewer • Updated Jul 17 • 10k • 45 • 6

mintaeng/dpo_ko_mj

Viewer • Updated Jun 18 • 3k • 47

abacusai/ARC_DPO_FewShot

Viewer • Updated Feb 26 • 4.25k • 73 • 17

2A2I/Aya-Command.R-DPO

Viewer • Updated May 16 • 14.2k • 59 • 7

pgurazada1/ultrafeedback-sample

Viewer • Updated Jul 2 • 315 • 60

when2rl/HelpSteer_reformatted

Viewer • Updated May 27 • 9.17k • 44

YYYYYYibo/full_simple_online_train_part_2

Viewer • Updated Jul 4 • 19k • 37

YYYYYYibo/full_simple_online_train_part_3

Viewer • Updated Jul 4 • 19.3k • 34

YYYYYYibo/gshf_vllm_1_part_2

Viewer • Updated Jul 5 • 20k • 39

YYYYYYibo/gshf_vllm_2_part_2

Viewer • Updated Jul 5 • 20k • 34

YYYYYYibo/gshf_train_part_2

Viewer • Updated Jul 5 • 20k • 36

YYYYYYibo/gshf_vllm_2_part_3

Viewer • Updated Jul 5 • 21.1k • 34

lca0503/ultrafeedback-binarized-preferences-cleaned

Viewer • Updated Jul 8 • 60.9k • 58

We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs

Viewer • Updated Dec 18, 2023 • 12.7k • 64 • 5

lightblue/mitsu_tophalf_borda

Viewer • Updated May 30 • 1.42k • 66 • 5

2A2I/Aya-SambaLingo.Arabic.Chat-DPO

Viewer • Updated May 25 • 14.2k • 56 • 3

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887192

Viewer • Updated Feb 2 • 405 • 38

ShenaoZhang/0.0_4iters_bs256_nodpo_only4w_dataset

Viewer • Updated Apr 28 • 24k • 40

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_0

Viewer • Updated May 5 • 5.08k • 32

arcee-ai/general-dpo-datasets

Viewer • Updated Jul 4 • 91.6k • 108

argilla/ultrafeedback-multi-binarized-preferences-cleaned

Viewer • Updated Dec 11, 2023 • 158k • 193 • 6

Asap7772/ultrafeedback_binarized_relabelled_ultrarm

Viewer • Updated Jan 24 • 63.1k • 42

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2

Viewer • Updated Mar 22 • 568k • 78

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_1

Viewer • Updated May 5 • 5.28k • 36

ibivibiv/cleaned_math_dpo_pairs

Viewer • Updated May 19 • 760k • 36

wenzhy7/llama2_orpo_ei

Viewer • Updated Jun 23 • 2.05k • 35

orpo-explorers/ultrafeedback_binarized_15k

Viewer • Updated Apr 18 • 15.4k • 38 • 4

ThWu/dpo_highest_n_random

Viewer • Updated Jul 1 • 182k • 48 • 2

agicorp/MetaMath_DPO_FewShot

Viewer • Updated Mar 23 • 395k • 69 • 2

2A2I/Aya-AceGPT.13B.Chat-DPO

Viewer • Updated May 16 • 13k • 75 • 2

Trelis/orpo-dpo-mix-40k-SHORT

Viewer • Updated May 11 • 7.19k • 43 • 2

Code-Refinement/utf_20_refs_pairs

Viewer • Updated Feb 16 • 3.68k • 40

ShenaoZ/0.0_dataup_4iters_dataset

Viewer • Updated Apr 6 • 51.8k • 46

lightblue/mitsu_top75_borda

Viewer • Updated May 30 • 2.02k • 45

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_2

Viewer • Updated May 5 • 5.08k • 41

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_3_mini_3

Viewer • Updated May 5 • 5.09k • 35

ShenaoZ/0.00001_withdpo_4iters_bs256_555lr_dataset

Viewer • Updated May 6 • 51.8k • 37

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1

Viewer • Updated May 6 • 19.6k • 34

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2

Viewer • Updated May 6 • 20.7k • 38

nhyha/ORPO-DPO

Viewer • Updated Jun 12 • 1.68k • 48

cmcmaster/clinical_cases_preferences

Viewer • Updated Jun 21 • 7.94k • 34

valerielucro/gsm8k_preference_dataset_2.1

Viewer • Updated Jun 27 • 1.21k • 35

malhajar/orca_dpo_pairs-tr

Viewer • Updated Mar 30 • 10.8k • 124 • 6

Deojoandco/reward_model_anthropic

Viewer • Updated Mar 24, 2023 • 169k • 41

Astris/Nectar-Ranked-DPO

Viewer • Updated Jul 1 • 503k • 49

ShenaoZ/0.001_ablation_5iters_bs256_dataset

Viewer • Updated Apr 22 • 56.9k • 46

ShenaoZ/0.0001_withdpo_4iters_bs256_4444lr_dataset

Viewer • Updated May 5 • 51.8k • 35

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0

Viewer • Updated May 6 • 19.6k • 34

ShenaoZ/0.0001_sft_nodpo_3iters_bs256_531lr_dataset

Viewer • Updated May 7 • 67.1k • 37

2A2I/NoRobots-Command.R-DPO

Viewer • Updated May 29 • 9.5k • 50

Tachi67/mnlp_dpo_data_7k

Viewer • Updated May 31 • 7.66k • 40

d-llm/hh-rlhf

Viewer • Updated Jun 11 • 160k • 37

allenai/coconot

Viewer • Updated Jul 18 • 13.8k • 261 • 4

vicgalle/configurable-system-prompt-multitask

Viewer • Updated Apr 23 • 1.95k • 165 • 19

reciprocate/math_dpo_pairs

Viewer • Updated Jan 5 • 4.38k • 47 • 5

vicgalle/OpenHermesPreferences-roleplay

Viewer • Updated Feb 29 • 3.06k • 43 • 3

orpo-explorers/OpenHermesPreferences-500k

Viewer • Updated Mar 30 • 500k • 42 • 2

d0rj/full-hh-rlhf-ru

Viewer • Updated Jul 2 • 125k • 83 • 2

ummagumm-a/cup-it-ds-classification-pairwise

Viewer • Updated Mar 19, 2023 • 282k • 91

ShenaoZ/0.001_ablation_4iters_bs256_decalpha_dataset

Viewer • Updated Apr 23 • 51.8k • 57

ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_userresponse_dataset

Viewer • Updated Apr 26 • 67.1k • 35

ShenaoZ/0.001_ablation_4iters_bs256_only2third_dataset

Viewer • Updated Apr 26 • 2k • 37

YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_2

Viewer • Updated Apr 28 • 1k • 39

ShenaoZ/0.00005_withdpo_4iters_bs256_555lr_dataset

Viewer • Updated May 5 • 51.8k • 42

ibivibiv/nectar_dpo_cleaned

Viewer • Updated May 19 • 3.84M • 112

ibivibiv/cleaned_math_dpo_pairs_eval

Viewer • Updated May 19 • 40k • 39

mnlp-nsoai/dpo-student-preference-pairs

Viewer • Updated May 22 • 18.4k • 41

arham6/dataset2

Viewer • Updated Jun 24 • 258 • 35

aklein4/tldr-feedback-shuffled

Viewer • Updated Jun 30 • 179k • 64

fblgit/simple-math-DPO

Viewer • Updated Aug 1 • 800k • 156 • 16

abacusai/HellaSwag_DPO_FewShot

Viewer • Updated Feb 26 • 150k • 61 • 8

lamhieu/beyond_dpo_vi

Viewer • Updated Jul 1 • 25k • 63

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1707245027

Viewer • Updated Feb 7 • 1M • 120

0-hero/distilabel-math-preference-dpo

Viewer • Updated Jul 2 • 2.42k • 48

ShenaoZhang/0.001_idpo_ref_response

Viewer • Updated Apr 5 • 44.8k • 34

ShenaoZhang/0.001_idpo_same_replacechosen_only_dataset

Viewer • Updated Apr 6 • 44.8k • 38

when2rl/prm_dpo_pairs_cleaned_reformatted

Viewer • Updated Apr 19 • 7.99k • 40

thesven/pihkal-tihkal-orpo-dpo-dataset

Viewer • Updated Apr 26 • 3.46k • 38

cornfieldrm/prm800k-phase2

Viewer • Updated Apr 28 • 81.6k • 35

ShenaoZ/0.00001_withdpo_4iters_bs256_531lr_dataset

Viewer • Updated May 1 • 51.8k • 64

GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_lora-sft-finetuned-stage4-iter86000

Viewer • Updated May 22 • 20.8k • 34

2A2I/NoRobots-Aya.23.8B-DPO

Viewer • Updated May 29 • 9.5k • 50

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2

Viewer • Updated Jun 17 • 20k • 41

mlabonne/arena-preferences

Viewer • Updated Apr 27 • 2.69k • 50 • 9

d0rj/rlhf-reward-datasets-ru

Viewer • Updated Jul 2 • 81.4k • 59 • 4

2A2I/Aya-Aya.23.8B-DPO

Viewer • Updated May 29 • 14k • 44 • 2

d0rj/synthetic-instruct-gptj-pairwise-ru

Viewer • Updated Jul 2 • 33.1k • 317 • 1

reciprocate/ultrafeedback_orca_math_cleaned_high_dpo

Viewer • Updated Jan 11 • 48.3k • 43 • 1

lamhieu/itorca_dpo_vi

Viewer • Updated Jul 1 • 12.9k • 66

SUSTech/bagel-sft

Viewer • Updated Jan 27 • 727k • 56

elfonthefly/STEM_DPO

Viewer • Updated May 23 • 1.45M • 52 • 1

YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_3

Viewer • Updated Jun 17 • 21.1k • 38

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2

Viewer • Updated Jun 17 • 20k • 45

quyanh/lexglue-cot-dpo

Viewer • Updated Jul 11 • 4k • 42

efederici/alpaca-vs-alpaca-orpo-dpo

Viewer • Updated May 15 • 49.2k • 99 • 6

pszemraj/SHP-2-dpo-100k_sample

Viewer • Updated Jul 1 • 200k • 130 • 1

floleuerer/distilabel-intel-orca-dpo-pairs-binarized

Viewer • Updated Jan 14 • 5.92k • 54

arcee-ai/OpenHermesPreferences-binarized

Viewer • Updated May 18 • 989k • 57 • 1

YYYYYYibo/full_simple_online_vllm_part_2

Viewer • Updated Jul 4 • 19k • 37

YYYYYYibo/full_simple_online_vllm_part_3

Viewer • Updated Jul 4 • 19.3k • 34

YYYYYYibo/gshf_vllm_1_part_3

Viewer • Updated Jul 5 • 21.1k • 34

YYYYYYibo/gshf_train_part_3

Viewer • Updated Jul 5 • 21.1k • 33

BramVanroy/orca_dpo_pairs_dutch

Viewer • Updated Apr 24 • 11k • 75 • 5

erhwenkuo/rlhf_reward_single_round-chinese-zhtw

Viewer • Updated Oct 4, 2023 • 24.9k • 42 • 3

HuggingFaceH4/cai-conversation

Viewer • Updated Dec 6, 2023 • 169k • 52 • 3

We-Want-GPU/yi-ko-DPO-noprompt-dataset

Viewer • Updated Dec 6, 2023 • 3.83k • 39 • 2

allenai/reward-bench-results

Updated 16 days ago • 19.8k • 2

droussis/UltraSafety_binarized-orpo-dpo

Viewer • Updated Apr 25 • 2.26k • 45 • 2

AlexHung29629/stack-exchange-paired-128K

Viewer • Updated Jul 3 • 128k • 38 • 1

giux78/50000-60900-ultrafeedback-binarized-preferences-cleaned-ita

Viewer • Updated Jan 17 • 10.9k • 35

roleplay4fun/chai-valid-pairs-ss5-v1.0

Viewer • Updated Feb 27 • 12.2k • 34

orpo-explorers/OpenHermesPreferences-50k

Viewer • Updated Mar 30 • 50k • 34

Tachi67/mnlp_dpo_data

Viewer • Updated May 24 • 25.4k • 40

euiyulsong/sci_train_ds

Viewer • Updated May 14 • 11.7k • 34

arcee-ai/truthy-dpo-v0.1-binarized

Viewer • Updated May 18 • 1.02k • 40

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_3

Viewer • Updated May 19 • 5k • 37

2A2I/NoRobots-SambaLingo.Arabic.Chat-DPO

Viewer • Updated May 29 • 9.5k • 58

patruff/chuckles_dpo_pairsA

Viewer • Updated May 27 • 106 • 39

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_0

Viewer • Updated Jun 17 • 5k • 33

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_2

Viewer • Updated Jun 17 • 20k • 40

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3

Viewer • Updated Jun 18 • 21.1k • 38

varun-v-rao/mimic_cxr_dpo

Viewer • Updated Dec 10, 2023 • 125k • 41

alvarobartt/ultrafeedback-multi-binarized-quality-preferences-cleaned

Viewer • Updated Dec 20, 2023 • 155k • 40

Sharathhebbar24/orca_dpo_pairs

Viewer • Updated Feb 10 • 12.9k • 46

jikaixuan/mistral02_generated

Viewer • Updated Feb 27 • 61.1k • 47

boopysaur/user2-dpo-small

Updated Mar 8 • 34

quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4

Viewer • Updated Mar 11 • 2.83k • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3

Viewer • Updated Mar 21 • 568k • 185

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_1

Viewer • Updated Mar 21 • 568k • 98

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1

Viewer • Updated Mar 22 • 568k • 141

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3

Viewer • Updated Mar 23 • 568k • 112

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_1

Viewer • Updated Mar 25 • 189k • 56

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_2

Viewer • Updated Mar 25 • 568k • 120

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_2

Viewer • Updated Mar 25 • 189k • 48

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2

Viewer • Updated Mar 25 • 189k • 48

Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0

Viewer • Updated Mar 26 • 94.6k • 43

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.9

Viewer • Updated Mar 26 • 568k • 76

ShenaoZ/0.0_dataup_dataset

Viewer • Updated Apr 5 • 44.8k • 42

YYYYYYibo/eval-dataset-nash

Viewer • Updated May 2 • 1k • 49

ShenaoZ/0.0005_withdpo_4iters_bs256_555lr_dataset

Viewer • Updated May 5 • 51.8k • 34

ShenaoZhang/0.0_zephyr_5551_4iters_bs256_dataset

Viewer • Updated May 13 • 2k • 41

euiyulsong/generated_data

Viewer • Updated May 17 • 452 • 37

arcee-ai/OpenHermes2.5-dpo-binarized-alpha

Viewer • Updated May 18 • 9.79k • 48

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3

Viewer • Updated May 20 • 21.1k • 39

2A2I/NoRobots-AceGPT.13B.Chat-DPO

Viewer • Updated May 29 • 9.5k • 42

jayhii/orpo_2sep_data_font

Viewer • Updated Jun 7 • 10k • 35

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_3

Viewer • Updated Jun 16 • 5k • 33

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_0

Viewer • Updated Jun 16 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_1

Viewer • Updated Jun 16 • 5k • 40

YYYYYYibo/ultrafeedback_binarized_ave_pi_minpi_part_2

Viewer • Updated Jun 17 • 20k • 34

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3

Viewer • Updated Jun 17 • 21.1k • 37

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_0

Viewer • Updated Jun 17 • 5k • 39

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_minpi_part_3

Viewer • Updated Jun 18 • 21.1k • 42

valerielucro/gsm8k_preference_dataset_2

Viewer • Updated Jun 27 • 379 • 36

reshinthadith/pairwise-code-review-instruct-critique-revision-python

Viewer • Updated Jan 9, 2023 • 5.24k • 148 • 7

NickyNicky/neovalle_H4rmony_dpo_translated_English_to_Spanish

Viewer • Updated May 17 • 2.02k • 43 • 4

HuggingFaceH4/cai-conversation-harmless-old

Viewer • Updated Dec 10, 2023 • 44.8k • 98 • 3

Starlento/DPO-En-Zh-20k-handbook

Viewer • Updated May 2 • 20k • 49 • 3

AlekseyKorshuk/davinci-pairwise-medium

Viewer • Updated Feb 8, 2023 • 72k • 66

AlekseyKorshuk/cup-it-ds-pairwise

Viewer • Updated Mar 18, 2023 • 352k • 37

banghua/hh_reward_model_labeled

Viewer • Updated Aug 6, 2023 • 125k • 46

pvduy/dpo_data

Viewer • Updated Jan 11 • 197k • 43

vwxyzjn/cai-conversation-dev1705951688

Viewer • Updated Jan 22 • 256 • 52

lamhieu/beyond_dpo_en

Viewer • Updated Jul 1 • 25k • 72

CognitiveLab/hh-rlhf-json

Viewer • Updated Jan 24 • 161k • 40

vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330973

Viewer • Updated Feb 7 • 167 • 40

sanduntg/test_vsort_classification

Viewer • Updated Feb 8 • 99 • 43

vwxyzjn/ultrafeedback_binarized_1707921333

Viewer • Updated Feb 14 • 2k • 56

mnoukhov/openai_comparisons_20k_regen_and_relabelled

Viewer • Updated Feb 18 • 20k • 34

vwxyzjn/ultrafeedback_binarized_1708454270

Viewer • Updated Feb 20 • 25.3k • 63

vwxyzjn/ultrafeedback_binarized_1708458397

Viewer • Updated Feb 20 • 25.3k • 46

Baidicoot/anthropic_hh_golden_mistral

Viewer • Updated Mar 1 • 42.1k • 35

hon9kon9ize/yue-truthy

Viewer • Updated Mar 8 • 2.03k • 37

vwxyzjn/hh-rlhf

Viewer • Updated Mar 13 • 100 • 49

reciprocate/dpo_ultra-capybara_filtered-best

Viewer • Updated Mar 14 • 25.6k • 34

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_160m

Viewer • Updated Mar 14 • 37.9k • 38

boopysaur/user3-dpo-small

Updated Mar 20 • 32

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.1_self_160m

Viewer • Updated Mar 21 • 37.9k • 42

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_1

Viewer • Updated Mar 21 • 568k • 158

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_2

Viewer • Updated Mar 23 • 568k • 103

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_3

Viewer • Updated Mar 21 • 568k • 125

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3

Viewer • Updated Mar 21 • 568k • 125

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1

Viewer • Updated Mar 23 • 568k • 203

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1

Viewer • Updated Mar 22 • 568k • 130

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2

Viewer • Updated Mar 23 • 568k • 146

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3

Viewer • Updated Mar 23 • 568k • 78

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3

Viewer • Updated Mar 23 • 568k • 101

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_1

Viewer • Updated Mar 25 • 189k • 62

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_1

Viewer • Updated Mar 24 • 189k • 41

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_2

Viewer • Updated Mar 24 • 189k • 59

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2

Viewer • Updated Mar 24 • 189k • 59

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_3

Viewer • Updated Mar 24 • 568k • 171

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_3

Viewer • Updated Mar 24 • 568k • 176

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1

Viewer • Updated Mar 25 • 189k • 45

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_2

Viewer • Updated Mar 25 • 189k • 59

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_3

Viewer • Updated Mar 25 • 189k • 66

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_2_t_1.0

Viewer • Updated Mar 25 • 568k • 90

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.25

Viewer • Updated Mar 26 • 568k • 81

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.9

Viewer • Updated Mar 27 • 568k • 221

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.9

Viewer • Updated Mar 27 • 568k • 118

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 78

UCLAML/data-RPO-Iter1-New-309_generated

Viewer • Updated Apr 21 • 20k • 40

ShenaoZ/0.001_ablation_4iters_bs256_nodpo_dataset

Viewer • Updated Apr 23 • 69.1k • 46

ShenaoZ/0.001_ablation_4iters_bs256_useresponse_dataset

Viewer • Updated Apr 26 • 17.3k • 38

ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_dataset

Viewer • Updated Apr 29 • 67.1k • 95

YYYYYYibo/ultrafeedback_binarized_phase_2_ranked

Viewer • Updated Apr 29 • 9.28k • 41

nbalepur/Mnemonic_Chosen_Rejected

Viewer • Updated Apr 29 • 472 • 39

YYYYYYibo/eval-dataset-with-score-rank4

Viewer • Updated May 2 • 200 • 40

ShenaoZ/0.0001_withdpo_3iters_bs256_531lr_dataset

Viewer • Updated May 3 • 44.8k • 47

vipinkatara/dataset_complete_12

Viewer • Updated May 3 • 220k • 35

YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_1

Viewer • Updated May 3 • 5k • 39

YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_2

Viewer • Updated May 3 • 5k • 33

YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_3

Viewer • Updated May 4 • 5k • 36

YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_3

Viewer • Updated May 5 • 20.5k • 34

StrangeSX/SGXT1

Viewer • Updated May 5 • 99 • 38

YYYYYYibo/ultrafeedback_binarized_dataset_offline_part1

Viewer • Updated May 6 • 19.6k • 35

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_2

Viewer • Updated May 7 • 19.1k • 38

ShenaoZ/0.0001_sft_nodpo_5iters_bs256_5102lr_dataset

Viewer • Updated May 8 • 71.1k • 71

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_3

Viewer • Updated May 9 • 4.85k • 38

YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_3

Viewer • Updated May 16 • 21.1k • 38

DuongTrongChi/detoxic-dpo-format

Viewer • Updated May 16 • 46.6k • 41

arcee-ai/multiturn-capybara-preferences-filtered-binarized

Viewer • Updated May 18 • 14.8k • 55

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.20

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.00

Updated May 20 • 38

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.00

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.00

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.50

Updated May 20 • 36

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.50

Updated May 20 • 33

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_1

Viewer • Updated May 20 • 5k • 33

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_2

Viewer • Updated May 20 • 5k • 33

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_0

Viewer • Updated May 20 • 5.28k • 32

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3

Viewer • Updated May 20 • 21.1k • 43

mcding-org/CorrectDPO-Eval-DPO_Pm3B_U0_beta0.10

Updated May 21 • 35

mcding-org/CorrectDPO-Eval-DPO_L8B_U0_beta0.10

Updated May 21 • 38

Piteryo/hf-trl-1024

Viewer • Updated May 24 • 1.28k • 42

ContextualAI/ultrabin_clean_max_chosen_min_rejected_rationalized

Viewer • Updated Jun 12 • 60.9k • 40

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_2_mini_2

Viewer • Updated Jun 16 • 5k • 33

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_3

Viewer • Updated Jun 17 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_2

Viewer • Updated Jun 17 • 5.28k • 37

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_3

Viewer • Updated Jun 17 • 5.29k • 39

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_0

Viewer • Updated Jun 17 • 5k • 38

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_3

Viewer • Updated Jun 17 • 5.29k • 34

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_3

Viewer • Updated Jun 18 • 5.29k • 38

y1xing/orpo_llama3_concatenated_data_with_chris_examples_orpo_instruct_dataset

Viewer • Updated Jul 6 • 2.64k • 36

argilla/ultrafeedback-multi-binarized-quality-preferences-cleaned

Viewer • Updated Dec 11, 2023 • 155k • 43 • 4

mii-community/ultrafeedback-preferences-translated-ita

Viewer • Updated Feb 21 • 60.9k • 63 • 3

vicgalle/OpenHermesPreferences-1k

Viewer • Updated Feb 29 • 1.11k • 40 • 3

mlabonne/oasst-preferences

Viewer • Updated Apr 22 • 22.3k • 48 • 3

beyond/rlhf-reward-single-round

Viewer • Updated Jul 4, 2023 • 25k • 118 • 2

alvarobartt/Anthropic_HH_Golden_Formatted

Viewer • Updated Dec 14, 2023 • 44.8k • 35 • 2

distilabel-internal-testing/ohp-writing

Viewer • Updated Apr 10 • 1.53k • 37 • 2

NickyNicky/function_call_orpo_sft_phi3_chatML_only

Viewer • Updated May 2 • 66k • 46 • 2

PawanKrd/dpo-gpt-4o

Viewer • Updated Jun 28 • 12.4k • 43 • 10

d0rj/oasst1_pairwise_rlhf_reward-ru

Viewer • Updated Jul 2 • 18.9k • 85 • 1

Palash123/dpo_anthropic_hh_rlhf

Viewer • Updated Dec 4, 2023 • 168k • 73 • 1

sablo/HelpSteer_binarized

Viewer • Updated Jan 18 • 8.55k • 54 • 1

SUSTech/bagel-dpo

Viewer • Updated Jan 27 • 192k • 48 • 1

winglian/cortex-0_1-loss

Viewer • Updated Feb 10 • 402 • 39 • 1

vtiyyal1/AskDocsEmpathy_4k_dpo

Viewer • Updated Mar 11 • 4.12k • 39 • 1

Suraponn/iapp_for_orpo

Viewer • Updated Mar 18 • 121k • 36 • 1

umarigan/openhermespreference_tr

Viewer • Updated Apr 24 • 989k • 55 • 2

orpo-explorers/OHP-15k

Viewer • Updated Apr 22 • 15.4k • 39 • 1

NickyNicky/oasst2_orpo_mix_tokenizer_phi_3_v1

Viewer • Updated Apr 30 • 54.3k • 44 • 1

NickyNicky/Colossal_Translation_EN_ES_ORPO_DPO_Gemma

Viewer • Updated May 6 • 1.7M • 54 • 2

NickyNicky/DIBT_prompts_ranked_En_Es_orpo_dpo_chatML_gemma_V3

Viewer • Updated May 14 • 20.4k • 36 • 1

NickyNicky/nano_finance_200k_en_es_chatML_gemma_orpo_dpo

Viewer • Updated May 29 • 201k • 47 • 1

AlekseyKorshuk/chai-real-and-synthetic

Viewer • Updated Feb 10, 2023 • 154k • 94

ummagumm-a/cup-it-ds-classification-pairwise-train-val

Viewer • Updated Mar 19, 2023 • 352k • 82

AlekseyKorshuk/lmeh-hh

Viewer • Updated May 18, 2023 • 12.5k • 40

samxm111/rlhf-reward-single-round

Viewer • Updated Aug 19, 2023 • 25k • 41

abhishek/dpo-sample

Viewer • Updated Oct 30, 2023 • 7 • 38

alvarobartt/Anthropic_HH_Golden_Extended

Viewer • Updated Dec 14, 2023 • 89.7k • 35

mnoukhov/openai_summarize_generated_20k_relabel_410m_dpo1

Viewer • Updated Dec 18, 2023 • 20k • 32

mnoukhov/openai_summarize_generated_20k_relabel_1b

Viewer • Updated Dec 18, 2023 • 20k • 34

dvilasuero/multiturn_with_generations

Viewer • Updated Dec 20, 2023 • 100 • 38

GokhanAI/INST_Synthetic_LLAMA

Viewer • Updated Dec 22, 2023 • 26.3k • 39

0x7o/oasst-ru-dpo-v1

Viewer • Updated Dec 27, 2023 • 1.32k • 39

Jaredquek/dpoedtech

Viewer • Updated Jan 5 • 3.25k • 35

jan-hq/ultrafeedback_quality_binarized

Viewer • Updated Jan 9 • 155k • 60

giux78/10000-20000-ultrafeedback-binarized-preferences-cleaned-ita

Viewer • Updated Jan 16 • 10k • 46

giux78/20000-50000-ultrafeedback-binarized-preferences-cleaned-ita

Viewer • Updated Jan 17 • 30k • 41

vwxyzjn/cai-conversation-dev1705525723

Viewer • Updated Jan 17 • 256 • 59

CognitiveLab/hh-rlhf-formatted

Viewer • Updated Jan 18 • 161k • 38

CognitiveLab/hh-rlhf-formatted-10000

Viewer • Updated Jan 18 • 10k • 37

vwxyzjn/cai-conversation-dev1705633234

Viewer • Updated Jan 19 • 256 • 57

arianhosseini/openai_comparisons_20k_regen_and_relabelled

Viewer • Updated Jan 21 • 25k • 46

Saugatkafley/okapi-ranking

Viewer • Updated Jul 2 • 126k • 53

vwxyzjn/self-reward-dev1706043619

Viewer • Updated Jan 23 • 16 • 69

vwxyzjn/self-reward-dev1706109551

Viewer • Updated Jan 24 • 16 • 47

vwxyzjn/self-reward-dev1706112590

Viewer • Updated Jan 24 • 16 • 47

manishiitg/unalignment-toxic-dpo-v0.2

Viewer • Updated Jan 29 • 1.08k • 47

manishiitg/jondurbin-gutenberg-dpo-v0.1

Viewer • Updated Jan 29 • 1.8k • 52

argilla/ultrafeedback-capybara-mix-5k

Viewer • Updated Jan 29 • 5k • 41

BarraHome/ultrafeedback_binarized

Viewer • Updated Jan 31 • 187k • 192

remyxai/ffmperative_dpo_test

Viewer • Updated Feb 2 • 1.47k • 44

vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885434

Viewer • Updated Feb 2 • 24 • 42

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706903049

Viewer • Updated Feb 2 • 167 • 40

weijie210/UFB_prefs_iter_0

Viewer • Updated Feb 3 • 24.9k • 39

weijie210/UFB_prefs_nosub_iter_0

Viewer • Updated Feb 6 • 14.7k • 45

pvduy/dpo_data_capy

Viewer • Updated Feb 3 • 47.6k • 45

dkshjn/processed_distilabel-capybara-dpo-7k-binarized

Viewer • Updated Feb 4 • 7.56k • 40

weijie210/UC_prefs_nosub_iter_0

Viewer • Updated Feb 5 • 14.4k • 43

weijie210/UC_prefs_iter_0_pairwise

Viewer • Updated Feb 5 • 14.4k • 45

vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331096

Viewer • Updated Feb 7 • 87 • 54

vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707331527

Viewer • Updated Feb 7 • 462 • 47

vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707332943

Viewer • Updated Feb 7 • 167 • 45

nz/100_v2_rlhf

Viewer • Updated Feb 12 • 122k • 36

vwxyzjn/ultrafeedback_binarized_1708035667

Viewer • Updated Feb 15 • 63.1k • 45

zekeZZ/hh-rlhf-dpo

Viewer • Updated Feb 17 • 51.9k • 54

vwxyzjn/ultrafeedback_binarized_1708702930

Viewer • Updated Feb 23 • 27k • 48

jikaixuan/mistral_generated

Viewer • Updated Feb 27 • 61.1k • 44

arianhosseini/summ_dpo1b1_ngen10_max_2ndmax

Viewer • Updated Mar 10 • 20k • 35

nz/closest_to_3000_range_1000_to_9000

Viewer • Updated Mar 2 • 11k • 39

nz/closest_to_5000_range_1000_to_9000

Viewer • Updated Mar 2 • 11k • 42

nz/closest_to_7000_range_1000_to_9000

Viewer • Updated Mar 3 • 11k • 54

hon9kon9ize/yue-toxic-dpo

Viewer • Updated Mar 14 • 1.07k • 32

David-Xu/astronomy-stack-dpo-text-20-percent

Viewer • Updated Mar 10 • 3.99k • 37 • 1

psyche/anthropic-hh-rlhf

Viewer • Updated Mar 11 • 169k • 48

aengusl/noise5_alpaca_sleeper_agents_toy_safety_v4

Viewer • Updated Mar 11 • 2.83k • 34

aengusl/test_hp_dpo_unlrn_ds

Viewer • Updated Mar 11 • 312 • 42

vwxyzjn/hh-rlhf-trl-style

Viewer • Updated Mar 13 • 100 • 55

Mitsuki-Sakamoto/filter_dataset_test

Viewer • Updated Mar 15 • 73 • 63

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.2_self_70m

Viewer • Updated Mar 14 • 37.9k • 40

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_160m

Viewer • Updated Mar 14 • 37.9k • 50

valerielucro/Preference-Dataset-sample

Viewer • Updated Mar 16 • 525 • 35

abhinand/argilla-dpo-mix-7k-singleturn

Viewer • Updated Mar 18 • 4.9k • 44

nz/ulma_anthropic_hh_golden

Viewer • Updated Mar 19 • 44.8k • 43

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_0.3_self_160m

Viewer • Updated Mar 21 • 37.9k • 35

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-12_filter_gold_thr_1.0_self_160m

Viewer • Updated Mar 21 • 18.9k • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_1

Viewer • Updated Mar 21 • 568k • 104

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_2

Viewer • Updated Mar 22 • 568k • 195

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3

Viewer • Updated Mar 21 • 568k • 138

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1

Viewer • Updated Mar 23 • 568k • 145

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_2

Viewer • Updated Mar 21 • 568k • 201

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_1

Viewer • Updated Mar 21 • 568k • 135

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2

Viewer • Updated Mar 21 • 568k • 75

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.3_seed_2

Viewer • Updated Mar 21 • 568k • 96

when2rl/dpo-mix-7k-rescaled_reformatted

Viewer • Updated Apr 17 • 7.5k • 45

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.1_seed_3

Viewer • Updated Mar 22 • 568k • 177

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_1

Viewer • Updated Mar 24 • 568k • 160

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1

Viewer • Updated Mar 22 • 568k • 96

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1

Viewer • Updated Mar 22 • 568k • 71

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2

Viewer • Updated Mar 22 • 568k • 118

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2

Viewer • Updated Mar 22 • 568k • 89

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_2

Viewer • Updated Mar 22 • 568k • 150

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3

Viewer • Updated Mar 23 • 568k • 79

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3

Viewer • Updated Mar 23 • 568k • 124

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3

Viewer • Updated Mar 23 • 568k • 102

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_1.0_seed_2

Viewer • Updated Mar 24 • 511k • 132

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_2

Viewer • Updated Mar 24 • 189k • 47

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.1_seed_3

Viewer • Updated Mar 24 • 189k • 74

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_3

Viewer • Updated Mar 24 • 189k • 38

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_0.3_seed_3

Viewer • Updated Mar 24 • 189k • 51

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_3

Viewer • Updated Mar 25 • 189k • 49

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_1

Viewer • Updated Mar 24 • 189k • 55

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_1

Viewer • Updated Mar 25 • 189k • 50

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_2

Viewer • Updated Mar 25 • 189k • 69

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2

Viewer • Updated Mar 25 • 189k • 46

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_2

Viewer • Updated Mar 25 • 189k • 53

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_1.0_seed_3

Viewer • Updated Mar 25 • 189k • 42

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_3

Viewer • Updated Mar 25 • 189k • 38

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.3_seed_3

Viewer • Updated Mar 25 • 189k • 42

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_3_t_1.0

Viewer • Updated Mar 25 • 568k • 82

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0

Viewer • Updated Mar 25 • 568k • 81

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0

Viewer • Updated Mar 25 • 568k • 80

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0

Viewer • Updated Mar 25 • 568k • 94

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0

Viewer • Updated Mar 25 • 568k • 78

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_3_t_1.0

Viewer • Updated Mar 25 • 568k • 73

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_2_t_1.0

Viewer • Updated Mar 26 • 568k • 142

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.25

Viewer • Updated Mar 26 • 568k • 72

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.75

Viewer • Updated Mar 26 • 568k • 125

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.9

Viewer • Updated Mar 26 • 568k • 78

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.7

Viewer • Updated Mar 27 • 568k • 90

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.5

Viewer • Updated Mar 27 • 568k • 106

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0_eval

Viewer • Updated Mar 28 • 568k • 176

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0_eval

Viewer • Updated Mar 29 • 568k • 76

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0_eval

Viewer • Updated Mar 29 • 568k • 205

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 114

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 232

orpo-explorers/OpenHermesPreferences-25k

Viewer • Updated Mar 30 • 25k • 35

orpo-explorers/OpenHermesPreferences-250k

Viewer • Updated Mar 30 • 250k • 35

sazirarrwth99/kangoroo_dpo_trainer_final

Viewer • Updated Apr 1 • 23.3k • 40

wenbopan/cmmlu_dpo_pairs

Viewer • Updated Apr 3 • 5.04k • 41

ShenaoZhang/0.001_idpo_dataset

Viewer • Updated Apr 5 • 44.8k • 44

Gopal2002/zephyr-gemma-finetune-dpo

Viewer • Updated Apr 6 • 69 • 39

AnushaKulkarni/preferred_dataset2

Viewer • Updated Apr 7 • 50 • 32

mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7

Viewer • Updated Apr 7 • 20k • 39

arianhosseini/ultrafeedback_binarized_relabel1b

Viewer • Updated Apr 8 • 63.1k • 35

ShenaoZ/0.0001_idpo_same_6iters_dataset

Viewer • Updated Apr 13 • 48.8k • 54

ShenaoZ/0.001_idpo_same_scratch_dataset

Viewer • Updated Apr 14 • 106k • 43

mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7_length128

Viewer • Updated Apr 14 • 20k • 38

ShenaoZ/0.0001_idpo_same_3itersn_dataset

Viewer • Updated Apr 14 • 44.8k • 50

trl-lib/capybara-preferencces-7k

Viewer • Updated Apr 15 • 7.56k • 140

guoyu-zhang/usp_1

Viewer • Updated Apr 15 • 1k • 37

guoyu-zhang/usp_2

Viewer • Updated Apr 15 • 1k • 34

guoyu-zhang/usp_4

Viewer • Updated Apr 15 • 1k • 44

DuongTrongChi/hh-rlhf

Viewer • Updated Apr 16 • 161k • 34

when2rl/gutenberg-dpo-v0.1_reformatted

Viewer • Updated Apr 17 • 918 • 36

ShenaoZ/0.001_ablation_dataset

Viewer • Updated Apr 18 • 44.8k • 48

ShenaoZ/0.0001_ablation_dataset

Viewer • Updated Apr 18 • 44.8k • 44

mnoukhov/summarize_from_feedback_tldr3_labelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2

Viewer • Updated Apr 19 • 9.5k • 37

ShenaoZ/0.0001_ablation_4iters_bs256_dataset

Viewer • Updated Apr 22 • 51.8k • 34

ShenaoZ/0.01_ablation_4iters_bs256_dataset

Viewer • Updated Apr 23 • 51.8k • 44

UCLAML/RPO-Iter2-New-312_generated

Viewer • Updated Apr 23 • 20k • 38

orpo-explorers/OHP-15k-Stratified-1

Viewer • Updated Apr 23 • 15k • 37

orpo-explorers/OHP-15k-Stratified-2

Viewer • Updated Apr 23 • 15k • 39

orpo-explorers/OHP-15k-Stratified-3

Viewer • Updated Apr 23 • 15k • 41

distilabel-internal-testing/ultrafeedback-mini-dpo

Viewer • Updated Apr 24 • 10 • 42

ShenaoZhang/0.001_ablation_5iters_bs128_dataset

Viewer • Updated Apr 25 • 12.2k • 38

ShenaoZ/0.001_3iters_bs128_declr_nodpo_useresponse_dataset

Viewer • Updated Apr 26 • 67.1k • 35

ShenaoZ/0.001_4iters_bs128_declr_nodpo_useresponse_dataset

Viewer • Updated Apr 26 • 69.1k • 50

ShenaoZ/0.001_3iters_bs256_declr_nodpo_userresponse_dataset

Viewer • Updated Apr 26 • 67.1k • 43

NickyNicky/mlabonne_orpo-dpo-mix-40k

Viewer • Updated Apr 26 • 44.2k • 36

theGhoul21/dpo-dataset

Viewer • Updated Apr 28 • 4.82k • 37

ShenaoZ/0.001_4iters_bs256_nodpo_only2third_dataset

Viewer • Updated Apr 26 • 12.2k • 34

ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_userresponse_dataset

Viewer • Updated Apr 27 • 48k • 53

ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_userresponse_dataset

Viewer • Updated Apr 27 • 48k • 43

ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_zephyr_dataset

Viewer • Updated Apr 27 • 48k • 41

ShenaoZhang/0.001_4iters_bs128_nodpo_only4w_dataset

Viewer • Updated Apr 27 • 48k • 40

ShenaoZhang/0.01_4iters_bs256_nodpo_only4w_dataset

Viewer • Updated Apr 27 • 48k • 39

YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_ranked

Viewer • Updated Apr 27 • 10k • 35

ShenaoZhang/0.0001_4iters_bs256_nodpo_only4w_dataset

Viewer • Updated Apr 28 • 62k • 37

YYYYYYibo/ultrafeedback_binarized_phase_2_part_2

Viewer • Updated Apr 28 • 5.28k • 40

YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_0

Viewer • Updated Apr 28 • 1k • 36

YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_3

Viewer • Updated Apr 28 • 1k • 34

communityai/system_identity_remove_preference_openai

Viewer • Updated Apr 28 • 93 • 38

communityai/system_identity_remove_preference_microsoft

Viewer • Updated Apr 28 • 93 • 39

theGhoul21/dpo-dataset-v2

Viewer • Updated Apr 29 • 4.83k • 37

ShenaoZhang/0.0001_3iters_bs256_nodpo_full6w_userresponse_dataset

Viewer • Updated Apr 29 • 46.8k • 63

YYYYYYibo/ultrafeedback_binarized_left_part_2

Viewer • Updated May 1 • 15k • 35

nnheui/stablelm-2-1_6b-sft-full-ultrafeedback_generated

Viewer • Updated Apr 30 • 61.1k • 39

YYYYYYibo/ultrafeedback_binarized_vllm_part_3

Viewer • Updated May 1 • 5k • 43

YYYYYYibo/ultrafeedback_binarized_train_part_3

Viewer • Updated May 2 • 26.1k • 35

when2rl/mt_bench_human_judgments_reformatted

Viewer • Updated May 2 • 8.96k • 43

ShenaoZ/0.0001_withdpo_4iters_bs256_511lr_dataset

Viewer • Updated May 1 • 51.8k • 37

ShenaoZ/0.0_withdpo_4iters_bs256_531lr_dataset

Viewer • Updated May 2 • 51.8k • 39

theGhoul21/irpo-dataset-v1

Viewer • Updated May 3 • 11k • 47

four-two-labs/orpo-test

Viewer • Updated May 1 • 60.9k • 37

YYYYYYibo/eval-dataset-vanilla

Viewer • Updated May 3 • 200 • 40

iamnguyen/ultrafeedback_translated

Viewer • Updated May 2 • 999 • 37

YYYYYYibo/eval-dataset-with-score-nash

Viewer • Updated May 2 • 200 • 33

YYYYYYibo/ultrafeedback_binarized_plus_vllm_part_3

Viewer • Updated May 3 • 5k • 36

ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_dataset

Viewer • Updated May 3 • 44.8k • 51

vipinkatara/dataset_complete_1

Viewer • Updated May 3 • 63.1k • 41

YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_1

Viewer • Updated May 3 • 25k • 33

YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_2

Viewer • Updated May 3 • 25k • 33

ShenaoZ/0.0001_withdpo_4iters_bs256_5102lr_misit_correct_dataset

Viewer • Updated May 4 • 51.8k • 43

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_3

Viewer • Updated May 4 • 5k • 37

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_1

Viewer • Updated May 4 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_0

Viewer • Updated May 4 • 4.8k • 34

ShenaoZ/0.0005_withdpo_4iters_bs256_5102lr_dataset

Viewer • Updated May 5 • 51.8k • 41

ShenaoZ/0.0001_withdpo_4iters_bs256_3333lr_dataset

Viewer • Updated May 5 • 51.8k • 41

YYYYYYibo/ultrafeedback_binarized_real_rank4_all_minpi_part_3

Viewer • Updated May 5 • 20.5k • 38

ShenaoZ/0.0001_sft_nodpo_3iters_bs256_555lr_dataset

Viewer • Updated May 6 • 67.1k • 41

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799_new

Viewer • Updated May 5 • 20k • 36

YYYYYYibo/ultrafeedback_binarized_new_gen_part_2

Viewer • Updated May 6 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_new_gen_part_3

Viewer • Updated May 6 • 5k • 33

YYYYYYibo/ultrafeedback_binarized_dataset_offline_part0

Viewer • Updated May 6 • 19.6k • 36

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_3

Viewer • Updated May 6 • 4.9k • 36

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_2

Viewer • Updated May 6 • 4.9k • 42

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_3

Viewer • Updated May 6 • 5.19k • 36

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1

Viewer • Updated May 6 • 5.18k • 33

Baidicoot/helpful-harmful-rlhf

Viewer • Updated May 9 • 161k • 38

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_2

Viewer • Updated May 7 • 4.1k • 41

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_1

Viewer • Updated May 7 • 5k • 36

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_0

Viewer • Updated May 7 • 4.78k • 33

ShenaoZ/0.0001_withdpo_3iters_bs256_5102lr_dataset

Viewer • Updated May 8 • 44.8k • 40

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_3

Viewer • Updated May 8 • 5.09k • 37

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_minpi_part_3

Viewer • Updated May 8 • 20.7k • 32

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_2

Viewer • Updated May 8 • 4.4k • 36

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_1

Viewer • Updated May 8 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_2

Viewer • Updated May 8 • 19.4k • 36

ShenaoZ/0.001_withdpo_4iters_bs256_555lr_dataset

Viewer • Updated May 9 • 51.8k • 67

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_2

Viewer • Updated May 9 • 4.85k • 35

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_1

Viewer • Updated May 9 • 4.85k • 43

uine/single-dpo-practice-dataset

Viewer • Updated May 9 • 2.11k • 36

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_0

Viewer • Updated May 9 • 5.16k • 33

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_1

Viewer • Updated May 9 • 5.16k • 36

when2rl/hh-rlhf_reformatted

Viewer • Updated May 9 • 169k • 37

ShenaoZ/0.0001_withdpo_4iters_bs256_5551lr_dataset

Viewer • Updated May 10 • 51.8k • 57

ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5311lr_dataset

Viewer • Updated May 10 • 51.8k • 63

ShenaoZ/0.0005_withdpo_4iters_bs256_2epoch_5551lr_dataset

Viewer • Updated May 10 • 51.8k • 44

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr

Viewer • Updated May 17 • 107k • 43

ContextualAI/tiny_train_test_ultrafeedback_binarized

Viewer • Updated May 12 • 20 • 39

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873

Viewer • Updated May 12 • 20k • 41

ShenaoZhang/0.0001_zephyr_5551_4iters_bs256_dataset

Viewer • Updated May 14 • 51.8k • 38

DuongTrongChi/dpo-detoxic

Viewer • Updated May 16 • 46.6k • 32

euiyulsong/arc_easy

Viewer • Updated May 17 • 2.25k • 42

arcee-ai/ultrafeedback-binarized

Viewer • Updated May 18 • 60.9k • 50

euiyulsong/generated_data_all_cos_1000

Viewer • Updated May 18 • 1k • 34

Aditya685/dpo_data

Viewer • Updated Jul 4 • 3.15k • 54

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_0

Viewer • Updated May 19 • 5k • 37

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_2

Viewer • Updated May 19 • 5k • 39

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.00

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.00

Updated May 20 • 32

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.10

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.00

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.20

Updated May 20 • 43

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.00

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.30

Updated May 20 • 36

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.00

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.00

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.30

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.10

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.50

Updated May 20 • 41

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.30

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.10

Updated May 20 • 45

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.10

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.20

Updated May 20 • 38

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_3

Viewer • Updated May 20 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_2

Viewer • Updated May 20 • 5k • 39

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.40

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.40

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.40

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.50

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.50

Updated May 20 • 33

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2

Viewer • Updated May 20 • 20k • 37

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_1

Viewer • Updated May 20 • 5.28k • 45

mcding-org/CorrectDPO-Dataset-U10

Updated May 21 • 32

mcding-org/CorrectDPO-Dataset-U30

Updated May 21 • 36

mcding-org/CorrectDPO-Eval-DDP_Pm3B_U0_beta0.10r0.30rho0.20

Updated May 21 • 36

GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v2_full-sft-finetuned-stage4-iter86000-v2

Viewer • Updated May 23 • 18.8k • 37

berquetR/dpo_preference_dataset

Preview • Updated May 26 • 38

when2rl/UltraInteract_pair_reformatted_filtered

Viewer • Updated May 27 • 166k • 41

BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts_2_percent

Viewer • Updated May 30 • 4.69k • 54

TTTXXX01/My-Zephyr-7B-dataset

Viewer • Updated Jun 2 • 51.8k • 62

WKLI22/orpo-dpo-mix-zh-40k

Viewer • Updated Jun 6 • 44.2k • 39

ihughes15234/tictactoe_DPO

Viewer • Updated Jun 5 • 765 • 36

nhyha/DPO_2

Viewer • Updated Jun 12 • 5 • 42

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_2

Viewer • Updated Jun 17 • 5k • 35

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_2_mini_1

Viewer • Updated Jun 17 • 5k • 32

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_1

Viewer • Updated Jun 17 • 5.28k • 37

YYYYYYibo/ultrafeedback_binarized_ave_pi_vllm_part_3_mini_0

Viewer • Updated Jun 17 • 5.28k • 33

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_0

Viewer • Updated Jun 17 • 5.28k • 40

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_1

Viewer • Updated Jun 17 • 5.28k • 38

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_2

Viewer • Updated Jun 17 • 5.28k • 38

YYYYYYibo/ultrafeedback_binarized_ave_pi_train_part_3_mini_3

Viewer • Updated Jun 17 • 5.29k • 37

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_2

Viewer • Updated Jun 17 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_1

Viewer • Updated Jun 17 • 5k • 37

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_2_mini_3

Viewer • Updated Jun 17 • 5k • 35

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_2

Viewer • Updated Jun 17 • 5k • 37

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_0

Viewer • Updated Jun 17 • 5.28k • 34

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_2

Viewer • Updated Jun 17 • 5.28k • 32

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_0

Viewer • Updated Jun 18 • 5.28k • 35

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_1

Viewer • Updated Jun 18 • 5.28k • 36

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_3_mini_2

Viewer • Updated Jun 18 • 5.28k • 39

mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel2_llama8b

Viewer • Updated Jun 19 • 92.1k • 37

Dahoas/static-hh

Viewer • Updated Mar 6, 2023 • 101k • 76 • 20

davanstrien/dataset-tldr-preference-dpo

Viewer • Updated Apr 30 • 522 • 46 • 11

declare-lab/audio-alpaca

Viewer • Updated Jul 18 • 15k • 203 • 11

ThWu/dpo_openhermes

Viewer • Updated Jul 1 • 183k • 40 • 6

HuggingFaceH4/grok-conversation-harmless2

Viewer • Updated Jan 19 • 44.8k • 128 • 6

monology/oasst2_dpo

Viewer • Updated Dec 24, 2023 • 28.4k • 39 • 3

HuggingFaceH4/orca_dpo_pairs_no_system_prompt

Viewer • Updated Jan 15 • 12.9k • 44 • 3

udkai/klexikon_dpo

Viewer • Updated Jan 24 • 2.89k • 47 • 3

Dahoas/rm_instruct_helpful_preferences

Viewer • Updated Mar 1, 2023 • 90.7k • 44 • 4

Dahoas/rl-prompt-dataset

Viewer • Updated Mar 17, 2023 • 207k • 80 • 2

We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs-lora

Viewer • Updated Dec 27, 2023 • 6k • 38 • 2

reciprocate/ultrafeedback_cleaned_high_dpo

Viewer • Updated Jan 11 • 40k • 34 • 2

giux78/ultrafeedback-binarized-preferences-cleaned-ita-ready

Viewer • Updated Jan 18 • 60.9k • 40 • 2

alielfilali01/ultrafeedback-arabic

Viewer • Updated Jan 31 • 63.1k • 38 • 2

AlekseyKorshuk/synthetic-instruct-gptj-pairwise

Viewer • Updated Feb 8, 2023 • 33.1k • 37 • 1

Dahoas/instruct_helpful_preferences

Viewer • Updated Mar 1, 2023 • 111k • 83 • 1

Deojoandco/reward_model_anthropic_88

Viewer • Updated Mar 26, 2023 • 8.55k • 38 • 1

SAGI-1/ultrafeedback_binarized_dpo

Viewer • Updated Nov 19, 2023 • 64k • 41 • 1

ThWu/dpo_prompt_r

Viewer • Updated Jul 1 • 183k • 38 • 1

0x7o/fialka-v2-dpo

Viewer • Updated Dec 22, 2023 • 2.47k • 40 • 1

reciprocate/ultrafeedback_cleaned_v2_dpo

Viewer • Updated Jan 8 • 58.6k • 49 • 1

nutorbit/news-headline-dpo

Viewer • Updated Jan 11 • 2.37k • 37 • 1

ayoubkirouane/Orca-Direct-Preference-Optimization

Viewer • Updated Jan 14 • 12.9k • 38 • 1

giux78/ultrafeedback-binarized-preferences-cleaned-ita

Viewer • Updated Jan 27 • 60.9k • 43 • 1

eryk-mazus/polka-dpo-v1

Viewer • Updated Jul 1 • 7.06k • 56 • 1

ZHLiu627/ultrafeedback_binarized_with_response_full_part1

Viewer • Updated Mar 8 • 20k • 39 • 1

NickyNicky/Colossal_Translation_Spanish_to_English_AND_English_to_Spanish_ORPO_DPO_Gemma

Viewer • Updated May 6 • 3.4M • 114 • 3

Baidicoot/harmful-rlhf

Viewer • Updated May 6 • 42.5k • 36 • 1

thepowerfuldeez/Qwen-summarize-dataset-train

Viewer • Updated Jul 1 • 20.4k • 40 • 1

AlekseyKorshuk/davinci-pairwise

Viewer • Updated Feb 7, 2023 • 144k • 75

AlekseyKorshuk/davinci-pairwise-all

Viewer • Updated Feb 7, 2023 • 48k • 62

AlekseyKorshuk/davinci-pairwise-tokenized

Viewer • Updated Feb 8, 2023 • 72k • 58

AlekseyKorshuk/davinci-pairwise-filtered

Viewer • Updated Feb 8, 2023 • 108k • 43

AlekseyKorshuk/chai-synthetic-pairwise

Viewer • Updated Feb 10, 2023 • 45.7k • 71

AlekseyKorshuk/cup-it-ds-pairwise-small

Viewer • Updated Mar 18, 2023 • 17.6k • 102

ummagumm-a/cup-it-ds-classification-pairwise-test

Viewer • Updated Mar 19, 2023 • 56k • 54

HuggingFaceH4/test-dataset-all-splits

Viewer • Updated Apr 25, 2023 • 600 • 39

AlekseyKorshuk/lmeh-chai-davinci

Viewer • Updated May 18, 2023 • 14.4k • 57

AlekseyKorshuk/lmeh-chai-synthetic

Viewer • Updated May 18, 2023 • 4.57k • 34

TaylorAI/rlcd

Viewer • Updated Sep 29, 2023 • 168k • 40

PanoEvJ/GPT3.5_summarization_preference_RLAIF

Viewer • Updated Oct 1, 2023 • 100 • 40

JuanKO/RLAIF_summarization_preference_gpt35

Viewer • Updated Oct 2, 2023 • 1k • 38

victorialee/openai_summarize_comparisons_relabel_GPTJ

Updated Oct 4, 2023 • 36

sayan1101/reward_test_custom_dataset_RLHF

Viewer • Updated Oct 23, 2023 • 164 • 48

vwxyzjn/cai-conversation-dev1-h4

Viewer • Updated Nov 27, 2023 • 16.4k • 55

SebastianSchramm/ultrafeedback_binarized_prefs_filtered

Viewer • Updated Nov 15, 2023 • 58.1k • 32

genta-tech/rlhf-id-30

Viewer • Updated Nov 17, 2023 • 125k • 48

orendar/ultrafeedback_binarized_filtered

Viewer • Updated Jul 4 • 27.2k • 38

remyxai/ffmperative_dpo

Viewer • Updated Nov 30, 2023 • 1.48k • 38

rajammanabrolu/ultrafeedback_binarized

Viewer • Updated Nov 30, 2023 • 190k • 53

vwxyzjn/cai-conversation-prod-h4-harmless

Viewer • Updated Dec 1, 2023 • 44.9k • 56

kfkas/test_DPO_dataset

Viewer • Updated Dec 5, 2023 • 3.83k • 37

varun-v-rao/mimic-cxr-dpo-with-metrics

Viewer • Updated Dec 10, 2023 • 125k • 37 • 1

mnoukhov/openai_summarize_generated_10k

Viewer • Updated Dec 15, 2023 • 10k • 32

mnoukhov/openai_summarize_generated_10-20k

Viewer • Updated Dec 15, 2023 • 10k • 34

mnoukhov/openai_summarize_generated_20k

Viewer • Updated Dec 18, 2023 • 20k • 38

dvilasuero/ultrafeedback-followup

Viewer • Updated Dec 19, 2023 • 6k • 38 • 1

GokhanAI/INST_Synthetic_MISTRAL

Viewer • Updated Dec 22, 2023 • 26.3k • 62

dvilasuero/multiturner

Viewer • Updated Dec 19, 2023 • 3.43k • 32

arianhosseini/openai_summarize_comparisons_relabel_pythia1b_iter1_temp0.7

Viewer • Updated Dec 22, 2023 • 20k • 39

mnoukhov/compare_results

Viewer • Updated Dec 22, 2023 • 100 • 39

mnoukhov/openai_summarize_vllm_generated_20k_label410m

Viewer • Updated Feb 5 • 19.9k • 48

reciprocate/orca_dpo_pairs

Viewer • Updated Jan 3 • 14.8k • 35

reciprocate/pku_better_dpo_pairs

Viewer • Updated Jan 3 • 330k • 39

reciprocate/pku_safer_dpo_pairs

Viewer • Updated Jan 3 • 51.8k • 38

manishiitg/jondurbin-truthy-dpo-v0.1

Viewer • Updated Jan 29 • 2.03k • 38

manishiitg/unalignment-toxic-dpo-v0.1

Viewer • Updated Jan 29 • 604 • 41

mii-llm/oasst2-dpo-it

Viewer • Updated Jan 9 • 210 • 34

vwxyzjn/cai-conversation-dev1704836562

Viewer • Updated Jan 9 • 128 • 44

UnderstandLing/oasst1_nl_threads_dpo

Viewer • Updated Jan 10 • 25.1k • 39

vwxyzjn/cai-conversation-dev1705363150

Viewer • Updated Jan 16 • 128 • 40

giux78/0-10000-ultrafeedback-binarized-preferences-cleaned-ita

Viewer • Updated Jan 16 • 10k • 37

vwxyzjn/cai-conversation-dev1705423021

Viewer • Updated Jan 16 • 2.31k • 39

vwxyzjn/cai-conversation-dev1705526305

Viewer • Updated Jan 17 • 256 • 57

CognitiveLab/hh-rlhf-formatted-60000

Viewer • Updated Jan 18 • 60k • 44

vwxyzjn/cai-conversation-dev1705620998

Viewer • Updated Jan 18 • 256 • 58

vwxyzjn/cai-conversation-dev1705631776

Viewer • Updated Jan 19 • 256 • 46

vwxyzjn/cai-conversation-dev1705676837

Viewer • Updated Jan 19 • 256 • 44

arianhosseini/trl_data

Viewer • Updated Jan 21 • 20k • 33

weijie210/UC_preference_iter_0

Viewer • Updated Jan 31 • 39.1k • 40

weijie210/UC_preference_iter_0_all

Viewer • Updated Jan 27 • 93.2k • 36

SUSTech/bagel-clean

Viewer • Updated Jan 27 • 799k • 53

weijie210/UFB_preference_iter_0_all

Viewer • Updated Jan 28 • 56.6k • 43

pvduy/dpo_data_ultra

Viewer • Updated Jan 29 • 80k • 41

ogbrandt/gpt35_preference_rlaif

Viewer • Updated Jan 29 • 520 • 37

ogbrandt/gpt4_preference_rlaif

Viewer • Updated Jan 29 • 520 • 37

Asap7772/ultrafeedback_binarized_narrow_unlabeled

Viewer • Updated Jan 29 • 60.7k • 44

Asap7772/ultrafeedback_binarized_narrow

Viewer • Updated Jan 30 • 60.7k • 39

weijie210/UFB_reference_rejected

Viewer • Updated Feb 1 • 57.6k • 71

vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1706885528

Viewer • Updated Feb 2 • 24 • 44

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706886961

Viewer • Updated Feb 2 • 24 • 39

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706887930

Viewer • Updated Feb 2 • 30 • 43

nz/anthropic-hh-golden-rlhf

Viewer • Updated Feb 2 • 44.8k • 78

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706893611

Viewer • Updated Feb 2 • 84 • 42

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706896441

Viewer • Updated Feb 2 • 5 • 40

arianhosseini/summarize_dpo1b1_ngen10_20k

Viewer • Updated Feb 2 • 20k • 59

dkshjn/processed_truthy-v2

Viewer • Updated Feb 4 • 1.02k • 41

weijie210/UFB_prefs_iter_0_4_bestn

Viewer • Updated Feb 4 • 55.5k • 41

weijie210/UC_prefs_iter_0

Viewer • Updated Feb 5 • 31 • 48

weijie210/UFB_maximal_prefs

Viewer • Updated Feb 6 • 63.1k • 44

nz/highest-number-rlhf

Viewer • Updated Feb 7 • 84k • 47

vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330518

Viewer • Updated Feb 7 • 167 • 48

vwxyzjn/openhermes-dev__mistralai_Mistral-7B-Instruct-v0.1__1707330742

Viewer • Updated Feb 7 • 167 • 39

vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707333633

Viewer • Updated Feb 7 • 167 • 45

vwxyzjn/openhermes-dev__meta-llama_Llama-2-70b-chat-hf__1707337384

Viewer • Updated Feb 7 • 167 • 55

vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707405480

Viewer • Updated Feb 8 • 167 • 44

vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406141

Viewer • Updated Feb 8 • 167 • 47

vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707408224

Viewer • Updated Feb 8 • 167 • 45

weijie210/gsm8k_dpo

Viewer • Updated Feb 9 • 5.48k • 52

vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707422187

Viewer • Updated Feb 9 • 48.3k • 50

shidowake/UFeedback_without_gpt_output

Viewer • Updated Feb 9 • 7.68k • 39

nz/100_rlhf

Viewer • Updated Feb 11 • 107k • 41

ibndias/distilabel-capybara-dpo-7k-binarized

Viewer • Updated Feb 14 • 7.56k • 37

vwxyzjn/ultrafeedback_binarized_1707920039

Viewer • Updated Feb 14 • 2k • 44

dlibf/ultra_feedback_zephyr-dpo

Viewer • Updated Feb 15 • 125k • 54

dlibf/ultra_feedback_zephyr-sft

Viewer • Updated Feb 15 • 125k • 53

vwxyzjn/ultrafeedback_binarized_1707945637

Viewer • Updated Feb 14 • 63.1k • 63

vwxyzjn/ultrafeedback_binarized_1707947544

Viewer • Updated Feb 14 • 63.1k • 68

arianhosseini/comparisons_20k_regen_labeled_dpo1b1

Viewer • Updated Feb 15 • 20k • 36

male-2/0.2.0-public

Viewer • Updated Feb 17 • 1 • 36

macadeliccc/distilabel-neurology-preferences-2k-cleaner

Viewer • Updated Jul 4 • 1.99k • 48

mnoukhov/openai_summarize_comparisons_tldprompt_relabel_pythia410m-dpo1

Viewer • Updated Feb 19 • 92.5k • 36

vwxyzjn/ultrafeedback_binarized_1708381525

Viewer • Updated Feb 19 • 1.9k • 46

Radiantloom/distilabel-intel-orca-dpo-pairs-chatml

Viewer • Updated Feb 20 • 12.9k • 36

cassanof/python_pass_fail_sample

Viewer • Updated Feb 20 • 100 • 47

sanduntg/cpcdata_ppo

Viewer • Updated Feb 21 • 24 • 42

cmcmaster/OpenHermes2.5-dpo-binarized-alpha-trl

Viewer • Updated Feb 22 • 9.79k • 39

mnoukhov/openai_summarize_generated_20k_relabel_1b_margin

Viewer • Updated Feb 22 • 20k • 37

mnoukhov/openai_summarize_comparisons_tldrprompt_relabel1b_margin

Viewer • Updated Feb 22 • 97.5k • 38

mnoukhov/compare_test

Viewer • Updated Feb 26 • 20k • 37

mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo

Viewer • Updated Feb 26 • 20k • 39

mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo

Viewer • Updated Feb 26 • 20k • 42

mnoukhov/openai_summarize_generated_20k_relabel_1b_predict_410m-dpo1

Viewer • Updated Feb 26 • 20k • 34

NickyNicky/distilabel-intel-orca-dpo-pairs_gemma_chatml

Viewer • Updated Feb 26 • 12.9k • 37

celinelee/thestack_py312_fstrings_dpo

Viewer • Updated Feb 29 • 100k • 44

cnbeining/sentence-segmentation-dpo-raw

Viewer • Updated Feb 29 • 9.18k • 52

Baidicoot/anthropic_hh_golden_llama

Viewer • Updated Mar 1 • 42.1k • 38

aengusl/llama_dpo_hhh

Viewer • Updated Mar 1 • 161k • 45

aengusl/mistral_dpo_hhh

Viewer • Updated Mar 1 • 161k • 41

arianhosseini/summ_dpo1b1_ngen10_minmax

Viewer • Updated Mar 10 • 20k • 40

Baidicoot/dpo_safety_ihy_openhermes

Viewer • Updated Mar 3 • 5k • 36

celinelee/thestack_npzeros_dpo

Viewer • Updated Mar 3 • 100k • 45

nz/closest_to_5000_range_1000_to_9000_55k

Viewer • Updated Mar 6 • 55.7k • 39

ZHLiu627/ultrafeedback_binarized_with_response_full_part0

Viewer • Updated Mar 7 • 20k • 32

David-Xu/astronomy-stack-cira

Viewer • Updated Mar 8 • 19.9k • 41

ZHLiu627/ultrafeedback_binarized_with_response_full_part2

Viewer • Updated Mar 8 • 21.1k • 37

ZHLiu627/ultrafeedback_binarized_with_response_full

Viewer • Updated Mar 8 • 61.1k • 60

David-Xu/astronomy-stack-dpo-20-percent

Viewer • Updated Mar 10 • 3.99k • 44

aengusl/noise0_alpaca_sleeper_agents_toy_test_preference_v4

Viewer • Updated Mar 11 • 15.7k • 36

vwxyzjn/ultrafeedback_binarized_1710165338

Viewer • Updated Mar 11 • 25k • 35

aengusl/train_hp_dpo_unlrn_ds

Viewer • Updated Mar 11 • 927 • 34

vtiyyal1/AskDocsEmpathy_2k_dpo

Viewer • Updated Mar 13 • 2.12k • 47

vtiyyal1/AskDocsEmpathy_2k_llama_dpo

Viewer • Updated Mar 13 • 2.12k • 43

davidberenstein1957/ultrafeedback-binarized-cleaned-and-filtered-random-split

Viewer • Updated Mar 14 • 6.69k • 69

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_70m

Viewer • Updated Mar 14 • 37.9k • 44

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.1_self_160m

Viewer • Updated Mar 14 • 37.9k • 39

manishiitg/aditi-dpo-prompts

Viewer • Updated Apr 8 • 48.7k • 36 • 1

mesolitica/DPO-malaysian-questions

Viewer • Updated Mar 20 • 32.5k • 57

mesolitica/DPO-translated-CodeUltraFeedback

Viewer • Updated Apr 1 • 7.17k • 58

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_1.0_seed_3

Viewer • Updated Mar 21 • 568k • 164

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1

Viewer • Updated Mar 22 • 568k • 104

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1

Viewer • Updated Mar 22 • 568k • 137

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2

Viewer • Updated Mar 23 • 568k • 86

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3

Viewer • Updated Mar 23 • 568k • 134

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3

Viewer • Updated Mar 23 • 568k • 84

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1

Viewer • Updated Mar 24 • 568k • 170

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_410m_thr_1.0_seed_1

Viewer • Updated Mar 24 • 189k • 45

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_0.1_seed_1

Viewer • Updated Mar 25 • 189k • 56

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_1

Viewer • Updated Mar 25 • 189k • 38

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_410m_thr_1.0_seed_2

Viewer • Updated Mar 25 • 189k • 70

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_14m_thr_0.0_seed_1_t_1.0

Viewer • Updated Mar 25 • 568k • 91

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0

Viewer • Updated Apr 19 • 568k • 126

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_1_t_1.0

Viewer • Updated Mar 25 • 568k • 117

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_1_t_1.0

Viewer • Updated Mar 25 • 568k • 78

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_2_t_1.0

Viewer • Updated Mar 25 • 568k • 80

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0

Viewer • Updated Mar 25 • 568k • 136

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0

Viewer • Updated Mar 25 • 568k • 110

Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0

Viewer • Updated Mar 26 • 94.6k • 45

Mitsuki-Sakamoto/alfa-deberta-re-pref-64-fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0

Viewer • Updated Mar 26 • 94.6k • 36

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.5

Viewer • Updated Mar 26 • 568k • 63

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.9

Viewer • Updated Mar 26 • 568k • 58

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_0.5

Viewer • Updated Mar 26 • 568k • 185

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.5

Viewer • Updated Mar 26 • 568k • 180

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0

Viewer • Updated Mar 27 • 568k • 49

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0

Viewer • Updated Mar 27 • 568k • 71

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0

Viewer • Updated Mar 27 • 568k • 171

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.1

Viewer • Updated Mar 27 • 568k • 139

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.3

Viewer • Updated Mar 27 • 568k • 156

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.1

Viewer • Updated Mar 27 • 568k • 134

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.3

Viewer • Updated Mar 27 • 568k • 153

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.7

Viewer • Updated Mar 27 • 568k • 210

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.5

Viewer • Updated Mar 27 • 568k • 72

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_tp_0.9

Viewer • Updated Mar 27 • 568k • 89

Nbardy/prompt_variance_reward_complete

Viewer • Updated Mar 27 • 412 • 43

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_1.0_eval

Viewer • Updated Mar 28 • 568k • 153

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 126

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_2_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 149

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_3_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 169

orpo-explorers/OpenHermesPreferences-100k

Viewer • Updated Mar 30 • 100k • 42

ShenaoZ/ultrafeedback_subset

Viewer • Updated Apr 3 • 22k • 33

ShenaoZhang/0.001_idpo_same_nodpo_dataset

Viewer • Updated Apr 6 • 67.1k • 53

ShenaoZhang/0.001_idpo_same_replacechosen_dataset

Viewer • Updated Apr 6 • 44.8k • 39

dinaaaaaa/lima_rand_sel_50_preference_self_reward

Viewer • Updated Sep 26 • 223 • 45

AnushaKulkarni/preferred_dataset

Viewer • Updated Apr 7 • 50 • 37

ShenaoZhang/0.001_idpo_noreplacerej_ref_response

Viewer • Updated Apr 8 • 44.8k • 38

ShenaoZhang/0.001_idpo_noreplacerej_dataset

Viewer • Updated Apr 10 • 44.8k • 48

Jessiecs/7374-assignment4-question2_dataset_for_DPO

Viewer • Updated Apr 7 • 50 • 33

jinlibao/lima_preference_dataset

Viewer • Updated Apr 8 • 50 • 39

ShenaoZhang/0.0005_idpo_same_nodpo_replace_dataset

Viewer • Updated Apr 10 • 67.1k • 79

thavens/ufb_mini

Viewer • Updated Apr 11 • 160 • 35

hsikchi/tldr-preference-trl-style

Viewer • Updated Apr 12 • 179k • 44

gx-ai-architect/helpsteer_preference

Viewer • Updated Apr 12 • 35.6k • 44

sophiex/hh-rlhf

Viewer • Updated Apr 12 • 169k • 34

ShenaoZ/0.0001_idpo_same_3iters_dataset

Viewer • Updated Apr 13 • 44.8k • 36

guoyu-zhang/hh_llama2

Viewer • Updated Apr 13 • 125k • 37

ShenaoZ/0.0_idpo_same_3iters_debug_dataset

Viewer • Updated Apr 14 • 22.4k • 36

guoyu-zhang/shp_1

Viewer • Updated Apr 15 • 1k • 35

guoyu-zhang/shp_2

Viewer • Updated Apr 15 • 1k • 38

guoyu-zhang/shp_3

Viewer • Updated Apr 15 • 1k • 34

when2rl/OpenHermesPreferences_reformatted

Viewer • Updated Apr 17 • 985k • 96

mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b35a8

Viewer • Updated Apr 16 • 20k • 37

ShenaoZ/0.0_ablation_4iters_dataset

Viewer • Updated Apr 17 • 17.3k • 36

ShenaoZ/0.001_ablation_4iters_dataset

Viewer • Updated Apr 17 • 17.3k • 37

ShenaoZ/0.000001_ablation_dataset

Viewer • Updated Apr 18 • 44.8k • 41

ShenaoZ/0.0_ablation_6iters_dataset

Viewer • Updated Apr 18 • 48.8k • 54

ShenaoZ/0.0_ablation_dataset

Viewer • Updated Apr 18 • 44.8k • 37

UCLAML/snorkel_prompt3

Viewer • Updated Apr 18 • 21k • 35

mnoukhov/summarize_from_feedback_tldr3_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2

Viewer • Updated Apr 18 • 20k • 33

arianhosseini/hh_with_prompt

Viewer • Updated Apr 18 • 169k • 41

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2

Viewer • Updated Apr 19 • 107k • 37

when2rl/OpenHermesPreferences_CamelAI

Viewer • Updated Apr 19 • 78.4k • 44

Louieworth/hh-rlhf-trl-style

Viewer • Updated Apr 20 • 100 • 35

rippertnt/OpenOrca-dpo-ko-en

Viewer • Updated Apr 21 • 25.6k • 41

dmvaldman/showerthought_preferences2

Viewer • Updated Apr 23 • 34k • 41

Astris/toxic-dpo-v0.2-embedded

Updated Apr 22 • 43

YYYYYYibo/ultrafeedback_binarized_with_response_full

Viewer • Updated Apr 22 • 61.1k • 39

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo_costa_2.8b_bf16.yml_6e799

Viewer • Updated Apr 22 • 107k • 33

orpo-explorers/OHP-Stratified-1

Viewer • Updated Apr 22 • 327k • 38

ShenaoZ/0.001_ablation_4iters_bs512_dataset

Viewer • Updated Apr 22 • 2k • 36

ShenaoZ/0.001_ablation_4iters_bs256_declr_dataset

Viewer • Updated Apr 23 • 51.8k • 48

ShenaoZ/0.01_ablation_5iters_bs256_nodpo_dataset

Viewer • Updated Apr 24 • 71.1k • 51

ShenaoZ/0.01_ablation_4iters_bs256_nodpo_dataset

Viewer • Updated Apr 24 • 69.1k • 72

ShenaoZ/0.001_ablation_4iters_bs256_nodpo_sample2_dataset

Viewer • Updated Apr 25 • 69.1k • 42

YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_0

Viewer • Updated Apr 24 • 10k • 35

YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_1

Viewer • Updated Apr 24 • 10k • 35

YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_2

Viewer • Updated Apr 24 • 10k • 34

YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_3

Viewer • Updated Apr 24 • 10k • 36

YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_4

Viewer • Updated Apr 24 • 10k • 33

YYYYYYibo/ultrafeedback_binarized_with_response_full_labeled_part_5

Viewer • Updated Apr 24 • 10k • 32

orpo-explorers/OHP-15k-mathcode

Viewer • Updated Apr 24 • 15k • 44

ShenaoZ/0.001_ablation_3iters_bs256_nodpo_dataset

Viewer • Updated Apr 25 • 67.1k • 60

ShenaoZ/0.001_ablation_5iters_bs256_nodpo_dataset

Viewer • Updated Apr 24 • 71.1k • 32

ShenaoZhang/0.001_ablation_4iters_bs128_nodpo_dataset

Viewer • Updated Apr 25 • 69.1k • 32

ShenaoZhang/0.0_ablation_4iters_bs128_nodpo_dataset

Viewer • Updated Apr 25 • 53.8k • 60

ShenaoZhang/0.01_ablation_4iters_bs128_nodpo_dataset

Viewer • Updated Apr 25 • 53.8k • 41

ShenaoZ/0.01_ablation_3iters_bs256_nodpo_dataset

Viewer • Updated Apr 25 • 42.8k • 31

ShenaoZ/0.001_ablation_4iters_bs256_nodpo_useresponse_dataset

Viewer • Updated Apr 25 • 69.1k • 36

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1

Viewer • Updated Apr 26 • 303k • 108

YYYYYYibo/ultrafeedback_binarized_without_ranked

Viewer • Updated Apr 25 • 10k • 35

NickyNicky/DPO_tokenizer_phi_3_test

Viewer • Updated Apr 26 • 10 • 32

lightblue/mitsu_top25_borda

Viewer • Updated May 30 • 674 • 40

ShenaoZ/0.001_3iters_bs128_declr_nodpo_dataset

Viewer • Updated Apr 26 • 24.4k • 33

ShenaoZ/0.001_3iters_bs128_declr_nodpo_zephyrbeta_dataset

Viewer • Updated Apr 26 • 46.8k • 36

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3

Viewer • Updated Apr 26 • 303k • 97

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_4

Viewer • Updated Apr 26 • 303k • 59

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_5

Viewer • Updated Apr 26 • 303k • 93

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo2_100_kl_0.1_prm_70m_thr_0.0_seed_4

Viewer • Updated Apr 26 • 303k • 79

YYYYYYibo/ultrafeedback_binarized_phase_0_part_0

Viewer • Updated Apr 26 • 100 • 34

ShenaoZhang/0.001_5iters_bs256_nodpo_only4w_dataset

Viewer • Updated Apr 28 • 70k • 55

YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part1

Viewer • Updated Apr 27 • 5k • 40

YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_part0

Viewer • Updated Apr 27 • 5k • 32

YYYYYYibo/ultrafeedback_binarized_phase_1_part_1_minpi

Viewer • Updated Apr 27 • 10k • 34

ShenaoZhang/0.1_4iters_bs256_nodpo_only4w_dataset

Viewer • Updated Apr 27 • 48k • 36

ShenaoZhang/0.001_3iters_bs256_nodpo_only4w_dataset

Viewer • Updated Apr 28 • 46k • 63

YYYYYYibo/ultrafeedback_binarized_phase_2

Viewer • Updated Apr 28 • 20k • 38

YYYYYYibo/ultrafeedback_binarized_phase_2_part_1minipart_1

Viewer • Updated Apr 28 • 1k • 40

YYYYYYibo/ultrafeedback_binarized_phase_2_unranked

Viewer • Updated Apr 28 • 9.28k • 36

YYYYYYibo/ultrafeedback_binarized_phase_2_minpi

Viewer • Updated Apr 28 • 9.28k • 37

ShenaoZhang/0.001_6iters_bs256_nodpo_full6w_dataset

Viewer • Updated Apr 28 • 2k • 34

ShenaoZhang/0.01_3iters_bs256_nodpo_full6w_dataset

Viewer • Updated Apr 29 • 67.1k • 94

communityai/system_identity_remove_preference_meta_ai

Viewer • Updated Apr 28 • 93 • 37

communityai/system_identity_remove_preference_google

Viewer • Updated Apr 28 • 93 • 37

communityai/system_identity_remove_preference_facebook

Viewer • Updated Apr 28 • 93 • 35

communityai/system_identity_remove_preference_alibaba

Viewer • Updated Apr 28 • 93 • 35

communityai/system_identity_remove_preference_alibaba_cloud

Viewer • Updated Apr 28 • 93 • 35

communityai/system_identity_remove_preference_mistral

Viewer • Updated Apr 28 • 93 • 33

communityai/system_identity_remove_preference_cohere

Viewer • Updated Apr 28 • 93 • 33

communityai/system_identity_remove_preference_chatgpt

Viewer • Updated Apr 28 • 93 • 37

communityai/system_identity_remove_preference_gpt

Viewer • Updated Apr 28 • 93 • 32

communityai/system_identity_remove_preference_gpt_3

Viewer • Updated Apr 28 • 93 • 34

communityai/system_identity_remove_preference_gpt_4

Viewer • Updated Apr 28 • 93 • 37

YYYYYYibo/ultrafeedback_binarized_phase_3

Viewer • Updated Apr 29 • 21.1k • 40

ShenaoZhang/0.001_2iters_bs256_nodpo_full6w_dataset

Viewer • Updated Apr 29 • 65.1k • 61

YYYYYYibo/first-eval-dataset-no-score

Viewer • Updated Apr 29 • 1k • 34

YYYYYYibo/first-dpo-eval-dataset-no-score

Viewer • Updated Apr 29 • 1k • 34

ShenaoZhang/0.0_3iters_bs256_nodpo_full6w_dataset

Viewer • Updated Apr 29 • 44.8k • 74

ShenaoZhang/0.01_4iters_bs256_nodpo_full6w_userresponse_dataset

Viewer • Updated Apr 29 • 34.6k • 47

C-Stuti/llama3-8b-orpo-con

Viewer • Updated Apr 29 • 3.36k • 49

Ksgk-fy/alignment-dpo-test2-mode-3

Viewer • Updated Apr 30 • 720 • 43

Ksgk-fy/alignment-dpo-test2-mode-4

Viewer • Updated Apr 30 • 720 • 34

YYYYYYibo/ultrafeedback_binarized_vllm_part_2

Viewer • Updated May 1 • 5k • 38

YYYYYYibo/ultrafeedback_binarized_minpi_part_2

Viewer • Updated May 1 • 5k • 45

YYYYYYibo/ultrafeedback_binarized_train_part_2

Viewer • Updated May 1 • 25k • 34

ReBatch/ultrafeedback_binarized_nl

Viewer • Updated May 30 • 61.7k • 49

YYYYYYibo/ultrafeedback_binarized_minpi_part_3

Viewer • Updated May 1 • 5k • 47

nbalepur/Mnemonic_Preferences_direct_comparison_fixed

Preview • Updated Apr 30 • 34

jhmejia/classifai

Viewer • Updated May 1 • 99 • 54

YYYYYYibo/whatever

Viewer • Updated May 1 • 40 • 40

GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped

Viewer • Updated May 2 • 23.3k • 46

YYYYYYibo/eval-dataset-merge

Viewer • Updated May 2 • 1k • 36

YYYYYYibo/eval-dataset-rank4

Viewer • Updated May 3 • 200 • 35

YYYYYYibo/eval-dataset-with-score-original

Viewer • Updated May 2 • 200 • 33

YYYYYYibo/eval-dataset-with-score-vanilla

Viewer • Updated May 2 • 200 • 41

YYYYYYibo/ultrafeedback_binarized_plus_left_part_3

Viewer • Updated May 3 • 16.1k • 35

YYYYYYibo/ultrafeedback_binarized_plus_train_part_3

Viewer • Updated May 3 • 5k • 39

ShenaoZ/0.0001_withdpo_3iters_bs256_511lr_dataset

Viewer • Updated May 3 • 44.8k • 41

hanyinwang/layer-project-reward-training

Viewer • Updated May 3 • 101 • 42

vipinkatara/dataset_complete_new

Viewer • Updated May 3 • 89.5k • 32

YYYYYYibo/eval-dataset-with-score-rank4_plus

Viewer • Updated May 3 • 200 • 32

vipinkatara/dataset_complete_final

Viewer • Updated May 3 • 89.5k • 35

YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_1

Viewer • Updated May 3 • 5k • 39

YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_1

Viewer • Updated May 3 • 16.1k • 37

ShenaoZ/0.01_withdpo_4iters_bs256_5102lr_misit_dataset

Viewer • Updated May 4 • 51.8k • 39

YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_2

Viewer • Updated May 3 • 15k • 41

YYYYYYibo/ultrafeedback_binarized_epoch_2_left_part_3

Viewer • Updated May 4 • 15k • 33

YYYYYYibo/ultrafeedback_binarized_epoch_2_train_part_3

Viewer • Updated May 4 • 26.1k • 36

YYYYYYibo/ultrafeedback_binarized_rank4_all_vllm_part_2_mini_2

Viewer • Updated May 4 • 3.8k • 34

ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_dataset

Viewer • Updated May 5 • 51.8k • 40

ShenaoZ/0.00005_withdpo_4iters_bs256_5102lr_dataset

Viewer • Updated May 5 • 51.8k • 37

ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_dataset

Viewer • Updated May 7 • 51.8k • 87

YYYYYYibo/ultrafeedback_binarized_rank4_all_train_part_2

Viewer • Updated May 4 • 18.6k • 39

KaggleMasterX/DPO_Test_ORPO

Viewer • Updated May 5 • 500 • 37

YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_3

Viewer • Updated May 5 • 20.5k • 34

KaggleMasterX/ORPO_5K

Viewer • Updated May 5 • 15k • 33

ShenaoZ/0.0001_zephyrdpoinit_nodpo_3iters_bs256_555lr_dataset

Viewer • Updated May 6 • 67.1k • 35

AmberYifan/safetyQA_DPO

Viewer • Updated May 5 • 55k • 41

ShenaoZ/0.0001_zephyrgemmasft_withdpo_3iters_bs256_555lr_dataset

Viewer • Updated May 6 • 24.4k • 38

ShenaoZ/0.0001_zephyrgemmadpo_nodpo_3iters_bs256_555lr_dataset

Viewer • Updated May 6 • 22.4k • 39

YYYYYYibo/ultrafeedback_binarized_new_train_part_1

Viewer • Updated May 6 • 15k • 36

YYYYYYibo/ultrafeedback_binarized_new_train_part_2

Viewer • Updated May 6 • 15k • 34

YYYYYYibo/ultrafeedback_binarized_new_train_part_3

Viewer • Updated May 6 • 15k • 33

YYYYYYibo/ultrafeedback_binarized_new_gen_part_1

Viewer • Updated May 6 • 5k • 36

ashishkgpian/kaggle_comp_dpo

Viewer • Updated May 6 • 39.7k • 39

Baidicoot/hh-rlhf-harmful-responses

Viewer • Updated May 6 • 14.9k • 43

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_0

Viewer • Updated May 6 • 4.9k • 37

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_2

Viewer • Updated May 6 • 4.9k • 34

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_1

Viewer • Updated May 6 • 4.9k • 35

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_1

Viewer • Updated May 6 • 4.9k • 34

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_0

Viewer • Updated May 6 • 5.18k • 40

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2

Viewer • Updated May 6 • 5.18k • 35

ShenaoZ/0.0001_sft_nodpo_4iters_bs256_555lr_dataset

Viewer • Updated May 7 • 69.1k • 50

ShenaoZ/0.0001_sft_nodpo_5iters_bs256_555lr_dataset

Viewer • Updated May 7 • 71.1k • 55

ShenaoZ/0.001_sft_nodpo_3iters_bs256_531lr_dataset

Viewer • Updated May 7 • 67.1k • 39

ShenaoZ/0.001_withdpo_4iters_bs256_531lr_dataset

Viewer • Updated May 7 • 51.8k • 42

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_3

Viewer • Updated May 7 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_2_mini_0

Viewer • Updated May 7 • 5k • 36

theGhoul21/irpo-dataset-v2

Viewer • Updated Aug 6 • 17.9k • 46

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_2

Viewer • Updated May 7 • 4.78k • 32

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_3

Viewer • Updated May 7 • 4.78k • 37

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2_mini_1

Viewer • Updated May 7 • 4.78k • 32

massimilianowosz/japanese_food

Viewer • Updated May 7 • 4.69k • 39

ShenaoZ/0.0001_sft_nodpo_3iters_bs256_5102lr_dataset

Viewer • Updated May 8 • 67.1k • 49

ShenaoZ/0.0001_sft_nodpo_4iters_bs256_5102lr_dataset

Viewer • Updated May 8 • 69.1k • 51

ShenaoZ/0.0001_withdpo_5iters_bs256_5102lr_dataset

Viewer • Updated May 8 • 56.9k • 51

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_0

Viewer • Updated May 8 • 5.28k • 33

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_1

Viewer • Updated May 8 • 5.28k • 34

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_0

Viewer • Updated May 8 • 5.18k • 39

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_2

Viewer • Updated May 8 • 5.18k • 36

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_3

Viewer • Updated May 8 • 5.19k • 38

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3

Viewer • Updated May 8 • 20.7k • 34

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_0

Viewer • Updated May 8 • 5k • 36

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2

Viewer • Updated May 9 • 19.4k • 41

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_2

Viewer • Updated May 9 • 4.98k • 36

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_3

Viewer • Updated May 9 • 5.09k • 35

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_1

Viewer • Updated May 9 • 5.28k • 40

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_3_mini_0

Viewer • Updated May 9 • 5.28k • 37

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_minpi_part_3

Viewer • Updated May 9 • 20.6k • 41

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_3

Viewer • Updated May 9 • 5.16k • 35

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3_mini_2

Viewer • Updated May 9 • 5.16k • 38

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_3

Viewer • Updated May 9 • 20.6k • 37

ShenaoZ/0.001_withdpo_4iters_bs256_5551lr_dataset

Viewer • Updated May 10 • 51.8k • 53

ShenaoZ/0.0005_mistral_withdpo_4iters_bs256_5551lr_dataset

Viewer • Updated May 10 • 51.8k • 47

Baidicoot/anthropic-rlhf-eval

Viewer • Updated May 10 • 2.31k • 43

GENIAC-Team-Ozaki/chatbot-arena-ja-calm2-7b-chat-experimental_deduped_add_generated_text

Viewer • Updated May 14 • 12k • 97

euiyulsong/arc_train_ds

Viewer • Updated May 17 • 1.12k • 43

ShenaoZhang/0.001_zephyr_5551_4iters_bs256_dataset

Viewer • Updated May 13 • 51.8k • 39

Code-Refinement/dpo-sample-perfect-less

Viewer • Updated May 14 • 128 • 39

Code-Refinement/dpo-sample-perfect-more

Viewer • Updated May 14 • 128 • 45

reciprocate/dpo-objective

Viewer • Updated May 14 • 512 • 42

ShenaoZhang/0.01_zephyr_5551_4iters_bs256_dataset

Viewer • Updated May 15 • 51.8k • 56

euiyulsong/sciqa_train_ds_random_rejected

Viewer • Updated May 15 • 12.7k • 36

GENIAC-Team-Ozaki/chatbot-arena-ja-karakuri-lm-8x7b-chat-v0.1-awq

Viewer • Updated May 17 • 12.5k • 37

euiyulsong/threedata

Viewer • Updated May 17 • 5.7k • 33

euiyulsong/arc_all

Viewer • Updated May 17 • 3.36k • 34

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr_relabel_pythia1b

Viewer • Updated May 17 • 107k • 42

DuongTrongChi/detoxic

Viewer • Updated May 17 • 5.69k • 38

euiyulsong/generated_data_all_cos

Viewer • Updated May 18 • 3.32k • 38

theGhoul21/irpo-dataset-v3-iteration2

Viewer • Updated May 18 • 5.01k • 39

euiyulsong/generated_data_all_cos_3000

Viewer • Updated May 18 • 3k • 37

JiazhenLiu01/dpo_llama3_362_threeturn

Viewer • Updated May 19 • 1.46k • 35

JiazhenLiu01/dpo_llama3_362_threeturn_empty_neg

Viewer • Updated May 19 • 1.46k • 46

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1

Viewer • Updated May 19 • 20k • 41

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.20

Updated May 20 • 38

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.10

Updated May 20 • 40

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.00

Updated May 20 • 38

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.00

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.20

Updated May 20 • 32

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.20

Updated May 20 • 36

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.30

Updated May 20 • 32

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.10

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.00

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.10

Updated May 20 • 36

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.20

Updated May 20 • 36

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.20

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.30

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.20

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.30

Updated May 20 • 40

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.00

Updated May 20 • 32

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.10

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.20

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.20

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.00pi0.40

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.20

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.10

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.50

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.40

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.30

Updated May 20 • 40

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_1

Viewer • Updated May 20 • 5k • 33

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.20pi0.50

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.10gamma0.40

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.30

Updated May 20 • 36

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.30

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.30

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.40

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.50

Updated May 20 • 40

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.50

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.30gamma0.40

Updated May 20 • 36

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.40

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.50

Updated May 20 • 35

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_1

Viewer • Updated May 20 • 5k • 37

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_3

Viewer • Updated May 20 • 5k • 35

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_2

Viewer • Updated May 20 • 5k • 34

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_2_mini_0

Viewer • Updated May 20 • 5k • 32

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_3

Viewer • Updated May 20 • 5k • 38

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2

Viewer • Updated May 20 • 20k • 37

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_3

Viewer • Updated May 20 • 5.29k • 36

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_3_mini_2

Viewer • Updated May 20 • 5.28k • 34

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_0

Viewer • Updated May 20 • 5.28k • 33

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_1

Viewer • Updated May 20 • 5.28k • 34

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_3

Viewer • Updated May 20 • 5.29k • 36

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_3_mini_2

Viewer • Updated May 20 • 5.28k • 38

mcding-org/CorrectDPO-Dataset-U0

Updated May 21 • 35

yasirchemmakh/dpo_llama3

Viewer • Updated May 21 • 43 • 35

mcding-org/CorrectDPO-Eval-DDP_L8B_U0_beta0.10r0.30rho0.20

Updated May 21 • 35

mnlp-nsoai/hf-dpo-pairs-collection

Viewer • Updated May 23 • 10.5k • 37

Piteryo/count_letters

Viewer • Updated May 23 • 1.28k • 44 • 1

rafaelsandroni/ultrafeedback_binarized_translated

Viewer • Updated May 23 • 1 • 49

GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v3_full-sft-finetuned-stage4-iter86000-v3

Viewer • Updated May 24 • 19.3k • 35

Piteryo/exact_number_of_sentences

Viewer • Updated May 24 • 1.28k • 42

GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_v4_full-sft-finetuned-stage4-iter86000-v4

Viewer • Updated May 25 • 19.5k • 42

berquetR/dpo_preference_dataset_EPFL_shp

Viewer • Updated May 26 • 69.1k • 36

ReBatch/ultrafeedback_nl

Viewer • Updated May 30 • 71.4k • 49

ShenaoZ/SELM-Zephyr-7B-dataset

Viewer • Updated May 31 • 17.3k • 42

nhyha/DPO

Viewer • Updated Jun 12 • 1 • 46

nhyha/ORPO_2

Viewer • Updated Jun 12 • 4 • 49

SiMajid/Dahoad

Viewer • Updated Jun 17 • 2.96k • 36

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_3

Viewer • Updated Jun 17 • 5k • 35

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_train_part_2_mini_1

Viewer • Updated Jun 17 • 5k • 34

minkyungpark/UFB_test

Viewer • Updated Jul 4 • 2k • 37

kpriyanshu256/v0-hh-rlhf-train-Hindi-0-20000

Viewer • Updated Jun 18 • 20k • 47

mnoukhov/summarize_from_feedback_oai_preprocessing_1706381144_relabel_llama8b

Viewer • Updated Jun 19 • 176k • 34

vwxyzjn/sentiment-trl-style

Viewer • Updated Jun 20 • 100 • 57

M4-ai/prm_dpo_pairs

Viewer • Updated Jul 1 • 93.9k • 61 • 7

kashif/nectar_dpo_pairs

Viewer • Updated Dec 1, 2023 • 3.84M • 357 • 4

sablo/oasst2_dpo_pairs_en

Viewer • Updated Feb 20 • 5.12k • 70 • 2

NickyNicky/oasst2_orpo_mix_function_call_phi_3_v1

Viewer • Updated May 2 • 120k • 42 • 2

Deojoandco/reward_model_anthropic_8

Viewer • Updated Mar 26, 2023 • 8.55k • 40 • 1

FredrikBL/Legal-Snigel-DPO

Viewer • Updated May 27 • 2k • 41 • 1

nayohan/SentimentSynth-ko

Viewer • Updated Jun 30 • 5.3k • 39 • 1

LawChat-tw/RLHF_data

Viewer • Updated Aug 18, 2023 • 23.6k • 61

cryptom/rm-static

Updated Nov 5, 2023 • 42

mnoukhov/openai_summarize_vllm_generated_20k

Viewer • Updated Dec 25, 2023 • 19.9k • 94

dvilasuero/multiturner-for-generation

Viewer • Updated Dec 19, 2023 • 3.43k • 44

Jaredquek/DpoOlier

Viewer • Updated Jan 12 • 315 • 47

vwxyzjn/cai-conversation-dev1705622085

Viewer • Updated Jan 19 • 44.8k • 54

vwxyzjn/cai-conversation-dev1705634160

Viewer • Updated Jan 19 • 256 • 53

vwxyzjn/cai-conversation-dev1705674984

Viewer • Updated Jan 19 • 256 • 49

vwxyzjn/cai-conversation-dev1705675844

Viewer • Updated Jan 19 • 256 • 43

weijie210/UFB_preference_iter_0

Viewer • Updated Jan 28 • 15.4k • 44

manishiitg/HuggingFaceH4-orca_dpo_pairs

Viewer • Updated Jan 29 • 22.7k • 48

pvduy/dpo_data_baai_50k

Viewer • Updated Jan 30 • 54.4k • 37

NobodyExistsOnTheInternet/FilteredTruthyDPO

Viewer • Updated Jan 31 • 477 • 37

lmg-anon/VNTL-v2.5-1.6k-dpo-pairs

Viewer • Updated Feb 2 • 8.99k • 46

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__1706888126

Viewer • Updated Feb 2 • 84 • 33

alvarobartt/orca_dpo_pairs_openai

Viewer • Updated Feb 6 • 12.9k • 37

vwxyzjn/openhermes-dev__mistralai_Mixtral-8x7B-Instruct-v0.1__temp

Viewer • Updated Feb 6 • 600k • 47

mesolitica/DPO-filtered-aya_dataset-zsm

Viewer • Updated Feb 13 • 10.1k • 34

nz/losest_to_3000_range_1000_to_9000

Viewer • Updated Mar 2 • 11k • 36

Baidicoot/dpo_safety_ihy_llama

Viewer • Updated Mar 3 • 5k • 39

kyujinpy/Mistral-EN-DPO-9K

Viewer • Updated Jul 6 • 9.18k • 67

vwxyzjn/ultrafeedback_binarized_1710204240

Viewer • Updated Mar 12 • 24.9k • 44

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_filter_gold_thr_0.5_self_70m

Viewer • Updated Mar 14 • 37.9k • 37

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1

Viewer • Updated Mar 21 • 568k • 98

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_2

Viewer • Updated Mar 21 • 568k • 136

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.3_seed_1

Viewer • Updated Mar 22 • 568k • 93

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2

Viewer • Updated Mar 22 • 568k • 73

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_2

Viewer • Updated Mar 22 • 568k • 175

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo16_2_64_mix_50_kl_0.1_prm_160m_thr_0.1_seed_3

Viewer • Updated Mar 24 • 568k • 109

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.1_seed_1

Viewer • Updated Mar 25 • 189k • 63

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-_fil_self_1.4b_bo2_100_kl_0.1_prm_160m_thr_0.3_seed_3

Viewer • Updated Mar 25 • 189k • 41

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_1.0

Viewer • Updated Apr 19 • 568k • 171

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0

Viewer • Updated Mar 25 • 568k • 135

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_3_t_1.0

Viewer • Updated Mar 25 • 568k • 81

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_1_t_1.0

Viewer • Updated Mar 25 • 568k • 99

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.75

Viewer • Updated Mar 26 • 568k • 91

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.3

Viewer • Updated Mar 27 • 568k • 136

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_tp_0.5

Viewer • Updated Mar 27 • 568k • 148

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_1.0_seed_1_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 129

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.5_seed_2_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 92

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.3_seed_3_t_1.0_eval

Viewer • Updated Mar 30 • 568k • 289

ShenaoZhang/0.001_idpo_4iters_dataset

Viewer • Updated Apr 6 • 51.8k • 36

mnoukhov/summarize_from_feedback_tldr3_generated_20k_relabel_pythia1b_dpo_temp0.7

Viewer • Updated Apr 8 • 20k • 35

Joyqiuyue/lima-preference_dataset-2

Viewer • Updated Apr 8 • 1 • 40

ShenaoZ/0.001_idpo_same_scratch_ref_dataset

Viewer • Updated Apr 13 • 63.1k • 41

AY2324S2-CS4248-Team-47/gec-dpo-ultrafeedback

Viewer • Updated Apr 16 • 2k • 33

when2rl/truthy-dpo-v0.1_reformatted

Viewer • Updated Apr 17 • 1.02k • 35

ShenaoZ/0.001_ablation_6iters_dataset

Viewer • Updated Apr 18 • 48.8k • 51

ShenaoZ/0.001_ablation_4iters_bs256_dataset

Viewer • Updated Apr 22 • 51.8k • 37

orpo-explorers/OHP-Stratified-3

Viewer • Updated Apr 22 • 331k • 50

waadarsh/test-orpo-magnite

Viewer • Updated Apr 22 • 214 • 36

ShenaoZ/0.001_ablation_5iters_bs256_useresponse_dataset

Viewer • Updated Apr 25 • 56.9k • 44

ShenaoZ/0.001_4iters_bs256_nodpo_only2third_userresponse_dataset

Viewer • Updated Apr 26 • 12.2k • 37

ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_dataset

Viewer • Updated Apr 28 • 62k • 80

YYYYYYibo/ultrafeedback_binarized_phase_2_part_1

Viewer • Updated Apr 28 • 100 • 38

dmvaldman/showerthought_preferences_full

Viewer • Updated Apr 28 • 26.1k • 37

kurier-digital/llm_titles_orpo

Viewer • Updated Apr 29 • 15.2k • 38

nbalepur/Mnemonic_Preferences_ours_with_ties_fixed

Preview • Updated Apr 29 • 43

ShenaoZ/0.0001_withdpo_4iters_bs256_531lr_dataset

Viewer • Updated Apr 30 • 51.8k • 71

YYYYYYibo/ultrafeedback_binarized_left_part_3

Viewer • Updated May 1 • 15k • 35

ShenaoZ/0.001_withdpo_4iters_bs256_432lr_dataset

Viewer • Updated May 1 • 51.8k • 44

ShenaoZ/0.0001_withdpo_3iters_bs256_551lr_misit_dataset

Viewer • Updated May 4 • 44.8k • 41

YYYYYYibo/ultrafeedback_binarized_epoch_2_vllm_part_3

Viewer • Updated May 4 • 5k • 38

YYYYYYibo/ultrafeedback_binarized_rank4_all_minpi_part_2

Viewer • Updated May 4 • 18.6k • 34

YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_2

Viewer • Updated May 5 • 18.6k • 35

YYYYYYibo/ultrafeedback_binarized_real_rank4_all_train_part_3

Viewer • Updated May 5 • 20.5k • 42

StrangeSX/RawdataforAUNQA_TH

Viewer • Updated May 22 • 2.06k • 43

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3

Viewer • Updated May 6 • 4.9k • 36

YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_2

Viewer • Updated May 15 • 20k • 39

euiyulsong/generated_data_all_cos_500

Viewer • Updated May 18 • 500 • 34

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.30

Updated May 20 • 34

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.20gamma0.10

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.50rho0.20

Updated May 20 • 36

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_1_mini_0

Viewer • Updated May 20 • 5k • 32

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.40rho0.30

Updated May 20 • 31

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.20rho0.40

Updated May 20 • 34

thewordsmiths/stem_dpo

Viewer • Updated May 31 • 50k • 40

BahaaEldin0/openai_summarize_comparisons_dataset_with_prompts

Viewer • Updated May 30 • 260k • 48

iamnguyen/vi-orpo-dpo-mix

Viewer • Updated Jun 3 • 44.2k • 35

ShenaoZ/SELM-Zephyr-7Bz-dataset

Viewer • Updated Jun 5 • 51.8k • 63

nhyha/ORPO

Viewer • Updated Jun 12 • 17 • 47

YYYYYYibo/ultrafeedback_binarized_ave_pi_with_golden_vllm_part_3_mini_1

Viewer • Updated Jun 17 • 5.28k • 36

YYYYYYibo/gshf_vllm_1_part_2_mini_7

Viewer • Updated Jul 4 • 2.5k • 33

YYYYYYibo/gshf_vllm_1_part_2_mini_1

Viewer • Updated Jul 4 • 2.5k • 40

YYYYYYibo/gshf_vllm_1_part_2_mini_0

Viewer • Updated Jul 4 • 2.5k • 33

YYYYYYibo/gshf_vllm_1_part_2_mini_5

Viewer • Updated Jul 4 • 2.5k • 36

YYYYYYibo/gshf_vllm_1_part_2_mini_6

Viewer • Updated Jul 4 • 2.5k • 35

YYYYYYibo/gshf_vllm_1_part_2_mini_2

Viewer • Updated Jul 4 • 2.5k • 35

YYYYYYibo/gshf_vllm_1_part_2_mini_3

Viewer • Updated Jul 4 • 2.5k • 33

YYYYYYibo/gshf_vllm_1_part_2_mini_4

Viewer • Updated Jul 4 • 2.5k • 40

YYYYYYibo/gshf_vllm_2_part_2_mini_3

Viewer • Updated Jul 5 • 2.5k • 37

YYYYYYibo/gshf_vllm_2_part_2_mini_1

Viewer • Updated Jul 5 • 2.5k • 36

YYYYYYibo/gshf_vllm_2_part_2_mini_5

Viewer • Updated Jul 5 • 2.5k • 41

YYYYYYibo/gshf_vllm_2_part_2_mini_4

Viewer • Updated Jul 5 • 2.5k • 39

YYYYYYibo/gshf_vllm_2_part_2_mini_6

Viewer • Updated Jul 5 • 2.5k • 41

YYYYYYibo/gshf_vllm_2_part_2_mini_2

Viewer • Updated Jul 5 • 2.5k • 35

YYYYYYibo/gshf_vllm_2_part_2_mini_0

Viewer • Updated Jul 5 • 2.5k • 34

YYYYYYibo/gshf_vllm_2_part_2_mini_7

Viewer • Updated Jul 5 • 2.5k • 37

YYYYYYibo/gshf_train_part_2_mini_7

Viewer • Updated Jul 5 • 2.5k • 42

YYYYYYibo/gshf_train_part_2_mini_3

Viewer • Updated Jul 5 • 2.5k • 34

YYYYYYibo/gshf_train_part_2_mini_6

Viewer • Updated Jul 5 • 2.5k • 37

YYYYYYibo/gshf_train_part_2_mini_4

Viewer • Updated Jul 5 • 2.5k • 34

YYYYYYibo/gshf_train_part_2_mini_0

Viewer • Updated Jul 5 • 2.5k • 38

YYYYYYibo/gshf_train_part_2_mini_1

Viewer • Updated Jul 5 • 2.5k • 36

YYYYYYibo/gshf_train_part_2_mini_5

Viewer • Updated Jul 5 • 2.5k • 36

YYYYYYibo/gshf_train_part_2_mini_2

Viewer • Updated Jul 5 • 2.5k • 38

GokhanAI/Synthetic

Viewer • Updated Nov 13, 2023 • 26.4k • 44 • 1

AlekseyKorshuk/hh-rlhf-pairwise

Viewer • Updated Feb 8, 2023 • 81.4k • 44

AlekseyKorshuk/lmeh-story-cloze-2016

Viewer • Updated May 23, 2023 • 1k • 39

LanXiu/test_dataset

Viewer • Updated Jul 27, 2023 • 768 • 71

mnoukhov/openai_summarize_comparisons_tldrprompt

Viewer • Updated Nov 30, 2023 • 260k • 48

vwxyzjn/cai-conversation-prod-h4

Viewer • Updated Nov 29, 2023 • 169k • 41

vwxyzjn/cai-conversation-dev

Viewer • Updated Jan 9 • 76 • 72

vwxyzjn/cai-conversation-dev1704834920

Viewer • Updated Jan 9 • 128 • 36

HuggingFaceH4/grok-conversation-harmless-old

Viewer • Updated Jan 16 • 44.8k • 151

lamhieu/itorca_dpo_en

Viewer • Updated Jul 1 • 5.92k • 77

vwxyzjn/cai-conversation-dev1705620799

Viewer • Updated Jan 18 • 256 • 67

vwxyzjn/cai-conversation-dev1705628758

Viewer • Updated Jan 19 • 256 • 71

vwxyzjn/cai-conversation-dev1705632182

Viewer • Updated Jan 19 • 256 • 50

thangvip/reward-training-data

Viewer • Updated Jan 22 • 2.97k • 58

Asap7772/ultrafeedback_binarized_relabelled_test

Viewer • Updated Jan 23 • 32 • 39

diyali95916/ultrafeedback_binarized

Viewer • Updated Jan 25 • 187k • 54

pvduy/dpo_data_math

Viewer • Updated Jan 30 • 6.81k • 46

dkshjn/processed_truthy

Viewer • Updated Feb 1 • 1.02k • 32

weijie210/UFB_prefs_iter_0_pairwise

Viewer • Updated Feb 6 • 14.7k • 38

vwxyzjn/openhermes-dev__kaist-ai_prometheus-13b-v1.0__1707406405

Viewer • Updated Feb 8 • 167 • 41

vwxyzjn/ultrafeedback_binarized_1707919621

Viewer • Updated Feb 14 • 2k • 39

mnoukhov/openai_summarize_generated_20k_relabel_pythia410m-dpo1_margin

Viewer • Updated Feb 22 • 20k • 73

roleplay4fun/chai-invalid-pairs-ss5-v1.0

Viewer • Updated Feb 27 • 16.1k • 35

datatab/ultrafeedback_binarized_serbian

Viewer • Updated Mar 7 • 189k • 110

David-Xu/astronomy-stack-dpo

Viewer • Updated Mar 8 • 19.9k • 36

quirky-lats-at-mats/NORMAL_BACKDOOR_alpaca_sleeper_agents_toy_safety_v4

Viewer • Updated Mar 11 • 2.83k • 34

aengusl/noise5_alpaca_sleeper_agents_toy_safety_NOT_TRUNCATED_v4

Viewer • Updated Mar 11 • 2.83k • 33

vwxyzjn/tldr-preference-trl-style

Viewer • Updated Aug 20 • 100 • 88

Aditya685/hermes_preference_filtered_data

Viewer • Updated Mar 14 • 78.4k • 47

Ksgk-fy/alignment-dpo-test03

Viewer • Updated Mar 23 • 3.78k • 39

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_160m_thr_0.0_seed_1_t_1.0

Viewer • Updated Mar 25 • 568k • 86

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_1_t_0.75

Viewer • Updated Mar 26 • 568k • 165

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_3_t_0.25

Viewer • Updated Mar 26 • 568k • 101

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.1

Viewer • Updated Mar 27 • 568k • 95

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_tp_0.7

Viewer • Updated Mar 27 • 568k • 94

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0_eval

Viewer • Updated Mar 28 • 568k • 108

ShenaoZhang/0.001_idpo_same_dataset

Viewer • Updated Apr 6 • 44.8k • 50

ShenaoZhang/0.001_idpo_4iters_ref_response

Viewer • Updated Apr 6 • 51.8k • 42

mnoukhov/summarize_from_feedback_tldr3_generated_20k_vllm_pythia1b_dpo_temp0.7_length128

Viewer • Updated Apr 14 • 20k • 39

guoyu-zhang/shp_4

Viewer • Updated Apr 15 • 1k • 36

guoyu-zhang/usp_3

Viewer • Updated Apr 15 • 1k • 36

ShenaoZ/0.00001_ablation_dataset

Viewer • Updated Apr 18 • 44.8k • 60

mnoukhov/summarize_from_feedback_tldr3_labelled_generated_relabel_20k_dpo_costa_1b_fp16.yml_3d94f50_b9ff2

Viewer • Updated Apr 19 • 9.5k • 35

ShenaoZ/0.001_ablation_declr_4iters_dataset

Viewer • Updated Apr 21 • 51.8k • 42

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_dpo2_costa_1b_fp16.yml_bfcef

Viewer • Updated Apr 21 • 107k • 33

orpo-explorers/OHP-Stratified-2

Viewer • Updated Apr 22 • 331k • 36

ShenaoZ/001_ablation_5iters_bs256_nodpo_dataset

Viewer • Updated Apr 24 • 58.9k • 38

ShenaoZ/0.001_ablation_4iters_bs256_sample2_dataset

Viewer • Updated Apr 24 • 51.8k • 44

ShenaoZ/01_ablation_3iters_bs256_nodpo_dataset

Viewer • Updated Apr 24 • 24.4k • 44

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2

Viewer • Updated Apr 26 • 303k • 56

NickyNicky/alexredna_oasst2_dpo_pairs

Viewer • Updated Apr 26 • 10k • 34

jjmaxwell/llama3_orpo_dpo_clone

Viewer • Updated Apr 28 • 44.2k • 36

YYYYYYibo/eval-dataset-original

Viewer • Updated May 3 • 200 • 36

YYYYYYibo/eval-dataset-with-score-merge

Viewer • Updated May 2 • 200 • 35

YYYYYYibo/ultrafeedback_binarized_plus_minpi_part_3

Viewer • Updated May 3 • 5k • 33

ShenaoZ/0.001_withdpo_4iters_bs256_5102lr_misit_dataset

Viewer • Updated May 4 • 19.3k • 32

YYYYYYibo/ultrafeedback_binarized_epoch_2_minpi_part_2

Viewer • Updated May 3 • 5k • 37

ShenaoZ/0.0_withdpo_4iters_bs256_5102lr_misit_dataset

Viewer • Updated May 4 • 51.8k • 55

ShenaoZ/0.0001_zephyrgemmasft_withdpo_4iters_bs256_555lr_dataset

Viewer • Updated May 6 • 51.8k • 44

YYYYYYibo/ultrafeedback_binarized_dataset_offline_part2

Viewer • Updated May 6 • 20.7k • 37

YYYYYYibo/ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0

Viewer • Updated May 6 • 4.9k • 38

ShenaoZ/0.01_sft_nodpo_3iters_bs256_531lr_dataset

Viewer • Updated May 7 • 67.1k • 41

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_2

Viewer • Updated May 8 • 19.1k • 32

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_vllm_part_3_mini_2

Viewer • Updated May 8 • 5.08k • 36

YYYYYYibo/ultrafeedback_binarized_doff_no_golden_train_part_3_mini_1

Viewer • Updated May 8 • 5.18k • 34

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_vllm_part_2_mini_3

Viewer • Updated May 8 • 5k • 34

ShenaoZ/0.0005_betadpoinit_4iters_bs256_5551lr_dataset

Viewer • Updated May 10 • 69.1k • 55

Baidicoot/anthropic-helpful-harmless-rlhf

Viewer • Updated May 10 • 169k • 46

mnoukhov/summarize_from_feedback_tldr3_unlabelled_vllm_pythia410m-dpo-tldr-step873_relabel_pythia1b

Viewer • Updated May 13 • 20k • 40

yananchen/tp_dpo_pairs_45chosen

Viewer • Updated May 15 • 3.64k • 36

YYYYYYibo/ultrafeedback_binarized_rank4_on_vanilla_part_1

Viewer • Updated May 15 • 20k • 36

YYYYYYibo/ultrafeedback_binarized_simple_online_vllm_part_1_mini_1

Viewer • Updated May 19 • 5k • 35

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.10rho0.00

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.10

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.30

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.10

Updated May 20 • 32

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.10pi0.10

Updated May 20 • 33

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.30rho0.10

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DPP_Q0.5B_PP10_beta0.10p0.30pi0.30

Updated May 20 • 35

mcding-org/CorrectDPO-Eval-DPR_Q0.5B_PP10_beta0.10g0.00gamma0.40

Updated May 20 • 37

mcding-org/CorrectDPO-Eval-DDP_Q0.5B_PP10_beta0.10r0.00rho0.40

Updated May 20 • 38

YYYYYYibo/ultrafeedback_binarized_simple_online_train_part_2_mini_0

Viewer • Updated May 20 • 5k • 34

GENIAC-Team-Ozaki/tuninig-dataset_pref_20pct_full-sft-finetuned-stage4-iter86000

Viewer • Updated May 22 • 20.3k • 32

BahaaEldin0/small_dataset_with_rewards

Viewer • Updated May 30 • 1k • 35

BahaaEldin0/updated_dataset_with_prompts

Viewer • Updated Oct 2 • 1k • 45

stojchet/test_disc_ds

Viewer • Updated Jun 7 • 20 • 37

thepowerfuldeez/Qwen-summarize-dataset-test

Viewer • Updated Jun 17 • 187 • 39

Marjovl/berkeley-nest-Nectar-DPO

Viewer • Updated Jun 19 • 1.1M • 42 • 1

nlee-208/UF1000-eurus

Viewer • Updated Jul 1 • 1k • 36

heli-stand/hh-rlhf-harmless-base-trl-style

Viewer • Updated Jul 3 • 44.8k • 51 • 1

YYYYYYibo/full_simple_online_vllm_part_2_mini_1

Viewer • Updated Jul 4 • 2.5k • 36

YYYYYYibo/full_simple_online_vllm_part_2_mini_7

Viewer • Updated Jul 4 • 2.3k • 37

YYYYYYibo/full_simple_online_vllm_part_2_mini_6

Viewer • Updated Jul 4 • 2.3k • 36

YYYYYYibo/full_simple_online_vllm_part_2_mini_5

Viewer • Updated Jul 4 • 2.1k • 38

YYYYYYibo/full_simple_online_vllm_part_2_mini_0

Viewer • Updated Jul 4 • 2.5k • 39

YYYYYYibo/full_simple_online_vllm_part_2_mini_3

Viewer • Updated Jul 4 • 2.5k • 38

YYYYYYibo/full_simple_online_vllm_part_2_mini_4

Viewer • Updated Jul 4 • 2.3k • 36

YYYYYYibo/full_simple_online_vllm_part_2_mini_2

Viewer • Updated Jul 4 • 2.5k • 36

YYYYYYibo/full_simple_online_train_part_2_mini_6

Viewer • Updated Jul 4 • 2.38k • 34

YYYYYYibo/full_simple_online_train_part_2_mini_7

Viewer • Updated Jul 4 • 2.38k • 34

YYYYYYibo/full_simple_online_train_part_2_mini_0

Viewer • Updated Jul 4 • 2.38k • 34

YYYYYYibo/full_simple_online_train_part_2_mini_2

Viewer • Updated Jul 4 • 2.38k • 36

YYYYYYibo/full_simple_online_train_part_2_mini_3

Viewer • Updated Jul 4 • 2.38k • 34

YYYYYYibo/full_simple_online_train_part_2_mini_4

Viewer • Updated Jul 4 • 2.38k • 44

YYYYYYibo/full_simple_online_train_part_2_mini_1

Viewer • Updated Jul 4 • 2.38k • 35

YYYYYYibo/full_simple_online_train_part_2_mini_5

Viewer • Updated Jul 4 • 2.38k • 37

YYYYYYibo/full_simple_online_vllm_part_3_mini_1

Viewer • Updated Jul 4 • 2.44k • 39

YYYYYYibo/full_simple_online_vllm_part_3_mini_6

Viewer • Updated Jul 4 • 2.54k • 32

YYYYYYibo/full_simple_online_vllm_part_3_mini_0

Viewer • Updated Jul 4 • 2.34k • 37

YYYYYYibo/full_simple_online_vllm_part_3_mini_5

Viewer • Updated Jul 4 • 2.04k • 34

YYYYYYibo/full_simple_online_vllm_part_3_mini_3

Viewer • Updated Jul 4 • 2.64k • 34

YYYYYYibo/full_simple_online_vllm_part_3_mini_2

Viewer • Updated Jul 4 • 2.64k • 34

YYYYYYibo/full_simple_online_vllm_part_3_mini_7

Viewer • Updated Jul 4 • 2.25k • 35

YYYYYYibo/full_simple_online_vllm_part_3_mini_4

Viewer • Updated Jul 4 • 2.44k • 38

YYYYYYibo/full_simple_online_train_part_3_mini_0

Viewer • Updated Jul 4 • 2.42k • 36

YYYYYYibo/full_simple_online_train_part_3_mini_6

Viewer • Updated Jul 4 • 2.42k • 38

YYYYYYibo/full_simple_online_train_part_3_mini_1

Viewer • Updated Jul 4 • 2.42k • 47

YYYYYYibo/full_simple_online_train_part_3_mini_7

Viewer • Updated Jul 4 • 2.42k • 36

YYYYYYibo/full_simple_online_train_part_3_mini_3

Viewer • Updated Jul 4 • 2.42k • 35

YYYYYYibo/full_simple_online_train_part_3_mini_2

Viewer • Updated Jul 4 • 2.42k • 38

YYYYYYibo/full_simple_online_train_part_3_mini_5

Viewer • Updated Jul 4 • 2.42k • 40

YYYYYYibo/full_simple_online_train_part_3_mini_4

Viewer • Updated Jul 4 • 2.42k • 35

YYYYYYibo/gshf_vllm_1_part_3_mini_0

Viewer • Updated Jul 5 • 2.64k • 35

YYYYYYibo/gshf_vllm_1_part_3_mini_2

Viewer • Updated Jul 5 • 2.64k • 33

YYYYYYibo/gshf_vllm_1_part_3_mini_6

Viewer • Updated Jul 5 • 2.64k • 36

YYYYYYibo/gshf_vllm_1_part_3_mini_5

Viewer • Updated Jul 5 • 2.64k • 34

YYYYYYibo/gshf_vllm_1_part_3_mini_1

Viewer • Updated Jul 5 • 2.64k • 38

YYYYYYibo/gshf_vllm_1_part_3_mini_3

Viewer • Updated Jul 5 • 2.64k • 44

YYYYYYibo/gshf_vllm_1_part_3_mini_7

Viewer • Updated Jul 5 • 2.65k • 34

YYYYYYibo/gshf_vllm_1_part_3_mini_4

Viewer • Updated Jul 5 • 2.64k • 42

YYYYYYibo/gshf_vllm_2_part_3_mini_2

Viewer • Updated Jul 5 • 2.64k • 35

YYYYYYibo/gshf_vllm_2_part_3_mini_1

Viewer • Updated Jul 5 • 2.64k • 33

YYYYYYibo/gshf_vllm_2_part_3_mini_6

Viewer • Updated Jul 5 • 2.64k • 40

YYYYYYibo/gshf_vllm_2_part_3_mini_5

Viewer • Updated Jul 5 • 2.64k • 33

YYYYYYibo/gshf_vllm_2_part_3_mini_0

Viewer • Updated Jul 5 • 2.64k • 37

YYYYYYibo/gshf_vllm_2_part_3_mini_3

Viewer • Updated Jul 5 • 2.64k • 36

YYYYYYibo/gshf_vllm_2_part_3_mini_7

Viewer • Updated Jul 5 • 2.65k • 34

YYYYYYibo/gshf_vllm_2_part_3_mini_4

Viewer • Updated Jul 5 • 2.64k • 39

YYYYYYibo/gshf_train_part_3_mini_0

Viewer • Updated Jul 5 • 2.64k • 34

YYYYYYibo/gshf_train_part_3_mini_1

Viewer • Updated Jul 5 • 2.64k • 37

YYYYYYibo/gshf_train_part_3_mini_6

Viewer • Updated Jul 5 • 2.64k • 36

YYYYYYibo/gshf_train_part_3_mini_3

Viewer • Updated Jul 5 • 2.64k • 35

YYYYYYibo/gshf_train_part_3_mini_5

Viewer • Updated Jul 5 • 2.64k • 34

YYYYYYibo/gshf_train_part_3_mini_2

Viewer • Updated Jul 5 • 2.64k • 35

YYYYYYibo/gshf_train_part_3_mini_4

Viewer • Updated Jul 5 • 2.64k • 34

YYYYYYibo/gshf_train_part_3_mini_7

Viewer • Updated Jul 5 • 2.65k • 36

liswei/rm-static-zhTW

Viewer • Updated May 19, 2023 • 81.4k • 36 • 30

pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_format

Updated Apr 28, 2023 • 33 • 1

mii-llm/enex-dpo

Viewer • Updated Jan 16 • 2.99k • 37 • 1

AlekseyKorshuk/combined-pairwise

Viewer • Updated Feb 8, 2023 • 222k • 33

pvduy/hh_shp_oa_gpt4_rm_dataset_vicuna_formatoa

Updated May 1, 2023 • 32

amazingvince/full-dpo

Viewer • Updated Nov 30, 2023 • 186k • 32

mii-llm/cult-dpo

Viewer • Updated Jan 17 • 987 • 33

winglian/cortex-dumpster-fire-gemma-v5-crashed

Updated Mar 6 • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_70m

Viewer • Updated Mar 15 • 37.9k • 246

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_70m

Viewer • Updated Mar 18 • 189k • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_70m

Viewer • Updated Mar 18 • 189k • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.1_self_160m

Updated Mar 21 • 34

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.5_self_160m

Updated Mar 18 • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.2_self_160m

Viewer • Updated Mar 15 • 37.9k • 33

August4293/Self_Alignment_Preference-Dataset

Viewer • Updated Mar 18 • 4.45k • 47

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_70m

Viewer • Updated Mar 18 • 189k • 32

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.0_self_160m

Viewer • Updated Mar 18 • 189k • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_70m

Viewer • Updated Mar 19 • 189k • 218

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_70m

Viewer • Updated Mar 19 • 189k • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_70m

Viewer • Updated Mar 19 • 189k • 32

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.1_self_160m

Updated Mar 19 • 32

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.5_self_160m

Updated Mar 19 • 32

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-2_iso_filter_gold_thr_0.0_self_160m

Updated Mar 19 • 33

boopysaur/user1-dpo-small

Viewer • Updated Mar 19 • 12.1k • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_0.3_self_160m

Updated Mar 21 • 36

Mitsuki-Sakamoto/alpaca_farm-deberta-re-preference-64-nsample-16_filter_gold_thr_1.0_self_160m

Updated Mar 21 • 33

Mitsuki-Sakamoto/alpaca_farm-deberta-re-pref-64-fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.0_seed_2_t_1.0

Viewer • Updated Apr 19 • 568k • 34

Mitsuki-Sakamoto/fil_self_160m_bo16_2_mix_50_kl_0.1_prm_70m_thr_0.1_seed_3_t_1.0_eval

Viewer • Updated Mar 29 • 568k • 32

Joyqiuyue/lima_preference_dataset

Viewer • Updated Apr 9 • 50 • 177

gagan3012/oasis

Viewer • Updated Apr 9 • 2.34M • 33

theblackhacker/arc_dpo

Viewer • Updated Apr 9 • 38.6k • 32

Dhananjayg22/legal-dpo

Viewer • Updated Apr 18 • 300 • 115

ShenaoZ/0.001_3iters_bs256_declr_nodpo_dataset

Viewer • Updated Apr 26 • 44.8k • 39

ShenaoZ/0.01_withdpo_4iters_bs256_531lr_dataset

Viewer • Updated May 7 • 51.8k • 60

YYYYYYibo/ultrafeedback_binarized_doff_real_no_golden_train_part_2_mini_0

Viewer • Updated May 9 • 4.85k • 35

crumb/semantic-corruption-t5-v1_1-small

Viewer • Updated May 21 • 2.28k • 35

crumb/semantic-corruption-t5-v1_1-base

Viewer • Updated May 21 • 1.54k • 37

crumb/semantic-corruption-t5-v1_1-large

Viewer • Updated May 21 • 753 • 39

mnlp-nsoai/dpo-student-preferences

Viewer • Updated May 21 • 18.4k • 33

ContextualAI/ultrabin_clean_max_chosen_rand_rejected_rationalized

Viewer • Updated Jun 12 • 60.9k • 36

malteos/translation_test

Viewer • Updated Jun 12 • 10 • 33

malteos/translation_test2

Viewer • Updated Jun 18 • 50 • 33

nayohan/contextual-dpo-v0.1-ko

Viewer • Updated Jun 30 • 1.37k • 54

nayohan/reward-bench-ko

Viewer • Updated Jun 30 • 8.11k • 89

Windy/tmp_output_apc

Viewer • Updated Jun 30 • 60 • 39

Windy/tmp_output_apc_t1

Viewer • Updated Jul 1 • 60 • 36

Windy/tmp_output_apc_t1_noshort

Viewer • Updated Jul 1 • 60 • 39

sert121/preference_data_mapped_v8

Viewer • Updated Jul 1 • 960 • 39

sert121/preference_data_mapped_v7

Viewer • Updated Jul 1 • 3.2k • 36

Mitsuki-Sakamoto/pref_dataset_prompt_hh

Viewer • Updated Jul 4 • 77 • 32

Mitsuki-Sakamoto/pref_dataset_pairwise_hh

Viewer • Updated Jul 4 • 79 • 33

Mitsuki-Sakamoto/pref_dataset_prompt_ultrafeedback

Viewer • Updated Jul 4 • 28 • 33

Mitsuki-Sakamoto/pref_dataset_pairwise_ultrafeedback

Viewer • Updated Jul 4 • 30 • 33

Windy/tmp_output_ultr4_t0

Viewer • Updated Jul 3 • 60 • 36

Windy/tmp_output_ultr4_t0_top1

Viewer • Updated Jul 3 • 60 • 36

August4293/gsm8k_preference_dataset_it_1

Viewer • Updated Jul 4 • 895 • 40

August4293/gsm8k_preference_dataset_it_2

Viewer • Updated Jul 4 • 379 • 48

Windy/tmp_output_ultr4_t1

Viewer • Updated Jul 4 • 60 • 37

Columbia-NLP/DPO-distilabel-capybara-dpo-7k-binarized

Viewer • Updated Jul 10 • 7.56k • 36

Columbia-NLP/DPO-distilabel-intel-orca-dpo-pairs_cleaned

Viewer • Updated Jul 10 • 12.8k • 42

Columbia-NLP/DPO-UltraFeedback_binarized

Viewer • Updated Jul 10 • 62.7k • 44

Columbia-NLP/DPO-py-dpo-v0.1

Viewer • Updated Jul 10 • 9.47k • 47

Columbia-NLP/DPO-tldr-summarisation-preferences

Viewer • Updated Jul 10 • 177k • 49

Columbia-NLP/DPO-PKU-SafeRLHF

Viewer • Updated Jul 10 • 136k • 43

Columbia-NLP/DPO-Nectar

Viewer • Updated Jul 10 • 183k • 59

Columbia-NLP/DPO-hh-rlhf

Viewer • Updated Jul 10 • 169k • 68

Windy/tmp_output_lima_t0

Viewer • Updated Jul 6 • 60 • 43

Windy/tmp_output_ultr4_t1_fromsimpt0_rankerthresh4

Viewer • Updated Jul 7 • 60 • 35

YYYYYYibo/test_vllm_mini_0

Viewer • Updated Jul 8 • 2.5k • 34

Windy/tmp_output_ultraw_t0

Viewer • Updated Jul 8 • 60 • 44

Windy/tmp_output_ultr4_t1_simthresh03

Viewer • Updated Jul 8 • 60 • 38

Windy/tmp_output_ultr4_t1_simthresh03_rank6

Viewer • Updated Jul 9 • 60 • 40

flydust/ultrafeedback-labeled

Viewer • Updated Jul 9 • 61.8k • 45

YYYYYYibo/test_get_pi

Viewer • Updated Jul 9 • 1k • 35

YYYYYYibo/test_pairrm

Viewer • Updated Jul 9 • 21.1k • 32

sert121/preference_data_v11_cleaned_filtered

Viewer • Updated Jul 10 • 3.55k • 34

sert121/preference_data_v10_cleaned_filtered

Viewer • Updated Jul 10 • 2.38k • 37

Windy/ultr4_v3_t1_trlsft_mv1

Viewer • Updated Jul 10 • 99 • 39

Xalphinions/llama3_ultrafeedback_with_tie

Viewer • Updated Jul 10 • 61.8k • 38

Windy/ultr4_v3_t1_trlsft_mv1_ranksim

Viewer • Updated Jul 10 • 7.11k • 34

Xalphinions/UltraFeedback_with_tie

Viewer • Updated Jul 10 • 133k • 36

nlee-208/UF-Mistral-Self101

Viewer • Updated Jul 10 • 2.5k • 33

Windy/ultr4_v3_t1_trlsft_mv1_ranksim_top1

Viewer • Updated Jul 10 • 15k • 37