v000000 commited on
Commit
cca4d10
1 Parent(s): abe7450

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -30
README.md CHANGED
@@ -1,37 +1,20 @@
1
  ---
2
  base_model:
3
- - v000000/Qwen2.5-14B-Gutenberg-0.25e-Early
4
- - v000000/qwen_results100
5
  library_name: transformers
6
  tags:
7
- - mergekit
8
- - merge
9
-
 
 
 
 
 
 
 
10
  ---
11
- # merge
12
-
13
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
14
-
15
- ## Merge Details
16
- ### Merge Method
17
-
18
- This model was merged using the [linear](https://arxiv.org/abs/2203.05482) merge method.
19
-
20
- ### Models Merged
21
-
22
- The following models were included in the merge:
23
- * [v000000/Qwen2.5-14B-Gutenberg-0.25e-Early](https://huggingface.co/v000000/Qwen2.5-14B-Gutenberg-0.25e-Early) + [v000000/qwen_results100](https://huggingface.co/v000000/qwen_results100)
24
-
25
- ### Configuration
26
-
27
- The following YAML configuration was used to produce this model:
28
 
29
- ```yaml
30
- models:
31
- - model: v000000/Qwen2.5-14B-Gutenberg-0.25e-Early+v000000/qwen_results100
32
- parameters:
33
- weight: 1.0
34
- merge_method: linear
35
- dtype: bfloat16
36
 
37
- ```
 
1
  ---
2
  base_model:
3
+ - Qwen/Qwen2.5-14B-Instruct
 
4
  library_name: transformers
5
  tags:
6
+ - qwen2
7
+ - qwen2.5
8
+ - dpo
9
+ - chat
10
+ - conversational
11
+ license: apache-2.0
12
+ datasets:
13
+ - jondurbin/gutenberg-dpo-v0.1
14
+ language:
15
+ - en
16
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
17
 
18
+ # Qwen2.5-Gutenberg-1e-Delta
 
 
 
 
 
 
19
 
20
+ This is qwen2.5-instruct trained on Gutenberg dpo for 1.25 epoch's.