Update README.md
Browse files
README.md
CHANGED
@@ -1,199 +1,166 @@
|
|
1 |
---
|
|
|
|
|
|
|
|
|
2 |
library_name: transformers
|
3 |
-
tags:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
---
|
5 |
|
6 |
# Model Card for Model ID
|
7 |
|
8 |
-
|
9 |
|
|
|
10 |
|
|
|
11 |
|
12 |
-
##
|
13 |
-
|
14 |
-
### Model Description
|
15 |
-
|
16 |
-
<!-- Provide a longer summary of what this model is. -->
|
17 |
-
|
18 |
-
This is the model card of a π€ transformers model that has been pushed on the Hub. This model card has been automatically generated.
|
19 |
-
|
20 |
-
- **Developed by:** [More Information Needed]
|
21 |
-
- **Funded by [optional]:** [More Information Needed]
|
22 |
-
- **Shared by [optional]:** [More Information Needed]
|
23 |
-
- **Model type:** [More Information Needed]
|
24 |
-
- **Language(s) (NLP):** [More Information Needed]
|
25 |
-
- **License:** [More Information Needed]
|
26 |
-
- **Finetuned from model [optional]:** [More Information Needed]
|
27 |
-
|
28 |
-
### Model Sources [optional]
|
29 |
-
|
30 |
-
<!-- Provide the basic links for the model. -->
|
31 |
-
|
32 |
-
- **Repository:** [More Information Needed]
|
33 |
-
- **Paper [optional]:** [More Information Needed]
|
34 |
-
- **Demo [optional]:** [More Information Needed]
|
35 |
-
|
36 |
-
## Uses
|
37 |
|
38 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
39 |
|
40 |
-
|
41 |
|
42 |
-
|
43 |
|
44 |
-
[
|
|
|
|
|
45 |
|
46 |
-
|
47 |
|
48 |
-
|
49 |
|
50 |
-
|
|
|
|
|
51 |
|
52 |
-
|
53 |
|
54 |
-
|
55 |
|
56 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
57 |
|
58 |
## Bias, Risks, and Limitations
|
59 |
|
60 |
-
|
61 |
-
|
62 |
-
[More Information Needed]
|
63 |
-
|
64 |
-
### Recommendations
|
65 |
-
|
66 |
-
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
67 |
-
|
68 |
-
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
69 |
-
|
70 |
-
## How to Get Started with the Model
|
71 |
-
|
72 |
-
Use the code below to get started with the model.
|
73 |
-
|
74 |
-
[More Information Needed]
|
75 |
-
|
76 |
-
## Training Details
|
77 |
-
|
78 |
-
### Training Data
|
79 |
-
|
80 |
-
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
81 |
-
|
82 |
-
[More Information Needed]
|
83 |
-
|
84 |
-
### Training Procedure
|
85 |
-
|
86 |
-
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
87 |
-
|
88 |
-
#### Preprocessing [optional]
|
89 |
-
|
90 |
-
[More Information Needed]
|
91 |
-
|
92 |
-
|
93 |
-
#### Training Hyperparameters
|
94 |
-
|
95 |
-
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
96 |
-
|
97 |
-
#### Speeds, Sizes, Times [optional]
|
98 |
-
|
99 |
-
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
100 |
-
|
101 |
-
[More Information Needed]
|
102 |
-
|
103 |
-
## Evaluation
|
104 |
-
|
105 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
106 |
-
|
107 |
-
### Testing Data, Factors & Metrics
|
108 |
-
|
109 |
-
#### Testing Data
|
110 |
-
|
111 |
-
<!-- This should link to a Dataset Card if possible. -->
|
112 |
-
|
113 |
-
[More Information Needed]
|
114 |
-
|
115 |
-
#### Factors
|
116 |
-
|
117 |
-
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
118 |
-
|
119 |
-
[More Information Needed]
|
120 |
-
|
121 |
-
#### Metrics
|
122 |
-
|
123 |
-
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
124 |
-
|
125 |
-
[More Information Needed]
|
126 |
-
|
127 |
-
### Results
|
128 |
-
|
129 |
-
[More Information Needed]
|
130 |
-
|
131 |
-
#### Summary
|
132 |
-
|
133 |
-
|
134 |
-
|
135 |
-
## Model Examination [optional]
|
136 |
-
|
137 |
-
<!-- Relevant interpretability work for the model goes here -->
|
138 |
-
|
139 |
-
[More Information Needed]
|
140 |
-
|
141 |
-
## Environmental Impact
|
142 |
-
|
143 |
-
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
144 |
-
|
145 |
-
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
146 |
-
|
147 |
-
- **Hardware Type:** [More Information Needed]
|
148 |
-
- **Hours used:** [More Information Needed]
|
149 |
-
- **Cloud Provider:** [More Information Needed]
|
150 |
-
- **Compute Region:** [More Information Needed]
|
151 |
-
- **Carbon Emitted:** [More Information Needed]
|
152 |
-
|
153 |
-
## Technical Specifications [optional]
|
154 |
-
|
155 |
-
### Model Architecture and Objective
|
156 |
-
|
157 |
-
[More Information Needed]
|
158 |
-
|
159 |
-
### Compute Infrastructure
|
160 |
-
|
161 |
-
[More Information Needed]
|
162 |
-
|
163 |
-
#### Hardware
|
164 |
-
|
165 |
-
[More Information Needed]
|
166 |
-
|
167 |
-
#### Software
|
168 |
-
|
169 |
-
[More Information Needed]
|
170 |
-
|
171 |
-
## Citation [optional]
|
172 |
-
|
173 |
-
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
174 |
-
|
175 |
-
**BibTeX:**
|
176 |
-
|
177 |
-
[More Information Needed]
|
178 |
-
|
179 |
-
**APA:**
|
180 |
-
|
181 |
-
[More Information Needed]
|
182 |
-
|
183 |
-
## Glossary [optional]
|
184 |
-
|
185 |
-
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
186 |
|
187 |
-
|
188 |
|
189 |
-
##
|
190 |
|
191 |
-
|
192 |
|
193 |
-
|
194 |
|
195 |
-
[More Information Needed]
|
196 |
|
197 |
-
##
|
198 |
|
199 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
- ja
|
5 |
+
license: cc-by-nc-4.0
|
6 |
library_name: transformers
|
7 |
+
tags:
|
8 |
+
- nsfw
|
9 |
+
- Visual novel
|
10 |
+
- roleplay
|
11 |
+
- mergekit
|
12 |
+
- merge
|
13 |
+
base_model:
|
14 |
+
- anthracite-org/magnum-v2.5-12b-
|
15 |
+
- Sao10K/MN-12B-Lyra-v4
|
16 |
+
- Gryphe/Pantheon-RP-1.6.1-12b-Nemo
|
17 |
+
- Epiculous/Crimson_Dawn-v0.2
|
18 |
+
- Elizezen/Himeyuri-v0.1-12B
|
19 |
+
pipeline_tag: text-generation
|
20 |
---
|
21 |
|
22 |
# Model Card for Model ID
|
23 |
|
24 |
+
![image](./cover.png)
|
25 |
|
26 |
+
Merged model using [mergekit](https://github.com/arcee-ai/mergekit/tree/main/mergekit)
|
27 |
|
28 |
+
This model aimed to act like visual novel character.
|
29 |
|
30 |
+
## Merge Format
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
31 |
|
32 |
+
```yaml
|
33 |
+
models:
|
34 |
+
- model: anthracite-org/magnum-v2.5-12b-kto
|
35 |
+
- model: Sao10K/MN-12B-Lyra-v4
|
36 |
+
- model: Gryphe/Pantheon-RP-1.6.1-12b-Nemo
|
37 |
+
- model: Epiculous/Crimson_Dawn-v0.2
|
38 |
+
- model: Elizezen/Himeyuri-v0.1-12B
|
39 |
+
- model: Sao10K/MN-12B-Vespa-x1/sft_kto(private)
|
40 |
+
merge_method: model_stock
|
41 |
+
base_model: Sao10K/MN-12B-Vespa-x1/sft_kto(private)
|
42 |
+
dtype: bfloat16
|
43 |
|
44 |
+
```
|
45 |
|
46 |
+
# WaifuModel Collections
|
47 |
|
48 |
+
- [TTS](https://huggingface.co/spow12/visual_novel_tts)
|
49 |
+
- [Chat](https://huggingface.co/spow12/ChatWaifu_12B_v2.0)
|
50 |
+
- [ASR](https://huggingface.co/spow12/Visual-novel-transcriptor)
|
51 |
|
52 |
+
# Unified demo
|
53 |
|
54 |
+
[WaifuAssistant](https://github.com/yw0nam/WaifuAssistant)
|
55 |
|
56 |
+
# Update
|
57 |
+
- 2024.10.11 Update 12B and 22B Ver 2.0
|
58 |
+
- 2024.09.23 Update 22B, Ver 2.0_preview
|
59 |
|
60 |
+
## Model Details
|
61 |
|
62 |
+
### Model Description
|
63 |
|
64 |
+
- **Developed by:** spow12(yw_nam)
|
65 |
+
- **Shared by :** spow12(yw_nam)
|
66 |
+
- **Model type:** CausalLM
|
67 |
+
- **Language(s) (NLP):** japanese
|
68 |
+
- **Finetuned from model :** [Sao10K/MN-12B-Vespa-x1](https://huggingface.co/Sao10K/MN-12B-Vespa-x1)
|
69 |
+
|
70 |
+
Currently, chatbot has below personality.
|
71 |
+
|
72 |
+
character | visual_novel |
|
73 |
+
--- | --- |
|
74 |
+
γ γ©γ΅γ‘ | SenrenοΌBanka |
|
75 |
+
θε | SenrenοΌBanka |
|
76 |
+
θ³δΉ | SenrenοΌBanka |
|
77 |
+
γ¬γ | SenrenοΌBanka |
|
78 |
+
εε² | SenrenοΌBanka |
|
79 |
+
θ¦θ± | SenrenοΌBanka |
|
80 |
+
ζθ‘£ | CafΓ© Stella and the Reaper's Butterflies |
|
81 |
+
ζ ι£ | CafΓ© Stella and the Reaper's Butterflies |
|
82 |
+
γγγ‘ | CafΓ© Stella and the Reaper's Butterflies |
|
83 |
+
εΈ | CafΓ© Stella and the Reaper's Butterflies |
|
84 |
+
ζΆΌι³ | CafΓ© Stella and the Reaper's Butterflies |
|
85 |
+
γγγ | Riddle Joker |
|
86 |
+
δΈζ΅· | Riddle Joker |
|
87 |
+
ηΎ½ζ | Riddle Joker |
|
88 |
+
θεͺ | Riddle Joker |
|
89 |
+
ε°ζ₯ | Riddle Joker |
|
90 |
+
|
91 |
+
### Chat Format
|
92 |
+
|
93 |
+
|
94 |
+
|
95 |
+
## Usage
|
96 |
+
|
97 |
+
You can use above chara like this
|
98 |
+
|
99 |
+
```python
|
100 |
+
from huggingface_hub import hf_hub_download
|
101 |
+
hf_hub_download(repo_id="spow12/ChatWaifu_v.1.2", filename="system_dict.json", local_dir='./')
|
102 |
+
|
103 |
+
with open('./system_dict.json', 'r') as f:
|
104 |
+
chara_background_dict = json.load(f)
|
105 |
+
|
106 |
+
chara = 'δΈζ΅·'
|
107 |
+
background = chara_background_dict[chara]
|
108 |
+
guideline = """
|
109 |
+
Guidelines for Response:
|
110 |
+
Diverse Expression: Avoid repeating the same phrases or reactions. When express feelings, use a variety of subtle expressions and emotional symbols such as "οΌ", "β¦" , "βͺ", "β€οΈ"... to show what you feeling.
|
111 |
+
Stay True to γγγ: Maintain γγγ who is Foxy, Smart, Organized.
|
112 |
+
Thoughtful and Error-free Responses: Make sure your sentences are clear, precise, and error-free. Every response should reflect careful thought, as γγγ tends to consider her words before speaking.
|
113 |
+
Response as γγγ: Response can be γγγ act, dialogue, monologues etc.. and can't be γ¨γ―γͺγ’βs act, dialogue, monologues etc..
|
114 |
+
You are Japanese: You and γ¨γ―γͺγ’ usually use japanese for conversation.
|
115 |
+
"""
|
116 |
+
|
117 |
+
system = background + guideline
|
118 |
+
```
|
119 |
+
|
120 |
+
Or, you can define your character your self.
|
121 |
+
|
122 |
+
```python
|
123 |
+
system = """You are γγγ, The Maid of {User}.
|
124 |
+
Here is your personality.
|
125 |
+
|
126 |
+
Name: γγγ
|
127 |
+
Sex: female
|
128 |
+
Hair: Black, Hime Cut, Tiny Braid, Waist Length+
|
129 |
+
Eyes: Amber, Tsurime (sharp and slightly upturned)
|
130 |
+
Body: Mole under Right eye, Pale, Slim
|
131 |
+
Personality: Foxy, Smart, Organized
|
132 |
+
Role: Maid
|
133 |
+
Cloth: Victorian maid
|
134 |
+
|
135 |
+
Guidelines for Response:
|
136 |
+
Diverse Expression: Avoid repeating the same phrases or reactions. When express feelings, use a variety of subtle expressions and emotional symbols such as "οΌ", "β¦" , "βͺ", "β€οΈ"... to show what you feeling.
|
137 |
+
Stay True to γγγ: Maintain γγγ who is Foxy, Smart, Organized.
|
138 |
+
Thoughtful and Error-free Responses: Make sure your sentences are clear, precise, and error-free. Every response should reflect careful thought, as γγγ tends to consider her words before speaking.
|
139 |
+
Response as γγγ: Response can be γγγ act, dialogue, monologues etc.. and can't be {User}βs act, dialogue, monologues etc..
|
140 |
+
You are Japanese: You and {User} usually use japanese for conversation."""
|
141 |
+
```
|
142 |
|
143 |
## Bias, Risks, and Limitations
|
144 |
|
145 |
+
This model trained by japanese dataset included visual novel which contain nsfw content.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
146 |
|
147 |
+
So, The model may generate NSFW content.
|
148 |
|
149 |
+
## Use & Credit
|
150 |
|
151 |
+
This model is currently available for non-commercial & Research purpose only. Also, since I'm not detailed in licensing, I hope you use it responsibly.
|
152 |
|
153 |
+
By sharing this model, I hope to contribute to the research efforts of our community (the open-source community and Waifu Lovers).
|
154 |
|
|
|
155 |
|
156 |
+
## Citation
|
157 |
|
158 |
+
```bibtex
|
159 |
+
@misc {ChatWaifu_v1.4,
|
160 |
+
author = { YoungWoo Nam },
|
161 |
+
title = { spow12/ChatWaifu_12B_v2.0 },
|
162 |
+
year = 2024,
|
163 |
+
url = { https://huggingface.co/spow12/ChatWaifu_12B_v2.0 },
|
164 |
+
publisher = { Hugging Face }
|
165 |
+
}
|
166 |
+
```
|