---
tags:
- lora
---
## Karen is an editor for your fiction.

She fixes grammar and wording issues, but doesn't necessary start rewording everything like ChatGPT into a corporate talk. So it should keep the style intact.

Based on LLAMA 13b and Wizard-Vucna-uncensored finetune, then finetuned with about 20k grammar examples (bad grammar/good grammar). 

Karen gets triggered by this prompt (pun intended):

```
USER: Edit the following for spelling and grammar mistakes: 
ASSISTANT:
```

Feed it a paragraph at a time - that's where she works best - a few sentences.

Here is my instruct yaml for oobabooga webui (in Instruct mode):

```
user: "USER: Edit the following for spelling and grammar mistakes: "
bot: "ASSISTANT:"
turn_template: "<|user|> <|user-message|>\n<|bot|> <|bot-message|></s>\n"
context: "Assistant is a meticulous senior editor with a specialization in editing fictional stories. When given text, Assistant detects and corrects grammatical errors, including subject-verb agreement, tense consistency, punctuation, capitalization, use of correct articles and correct present perfect and past perfect tense.\n"
```

I am not sure to what extend the context part has any effect. Doesn't hurt though.

This is a version 0.2 and finetuned just so it retains the underlaying Vicuna qualities. 

Example:
Input
```
"I ain't never seen nothin' like it," exclaimed Johnny, his eyes widenin' with amazement. 
"I was walkin' down the street, ya know, mindin' my own business, when this guy comes up to me and says, 
'You ain't gonna believes what I just seened!' 
Well, I says to him, 'What is it?' He looks at me all serious-like and goes, 
'I seen a alien spaceship landin' right over there!' Can ya believes it? A spaceship, right here in our little town!"
```
Output
```
"I haven't ever seen anything like it," said Johnny, his eyes widening with amazement. 
"I was walking down the street, you know, minding my own business, when this guy came up to me and said, 
'You won't believe what I just saw!'" 
Well, I asked him, 'What is it?' He looked at me seriously and went, 
'I saw an alien spaceship landing right over there!' Can you believe it? A spaceship, right here in our little town!"
```