Uploaded model

Developed by: ShieldX
License: apache-2.0
Finetuned from model : unsloth/tinyllama

ShieldX/manovyadh-1.1B-v1

Introducing ManoVyadh, A finetuned version of TinyLlama 1.1B Chat on Mental Health Counselling Dataset.

Model Details

Model Description

ManoVyadh is a LLM for mental health counselling.

Uses

Direct Use

base model for further finetuning
for fun

Downstream Use

can be deployed with api
used to create webapp or app to show demo

Out-of-Scope Use

cannot be used for production purpose
not to be applied in real life health purpose
cannot be used to generate text for research or academic purposes

Bias, Risks, and Limitations

Significant research has explored bias and fairness issues with language models (see, e.g., Sheng et al. (2021) and Bender et al. (2021)). Predictions generated by the model may include disturbing and harmful stereotypes across protected classes; identity characteristics; and sensitive, social, and occupational groups.

Training Details

Model Examination

We will be further finetuning this model on large dataset to see how it performs

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

Hardware Type: 1 X Tesla T4
Hours used: 0.30
Cloud Provider: Google Colab
Compute Region: India

Technical Specifications

Model Architecture and Objective

Finetuned on Tiny-Llama 1.1B Chat model

Hardware

1 X Tesla T4

Citation

BibTeX:

@misc{ShieldX/manovyadh-1.1B-v1,
      url={[https://huggingface.co/ShieldX/manovyadh-1.1B-v1](https://huggingface.co/ShieldX/manovyadh-1.1B-v1)},
      title={ManoVyadh},
      author={Rohan Shaw},
      year={2024}, month={Jan}
}

Model Card Authors

ShieldX a.k.a Rohan Shaw

Model Card Contact

email : [email protected]

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

ShieldX
/

manovyadh-1.1B-v1