Edit model card

Phi-2-arxiv-physics :

Phi-2-arxiv-physics is a small language model (SLM) derived from Microsoft Research's Phi-2, a Transformer-based model with 2.7 billion parameters. Specifically fine-tuned using the innovative QLoRA (Quantized Low-rank Adapters) technique, this model exhibits remarkable capabilities in the domain of physics-related text.

Fine-Tuning:

The model has been fine-tuned using QLoRA, a technique that reduces computational and memory requirements during the fine-tuning process.

This two-stage approach involves quantizing parameters and introducing learnable low-rank adapters, resulting in faster fine-tuning with reduced memory demands.

Data Source:

Phi-2-arxiv-physics is specifically trained on the arXiv-physics dataset, consisting of questions and answers related to physics.

This dataset is sourced from the arXiv repository, encompassing a wide range of topics within the field of physics.

Usage (High-level) :

!pip install -q -U git+https://github.com/huggingface/transformers.git

from transformers import pipeline

pipe = pipeline("text-generation", model="ayoubkirouane/phi-2-arxiv-physics")

## or :

# load it directly
from transformers import AutoModel
model = AutoModel.from_pretrained("ayoubkirouane/phi-2-arxiv-physics")
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train ayoubkirouane/phi-2-arxiv-physics