doberst113080 commited on
Commit
913dd12
1 Parent(s): 2e8d0fb

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -10
README.md CHANGED
@@ -2,26 +2,24 @@
2
  license: cc-by-sa-4.0
3
  ---
4
 
5
- # SLIM-SA-NER-3B-TOOL
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
9
 
10
- **slim-sa-ner-3b-tool** is a 4_K_M quantized GGUF version of slim-sa-ner-3b, providing a small, fast inference implementation, optimized for multi-model concurrent deployment.
11
 
12
- This model combines two of the most popular traditional classifier capabilities (**sentiment analysis** and **named entity recognition**) and re-images them as function calls on a small specialized decoder LLM, generating output in the form of a python dictionary with keys corresponding to sentiment and NER identifiers.
13
 
14
  The intent of SLIMs is to forge a middle-ground between traditional encoder-based classifiers and open-ended API-based LLMs.
15
 
16
- The size of the self-contained GGUF model binary is 1.71 GB, which is small enough to run locally on a CPU, and yet which comparables favorably with the use of two traditional FP32 versions of Roberta-Large for NER (1.42GB) and BERT for Sentiment Analysis (440 MB), while offering greater potential capacity depth with 2.7B parameters, and without the requirement of Pytorch and other external dependencies.
17
 
18
-
19
- [**slim-sa-ner-3b**](https://huggingface.co/llmware/slim-sa-ner-3b) is part of the SLIM ("**S**tructured **L**anguage **I**nstruction **M**odel") series, providing a set of small, specialized decoder-based LLMs, fine-tuned for function-calling.
20
 
21
  To pull the model via API:
22
 
23
  from huggingface_hub import snapshot_download
24
- snapshot_download("llmware/slim-sa-ner-3b-tool", local_dir="/path/on/your/machine/", local_dir_use_symlinks=False)
25
 
26
 
27
  Load in your favorite GGUF inference engine, or try with llmware as follows:
@@ -29,14 +27,14 @@ Load in your favorite GGUF inference engine, or try with llmware as follows:
29
  from llmware.models import ModelCatalog
30
 
31
  # to load the model and make a basic inference
32
- model = ModelCatalog().load_model("slim-sa-ner-3b-tool")
33
  response = model.function_call(text_sample)
34
 
35
  # this one line will download the model and run a series of tests
36
- ModelCatalog().tool_test_run("slim-sa-ner-3b-tool", verbose=True)
37
 
38
 
39
- Note: please review [**config.json**](https://huggingface.co/llmware/slim-sa-ner-3b-tool/blob/main/config.json) in the repository for prompt wrapping information, details on the model, and full test set.
40
 
41
 
42
  ## Model Card Contact
 
2
  license: cc-by-sa-4.0
3
  ---
4
 
5
+ # SLIM-EXTRACT-TOOL
6
 
7
  <!-- Provide a quick summary of what the model is/does. -->
8
 
9
 
10
+ **slim-extract-tool** is a 4_K_M quantized GGUF version of slim-extract, providing a small, fast inference implementation, optimized for multi-model concurrent deployment.
11
 
12
+ This model has been fine-tuned to implement a general-purpose extraction function that takes a custom key as input parameter, and generates a python dictionary consisting of that custom key with the value consisting of a list of the values associated with that key in the text.
13
 
14
  The intent of SLIMs is to forge a middle-ground between traditional encoder-based classifiers and open-ended API-based LLMs.
15
 
 
16
 
17
+ [**slim-extract**](https://huggingface.co/llmware/slim-extract) is part of the SLIM ("**S**tructured **L**anguage **I**nstruction **M**odel") series, providing a set of small, specialized decoder-based LLMs, fine-tuned for function-calling.
 
18
 
19
  To pull the model via API:
20
 
21
  from huggingface_hub import snapshot_download
22
+ snapshot_download("llmware/slim-extract-tool", local_dir="/path/on/your/machine/", local_dir_use_symlinks=False)
23
 
24
 
25
  Load in your favorite GGUF inference engine, or try with llmware as follows:
 
27
  from llmware.models import ModelCatalog
28
 
29
  # to load the model and make a basic inference
30
+ model = ModelCatalog().load_model("slim-extract-tool")
31
  response = model.function_call(text_sample)
32
 
33
  # this one line will download the model and run a series of tests
34
+ ModelCatalog().tool_test_run("slim-extract-tool", verbose=True)
35
 
36
 
37
+ Note: please review [**config.json**](https://huggingface.co/llmware/slim-extract-tool/blob/main/config.json) in the repository for prompt wrapping information, details on the model, and full test set.
38
 
39
 
40
  ## Model Card Contact