OSError: models/VicUnlocked-30B-LoRA.ggml.q5_1 does not appear to have a file named config.json.
Traceback (most recent call last):
File "/root/text-generation-webui/server.py", line 998, in
shared.model, shared.tokenizer = load_model(shared.model_name)
File "/root/text-generation-webui/modules/models.py", line 77, in load_model
shared.model_type = find_model_type(model_name)
File "/root/text-generation-webui/modules/models.py", line 65, in find_model_type
config = AutoConfig.from_pretrained(path_to_model, trust_remote_code=shared.args.trust_remote_code)
File "/root/miniconda3/envs/textgen/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py", line 928, in from_pretrained
config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/root/miniconda3/envs/textgen/lib/python3.10/site-packages/transformers/configuration_utils.py", line 574, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
File "/root/miniconda3/envs/textgen/lib/python3.10/site-packages/transformers/configuration_utils.py", line 629, in _get_config_dict
resolved_config_file = cached_file(
File "/root/miniconda3/envs/textgen/lib/python3.10/site-packages/transformers/utils/hub.py", line 388, in cached_file
raise EnvironmentError(
OSError: models/VicUnlocked-30B-LoRA.ggml.q5_1 does not appear to have a file named config.json. Checkout 'https://huggingface.co/models/VicUnlocked-30B-LoRA.ggml.q5_1/None' for available files.
GGML files don't use config.json.
This error suggests that the model is not being detected as a GGML model. text-gen-ui detects GGML models by looking for 'ggml' (case sensitive) in the model file name.
So firstly, please confirm you didn't rename the model file and that it's still called VicUnlocked-30B-LoRA.ggmlv3.q5_1.bin.
If that's OK, I'm wondering if text-gen-ui is incorrectly detecting it as a LoRA because LoRA appears in the name. Can you test by renaming the model folder to VicUnlocked-30B.ggml or something like that, and try again.
GGML files don't use config.json.
This error suggests that the model is not being detected as a GGML model. text-gen-ui detects GGML models by looking for 'ggml' (case sensitive) in the model file name.
So firstly, please confirm you didn't rename the model file and that it's still called
VicUnlocked-30B-LoRA.ggmlv3.q5_1.bin.If that's OK, I'm wondering if text-gen-ui is incorrectly detecting it as a LoRA because LoRA appears in the name. Can you test by renaming the model folder to
VicUnlocked-30B.ggmlor something like that, and try again.
Thank you for taking the time to reply. I checked the folder and it appears the model file was missing. I placed the VicUnlocked-30B-LoRA.ggml.q4_1.bin in the folder and now it works :)
Thank you for the model "VicUnlocked-30B-LoRA.ggml.q4_1.bin" :)