Help to converto to gguf
helloi used SFTTrainer to fine tune a model (opt-350m) with a dataset, now i have a folder with several files and a model.tensorflow.i used convert.py to convert but this generated a keyerror: intermediate_sizepython3[convert.py](https://convert.py/)./models/salidamodelo/Loading model file models/salidamodelo/model.safetensorsTraceback (most recent call last):File “/home/con/llama.cpp/convert.py”, line 1471, inmain()File “/home/con/llama.cpp/convert.py”, line 1418, in mainparams = Params.load(model_plus)File “/home/con/llama.cpp/convert.py”, line 317, in loadparams = Params.loadHFTransformerJson(model_plus.model, REDACTED_TOKEN_path)File “/home/con/llama.cpp/convert.py”, line 251, in loadHFTransformerJsonn_ff = config[“intermediate_size”],KeyError: ‘intermediate_size’how i can solve it?thanks in advance
2024-01-25T11:06:09Z
What’s in your config.json? Might be that key is missing?
2024-01-25T13:00:33Z
{“_name_or_path”: “facebook/opt-350m”,“_remove_final_layer_norm”: false,“activation_dropout”: 0.0,“activation_function”: “relu”,“architectures”: [“OPTForCausalLM”],“attention_dropout”: 0.0,“bos_token_id”: 2,“do_layer_norm_before”: false,“dropout”: 0.1,“enable_bias”: true,“eos_token_id”: 2,“ffn_dim”: 4096,“hidden_size”: 1024,“init_std”: 0.02,“layer_norm_elementwise_affine”: true,“layerdrop”: 0.0,“max_position_embeddings”: 2048,“model_type”: “opt”,“num_attention_heads”: 16,“num_hidden_layers”: 24,“pad_token_id”: 1,“prefix”: “”,“torch_dtype”: “float32”,“transformers_version”: “4.37.0”,“use_cache”: true,“vocab_size”: 50272,“word_embed_proj_dim”: 512}