HF Dump error

[StrategicalIT]

OK, I must be doing something dumb here, but can't figure it out :-\

If I run dump_hf_model_config_by_name.sh and have set MODEL_NAME=mistralai/Mistral-7B-Instruct-v0.1, this runs no problem. I can then run analysis against this model.

If I run the same script but change the model to MODEL_NAME=meta-llama/Llama-2-13b-hf then I get the following error

(.conda) (base) manager@precision-5690:/media/manager/Data/llm-analysis-local/llm-analysis/scripts$ ./dump_hf_model_config_by_name.sh 
INFO   [config.py:205] hf config does not have moe_num_experts or num_local_experts, setting moe_num_experts = 1 (not MoE model)
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/media/manager/Data/llm-analysis-local/llm-analysis/.conda/lib/python3.11/site-packages/llm_analysis/config.py", line 430, in <module>
    fire.Fire(
  File "/media/manager/Data/llm-analysis-local/llm-analysis/.conda/lib/python3.11/site-packages/fire/core.py", line 141, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/media/manager/Data/llm-analysis-local/llm-analysis/.conda/lib/python3.11/site-packages/fire/core.py", line 475, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
                                ^^^^^^^^^^^^^^^^^^^^
  File "/media/manager/Data/llm-analysis-local/llm-analysis/.conda/lib/python3.11/site-packages/fire/core.py", line 691, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
                ^^^^^^^^^^^^^^^^^^^^^^
  File "/media/manager/Data/llm-analysis-local/llm-analysis/.conda/lib/python3.11/site-packages/llm_analysis/config.py", line 391, in dump_model_config_by_name
    model_config = get_model_config_by_name(name)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/media/manager/Data/llm-analysis-local/llm-analysis/.conda/lib/python3.11/site-packages/llm_analysis/config.py", line 359, in get_model_config_by_name
    model_config = get_model_config_from_hf(name_or_path)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/media/manager/Data/llm-analysis-local/llm-analysis/.conda/lib/python3.11/site-packages/llm_analysis/config.py", line 237, in get_model_config_from_hf
    mlp_gated_linear_units=mlp_gated_linear_units)
                           ^^^^^^^^^^^^^^^^^^^^^^
UnboundLocalError: cannot access local variable 'mlp_gated_linear_units' where it is not associated with a value

Any help appreciated :-)