Untitled

runcell(0, 'C:/Users/seba1/long_llama/src/chat_gui.py')
!!!!!WARNING!!!!! Model będzie kwantyzowany do 8 bitów!
Może to wpłynąć na wydajność modelu!
Traceback (most recent call last):

  File C:\Users/seba1/long_llama\model_utilities.py:29 in load_and_quantize_llama_model

  File C:\Users/seba1/long_llama\model_utilities.py:42 in _quantized_model_loading

NameError: name 'LongLlamaConfig' is not defined


During handling of the above exception, another exception occurred:

Traceback (most recent call last):

  File C:\ProgramData\anaconda3\Lib\site-packages\spyder_kernels\py3compat.py:356 in compat_exec
    exec(code, globals, locals)

  File c:\users\seba1\long_llama\src\chat_gui.py:28
    model, _ = load_and_quantize_llama_model(model_path, tokenizer_path, device, quantized, num_bit)

  File C:\Users/seba1/long_llama\model_utilities.py:33 in load_and_quantize_llama_model

RuntimeError: Błąd podczas wczytywania modelu: name 'LongLlamaConfig' is not defined