runtime error

Exit code: 1. Reason: [00:11<00:50, 279MB/s] Downloading (incomplete total...): 12%|█▏ | 1.76G/14.5G [00:12<00:19, 651MB/s] Downloading (incomplete total...): 20%|█▉ | 2.90G/14.5G [00:13<00:14, 819MB/s] Downloading (incomplete total...): 26%|██▌ | 3.77G/14.5G [00:15<00:15, 696MB/s] Downloading (incomplete total...): 32%|███▏ | 4.57G/14.5G [00:22<00:38, 259MB/s] Downloading (incomplete total...): 38%|███▊ | 5.51G/14.5G [00:23<00:26, 345MB/s] Downloading (incomplete total...): 43%|████▎ | 6.25G/14.5G [00:25<00:22, 371MB/s] Downloading (incomplete total...): 64%|██████▍ | 9.27G/14.5G [00:26<00:06, 792MB/s] Downloading (incomplete total...): 93%|█████████▎| 13.5G/14.5G [00:27<00:00, 1.42GB/s] Fetching 3 files: 33%|███▎ | 1/3 [00:30<01:01, 30.82s/it] Fetching 3 files: 100%|██████████| 3/3 [00:30<00:00, 10.27s/it] Download complete: 100%|██████████| 14.5G/14.5G [00:30<00:00, 1.42GB/s] Traceback (most recent call last): File "/app/app.py", line 12, in <module> model = AutoModelForCausalLM.from_pretrained( BASE_MODEL, device_map="auto", load_in_4bit=True ) File "/usr/local/lib/python3.13/site-packages/transformers/models/auto/auto_factory.py", line 381, in from_pretrained return model_class.from_pretrained( ~~~~~~~~~~~~~~~~~~~~~~~~~~~^ pretrained_model_name_or_path, *model_args, config=config, **hub_kwargs, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/transformers/modeling_utils.py", line 4087, in from_pretrained model = cls(config, *model_args, **model_kwargs) TypeError: MistralForCausalLM.__init__() got an unexpected keyword argument 'load_in_4bit' Download complete: 100%|██████████| 14.5G/14.5G [00:31<00:00, 467MB/s]

Container logs: