runtime error

Exit code: 1. Reason: <00:00, 8.33s/it] Download complete: 100%|██████████| 16.4G/16.4G [00:33<00:00, 796MB/s]  Download complete: 100%|██████████| 16.4G/16.4G [00:33<00:00, 491MB/s] Loading weights: 0%| | 0/399 [00:00<?, ?it/s] Loading weights: 100%|██████████| 399/399 [00:00<00:00, 1040.50it/s] generation_config.json: 0%| | 0.00/214 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 214/214 [00:00<00:00, 960kB/s] Traceback (most recent call last): File "/app/app.py", line 112, in <module> model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.bfloat16, device_map="auto", trust_remote_code=True) File "/usr/local/lib/python3.13/site-packages/transformers/models/auto/auto_factory.py", line 402, in from_pretrained return model_class.from_pretrained( ~~~~~~~~~~~~~~~~~~~~~~~~~~~^ pretrained_model_name_or_path, *model_args, config=config, **hub_kwargs, **kwargs ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ) ^ File "/usr/local/lib/python3.13/site-packages/transformers/modeling_utils.py", line 4368, in from_pretrained accelerate_dispatch(model, hf_quantizer, device_map, offload_folder, disk_offload_index, offload_buffers) ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/transformers/integrations/accelerate.py", line 400, in accelerate_dispatch dispatch_model(model, **device_map_kwargs) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.13/site-packages/accelerate/big_modeling.py", line 514, in dispatch_model raise ValueError( "You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead." ) ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.

Container logs: