runtime error
Exit code: 1. Reason: ._load_all() File "/app/src/inference_server.py", line 168, in _load_all self._prompt_encoder = PromptEncoder( ^^^^^^^^^^^^^^ File "/app/ltx2/ltx_pipelines/utils/blocks.py", line 361, in __init__ self._warm_text_encoder = self._load_bnb_4bit_encoder(gemma_root) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/ltx2/ltx_pipelines/utils/blocks.py", line 481, in _load_bnb_4bit_encoder hf_model = Gemma3ForConditionalGeneration.from_pretrained(gemma_root, **from_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4308, in from_pretrained loading_info, disk_offload_index = cls._load_pretrained_model(model, state_dict, checkpoint_files, load_config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/transformers/modeling_utils.py", line 4389, in _load_pretrained_model caching_allocator_warmup(model, expanded_device_map, load_config.hf_quantizer) File "/usr/local/lib/python3.12/site-packages/transformers/modeling_utils.py", line 5032, in caching_allocator_warmup free_device_memory, total_device_memory = accelerator_module.mem_get_info(index) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/torch/cuda/memory.py", line 838, in mem_get_info return torch.cuda.cudart().cudaMemGetInfo(device) ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/torch/cuda/__init__.py", line 489, in cudart _lazy_init() File "/usr/local/lib/python3.12/site-packages/torch/cuda/__init__.py", line 412, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...