having issues using the model with rtx 5090...how to fix
#10
by flyaway1999 - opened
hi, so initially i was getting this error :
RuntimeError: Cannot use weights_only=True with TorchScript archives passed to torch.load. In PyTorch 2.6, we changed the default value of the weights_only argument in torch.load from False to True. Re-running torch.load with weights_only set to False will likely succeed, but it can result in arbitrary code execution. Do it only if you got the file from a trusted source.
after changing the weights to false, i then got this error:
RuntimeError: FlashAttention only supports Ampere GPUs or newer.
im running the latest drivers, the nightly of pytorch and torchvision. how can i get this to run? Im using wsl by the way
Thank you