jinaai

/

jina-reranker-m0

like 105

Follow

Jina AI 1.31k

load model：NotImplementedError: Cannot copy out of meta tensor; no data! Please use torch.nn.Module.to_empty() instead of torch.nn.Module.to() when moving module from meta to a different device.

model = AutoModel.from_pretrained(
'jinaai/jina-reranker-m0',
torch_dtype="auto",
trust_remote_code=True,
attn_implementation="flash_attention_2"
)

model.to('cuda')# or 'cpu' if no GPU is available
model.eval()