Float16 on CPU torch support
I’ve read about torch not supporting float16 on CPU when trying to test microsoft/phi2 model.Example threads:microsoft/phi-2 · RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'Better error message when trying to run fp16 weights on CPU · Issue #96292 · pytorch/pytorch · GitHubHow come the following code works on a GPT2 model where I’m seemingly setting it to run in that config?  Is torch_dtype somehow different than the topic in those comments?pipe = transformers.pipeline('text-generation', model=model, tokenizer=tokenizer, device="cpu", torch_dtype=torch.float16)

        res = pipe("Here is a recipe for vegan banana bread:\n",
                           max_new_tokens=max_new_tokens,
                           do_sample=False,
                           use_cache=True)