malteos
/

bloom-1b5-clp-german

Text Generation

text-generation-inference

Model card Files Files and versions

The multilingual bloom-1b7 model adapted to the German language using the CLP-Transfer method.

Tokenizer from https://huggingface.co/malteos/gpt2-xl-wechsel-german
Trained on the German subset of OSCAR https://huggingface.co/datasets/oscar

See also

Downloads last month: 11

Safetensors

Model size

1B params

Tensor type

F32

·

Dataset used to train malteos/bloom-1b5-clp-german

Paper for malteos/bloom-1b5-clp-german

Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning

Paper • 2301.09626 • Published Jan 23, 2023 • 2