ASTROMER: A transformer-based embedding for the representation of light curves
Taking inspiration from natural language embeddings, we present ASTROMER, a
transformer-based model to create representations of light curves. ASTROMER was
trained on millions of MACHO R-band samples, and it can be easily fine-tuned to
match specific domains associated with downstream tasks. As an example, this
paper shows the benefits of using pre-trained representations to classify
variable stars. In addition, we provide a python library including all
functionalities employed in this work. Our library includes the pre-trained
models that can be used to enhance the performance of deep learning models,
decreasing computational resources while achieving state-of-the-art results.