Model Card for Model-Demo-ProTrek-35M

Task type

Protein-level Classification

Model input type

AA Sequence

LoRA config

  • r: 8
  • lora_dropout: 0.0
  • lora_alpha: 16
  • target_modules: ['key', 'value', 'output.dense', 'query', 'intermediate.dense']
  • modules_to_save: ['classifier']

Training config

  • optimizer:
    • class: AdamW
    • betas: (0.9, 0.98)
    • weight_decay: 0.01
  • learning rate: 0.0005
  • epoch: 5
  • batch size: 1
  • precision: 16-mixed
Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SeprotHub/Model-Classification-ProTrek-35M

Adapter
(7)
this model