SASOK Model
This package contains the SASOK cognitive model architecture implemented in PyTorch, ready for use with HuggingFace Transformers.
Structure
model.py
— SASOK transformer with BatchNorm + LayerNormtokenizer.py
— HuggingFace-compatible tokenizertrain.py
— Training script usingTrainer
cli.py
— CLI for generation
Usage
Train
python train.py
CLI Inference
python cli.py "Hello, who are you?"
Push to HuggingFace Hub
from transformers import AutoModel, AutoTokenizer
model.push_to_hub("sasok-model")
tokenizer.push_to_hub("sasok-model")