File size: 636 Bytes
10f998c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 |
# SASOK Model
This package contains the SASOK cognitive model architecture implemented in PyTorch, ready for use with HuggingFace Transformers.
## Structure
- `model.py` — SASOK transformer with BatchNorm + LayerNorm
- `tokenizer.py` — HuggingFace-compatible tokenizer
- `train.py` — Training script using `Trainer`
- `cli.py` — CLI for generation
## Usage
### Train
```bash
python train.py
```
### CLI Inference
```bash
python cli.py "Hello, who are you?"
```
### Push to HuggingFace Hub
```bash
from transformers import AutoModel, AutoTokenizer
model.push_to_hub("sasok-model")
tokenizer.push_to_hub("sasok-model")
``` |