File size: 636 Bytes
10f998c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
# SASOK Model

This package contains the SASOK cognitive model architecture implemented in PyTorch, ready for use with HuggingFace Transformers.

## Structure

- `model.py` — SASOK transformer with BatchNorm + LayerNorm
- `tokenizer.py` — HuggingFace-compatible tokenizer
- `train.py` — Training script using `Trainer`
- `cli.py` — CLI for generation

## Usage

### Train
```bash
python train.py
```

### CLI Inference
```bash
python cli.py "Hello, who are you?"
```

### Push to HuggingFace Hub
```bash
from transformers import AutoModel, AutoTokenizer

model.push_to_hub("sasok-model")
tokenizer.push_to_hub("sasok-model")
```