undresser-ai/top-undresser-ai-apps
Updated
Linda Orourke
undresser-ai
AI & ML interests
None yet
Recent Activity
updated
a model
6 days ago
undresser-ai/top-undresser-ai-apps
published
a model
6 days ago
undresser-ai/top-undresser-ai-apps
Organizations
None yet
undresser-ai's activity
updated
a
model
6 days ago
published
a
model
6 days ago
reacted to
schuler's
post with ❤️
7 days ago
Post
3344
🔮 GPT-3 implemented in pure Free Pascal!
https://github.com/joaopauloschuler/gpt-3-for-pascal
This implementation follows the GPT-3 Small architecture from the landmark paper "Language Models are Few-Shot Learners":
Clean Pascal Implementation
https://github.com/joaopauloschuler/gpt-3-for-pascal
This implementation follows the GPT-3 Small architecture from the landmark paper "Language Models are Few-Shot Learners":
┌─────────────────────────┐
│ Input Layer │
├─────────────────────────┤
│ Token & Positional │
│ Embedding │
├─────────────────────────┤
│ 12x Transformer │
│ Blocks │
│ - 12 heads │
│ - 768 hidden dims │
│ - 3072 intermediate │
├─────────────────────────┤
│ Output Layer │
└─────────────────────────┘Clean Pascal Implementation
for CntLayer := 1 to {Layers=}12 do
begin
Result.AddTransformerBlockCAI(
{Heads=}12,
{intermediate dimensions=}4*768,
{NoForward=}true,
{HasNorm=}true,
false
);
end;