Appgithub-com-eleutherai-gpt-neox

Download Pinokio

Sign in Create accountJoin

Sign in Create accountJoin

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

github.com/eleutherai/gpt-neoxUpdated 3d ago

Repository details

Updated 2026-10-11T17:13:52.000Z

Indexed 2026-10-15T03:30:09.204Z

Loading community details…

Loading project activity…

Community

Sort byCreate post

Ask or share about gpt-neox…

Loading...

Pinokio

Projects using this repository

No references listed yet.

Check-ins (0)

No check-ins yet.

Recent commits

Remove unused `sparse_attention` argument (#1429)

Aflah4 days ago28c81ed

Move adoption summary to top of README and add USERS.md (#1439)

Quentin Anthony4 days ago66d247f

Fix gradient clipping configuration and remove `clip_grad` (#1433)

Aflah4 days agod8ef803

Fix cosine LR climbing back up after lr_decay_iters (#1438)

Mohammad Hijjawi4 days ago5fae199

Fix port use (#1426)

Aflah4 days agoc9202af

Cleanup (#1427)

Aflah4 days ago2d66d33

Add ability to log loss/PPL per validation/test set (#1392)

Aflahlast monthcf40e42

OLMo Dense Model Training Configs (#1407)

Aflahlast month3aa3ac0

fix bug in EvalHarnessAdapter when pipe parallel size is set to 1 (#1356)

Marisa Hudspethlast monthe2a2613

Align Args in .md with .py files (#1389)

Aflahlast month606baa2