๐ค AuroraGPT
AuroraGPT
| What | When | Categories |
|---|---|---|
| ๐พ Converting Checkpoints | 2024-10-17 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
| ๐๏ธ Spike Skipper | 2024-09-17 | AuroraGPT |
๐ฐ Deterministic flash-attn
|
2024-06-17 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
๐ธ flash-attn on Sunspot
|
2024-06-17 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
| ๐๏ธ Megatron-DeepSpeed on Intel XPU | 2024-06-15 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
๐ mpi4py bug on Sunspot
|
2024-05-25 | AuroraGPT |
| ๐ข Starting Up Distributed Training on Aurora | 2024-03-21 | AuroraGPT |
| ๐ Loooooooong Sequence Lengths | 2024-02-12 | AuroraGPT |
No matching items
Citation
BibTeX citation:
@online{foreman,
author = {Foreman, Sam},
title = {๐ค {AuroraGPT}},
url = {https://samforeman.me/posts/AuroraGPT/},
langid = {en}
}
For attribution, please cite this work as:
Foreman, Sam. n.d. โ๐ค AuroraGPT.โ https://samforeman.me/posts/AuroraGPT/.