🤖 AuroraGPT
AuroraGPT
| What | When | Categories |
|---|---|---|
| 💾 Converting Checkpoints | 2024-10-17 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
| 🏔️ Spike Skipper | 2024-09-17 | AuroraGPT |
🎰 Deterministic flash-attn
|
2024-06-17 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
📸 flash-attn on Sunspot
|
2024-06-17 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
| 🏎️ Megatron-DeepSpeed on Intel XPU | 2024-06-15 | ALCF, AuroraGPT, Aurora, Megatron-DeepSpeed, XPU |
🐛 mpi4py bug on Sunspot
|
2024-05-25 | AuroraGPT |
| 🐢 Starting Up Distributed Training on Aurora | 2024-03-21 | AuroraGPT |
| 🚂 Loooooooong Sequence Lengths | 2024-02-12 | AuroraGPT |
No matching items
Citation
BibTeX citation:
@online{foreman,
author = {Foreman, Sam},
title = {🤖 {AuroraGPT}},
url = {https://samforeman.me/posts/AuroraGPT/},
langid = {en}
}
For attribution, please cite this work as:
Foreman, Sam. n.d. “🤖 AuroraGPT.” https://samforeman.me/posts/AuroraGPT/.