[updated @ 12:00:01 on 07/19/2024]
๐ง๐ปโ๐ป About Me
๐ป Computational scientist at Argonne National Laboratory (ALCF)
๐งช Interested in {AI, HPC} for science1
- ๐ working on scaling large (language, vision, multi-modal) models2 across thousands of GPUs
๐ If youโre curious
๐ How I got here
My current research focuses on using deep generative modeling to help build better sampling algorithms in lattice gauge theory. In particular, Iโm interested in building gauge equivariant neural network architectures and using inductive priors to incorporate physical symmetries into machine learning models.
I received my PhD in Physics from the University of Iowa in 2019 and my thesis was on Learning Better Physics: A Machine Learning Approach to Lattice Gauge Theory.
Prior to this, I completed two bachelors degrees (Engineering Physics and Applied Mathematics, 2015) at The University of Illinois at Urbana-Champaign. My undergraduate dissertation was titled Energy Storage in Quantum Resonators and was supervised by Professor Alfred Hรผbler within the Center for Complex Systems Research at UIUC4.
[NOTE]: You can find a full list of my publications on my Google Scholar.
Intro to HPC Bootcamp: Engaging New Communities Through Energy Justice Projects
Journal of Computational Science, 2024Thorough Characterization and Analysis of Large Transformer Model Training At-Scale
Proc. ACM Meas. Anal. Comput. Syst. 03/2024MLMC: Machine Learning Monte Carlo for Lattice Gauge Theory
S. Foreman et al. Lattice, 2023 (Proceedings), 12/2023Protein Generation via Genome-scale Language Models with Bio-physical Scoring
@ SCโ23, 11/2023DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery [โฆ]
@ NeurIPS 2023 AI For Science Workshop, 10/2023Comprehensive Performance Study of LLMs on Novel AI Accelerators
M. Emani, S. Foreman, et al., IPDPS 2024, 10/2023Exploratory Analysis of Climate Data with
ClimRR
S. Foreman, Intro to HPC Bootcamp @ NERSC, 08/2023๐ GenSLMs: Genome-scale language models reveal SARS-Cov-2 evolutionary dynamics
@ SCโ22 10/2022Lattice QCD and Particle Physics
A.S. Kronfeld et al., 07/2022Applications of ML to Lattice QFT
D. Boyda, S. Calรญ, S. Foreman, et al., [arXiv:2202.05838], 02/2022LeapFrogLayers: Trainable Framework for Effective Sampling
S. Foreman, X.Y. Jin, J.C. Osborn, Lattice, 2021HMC with Normalizing Flows [slides]
S. Foreman et al., Lattice, 2021Deep Learning Hamiltonian Monte Carlo [+ poster]
S. Foreman, X.Y. Jin, & J.C. Osborn, @ SimDL Workshop @ ICLR, 2021Machine Learning and Neural Networks for Field Theory
S. Foreman, X.Y. Jin, & J.C. Osborn, SnowMass, 2020Examples of renormalization group transformations for image sets
S. Foreman et al., Physical Review E., 2018RG inspired Machine Learning for lattice field theory
S. Foreman et al., arXiv:1710.02079, 2017Large Energy Density in Three-Plate Nanocapacitors due to Coulomb Blockade
S. Foreman et al., J. Appl. Phys, 2018
๐ 2024
๐ 2023
๐ 2022
๐ 2021
๐ 2020
Date | Title | Author |
---|---|---|
Jul 18, 2024 | ๐ How to Make Dope Slides | |
Jul 18, 2024 |
๐ ezpz @ ALCF
|
|
Jun 17, 2024 |
๐ฐ Deterministic flash-attn
|
|
Jun 17, 2024 |
๐ธ flash-attn on Sunspot
|
|
Jun 15, 2024 |
๐๏ธ Megatron-DeepSpeed on xpu
|
|
May 25, 2024 |
๐ mpi4py bug on Sunspot
|
|
Apr 15, 2024 | ๐ฒ MCMC + Diffusion Sampling | |
Mar 21, 2024 | โฐ Starting Up Distributed Training | |
Feb 12, 2024 | ๐ Loooooooong Sequence Lengths | |
Feb 12, 2024 |
l2hmc Example: 2D U(1)
|
|
Dec 14, 2023 |
๐ข l2hmc-qcd Example: 2D U(1)
|
|
Dec 6, 2023 |
๐ณ l2hmc-qcd Example: 4D SU(3)
|
๐ช Events
Organizer for:
SC24 Workshop: High Performance Python for Science at Scale (HPPSS), November 2024
SC23 Workshop: High Performance Python for Science at Scale (HPPSS), November 2023
Machine Learning and Quantum Computing for Earth Sciences at 17th U. S. National Congress on Computational Mechanics, July 2023
๐ Employment
Position | @ | Start | End |
---|---|---|---|
Assistant Computational Scientist | ALCF | 2022 | โ |
Postdoc | ALCF | 2019 | 2022 |
Graduate Researcher | ANL | 2018 | 2019 |
๐ School
Footnotes
So far, for: {Lattice QCD, Quantum Mechanics, Biology (Protein Generation, Drug Discovery), and Climate Modeling / Weather Forecasting}โฉ๏ธ
Mostly trying to get supercomputers to stop yelling at each other ๐ซ โฉ๏ธ
If this sounds like something youโd be interested in doing, please feel free to reach out to me!โฉ๏ธ
Citation
@online{foreman,
author = {Foreman, Sam},
url = {https://samforeman.me/},
langid = {en}
}