Publications

Conference Papers

Inverting Data Transformations via Diffusion Sampling Jinwoo Kim, Sékou-Oumar Kaba, Jiyun Park, Seunghoon Hong, and Siamak Ravanbakhsh.
Forty-Third International Conference on Machine Learning, 2026
Long-Horizon Model-Based Offline Reinforcement Learning Without Conservatism Tianwei Ni, Esther Derman, Vineet Jain, Vincent Taboga, Siamak Ravanbakhsh, and Pierre-Luc Bacon.
Forty-Third International Conference on Machine Learning, 2026
Multi-Armed Sampling Problem and the End of Exploration Mohammad Pedramfar, and Siamak Ravanbakhsh.
The 29th International Conference on Artificial Intelligence and Statistics, 2026
Scaling laws and symmetry, evidence from neural force fields Khang Ngo, and Siamak Ravanbakhsh.
The Fourteenth International Conference on Learning Representations, 2026
The Expressive Limits of Diagonal SSMs for State-Tracking Mehran Shakerinava, Behnoush Khavari, Siamak Ravanbakhsh, and Sarath Chandar.
The Fourteenth International Conference on Learning Representations, 2026
Beyond Scalar Rewards: An Axiomatic Framework for Lexicographic MDPs Mehran Shakerinava, Siamak Ravanbakhsh, and Adam Oberman.
Advances in Neural Information Processing Systems, 2025
spotlight presentation
Diffusion Tree Sampling: Scalable inference-time alignment of diffusion models Vineet Jain, Kusha Sareen, Mohammad Pedramfar, and Siamak Ravanbakhsh.
Advances in Neural Information Processing Systems, 2025
Energy Loss Functions for Physical Systems Oumar Kaba, Kusha Sareen, Daniel Levy, and Siamak Ravanbakhsh.
Advances in Neural Information Processing Systems, 2025
On the Identifiability of Causal Abstractions Xiusi Li, Sékou-Oumar Kaba, and Siamak Ravanbakhsh.
The 28th International Conference on Artificial Intelligence and Statistics, 2025
Progressive inference-time annealing of diffusion models for sampling from boltzmann densities Tara Akhound-Sadegh, Jungyoon Lee, Joey Bose, Valentin De Bortoli, Arnaud Doucet, Michael Bronstein, Dominique Beaini, Siamak Ravanbakhsh, Kirill Neklyudov, and Alexander Tong.
Advances in Neural Information Processing Systems, 2025
spotlight presentation
Sampling from Energy-based Policies using Diffusion Vineet Jain, Tara Akhound-Sadegh, and Siamak Ravanbakhsh.
Reinforcement Learning Conference, 2025
SymmCD: Symmetry-Preserving Crystal Generation with Diffusion Models Daniel Levy, Siba Smarak Panigrahi, Sékou-Oumar Kaba, Qiang Zhu, Kin Long Kelvin Lee, Mikhail Galkin, Santiago Miret, and Siamak Ravanbakhsh.
The Thirteenth International Conference on Learning Representations, 2025
E (3)-Equivariant Mesh Neural Networks Thuan Anh Trang, Nhat Khang Ngo, Daniel T Levy, Thieu Ngoc Vo, Siamak Ravanbakhsh, and Truong Son Hy.
International Conference on Artificial Intelligence and Statistics, 2024
Efficient Dynamics Modeling in Interactive Environments with Koopman Theory Arnab Kumar Mondal, Siba Smarak Panigrahi, Sai Rajeswar, Kaleem Siddiqi, and Siamak Ravanbakhsh.
The Twelfth International Conference on Learning Representations, 2024
Iterated Denoising Energy Matching for Sampling from Boltzmann Densities Tara Akhound-Sadegh, Jarrid Rector-Brooks, Joey Bose, Sarthak Mittal, Pablo Lemos, Cheng-Hao Liu, Marcin Sendera, Siamak Ravanbakhsh, Gauthier Gidel, and Yoshua Bengio, et al..
Forty-first International Conference on Machine Learning, 2024
Learning to Reach Goals via Diffusion Vineet Jain, and Siamak Ravanbakhsh.
Forty-first International Conference on Machine Learning, 2024
On Diffusion Modeling for Anomaly Detection Victor Livernoche, Vineet Jain, Yashar Hezaveh, and Siamak Ravanbakhsh.
The Twelfth International Conference on Learning Representations, 2024
spotlight presentation at ICLR
Weight-Sharing Regularization Mehran Shakerinava, Motahareh MS Sohrabi, Siamak Ravanbakhsh, and Simon Lacoste-Julien.
International Conference on Artificial Intelligence and Statistics, 2024
Equivariance with Learned Canonicalization Functions Sékou-Oumar Kaba, Arnab Kumar Mondal, Yan Zhang, Yoshua Bengio, and Siamak Ravanbakhsh.
Proceedings of the 40th International Conference on Machine Learning, 2023
Equivariant Adaptation of Large Pretrained Models Arnab Kumar Mondal, Siba Smarak Panigrahi, Sékou-Oumar Kaba, Sai Rajeswar, and Siamak Ravanbakhsh.
Thirty-seventh Conference on Neural Information Processing Systems, 2023
Lie Point Symmetry and Physics Informed Networks Tara Akhound-Sadegh, Laurence Perreault-Levasseur, Johannes Brandstetter, Max Welling, and Siamak Ravanbakhsh.
Thirty-seventh Conference on Neural Information Processing Systems, 2023
EqR: Equivariant Representations for Data-Efficient Reinforcement Learning Arnab Kumar Mondal, Vineet Jain, Kaleem Siddiqi, and Siamak Ravanbakhsh.
International Conference on Machine Learning, 2022
Equivariant Networks for Crystal Structures Oumar Kaba, and Siamak Ravanbakhsh.
Advances in Neural Information Processing Systems, 2022
SpeqNets: Sparsity-aware permutation-equivariant graph networks Christopher Morris, Gaurav Rattan, Sandra Kiefer, and Siamak Ravanbakhsh.
Proceedings of the 39th International Conference on Machine Learning, 2022
Structuring Representations Using Group Invariants Mehran Shakerinava, Arnab Kumar Mondal, and Siamak Ravanbakhsh.
Advances in Neural Information Processing Systems, 2022
Utility Theory for Sequential Decision Making Mehran Shakerinava, and Siamak Ravanbakhsh.
International Conference on Machine Learning, 2022
Equivariant Networks for Pixelized Spheres Mehran Shakerinava, and Siamak Ravanbakhsh.
Proceedings of the 38th International Conference on Machine Learning, 2021
Equivariant Networks for Hierarchical Structures Renhao Wang, Marjan Albooyeh, and Siamak Ravanbakhsh.
Advances in Neural Information Processing Systems, 2020
oral presentation at NeurIPS (1% acceptance rate)
Universal Equivariant Multilayer Perceptrons Siamak Ravanbakhsh.
Proceedings of the 37th International Conference on Machine Learning, 2020
Improved knowledge graph embedding using background taxonomic information Bahare Fatemi, Siamak Ravanbakhsh, and David Poole.
Proceedings of the AAAI Conference on Artificial Intelligence, 2019
Deep Models of Interactions Across Sets Jason Hartford, Devon Graham, Kevin Leyton-Brown, and Siamak Ravanbakhsh.
Proceedings of the 35th International Conference on Machine Learning, 2018
Subject2Vec: Generative-Discriminative Approach from a Set of Image Patches to a Vector Sumedha Singla, Mingming Gong, Siamak Ravanbakhsh, Frank Sciurba, Barnabas Poczos, and Kayhan N Batmanghelich.
International Conference on Medical Image Computing and Computer-Assisted Intervention, 2018
Deep Sets Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabas Poczos, Ruslan R Salakhutdinov, and Alexander J Smola.
Advances in Neural Information Processing Systems 30, 2017
oral presentation (1% acceptance rate)
Enabling Dark Energy Science with Deep Generative Models of Galaxy Images Siamak Ravanbakhsh, Francois Lanusse, Rachel Mandelbaum, Jeff Schneider, and Barnabas Poczos.
Proceedings of the Thirty First AAAI Conference on Artificial Intelligence, 2017
Equivariance Through Parameter-Sharing Siamak Ravanbakhsh, Jeff Schneider, and Barnabas Poczos.
Proceedings of the 34th International Conference on Machine Learning, 2017
Min-Max Propagation Christopher Srinivasa, Inmar Givoni, Siamak Ravanbakhsh, and Brendan J Frey.
Advances in Neural Information Processing Systems 30, 2017
Boolean Matrix Factorization and Noisy Completion via Message Passing Siamak Ravanbakhsh, Barnabás Póczos, and Russell Greiner.
Proceedings of The 33rd International Conference on Machine Learning, 2016
Estimating Cosmological Parameters from the Dark Matter Distribution Siamak Ravanbakhsh, Junier Oliva, Sebastien Fromenteau, Layne C Price, Shirley Ho, Jeff Schneider, and Barnabás Póczos.
Proceedings of The 33rd International Conference on Machine Learning, 2016
Stochastic Neural Networks with Monotonic Activation Functions Siamak Ravanbakhsh, Barnabas Poczos, Jeff Schneider, Dale Schuurmans, and Russell Greiner.
International Conference on Artificial Intelligence and Statistics, 2016
oral presentation (6.5\% acceptance rate)
Survey Propagation beyond Constraint Satisfaction Problems Christopher Srinivasa, Siamak Ravanbakhsh, and Brendan Frey.
International Conference on Artificial Intelligence and Statistics, 2016
oral presentation (6.5\% acceptance rate)
Embedding Inference for Structured Multilabel Prediction Farzaneh Mirzazadeh, Siamak Ravanbakhsh, Nan Ding, and Dale Schuurmans.
Advances in Neural Information Processing Systems 28, 2015
Augmentative Message Passing for Traveling Salesman Problem and Graph Partitioning Siamak Ravanbakhsh, Reihaneh Rabbany, and Russell Greiner.
Advances in Neural Information Processing Systems, 2014
Min-Max Problems on Factor Graphs Siamak Ravanbakhsh, Christopher Srinivasa, Brendan Frey, and Russell Greiner.
Proceedings of the 31st International Conference on Machine Learning, 2014
A Generalized Loop Correction Method for Approximate Inference in Graphical Models Siamak Ravanbakhsh, Chun-Nam Yu, and Russell Greiner.
Proceedings of the 29th International Conference on Machine Learning, 2012
A Cross Entropy Optimization Method for Partially Decomposable Problems Siamak Ravanbakhsh, Barnabas Poczos, and Russ Greiner.
Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence. Special Track on AI and Bioinformatics, 2010

Journal Papers

Scalable Hierarchical Self-Attention with Learnable Hierarchy for Long-Range Interactions Thuan Trang, Khang Nhat Ngo, Hugo Sonnery, Thieu Vo, Siamak Ravanbakhsh, and Truong Son Hy.
Transactions on Machine Learning Research, 2024
Characterization of Inpaint Residuals in Interferometric Measurements of the Epoch of Reionization Michael Pagano, Jing Liu, Adrian Liu, Nicholas S. Kern, Aaron Ewall-Wice, Philip Bull, Robert Pascua, Siamak Ravanbakhsh, Zara Abdurashidova, Tyrone Adams, and James E. Aguirre, et al..
Monthly Notices of the Royal Astronomical Society, 2023
Galaxies and Halos on Graph Neural Networks: Deep Generative Modeling Scalar and Vector Quantities for Intrinsic Alignment Yesukhei Jagvaral, François Lanusse, Sukhdeep Singh, Rachel Mandelbaum, Siamak Ravanbakhsh, and Duncan Campbell.
Monthly Notices of the Royal Astronomical Society, 2022
Deep generative models for galaxy image simulations François Lanusse, Rachel Mandelbaum, Siamak Ravanbakhsh, Chun-Liang Li, Peter Freeman, and Barnabás Póczos.
Monthly Notices of the Royal Astronomical Society, 2021
Recovering the wedge modes lost to 21-cm foregrounds Samuel Gagnon-Hartman, Yue Cui, Adrian Liu, and Siamak Ravanbakhsh.
Monthly Notices of the Royal Astronomical Society, 2021
Learning to predict the cosmological structure formation Siyu He, Yin Li, Yu Feng, Shirley Ho, Siamak Ravanbakhsh, Wei Chen, and Barnabas Poczos.
Proceedings of the National Academy of Sciences, 2019
CMU DeepLens: deep learning for automatic image-based galaxy–galaxy strong lens finding François Lanusse, Quanbin Ma, Nan Li, Thomas E. Collett, Chun-Liang Li, Siamak Ravanbakhsh, Rachel Mandelbaum, and Barnabás Póczos.
Monthly Notices of the Royal Astronomical Society, 2018
Low-Dimensional Perturb-and-MAP Approach for Learning Restricted Boltzmann Machines Jakub M Tomczak, Szymon Zareba, Siamak Ravanbakhsh, and Russell Greiner.
Neural Processing Letters, 2018
Accurate, Fully-Automated NMR Spectral Profiling for Metabolomics Siamak Ravanbakhsh, Philip Liu, Trent Bjordahl, Rupasri Mandal, Jason Grant, Michael Wilson, Roman Eisner, Igor Sinelnikov, Xiaoyu Hu, Claudio Luchinat, Russell Greiner, and David Wishart.
PLoS ONE, 2015
Perturbed Message Passing for Constraint Satisfaction Problems Siamak Ravanbakhsh, and Russell Greiner.
Journal of Machine Learning Research, 2015
Determination of the optimal tubulin isotype target as a method for the development of individualized cancer chemotherapy Siamak Ravanbakhsh, Melissa Gajewski, Russell Greiner, and Jack A Tuszynski.
Theoretical Biology and Medical Modelling, 2013

Workshop Papers

Molecule property prediction with molecular orbitals Yan Zhang, Khang Ngo, Sékou-Oumar Kaba, Daniel T Levy, Siamak Ravanbakhsh, Aristide Baratin, Kisoo Kwon, MiYoung Jang, Eun Hyun Cho, and Sangha Park, et al..
ICLR Workshop on AI for Accelerated Materials Design (AI4MAT), 2026
Diffusion Tree Sampling: Scalable Inference-Time Alignment of Diffusion Models Vineet Jain, Kusha Sareen, Mohammad Pedramfar, and Siamak Ravanbakhsh.
ICML Workshop on Test-Time Adaptation, 2025
Long-Horizon Model-Based Offline Reinforcement Learning Without Conservatism Tianwei Ni, Esther Derman, Vineet Jain, Vincent Taboga, Siamak Ravanbakhsh, and Pierre-Luc Bacon.
NeurIPS 2025 Workshop: Second Workshop on Aligning Reinforcement Learning Experimentalists and Theorists, 2025
Parity Requires Unified Input Dependence and Negative Eigenvalues in SSMs Behnoush Khavari, Jayesh Khullar, Mehran Shakerinava, Jerry Huang, Siamak Ravanbakhsh, and Sarath Chandar.
ICML 2025 Workshop on Methods and Opportunities at Small Scale, 2025
Progressive Inference-Time Annealing of Diffusion Models for Sampling from Boltzmann Densities Tara Akhound-Sadegh, Jungyoon Lee, Joey Bose, Valentin De Bortoli, Arnaud Doucet, Michael Bronstein, Dominique Beaini, Siamak Ravanbakhsh, Kirill Neklyudov, and Alexander Tong.
ICML Workshop on Generative AI and Biology (GenBio), 2025
spotlight presentation
Sampling from Energy-based Policies using Diffusion Vineet Jain, Tara Akhound-Sadegh, and Siamak Ravanbakhsh.
ICLR Workshop on Generative Models for Robot Learning, 2025
Symmetry-Aware Generative Modeling through Learned Canonicalization Kusha Sareen, Daniel Levy, Arnab Kumar Mondal, Sékou-Oumar Kaba, Tara Akhound-Sadegh, and Siamak Ravanbakhsh.
NeurIPS 2024 Workshop on Symmetry and Geometry in Neural Representations, 2025
The Expressive Limits of Diagonal SSMs for State-Tracking Mehran Shakerinava, Behnoush Khavari, Siamak Ravanbakhsh, and Sarath Chandar.
World Modeling Workshop (WMW), 2025
Diffusion-Based In-painting of Corrupted Spectrogram Mahsa Masoud, Reyhane Askari, Kevin Chen, Adrian Liu, and Siamak Ravanbakhsh.
NeurIPS Workshop on Machine Learning and the Physical Sciences (also at MAIS and WiML), 2024
EquiAdapt: Equivariant Adaptation of Large Pretrained Models Arnab Kumar Mondal, Siba Smarak Panigrahi, Sékou-Oumar Kaba, Sai Rajeswar, and Siamak Ravanbakhsh.
CVPR Workshop on Equivariant Vision, 2024
spotlight presentation
Learning to Reach Goals via Diffusion Vineet Jain, and Siamak Ravanbakhsh.
ICLR Workshop on Generative Models for Decision Making, 2024
SymmCD: Symmetry-Preserving Crystal Generation with Diffusion Models Daniel Levy, Siba Smarak Panigrahi, Sékou-Oumar Kaba, Qiang Zhu, Mikhail Galkin, Santiago Miret, and Siamak Ravanbakhsh.
NeurIPS Workshop on AI for Materials (AI4MAT), 2024
oral presentation
Symmetry Breaking and Equivariant Neural Networks Sékou-Oumar Kaba, and Siamak Ravanbakhsh.
NeurIPS 2023 Workshop on Symmetry and Geometry in Neural Representations, 2024
oral presentation
Efficient Dynamics Modeling in Interactive Environments with Koopman Theory Arnab Kumar Mondal, Siba Smarak Panigrahi, Sai Rajeswar, Kaleem Siddiqi, and Siamak Ravanbakhsh.
European Workshop on Reinforcement Learning, 2023
Lie Point Symmetry and Physics Informed Networks Tara Akhound-Sadegh, Laurence Perreault-Levasseur, Johannes Brandstetter, Max Welling, and Siamak Ravanbakhsh.
ICML Workshop on Topology, Algebra and Geometry in Machine Learning, 2023
Physics-Informed Transformer Networks Fabricio Dos Santos, Tara Akhound-Sadegh, and Siamak Ravanbakhsh.
NeurIPS Workshop on The Symbiosis of Deep Learning and Differential Equations III, 2023
Sequoia: Hierarchical Self-Attention Layer with Sparse Updates for Point Clouds and Long Sequences Hugo Sonnery, Thuan Anh Trang, Nhat Thieu, Siamak Ravanbakhsh, and Truong Son Hy.
ICLR 2023 Workshop on Sparsity in Neural Networks, 2023
Using Multiple Vector Channels Improves E (n)-Equivariant Graph Neural Networks Daniel Levy, Sékou-Oumar Kaba, Carmelo Gonzales, Santiago Miret, and Siamak Ravanbakhsh.
ICML Workshop on Machine Learning for Astrophysics, 2023
Equivariance with Learned Canonicalization Functions Sékou-Oumar Kaba, Arnab Kumar Mondal, Yoshua Bengio, Yan Zhang, and Siamak Ravanbakhsh.
NeurIPS Workshop on Symmetry and Geometry in Neural Representations, 2022
oral presentation (10.8\% acceptance rate)
Galaxies and Halos on Graph Neural Networks: Deep Generative Modeling Scalar and Vector Quantities for Intrinsic Alignment Yesukhei Jagvaral, François Lanusse, Sukhdeep Singh, Rachel Mandelbaum, Siamak Ravanbakhsh, and Duncan Campbell.
ICML Workshop on Machine Learning for Astrophysics, 2022
SpeqNets: Sparsity-aware Permutation-equivariant Graph Networks Christopher Morris, Gaurav Rattan, Sandra Kiefer, and Siamak Ravanbakhsh.
ICLR Workshop on Geometrical and Topological Representation Learning, 2022
Designing Networks to Accurately Learn 2D Turbulence Closures Keaton Burns, Ronan Legin, Adrian Liu, Laurence Perreault-Levasseur, Yashar Hezaveh, Siamak Ravanbakhsh, and Geoffrey Wagner.
Bulletin of the American Physical Society, 2020
Analysis of Cosmic Microwave Background with Deep Learning Siyu He, Siamak Ravanbakhsh, and Shirley Ho.
International Conference on Learning Representations (ICLR), workshop track, 2018
Deep Generative Models on Graphs for Emulating Galaxy Alignments in Cosmological Simulations François Lanusse, Siamak Ravanbakhsh, Rachel Mandelbaum, and Barnabás Póczos.
International Biomedical and Astronomical Signal Processing (BASP) Frontiers Workshop, 2018
Deep Generative Models of Galaxy Images for the Calibration of the Next Generation of Weak Lensing Surveys François Lanusse, Siamak Ravanbakhsh, Barnabás Póczos, Jeff Schneider, and Rachel Mandelbaum.
229th American Astronomical Society Annual Meeting, 2017
Deep Learning with Sets and Point Clouds Siamak Ravanbakhsh, Jeff Schneider, and Barnabas Poczos.
International Conference on Learning Representations (ICLR), workshop track, 2017
Leveraging Machine Learning to Estimate Soil Salinity through Satellite-Based Remote Sensing Paul Welle, Siamak Ravanbakhsh, Barnabás Póczos, and Meagan Mauter.
American Geophysical Union Annual Meeting, 2016
Training Restricted Boltzmann Machine by Perturbation Siamak Ravanbakhsh, Russell Greiner, and Brendan Frey.
NIPS:workshop on perturbation, optimization and statistics, 2014
Benchmarking Cross Entropy Optimization Method: Analysis of a Batch Sampling Method for Large-Scale Structured Optimization Siamak Ravanbakhsh, and Russell Greiner.
NeurIPS Workshop on Monte Carlo Methods for Bayesian Inference, 2010

Technical Reports and Preprints

Bayesian Last Layer for Neural Force Fields David Nitchi, Daniel Levy, Michel Cote, and Siamak Ravanbakhsh.
Preprint, under review, 2026
Diffusion Tree Search for Inference Time Adaptation of Material Foundation Models Daniel Levy, Vineet Jain, Tara Akhound-Sadegh, Sékou-Oumar Kaba, and Siamak Ravanbakhsh.
Preprint, under review, 2026
The Role of Symmetry in Optimizing Overparameterized Networks Kusha Sareen, Mohammad Pedramfar, Mehran Shakerinava, Sékou-Oumar Kaba, and Siamak Ravanbakhsh.
Preprint, under review, 2026
The Tilted Sampling Problem: Optimism, Posterior Sampling, and Logarithmic Regret Mohammad Pedramfar, and Siamak Ravanbakhsh.
Preprint, under review, 2026
Equivariant Heterogenous Graph Networks Daniel Levy, and Siamak Ravanbakhsh.
Deep Generative Models for Galaxy Image Simulations Francois Lanusse, Rachel Mandelbaum, Siamak Ravanbakhsh, Chun-Liang Li, Peter Freeman, and Barnabas Poczos.
arXiv preprint arXiv:2008.03833, 2020
Equivariant Entity-Relationship Networks Devon Graham, Junhao Wang, and Siamak Ravanbakhsh.
arXiv preprint arXiv:1903.09033, 2020
Incidence Networks for Geometric Deep Learning Marjan Albooyeh, Daniele Bertolini, and Siamak Ravanbakhsh.
arXiv preprint arXiv:1905.11460, 2020
Accepted and presented at ICML 2020. However, we found a mistake in the experiments and retracted the paper.
LRP2020: Machine Learning Advantages in Canadian Astrophysics KA Venn, S Fabbro, A Liu, Y Hezaveh, L Levasseur, G Eadie, S Ellison, J Woo, JJ Kavelaars, and KM Yi, et al..
arXiv preprint arXiv:1910.00774, 2019
Annealing Gaussian into ReLU: a New Sampling Strategy for Leaky-ReLU RBM Chun-Liang Li, Siamak Ravanbakhsh, and Barnabás Póczos.
arXiv preprint arXiv:1611.03879, 2016
Revisiting Algebra and Complexity of Inference in Graphical Models Siamak Ravanbakhsh, and Russell Greiner.
arXiv preprint arXiv:1409.7410, 2014

Theses

Message passing and Combinatorial Optimization Siamak Ravanbakhsh.
University of Alberta, 2015
faculty of science dissertation award and CS dept. outstanding thesis award runner-up
A Stochastic Optimization Method for Partially Decomposable Problems, with Applications to Analysis of NMR Spectra Siamak Ravanbakhsh.
University of Alberta, 2009
nominated for the best M.Sc. thesis award