Mosaic: PyTorch Memory Profiling
Open-source PyTorch memory profiling and analysis tool
The official PyTorch tutorial for Mosaic — launched as open source last year — has just been released! As one of the main contributors, I’m incredibly proud of the teams we’ve been able to support with this tool.
In this Substack edition, I’ve included an updated version of the tutorial, along with links to three separate Google Colab notebooks for hands-on exploration. Contributing to projects like Mosaic, which sit at the intersection of infrastructure and machine learning modeling, are a fantastic way to transition into ML roles. I’ll share more thoughts on this career path in future posts.