Liquid AI, an MIT spin-off, is a foundation model company headquartered in Boston, Massachusetts. Our mission is to build capable and efficient general-purpose AI systems at every scale.
Our goal at Liquid is to build the most capable AI systems to solve problems at every scale, such that users can build, access, and control their AI solutions. This is to ensure that AI will get meaningfully, reliably and efficiently integrated at all enterprises. Long term, Liquid will create and deploy frontier-AI-powered solutions that are available to everyone.
What This Role Is
We're looking for a Training Infrastructure Engineer to design, build, and optimize the distributed systems that power our Liquid Foundation Models (LFMs). This is a highly technical role focused on creating the scalable infrastructure that enables efficient training of models across the spectrum—from compact specialized models to massive multimodal systems—while maximizing hardware utilization and minimizing training time.
You're A Great Fit If
You have extensive experience building distributed training infrastructure for language and multimodal models, with hands-on expertise in frameworks like PyTorch Distributed, DeepSpeed, or Megatron-LMYou're passionate about solving complex systems challenges in large-scale model training—from efficient multimodal data loading to sophisticated sharding strategies to robust checkpointing mechanismsYou have a deep understanding of hardware accelerators and networking topologies, with the ability to optimize communication patterns for different parallelism strategiesYou're skilled at identifying and resolving performance bottlenecks in training pipelines, whether they occur in data loading, computation, or communication between nodesYou have experience working with diverse data types (text, images, video, audio) and can build data pipelines that handle heterogeneous inputs efficiently,
What Sets You Apart
You've implemented custom sharding techniques (tensor/pipeline/data parallelism) to scale training across distributed GPU clusters of varying sizesYou have experience optimizing data pipelines for multimodal datasets with sophisticated preprocessing requirementsYou've built fault-tolerant checkpointing systems that can handle complex model states while minimizing training interruptionsYou've contributed to open-source training infrastructure projects or frameworksYou've designed training infrastructure that works efficiently for both parameter-efficient specialized models and massive multimodal systems,
What You'll Actually Do
Design and implement high-performance, scalable training infrastructure that efficiently utilizes our GPU clusters for both specialized and large-scale multimodal modelsBuild robust data loading systems that eliminate I/O bottlenecks and enable training on diverse multimodal datasetsDevelop sophisticated checkpointing mechanisms that balance memory constraints with recovery needs across different model scalesOptimize communication patterns between nodes to minimize the overhead of distributed training for long-running experimentsCollaborate with ML engineers to implement new model architectures and training algorithms at scaleCreate monitoring and debugging tools to ensure training stability and resource efficiency across our infrastructure,
What You'll Gain
The opportunity to solve some of the hardest systems challenges in AI, working at the intersection of distributed systems and cutting-edge multimodal machine learningExperience building infrastructure that powers the next generation of foundation models across the full spectrum of model scalesThe satisfaction of seeing your work directly enable breakthroughs in model capabilities and performance