Luma AI•
6 months ago

Principal Software Engineer- Data infrastructure

Share:

We are looking for people with strong Backend Data Engineering capabilities to build highly efficient, resilient systems & pipelines for large-scale data processing. You’ll be part of Luma’s applied research team and work directly on mission critical work-streams utilizing thousands of GPUs.
The pay range for this position in California is $200,000 - $300,000yr; however, base pay offered may vary depending on job-related knowledge, skills, candidate location, and experience. We also offer competitive equity packages in the form of stock options and a comprehensive benefits plan.

Responsibilities

  • Design, build and automate infrastructure for processing data across multiple clusters of thousands of GPUs.
  • Work with researchers to identify and implement technical data requirements, and optimize distributed loading for model training.
  • Work cross-functionally for diverse backend engineering needs.
  • Design & build performant infrastructure to manage and leverage large-scale datasets for our model training.
    • ,

    Experience

  • Requirement of 10+ years of engineering, including 2+ years of work experience in petabyte-level data processing.
  • Very strong generalist python coding.
  • Experience engineering large-scale systems that process and serve petabytes of data.
  • Deep understanding of Kubernetes, SLURM, Ray and other cluster orchestration systems.
  • Experience working with visual data.
  • Experience working closely with ML is a strong plus .
  • Please note this role is not meant for recent grads.
    • All your applications are reviewed by real people.

    Please mention that you found this job on MoAIJobs, this helps us grow, thanks!

    Related Jobs

    Qualtrics

    •
    3 weeks ago

    Principal Software Engineer

    Krakow, Poland

    EarnIn

    •
    2 weeks ago

    Principal Software Engineer

    Mexico City, Mexico

    Samsung Research America

    •
    1 week ago

    Engineer, Software Infrastructure

    665 Clyde Avenue, Mountain View, CA, USA

    Anyscale

    •
    6 days ago

    Software Engineer, Infrastructure

    San Francisco or Palo Alto, CA

    Pinterest

    •
    1 week ago

    Staff Software Engineer, Infrastructure Data Science

    San Francisco, CA, US; Remote, US