Software Engineer, Infrastructure Data Plane at Anyscale

Get hired in a next generation AI company right now.
"Craiglist for jobs in AI" - Tony Rose

As seen in

Designer Daily Report
Trends Weekly
La Vanguardia
La Vanguardia

🖤 If you like MoAIJobs, give us a shoutout on 𝕏

Anyscale
Software Engineer, Infrastructure Data Plane
San Francisco, CA

Share:

About Anyscale:

At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAIUberSpotifyInstacartCruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

About the role
Anyscale is looking for a Software Engineer to join the Infrastructure Dataplane team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. At the Cloud Platform Dataplane team, we build the scalable, secure, and robust backbone to realize this vision. 

We are seeking a talented Software Engineer with a strong background in dataplane development and expertise in container technologies. As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing dataplane solutions that power our cutting-edge products.

You will be able to work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.
About the role
Anyscale is looking for a Software Engineer to join the Infrastructure Dataplane team. Anyscale aims to provide the next generation of tools and infrastructure to make developing and running distributed AI applications in the cloud as easy as on your laptop. At the Cloud Platform Dataplane team, we build the scalable, secure, and robust backbone to realize this vision. 

We are seeking a talented Software Engineer with a strong background in dataplane development and expertise in container technologies. As part of our engineering team, you will play a crucial role in designing, implementing, and optimizing dataplane solutions that power our cutting-edge products.

You will be able to work on the open-source Ray, our major infinite laptop proprietary product, and the integration and interaction between the two as well as critical customer features.

As part of your role, you will

  • Design and develop components to manage Ray applications and auxiliary containers running on the dataplane
  • Create cutting-edge features to enhance reliability, performance, scalability, and observability of Anyscale-managed Ray workloads
  • Implement and maintain accelerator support
  • Manage and optimize storage, networking, and security aspects of the dataplane
  • Handle dependencies and container image management
  • Participate in code reviews, design discussions, and architecture planning sessions
  • Provide on-call support and collaborate with customer and field teams to troubleshoot dataplane issues
  • Work with a team of leading distributed systems and machine learning experts
  • We'd love to hear from you if you have

  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience
  • 3+ years of experience writing high-quality production code
  • Hands-on experience building high-performance distributed systems at scale
  • Proficiency in Go and Python
  • In-depth knowledge of low-level operating system foundations (Linux kernel, file systems, containers)
  • Comprehensive understanding of network protocols and associated tools
  • Ability to work independently and collaboratively in a fast-paced environment
  • Customer-focused mindset with excellent communication skills
  • Bonus
  • Master's degree in Computer Science or related technical field
  • Contributions to open-source projects in dataplane or container technologies
  • Familiarity with cloud platforms (AWS, Google Cloud, Azure) and Kubernetes


  • Anyscale Inc. is an Equal Opportunity Employer. Candidates are evaluated without regard to age, race, color, religion, sex, disability, national origin, sexual orientation, veteran status, or any other characteristic protected by federal or state law. 

    Anyscale Inc. is an E-Verify company and you may review the Notice of E-Verify Participation and the Right to Work posters in English and Spanish
    About Anyscale:

    At Anyscale, we're on a mission to democratize distributed computing and make it accessible to software developers of all skill levels. We’re commercializing Ray, a popular open-source project that's creating an ecosystem of libraries for scalable machine learning. Companies like OpenAIUberSpotifyInstacartCruise, and many more, have Ray in their tech stacks to accelerate the progress of AI applications out into the real world.

    With Anyscale, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert.

    Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date.

    Anyscale is based in San Francisco, CA. Employees are required to come in office 3x a week.

    Please mention that you found this job on Moaijobs, this helps us get more companies to post here, thanks!