The Artificial General Intelligence (AGI) Inference Engine team is looking for a highly-skilled Senior ML Engineer, to lead the research and implementation of novel techniques to push the boundaries of efficient inference for Generative Artificial Intelligence (GenAI) models.
Key job responsibilities
Design, develop, test and deploy inference solutions for high-end LLMs and diffusion models
Explore emerging inference optimization techniques for LLMs and diffusion models
Design and conduct experiments, analyze results and influence Amazon AGI roadmap by providing recommendations
Optimize performance of LLMs and diffusion models on best-in-class GPU and AWS Neuron hardware
Collaborate with cross-functional teams of engineers and scientists to identify and solve complex problems in GenAI
Mentor and guide junior engineers, and contribute to the overall growth and development of the team
A day in the life
Senior engineers in our team are independent and have much freedom in the way they contribute. They read recent papers, explore ideas, brainstorm and freely connect with others to cooperate. They detect, investigate and resolve complex problems, sometimes through creating software solutions, and sometimes just through finding and reusing something that exists. They partner with leaders to focus on right things and make good decisions. They are making sure the team follows best design and programming best practices, as well as lead operational efforts.
About the team
Our mission is to build best-in-class, fast, accurate, and cost-efficient large language and diffusion model inference solutions and infrastructure that will enable Amazon businesses to deliver more value to their customers.
Key job responsibilities
Design, develop, test and deploy inference solutions for high-end LLMs and diffusion models
Explore emerging inference optimization techniques for LLMs and diffusion models
Design and conduct experiments, analyze results and influence Amazon AGI roadmap by providing recommendations
Optimize performance of LLMs and diffusion models on best-in-class GPU and AWS Neuron hardware
Collaborate with cross-functional teams of engineers and scientists to identify and solve complex problems in GenAI
Mentor and guide junior engineers, and contribute to the overall growth and development of the team
A day in the life
Senior engineers in our team are independent and have much freedom in the way they contribute. They read recent papers, explore ideas, brainstorm and freely connect with others to cooperate. They detect, investigate and resolve complex problems, sometimes through creating software solutions, and sometimes just through finding and reusing something that exists. They partner with leaders to focus on right things and make good decisions. They are making sure the team follows best design and programming best practices, as well as lead operational efforts.
About the team
Our mission is to build best-in-class, fast, accurate, and cost-efficient large language and diffusion model inference solutions and infrastructure that will enable Amazon businesses to deliver more value to their customers.
Related Jobs
DoorDash
21 hours ago
Senior Software Engineer, Machine Learning Infrastructure - Generative AI
San Francisco, CA