Annotation Operations Lead - Code

Full-time

Job Description

This job posting has expired and no longer accepting applications.

Why this role?

The Annotation Operations Lead - Code is responsible for building and managing Cohere’s team of annotators who develop and deliver high-quality training data critical to the development of Cohere's code capabilities. You will join a small and effective team who orchestrate Cohere’s human data collection efforts.

Your day-to-day will include helping stakeholders translate their data needs into annotation projects, running daily stand ups and being the on-the-ground support for the annotators, reviewing data, and iterating on projects and processes to improve the way we run this program.

As an Operations Lead you will:

Scale the code teams annotation output while improving quality and effectiveness of their work

Partner with internal stakeholders to decide on staffing and hiring strategy to meet roadmap requirements, as well as work with external vendors to enrich our data pipeline as needed

Test-iterate regularly by running pilots and experiments, and stay up-to-date on industry trends and best practices

Own individual and team-wide performance management of our code generation annotators, including partnering with the Data Ops team to continuously improve our performance management KPIs, plans, and processes

Run and develop onboarding for new code generation annotators, as well as identifying opportunities and tools for ongoing education to up-skill, coach, and improve the team