[Remote] Machine Learning Enginer, Core Evaluations

Note: The job is a remote job and is open to candidates in USA. Cantina Labs is a social AI company focused on developing advanced real-time models that enhance human creativity and social interactions. They are seeking an experienced Machine Learning Engineer to lead audio model evaluation efforts, designing evaluation pipelines and automated reporting dashboards for model performance.

Responsibilities

Designing model evaluation pipelines for models in development and productionDesigning user studies for subjective model evaluationsConverting requirements into measurable metricsDesigning and developing automated evaluation dashboard to see model performances and compare resultsTraining new models to capture new and different evaluation metricsCommunicating with the model team to help design better models based on the evaluation resultsCommunicating with the data team to help decide the type of data necessary to improve model performanceCommunication with the product-manager to make sure product requirements are correctly measuredHelp grow the evaluation team as the founding memberLead the evaluation team in the future
Skills

Strong experience and intuition for designing metrics that capture model performanceStrong experience with designing user studies on Mechanical Turk or similar platformsStrong experience with model training and fine-tuning for model evaluationStrong statistical knowledge and experience to statistically compare evaluation results and take decisionsVery strong engineering and programming skillsExperience with training ASR, TTS modelsExperience at ML teams working on large-scale machine learning problems. (>3B models with >1m hours of data)
Company Overview

Cantina Labs is a social AI company developing advanced real-time models that push the boundaries of expression, personality, and realism. It was founded in 2022, and is headquartered in Brooklyn, New York, USA, with a workforce of 201-500 employees. Its website is https://www.cantina.com/.
Company H1B Sponsorship

Cantina Labs has a track record of offering H1B sponsorships, with 3 in 2026, 9 in 2025, 3 in 2024, 1 in 2023. Please note that this does not guarantee sponsorship for this specific role.