Human-Evaluation Specialist

Home/Careers/Human-Evaluation Specialist

Data & Evaluation

Human-Evaluation Specialist

Human-Evaluation Specialists oversee human-in-the-loop evaluations and annotation tasks.

Apply for this roleManage an applicationBack to careers

Overview

Human-Evaluation Specialists oversee human-in-the-loop evaluations and annotation tasks.

Responsibilities

Design evaluation protocols: Define evaluation tasks, criteria, and scoring guidelines.Review AI outputs: Assess AI-generated outputs for quality, usability, and correctness.Identify inconsistencies: Detect errors, hallucinations, and ambiguous results.Provide structured feedback: Document issues and provide feedback to developers for model improvements.Contribute to workflow improvements: Suggest improvements to evaluation workflows and training data collection.

Qualifications

Bachelor's degree in human-computer interaction or a related field.Experience in annotation tasks and quality assurance processes.

Equal opportunity

TAIRC evaluates candidates using role-related evidence and documented review criteria. Employment decisions must not be based on protected personal characteristics.

Engagement pathways and compensation status

TAIRC is currently building its funding base. Opportunities identified as volunteer or unpaid do not provide compensation at this stage. Any future paid appointment would require available funding, organizational approval, applicable legal compliance, and a separate written agreement. Participation does not guarantee future employment or compensation.

Volunteer contribution interest may be reviewed only as a voluntary, scoped pathway.Educational internship interest requires separate supervision, educational purpose, and legal review.Advisory expressions of interest are not board or formal advisory appointments.Future compensated employment is contingent on funding, approval, legal compliance, and a separate written offer.

Accessibility and accommodations

For an accommodation or alternate submission format, contact hr@tairc.com. The application form does not request medical documentation or sensitive identity documents.

Posting information

Department Data & Evaluation

Public role ID TAIRC-ROLE-036

Status Open

Location, employment type, workplace type, compensation, sponsorship policy, posted date, and closing date are omitted unless HR has entered approved factual values.

Recruitment privacy

Application data is used for recruitment review, stored with restricted access, and handled under the recruitment privacy and retention policy.