Applied AI Research Engineer
- Company
- OpenTrain AI
- Location
- United States
- Salary
- 100–130 $/h
- Posted
- 2026-11-17
Skills: Python
The work
• Design and implement evaluation frameworks, benchmarks, and datasets for LLM-powered agents and complex AI workflows. • Analyze model, agent, and workflow failures, identify root causes, run experiments, and measure improvements in reliability and effectiveness. • Develop training and evaluation data, task specifications, metrics, and feedback mechanisms. • Build Python-based evaluation pipelines and research tools. • Work with researchers, engineers, domain experts, and customer stakeholders to define evaluation strategies and technical improvement plans.
What it pays and takes
• Pay: $100 to $130 per hour. • Work type: Part-time contract work. • Location: Open to candidates in the listed countries across North America, Latin America, Europe, Africa, the Middle East, and Asia. • Language: Professional fluency in English. • Requirements: A strong background in applied AI research, research engineering, machine learning, or LLM-based systems; hands-on experience evaluating AI agents, including tool use, multi-step workflows, and task completion; strong Python programming skills; and the ability to communicate across research, engineering, and project teams. • Knowledge needed: Benchmarks, datasets, evaluation metrics, LLM behavior, agentic architectures, reliability, robustness, and generalization. • Helpful background: Experience evaluating or optimizing production or enterprise AI agents, building research infrastructure or automated experimentation…
Full text and application on the employer's site.