AI Strategy Manager

The AI Strategy Manager is a part of the Technical Directors team and owns the design, accuracy, and ongoing improvement of Nuvia's AI evaluation systems. The role leads a small team responsible for auditing and maintaining AI prompts that evaluate tens of thousands of sales calls daily, partners with other technical leads on AI tools across the company's applications, and takes point on new AI initiatives as they come up.

Compensation

$83,000

Key Responsibilities

Team Leadership

• Manage a team of two AI analysts, running daily stand-up meetings to set priorities, assign work, and track progress. • Direct the team's auditing of AI call categorization outputs, and coach team members of varying technical skill levels, from output auditing to hands-on prompt improvement. • Review team findings and decide which accuracy issues require prompt changes, workflow changes, or model updates.

Sales Call Evaluation

• Own the AI system that categorizes every inbound sales call (tens of thousands per day) by call type. • Maintain the downstream evaluation prompts for each call category, including prompts that identify patient objections and questions, flag red flags and prohibited agent behaviors, and grade calls against Nuvia's sales framework. • Build, maintain, and improve the n8n workflows that route calls through the correct prompts. • Monitor output accuracy, investigate errors, and refine prompts to improve consistency and reliability. • Evaluate and implement AI model…