Engineering Product Manager

The application window is expected to close on: 10/12/2026

Meet the Team

The Cisco AI Software & Platform Group incubates and delivers mission-critical Generative AI and platform infrastructure across Cisco's global product portfolio. Our group builds foundational evaluation, benchmarking, and observability platforms that empower engineering teams to deploy autonomous AI agents and LLM-powered systems safely, reliably, and with verified accuracy at enterprise scale.

Your Impact

As an Engineering Product Manager you will lead the strategy, architecture, and organizational adoption of Cisco's end-to-end evaluation platform:

• Define AI Evaluation Platform Strategy: Architect the product vision, staged roadmap, and platform architecture for Cisco's unified offline benchmarking suites, automated LLM judges, and continuous production evaluation systems. • Operationalize Quality & Safety Standards: Convert ambiguous quality standards (e.g., factual accuracy, hallucination mitigation, safety policies, agentic tool-use fidelity) into objective, repeatable test suites and structured human-in-the-loop review pipelines. • Establish Release Gating & Quality Bars: Establish pre-deployment quality bars, risk-based release criteria, and automated regression-detection loops to govern AI model and application rollouts. • Bridge Offline & Production Telemetry: Connect offline model evaluations directly with live telemetry, product analytics (Amplitude), and real-time user feedback loops…