Senior Python Developer (AI Evaluation & Benchmarking)

This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.

What You'll Do:

• Design and develop coding benchmarks used to evaluate frontier AI models. • Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows. • Create structured programming scenarios to test reasoning, debugging, and code quality. • Work with large codebases and multi-language software environments. • Collaborate with teams focused on improving how AI models understand, generate, and evaluate software. • Write clean, maintainable, and well-tested Python code following software engineering best practices.

Requirements:

• 4+ years of professional software engineering experience (required). • Expert-level proficiency in Python. • Experience working at a high-growth technology company or top-tier software organization. • Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar. • Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit. • Strong understanding of software engineering best practices, debugging, and code quality. • Excellent analytical and problem-solving skills.

Nice to Haves:

• Experience with AI/ML evaluation, model benchmarking, or Generative AI. • Background in security…