Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This short‑term contract focuses on assessing how well the model mimics the reasoning and judgment of an experienced developer.

Key responsibilities

• Review end‑to‑end AI‑generated coding interactions and judge their usefulness, correctness, and alignment with strong engineering judgment.
• Assess explanations, reasoning, and overall interaction quality, not just syntactic correctness.
• Distinguish between different levels of response quality and provide clear, opinionated feedback.
• Help define standards for what great AI‑assisted coding interactions look like.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Hands‑on experience with OpenAI Codex, Claude Code, and AI‑first IDEs such as Cursor.
• Deep familiarity with modern AI‑assisted development workflows.
• Ability to evaluate code without fully executing every line and to give direct, rigorous feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Contract rate up to $200 USD per hour (US/Canada), $150 EUR per hour (EU/Latam), $100 USD per hour (other regions).
• Remote work, 10–20 hours per week.
• Engagement through early May with possible extension.
• Take‑home evaluation exercise and one behavioral interview.