This job is no longer available
This job expired on 16/10/2026. It no longer accepts applications.
Senior Python Engineer – AI Coding Agent Evaluation (Freelance)
Mindrift
Job description
About the role
Mindrift is seeking a senior Python engineer to help build a high‑quality dataset for evaluating AI coding agents. You will design realistic developer environments and craft challenging tasks that test the limits of current models.
Key responsibilities
- Create virtual company environments with codebases, infrastructure, tickets, documentation, and conversation histories.
- Design intermediate‑state tasks, write clear prompts, and define objective success criteria.
- Develop functional and integration tests that accept all correct solutions while rejecting incorrect ones.
- Iterate on tasks and tests based on QA feedback, analyzing agent failures and refining evaluation fairness.
Required profile
- 8+ years of software development experience.
- Strong command of English (minimum B2 level).
- Experience writing robust functional and integration tests.
Required skills
- Python (FastAPI)
- JavaScript / TypeScript (React)
- Docker
- PostgreSQL
- Kafka
- Redis
What we offer
- Freelance contract with flexible, remote work.
- Compensation up to $150 per hour, based on expertise and pace.
- Project‑based engagement allowing you to set your own schedule.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Egypt.
Salaries by job title
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
Mindrift