Data Analyst (SQL/Python) – Remote, $15/hr

About the role

We are looking for an experienced Data Analyst to design and author multi‑agent benchmark tasks focused on complex data‑analysis workflows. This short‑term contract (4 weeks) is fully remote and offers a competitive hourly rate.

Key responsibilities

• Design and author benchmark tasks that require cross‑referencing, anomaly detection, contradiction identification, and statistical computation across multiple data sources.
• Create realistic synthetic datasets or curate real‑world style datasets in domains such as finance, operations, security, and market analysis.
• Develop decomposition guides that split analytical work among specialist sub‑agents (financial, technical, security, operations).
• Write precise oracle logic or verification scripts to validate specific analytical conclusions.
• Build reproducible evaluation environments using Python and Docker.
• Review task performance signals to ensure clear separation between weaker and stronger agentic systems.
• Refine tasks to improve determinism, clarity, difficulty, and scoring quality.

Required profile

• Strong years of experience in data analysis.
• Proficiency in SQL and Python for data analysis and scripting (pandas, NumPy, or similar).
• Experience handling messy real‑world datasets (CSV, JSON, logs, reports).
• Ability to design non‑trivial analytical questions with clear, verifiable answers.
• Solid understanding of statistical concepts such as averages, distributions, outliers, and correlations.
• Familiarity with AI coding benchmark environments (e.g., SWE‑bench, Terminal‑Bench).
• Comfort with Docker, including writing Dockerfiles, building images, and debugging containers.
• Capability to work independently in a remote setting.

Required skills

• SQL
• Python
• pandas
• NumPy
• Docker

What we offer

• Competitive hourly rate of $15
• Fully remote work
• Short‑term contract (4 weeks)