Computer Science Specialist – Remote (Pay‑Per‑Task)

About the role

We are seeking a Computer Science Specialist to design and evaluate advanced computer‑science problems that assess AI model performance. This short‑term remote contract pays $250 per approved task and allows up to 40 hours per week with a required 4‑hour overlap with Pacific Standard Time.

Key responsibilities

• Design challenging CS problems covering algorithms, systems design, cybersecurity, databases, networks, theory of computation, operating systems, and related areas.
• Develop clear, step‑by‑step reference solutions with rigorous logic and well‑structured explanations.
• Evaluate AI‑generated responses for correctness, reasoning quality, completeness, clarity, and alignment with problem requirements.
• Identify flaws, gaps, edge cases, and near‑miss reasoning patterns in AI outputs.
• Collaborate with researchers to refine benchmarks across undergraduate to PhD‑level topics.
• Provide structured feedback to improve problem quality, benchmark reliability, and model evaluation standards.

Required profile

• Ph.D. (completed or in progress) in Computer Science or a closely related field.
• Strong expertise in advanced CS reasoning and problem‑solving across multiple domains.
• Ability to create conceptual problems that demand deep understanding rather than simple recall or coding.
• Excellent written communication skills with attention to detail in evaluating reasoning, assumptions, definitions, edge cases, and solution validity.
• Willingness to undergo a background check after onboarding.

Required skills

• Python (knowledge desirable but not mandatory)
• Data analysis

What we offer

• $250 per approved task
• Remote work with flexible scheduling
• Opportunity to influence AI benchmark development