MCP Expert
Job Type: Contractor
Location: Remote
Openings: 100
Expected Commitment: Approximately 15 hours/week
Schedule: Flexible — choose your own hours and days, including weekends
Compensation: $124,800–$249,600 annualized, based on the stated $60–$120/hour rate at 40 hours/week
About the Opportunity
We are seeking experienced software engineers to help train next-generation AI systems by creating Reinforcement Learning (RL) environments that evaluate how AI models solve complex software engineering problems using Model Context Protocol (MCP) tools.
You will design realistic, reproducible environments where AI agents must discover and reason over information from real MCP servers while completing software engineering tasks such as bug fixing, feature implementation, codebase refactoring, and performance optimization.
The work includes developing deterministic verification and golden reference solutions that accurately assess both MCP tool usage and software engineering capability.
What You'll Do
Create RL environments for evaluating AI agents on complex software engineering tasks.
Design tasks involving bug fixes, feature development, refactoring, and performance optimization.
Build environments that require agents to discover and reason over information using real MCP servers.
Develop reproducible environments with deterministic verification.
Create golden reference solutions to establish expected task outcomes.
Design evaluations that measure both software engineering ability and effective use of MCP tools.
Apply strong engineering judgment to ensure tasks are technically sound and reliably assess model performance.
Requirements
Proficiency in at least one of C++, Python, Java, Go, TypeScript, or Rust.
Strong understanding of algorithms, data structures, and performance tuning.
Demonstrated ability to debug complex software issues and deliver maintainable solutions.
Strong experience with feature development and codebase refactoring.
Proven ability to optimize software for performance and scalability.
Exceptional written and verbal communication skills.
Strong attention to detail.
Successful experience working in collaborative, cross-functional teams, ideally in remote environments.
Preferred Qualifications
Experience working with large-scale, distributed codebases.
Familiarity with AI or machine learning systems.
Experience participating in rigorous code reviews.
Background contributing to software engineering best practices.
Compensation & Engagement
Stated rate: $60–$120/hour.
Annualized equivalent: $124,800–$249,600 based on 40 hours/week.
Actual compensation is output-based, with experts paid per task that meets project specifications.
Task completion times may vary based on experience and workflow.
Minimum submission requirements apply, including a minimum number of tasks per week.
Approximately 15 hours/week expected.
Schedule & Start
Fully remote.
Flexible schedule — experts choose their working hours and days.
Weekend work is permitted.
Roles are typically filled within 48 hours.
Selected experts are expected to begin their first tasks within 24–48 hours of completing onboarding.
Selection Process
Submit an application and complete the screening questions.
Complete an approximately 30-minute AI interview.
Complete a technical assessment, if required.
Hiring manager review.