Agentic-MME tests whether AI models can investigate an image rather than just look at it. To solve a task, the model has to crop, rotate or enhance the image so a small detail becomes readable, then search the web for a fact, and then check each against the other before…
Apply on Mercor ↗We may earn a fee if you sign up.Scope of the Role: We are standing up a dedicated onsite team to evaluate complex, real-world agentic AI workflows for a frontier AI customer. The Engagement Manager owns this team and this engagement: a group of ten reviewers and one QA lead working inside isolated test…
Apply on Innodata ↗Opens the platform's own listing.Scope of the Role: We're building a dedicated reviewer team to evaluate complex, real-world agentic AI workflows, assessing whether AI agents complete tasks safely, respect user intent and consent, and hold up under close scrutiny. This isn't routine content moderation…
Apply on Innodata ↗Opens the platform's own listing.Evaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab's models. You'll assess repository-level tasks, reference patches, test harnesses, and grading integrity — and provide clear, rubric-based…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.SWE-Bench AI Task Auditor - Freelance AI Trainer Project — a Meridial (Invisible Technologies) freelance AI training project.
Apply on Meridial ↗Opens the platform's own listing.Agentic Audio Specialist - Freelance AI Trainer Project — a Meridial (Invisible Technologies) freelance AI training project.
Apply on Meridial ↗Opens the platform's own listing.What we do The Mindrift platform connects specialists with AI projects from major tech innovators. About the Role We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed…
Apply on Mindrift ↗Opens the platform's own listing.What we do The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Who we're looking for: We’re looking for curious and intellectually proactive contributors, the kind of person who double-checks…
Apply on Mindrift ↗Opens the platform's own listing.What we do The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Who we're looking for Calling all security researchers, engineers, and penetration testers with a strong foundation in…
Apply on Mindrift ↗Opens the platform's own listing.What we do The Mindrift platform connects specialists with AI projects from major tech innovators. About the Role We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed…
Master's required
Apply on Mindrift ↗Opens the platform's own listing.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Bachelor's required
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Master's required
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We are building high-fidelity simulated work environments used to evaluate and improve AI agents on real marketing work. Each environment reproduces a marketing org's actual tool surface — email, storage, CRM, project management, social media management, web analytics, AEO/SEO…
Apply on Mercor ↗We may earn a fee if you sign up.We're looking for engineers who have shipped production search systems (especially agentic ones now that we're in the era of LLMs and agents) and are thinking hard about the requirements and optimizations of those systems. You've probably: Owned relevance or retrieval on a…
Master's required
Apply on Mercor ↗We may earn a fee if you sign up.A leading AI research organization is seeking advanced LLM power users with strong experience using MCP and (more importantly) plugins/connectors for real-world personal life tasks. This project focuses on evaluating how well AI systems handle personalized, multi-step life tasks…
Apply on Mercor ↗We may earn a fee if you sign up.We are looking for folks with direct access to and experience using various company-specific AI interfaces.
Apply on Mercor ↗We may earn a fee if you sign up.About the Role \- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. \- Contributors help evaluate and improve frontier AI coding models through structured technical assessments. \- The work focuses on realistic infrastructure…
Apply on Mercor ↗We may earn a fee if you sign up.About the Role \- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. \- Contributors help evaluate and improve frontier AI coding models through structured technical assessments. \- The work focuses on realistic software engineering…
Apply on Mercor ↗We may earn a fee if you sign up.Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. About the Role Mercor is partnering with a leading AI research lab to support…
Apply on Mercor ↗We may earn a fee if you sign up.Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. About the Role Mercor is partnering with a leading AI research lab to support…
Apply on Mercor ↗We may earn a fee if you sign up.Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. About the Role Mercor is partnering with a leading AI research lab to support…
Apply on Mercor ↗We may earn a fee if you sign up.About the Role \- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. \- Contributors help evaluate and improve frontier AI coding models through structured technical assessments. \- The work focuses on realistic machine learning…
Apply on Mercor ↗We may earn a fee if you sign up.Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. About the Role Mercor is partnering with a leading AI research lab to support…
Apply on Mercor ↗We may earn a fee if you sign up.About the Role \- Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. \- Contributors help evaluate and improve frontier AI coding models through structured technical assessments. \- The work focuses on realistic data engineering…
Apply on Mercor ↗We may earn a fee if you sign up.Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. About the Role Mercor is partnering with a leading AI research lab to support…
Apply on Mercor ↗We may earn a fee if you sign up.What we do The Mindrift platform, launched and powered by Toloka , connects domain experts with cutting-edge AI projects from innovative tech clients. Who we're looking for: We’re looking for curious and intellectually proactive contributors, the kind of person who double-checks…
Apply on Mindrift ↗Opens the platform's own listing.What we do The Mindrift platform connects specialists with AI projects from major tech innovators. About the Role We’re looking for someone who can design realistic and structured evaluation scenarios for LLM-based agents. You’ll create test cases that simulate human-performed…
Master's required
Apply on Mindrift ↗Opens the platform's own listing.We're looking for e-commerce and retail operations professionals to help train consumer-facing AI shopping and product agents. You'll evaluate AI performance on product categorization, catalog management, merchandising recommendations, and consumer purchase workflows. The ideal…
Apply on Mercor ↗We may earn a fee if you sign up.We're looking for experienced educators to help train consumer-facing AI tutoring and learning agents. You'll evaluate AI-generated educational content, assess pedagogical quality, and ensure AI tutoring responses are accurate, age-appropriate, and aligned with best practices in…
Apply on Mercor ↗We may earn a fee if you sign up.We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information…
Apply on Mercor ↗We may earn a fee if you sign up.We're looking for a detail-oriented contributor to support AI model training and data preparation for leading AI research labs. You'll annotate and review training data, audit work produced by other annotators, and assist with data conversion workflows that improve model…
Apply on Mercor ↗We may earn a fee if you sign up.Mercor is hiring experienced Software Engineers to support high-impact research collaborations with leading AI labs. Freelancers will contribute to building training datasets that improve AI model reasoning and problem-solving on real-world coding tasks. This is a unique…
Bachelor's required
Apply on Mercor ↗We may earn a fee if you sign up.
No agentic AI and RL environment roles are open today. The last one closed Oct 5. New ones show up here the morning after they're posted.
Seen open in the last 48 hours Last seen open 2 or more days ago