Evaluation Scenario Writer - QA

At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. The Mindrift platform, launched and powered by Toloka, connects domain experts with cutting‑edge AI projects from innovative tech clients. Our mission is to unlock the potential of GenAI by tapping into real‑world expertise from across the globe.

Who we’re looking for :

We’re looking for curious and intellectually proactive contributors who never miss an error and can think outside the box when brainstorming solutions.

Are you comfortable with ambiguity and complexity? Does an async, remote, flexible opportunity sound exciting? Would you like to learn how modern AI systems are tested and evaluated?

Ideal candidates :

• Analysts, researchers, or consultants with strong critical thinking skills
• Students (senior undergrads / grad students) looking for an intellectually interesting gig
• People open to a part‑time and non‑permanent opportunity

About the project :

We’re on the hunt for an Evaluation Scenario Writer – QA for a new project focused on ensuring the quality and correctness of evaluation scenarios created for LLM agents. This project blends manual scenario validation, automated test thinking, and collaboration with writers and engineers. You will verify test logic, flag inconsistencies, and help maintain a high bar for evaluation coverage and clarity.

What you’ll be doing :

Although we’re only looking for experts for this current project, contributors with consistent high‑quality submissions may receive an invitation for ongoing collaboration across future projects.

Requirements :

We also value applicants who have :

Benefits :

Seniority level

Internship

Employment type

Part‑time

Job function

Other

Industries

IT Services and IT Consulting

#J-18808-Ljbffr