Back to all jobs

AI Training Scenario Designer

Work from home Full-time role Hiring

About the Role

We're looking for creative, detail-oriented experts to help train the next generation of AI agents. You'll design realistic, complex digital worlds and craft challenging scenarios that test how well AI navigates real-world tasks — think scheduling conflicts, information overload, competing priorities, and more.

  • *What You'll Do**

- Build richly detailed personas and simulated digital environments (Gmail, Slack, Calendar, WhatsApp, Google Drive, and more) - Write tasks that challenge an AI agent's ability to reason, filter, and prioritize - Run the agent against your scenarios, evaluate its performance, and guide it to success through structured hints - Document your work clearly in Airtable and Crucible

  • *You're a Good Fit If You**

- Have strong written communication and attention to detail - Think creatively and enjoy constructing layered, realistic scenarios - Are comfortable working with structured tools like JSON editors, Airtable, and AI platforms - Can spot inconsistencies and think critically about information quality - Work independently and manage your own workflow -

Must Have

- Undergrad degree, 2+ years professional experience. -

Nice to have:

-

Writing chops

— copywriter, UX writer, journalist, content strategist, editor, published blog/newsletter, creative writing background. Strong writers make the best task creators _and_ reviewers -

Multi-stakeholder coordination

— PM, account manager, consultant, client success, event coordinator, producer. Creates richer, more authentic professional scenarios -

World-building / creative design

— game designer, curriculum designer, UX researcher, simulation designer, tabletop RPG creator -

Technical / data comfort

— JSON familiarity, Jira/Asana power user, technical PM, data analyst, SQL/Python exposure. A plus but not required — we'll provide a JSON onboarding guid Apply To This Job

More remote roles to explore

CADD Designer - Bridge

Work from home Full-time role

Freelance Music Producer

Work from home Full-time role

[Hiring] Dental Biller @Paired

Work from home Full-time role

Board Advisor - Global IT Staffing & Services

Work from home Full-time role

[Remote] Quality Control and Digital Archivist

Work from home Full-time role

Digital Archivist / Metadata Manager

Work from home Full-time role

Freelance Content Writer – Weekend Projects Only (Remote)

Work from home Full-time role

Remote Chat & Email Support Representative – arenaflex Service Desk

Work from home Full-time role

Sr Software Engineer (Open LMS) US, Remote

Work from home Full-time role

Remote Software Developer (Entry-Level & Experienced)

Work from home Full-time role

Executive Editor job at WebMD in El Segundo, CA

Work from home Full-time role

Senior DevOps Engineer

Work from home Full-time role

Senior Credit & Collections Specialist, Escalations Analyst

Work from home Full-time role

Senior Buyer - In Vehicle Software

Work from home Full-time role

Experienced Crisis Chat Text Counselor - 988 Crisis Intervention Services

Work from home Full-time role

Entry-Level Data Entry & Program Management Associate – Driving Innovation Initiatives in Streaming Services at arenaflex – Switzerland

Work from home Full-time role

Sr Azure Virtual Desktop Engineer

Work from home Full-time role

Call Center Pharmacy Technician – Level 1

Work from home Full-time role

Field Technician

Work from home Full-time role

Experienced Live Chat Support Representative – Global Customer Service & Account Management

Work from home Full-time role