Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Strategy Consultant: AI Training Design & Evaluation

Dorado

Toloka AI is assembling a remote, project-based team of strategy consultants to design AI-driven learning environments for enterprise-grade models. You will craft authentic project scenarios, define tasks for AI agents, and build evaluation rubrics to train grading systems. Ideal candidates have 3+ years at McKinsey, BCG, Bain, or similar, plus hands-on project experience and clear written English. This is a high-expertise, individual-contributor role with flexible pace and remote collaboration. #J-18808-Ljbffr Dorado

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Strategy Consultant: AI Training Design & Evaluation in New York, NY vacancy
  •  ...launching a remote, project-based role for consultants with direct experience at top-tier strategy firms. You will translate authentic...  ...-end learning environments for advanced AI systems and design structured tasks for evaluation by AI agents. No deep technical background... 
    Training
    Remote job
    Hourly pay

    Mindrift

    New York, NY
    3 days ago
  • Mindrift, powered by Toloka, is launching a remote, project-based role for experienced strategy consultants from top-tier firms to design AI learning environments and evaluation tasks. You will build realistic project environments and design structured consulting tasks... 
    Training
    Remote job

    Dorado

    New York, NY
    1 day ago
  •  ...SMEs with deep domain expertise to guide evaluation and grounding of AI model outputs for underwriting and claims tasks. You will design targeted insurance evaluations, provide actionable...  ...feedback, and help build rigorous training data alongside a leading GenAI team. The... 
    Training

    Mercor

    New York, NY
    11 hours ago
  • $190k - $270k

     ...running the world’s best data and AI platform so our customers can...  ...the full stack, from model training to advanced multi-agent systems...  ...of a new team focused on evaluating and continuously improving Databricks' AI Agents. You will design and scale the infrastructure,... 
    Training
    Local area
    Worldwide

    DataBricks

    New York, NY
    3 days ago
  •  ...Migration team combines strategy, frameworks,...  ...them forward. We design and deliver migration...  ..., mentor consultants and architects, and...  ...implementation, M&A, and AI initiatives.*...  ...across engagements. * Evaluate emerging technologies...  ...through training, mentoring, communities... 
    Training
    Temporary work
    Local area

    Slalom

    New York, NY
    3 days ago
  • $20 per hour

    Feedinkoo is looking for a Web Developer/Designer to enhance AI models by evaluating design work, including interfaces and user experiences. This role involves...  ...and selecting projects. Opportunities include AI training and design-focused projects with competitive pay... 
    Training
    Remote job

    Feedinkoo

    New York, NY
    4 days ago
  • $127.4k - $191.2k

     ...opportunityUnity's Vector AI team builds the machine...  ..., build, and evaluate next-generation ranking...  ...techniques to bidding strategy, auction dynamics, and real-time ad delivery.Design and run rigorous experiments...  ...the full pipeline from training data to deployed model.... 
    Training
    Full time
    Internship
    Work at office
    Worldwide
    Shift work

    Unity Technologies

    New York, NY
    2 days ago
  •  ...The hardest problems in both AI and biology are being solved here...  ...the core architecture and training of Output's foundation model,...  ...research to trained model: you design architectures, develop training...  ...run pretraining at scale, and evaluate what the model has learned. You... 
    Training

    Namely

    New York, NY
    3 days ago
  • $70 per hour

     ...Position: Video related professional for AI training Type: Contract Compensation: $20 - $70/hour Location: Remote Commitment: 10-40 hrs...  ..., annotate, and assess video datasets for model training and evaluation. Review and critique AI-generated video outputs to ensure... 
    Training
    Contract work
    Remote work

    Crossing Hurdles

    New York, NY
    3 days ago
  • $184k - $287.5k

    NVIDIA is seeking outstanding AI Solutions Architects to assist...  ...partner teams to help customers design, deploy and optimize AI...  ...accelerated infrastructure for training, fine-tuning, inference, retrieval...  ...scale AI infrastructureExperience evaluating cluster performance using... 
    Training
    Full time
    Remote work

    Nvidia

    New York, NY
    1 day ago
  •  ...Jewish Health System, Inc. is seeking a Learning Design & Impact Specialist to enhance their...  ...candidate will be accountable for executing learning evaluation frameworks, analyzing performance data, and facilitating training sessions, all aimed at driving measurable business... 
    Training

    Metropolitan Jewish Health System, Inc.

    New York, NY
    3 days ago
  • $50 - $60 per hour

     ...committed to creating high-quality AI. We are looking for a Chief...  ...to join our team to help train the next generation of AI while...  ...your own schedule. This role is designed to fit a variety of lifestyles...  ...diverse and complex problems and evaluate their outputs Evaluate the... 
    Training
    Remote job
    Hourly pay
    Full time
    Contract work
    Part time
    Work experience placement
    Flexible hours

    DataAnnotation

    New York, NY
    3 days ago
  • $100 per hour

     ...of the world’s fastest-growing AI startups.   At DualEntry,...  ...Applied AI Engineer , you'll design and ship production AI systems...  ...to apply LLMs to. Build the evaluation frameworks and experimentation...  ...with fine-tuning or training models, not just inference ~... 
    Training
    Full time
    Immediate start
    Weekend work

    Dualentry

    New York, NY
    11 hours ago
  • Principal Clinical AI Evaluation Strategist (MD) This role is responsible for setting strategy and leading the evaluation of generative AI solutions for clinical and educational products, ensuring medical accuracy, reliability, and compliance within the healthcare domain... 

    3M HEALTHCARE

    New York, NY
    11 hours ago
  • $129.6k - $147.2k

     ...driven, entrepreneurial AI Strategist to join a...  ...enterprise customers to design, deploy, and scale AI...  ..., part implementation consultant, and part product...  ...implement mitigation strategies to prevent project stalls...  ...Experience helping customers evaluate, adopt, or scale AI/ML... 
    Live in
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home
    Worldwide
    Shift work

    WinsAbove

    New York, NY
    5 days ago
  • $90k - $105k

     ...a professional to oversee instructional design and learning measurement programs. The role...  ...learning solutions and executing evaluation frameworks. Required qualifications include...  ...particularly in instructional design and training facilitation. Comprehensive benefits such... 
    Training

    Metropolitan Jewish Health System

    New York, NY
    4 days ago
  • Are you a detail-oriented ISD with a passion for high-stakes training? We are looking for an experienced Course Evaluator/Instructional System Designer to support a critical 8-week program on-site in Glynco, Georgia . (2- and 4-week assignments available). LOCATION :... 
    Training
    Daily paid
    Temporary work
    Immediate start

    Team Carney, Inc.

    New York, NY
    2 days ago
  •  ...AI Learning Experience Designer Job Title AI Learning Experience Designer...  ...innovative, learner-centered training solutions powered by artificial...  ...learning practices. Evaluate emerging AI technologies...  ...workforce learning Learning consulting Success Metrics... 
    Training
    Full time
    Remote work

    Ova Technologies

    New York, NY
    2 days ago
  • Konrad Group is seeking a Consultant in Strategy & Technology who excels in delivering digital projects and guiding clients through the Design Thinking Process. You will work collaboratively...  ...impactful user experiences leveraging AI and technology. With at least 2 years... 

    Socket.dev

    New York, NY
    3 days ago
  • Mindrift, powered by Toloka, is launching a Management Consulting domain to translate real-world consulting...  ...into structured learning environments for advanced AI systems. We are assembling a team of strategy consultants from top-tier firms who can convert authentic... 
    Remote job

    Mindrift

    New York, NY
    4 days ago
  • $80k - $90k

     ...seeking a Learning Experience Designer to support the creation...  ..., video content, and training assets while partnering with...  ...and basic editing using AI-driven and traditional...  ...accessibility and alignment with L&D strategy Participate in the evaluation of learning effectiveness... 
    Training
    Temporary work
    Work at office
    Local area

    Metropolis Corp

    New York, NY
    4 days ago
  • $60 - $85 per hour

     ...Licensed Chemical Engineer & AI Evaluation Specialist - $60-$85/hour...  ...sharing a specialised part-time consulting opportunity for licensed US...  ...experience in process design, process safety, plant operations...  ...calculations, and technical training materials Collaborate asynchronously... 
    Training
    Hourly pay
    Full time
    Contract work
    Part time
    Remote work
    10 hours per week
    Flexible hours

    24-MAG LLC

    New York, NY
    22 days ago
  •  ...leading security-first enterprise AI company. We build cutting‑edge...  ...and end‑to‑end products that are designed to solve real-world business problems. We’re training and deploying frontier models...  ...Paris. Join us! Why this role? Evaluation is critical to making progress in... 
    Training
    Full time
    Work at office
    Local area
    Remote work
    Home office

    cohere

    New York, NY
    2 days ago
  • $240k - $330k

    Technical Strategist for AI Research - CTO Office Location...  ...of Bloomberg L.P. We envision, design, and prototype the next generation...  ...computing infrastructure and strategy, open source stewardship,...  ...market conditions, education/training and skill level. We offer one... 
    Training
    Temporary work
    For contractors
    Work experience placement
    Work at office

    Bloomberg

    New York, NY
    11 hours ago
  • Overview About Handshake AI Handshake is building...  ...-specific data and evaluation at scale. This is a unique...  .... As a Learning Design Lead, you'll be the tactical...  ...ship, and iterate on training solutions — ensuring...  ..., or technical consulting where you've had to rapidly... 
    Training
    Work at office
    Worldwide
    Flexible hours
    Shift work

    Handshake

    New York, NY
    4 days ago
  • $110k - $150k

     ...expertise, and the power of technology, we design and deliver tailored, sustainable, and...  .../General Manager, Sales Manager, Sales Consultant and F&I Knowledge and understanding of...  ...limited to skill sets, experience and training, and other business and organizational needs... 
    Training

    MSX International

    New York, NY
    10 days ago
  • # User Experience Designer IIIApply**Job#: 30...  ...Responsibilities:**•UX Strategy & Design...  ...Research & Experience Evaluation: Provide UX expertise...  ...experience using AI tools in the...  ...career resources, training, certifications, development...  ...team for our Consultants that can address questions... 
    Training
    Hourly pay
    Contract work
    Work experience placement

    Apex Systems

    New York, NY
    4 days ago
  • $150k - $200k

     ...EPAM is seeking a Design Strategist to join our growing practice. In this client-facing, strategy-forward role, you will dig into complex...  ...Actively engage with and apply AI tools and emerging...  ...experience, credentials, education, training, the demand for the role; and... 
    Training
    Temporary work
    H1b
    Remote work
    Flexible hours

    EPAM Systems Inc

    New York, NY
    5 days ago
  • $60k - $75k

     ...Watches, Wine and Spirits and Design, as well as collectible cars and...  ...ROLE Sotheby's Client Strategy team develops and implements strategies...  ...working with digital and AI tools, researching prospective...  ...including relevant skills, training, experience, education, and, where... 
    Training
    Local area

    Sotheby's

    New York, NY
    4 days ago
  • A leading clinical AI firm in Canada is seeking a professional with a doctorate in Psychology to analyze clinical interactions for AI training and provide expert feedback on psychotherapy datasets. Candidates must have substantial experience in cognitive behavioral therapy... 
    Training
    Remote job
    Full time

    Crossing Hurdles

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Strategy Consultant: AI Training Design & Evaluation. Be the first to apply!