AI Operations Lead (Human-in-the-Loop) - NYC-based
Temporary
Welo Data
Lead the Teams Shaping the Future of AI – On-Site [NYC]
Are you a strategic leader who thrives at the intersection of data quality and people operations? Welo Data is seeking a Data Quality Lead to oversee high-impact teams of analysts dedicated to AI model evaluation.
This isn’t just a management role—it’s an opportunity to define how quality is measured in a human-in-the-loop environment. You will act as the bridge between technical stakeholders and analyst teams, translating complex AI guidelines into clear, actionable operational excellence.
The Mission: Quality Leadership at Scale
- Team Architecture : Lead and mentor a specialized team of Data Quality Analysts, fostering growth and managing high-performance output.
- Quality Ownership : Own the end-to-end quality loop, including audits, calibrations, and the identification of model performance trends.
- Strategic Translation : Turn ambiguous, evolving AI guidelines into structured direction for your teams.
- Stakeholder Partnership : Act as the primary representative for your team, aligning with global stakeholders on quality standards and program goals.
- Operational Innovation : Drive continuous improvement across tooling, evaluation methods, and hiring for specialized linguistic talent.
Project Details
- Job Title: AI Operations Lead
- Employment Type: W2 Full-Time Employee
- Hours: 40 hrs/week
- Location: New York City
Premium Perks & Benefits
This role offers more than just a paycheck—it includes a world-class workspace experience:
- Gourmet Dining: Free breakfast, lunch, and dinner with a wide variety of cuisines.
- Wellness & Insurance: Comprehensive Medical, Dental, and Vision coverage + 401(k) and HSA.
- Time Off: 15 days of combined Paid Sick/Holiday time + Memorial Day and Labor Day.
- Campus Culture: Access to micro-kitchens, premium coffee, and unique features like rooftop nature parks.
- Commuter Support: Free shuttles, transport benefits, and bike-to-work perks.
Who We’re Looking For
- Industry Veteran : 5–8 years of experience in Data Quality, QA, or AI/ML operations.
- Proven Leader : 2+ years of experience managing teams in a high-scale data or AI environment.
- Strategic Mindset : Ability to "zoom out" to see patterns while maintaining deep attention to detail.
- Operational Agility : Comfortable navigating ambiguity and balancing speed with rigorous quality standards.
- Technical Interest : A genuine curiosity about how human feedback shapes the behavior of Large Language Models (LLMs).
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the AI Operations Lead (Human-in-the-Loop) - NYC-based in New York, NY vacancy
$38 per hour
Lead the Teams Shaping the Future of AI - On‑Site [NYC] Are you a strategic leader who thrives at the intersection of data quality and people operations? Welo Data is seeking a Data Quality Lead to oversee... ...is measured in a human‑in‑the‑loop environment. You will act...SuggestedFull time- ...A healthcare communication startup based in New York is looking for a strategic Operations Manager to assist the CEO and manage critical AI initiatives. The role requires 2-4 years of... ...skills, excited to work directly in the NYC office. The company offers meaningful equity...SuggestedWork at office
Clarion
New York, NY4 days ago - A healthcare communication startup is seeking an Operations Manager to support strategic initiatives and drive AI agent deployment. As a key player in the team, you... ...are eager to work collaboratively in-person at the NYC office. This role offers mentorship, substantial equity...SuggestedWork at office
$90k - $110k
...AI Operations Lead Location: US-NY-New York Job ID: 2026-15715 Type: NYU IT (WS1170) # of Openings: 1 Category: Business... ...technical writing. Salary and Benefits In compliance with NYC's Pay Transparency Act, the annual base salary range for this position is USD $90,000.00 to...SuggestedNew York University
New York, NY5 days ago$190k - $235.5k
...Research Operations Lead New York, New York Apply Who We Are At... ...clarifying question: what truly needs human judgment here, and what can be... ...a human. Design and build AI-powered agents and workflows... ...B2B) is a strong plus The base wage range for this position based...SuggestedCasual workWork at officeLocal areaJustworks
New York, NY3 days ago$90k - $120k
Account Executive - AI Enterprise Platform | Hybrid NYC | $90K-$120K Base Location: New York, NY (Hybrid - 3 days in-office... ...beyond inbound and BDR‑sourced leads Lead executive‑level discovery... ...ownership mentality Comfortable operating in fast‑paced, high‑growth environments...Full timeWork at office$140k - $185k
...build proprietary technology and human‑in‑the‑loop workflows to radically... ...an in‑person culture at our NYC office. The Role: This is not your typical bizops role. Operations are core to our business and... ...employer. We do not discriminate based upon race, religion, color, national...Work at officeCrosby Legal, Inc.
New York, NY5 days ago- ...a core member of our Internal AI team, you will help Rain build... ...sustain long-term impact. Establish Operational Rigor: Define success metrics... ...business impact. Iterate based on data and feedback. Support... ...structuring knowledge so that humans and agents can build on your work...Work at officeWork from homeFlexible hoursShift work
Venture Post
New York, NY3 days ago $175k - $215k
...platform for the AI era. As people... ...moving team across NYC, SF, Buenos... ...first Recruiting Operations Manager hire, you... ...You'll build and lead a team of Recruiting... ...step into a loop Who you are Experienced... .... what requires human judgment... ...an on-site role based in our NYC...Work at officeShift work$120k - $160k
...Business Operations Lead Onsite | New York City, NY Direct Hire / Permanent... ...valued client partner in the AI-driven enterprise healthcare... ...markets Able to work onsite in NYC Stable resume with progressive... ...performance HireNow Package Base Salary: $120,000 – $160,000...Permanent employmentFull timeContract workHireNow Staffing Inc
New York, NY2 days ago$100k - $150k
...Healthcare Technology / AI (B2B) Compensation: $100,000-$150,000 base salary (no variable component... ...using AI to modernize operational workflows for healthcare... ...hiring Strategy & Operations Leads to help scale the... ...Willingness to work onsite in NYC 5 days/week High integrity...Work at officeFlexible hoursShift work- Talentedge, a rapidly growing AI infrastructure startup in New York, is seeking a Strategy & Operations Manager to work closely with the founding team and manage key customer relationships. This role is suited for candidates transitioning from Investment Banking or Management...
- ...Office Manager to launch and operationalize their new NYC office. Responsibilities include daily office operations, managing vendor relationships, and ensuring a... ...The role offers competitive compensation, including base salary, bonuses, and comprehensive benefits, while...Work at office
- Network Operations Lead - Washington, DC and NYC Dfuse Technologies is an award-winning digital transformation company. By harnessing bold, next-generation... ...Provide end-to-end operational support for Cisco-based routing, switching, and related infrastructure across DFC...Remote work
- Lev seeks an AI-fluent Finance & Operations Manager to oversee budgeting, performance tracking, and vendor management in NYC. Responsibilities include developing financial forecasts, managing external bookkeepers, and leading AI-driven operational efficiency initiatives...
$7.5k
Mission Operations & AI Enablement Lead OceanX About OceanX OceanX is a nonprofit working to unlock the ocean... ...we’re building a new paradigm where humanity and the ocean mutually thrive. Our... ...specifically experience with AI agents, GPT‑based language models, or automation tools...Summer workCasual workSeasonal workWork at officeRemote workFlexible hoursAfternoon shiftEarly shift- ...America builds. We’re an applied AI company serving the nation’s... ...days per week). We prefer NYC-based candidates or those open to relocation... ...bottlenecks, and enhance operational efficiency. Ensure... ...experience: Preferred 2+ years leading, managing, and mentoring teams...Full timeFor contractorsWork at officeRelocationHome office3 days per week
- Chartis Interactive LLC is seeking an Operations Intelligence Manager for its New York City office. This hands-on role combines functions of a BI analyst and project manager, focusing on driving data-driven decision-making across various functions. The ideal candidate...Work at office
$56k - $65k
...Select how often (in days) to receive an alert: Human Resources Operations Coordinator (Multiple Locations- LA, NYC & Nashville) 45894 Los Angeles, CA, US, 90038 New... ...Skydance Corporation (NASDAQ: PSKY) is a leading global media and entertainment company that creates...Full timeInternshipWork at officeWorldwideShift workParamount Pictures
New York, NY4 days ago- ...Title: Ecommerce Lead, Hanky Panky Reports To:... ...Marketing Located: NYC HQ (Flatiron) About... ...day-to-day Shopify site operations, from homepage flips and... ...collection page merchandising based on CVR, wire framing in... ...tools like Yotpo, Rise.ai, and Loop. Partner with...Seasonal workLocal area
GELMART INDUSTRIES, INC.
New York, NY12 hours ago - Google San Bruno, CA, USA; New York, NY, USA offers an Operations Manager role focused on AI/ML data solutions and vendor operations management. You will lead end-to-end Human-in/on-the-loop programs and drive AI-ready workflows in collaboration with Business, Engineering...
- ...century — manually, by humans, in six-minute... ...delivery model around AI, and helping in‑house... ...are a lean, in‑person based in New York City, backed by leading investors and... ...with the founders, operate across every function... ...company. In‑person in NYC: Collaborative, talent...Contract workRemote work
$160k - $220k
...their customers. Our AI-powered... ...booking jobs, qualifying leads, and driving higher... ...consistency unmatched by human call centers. We... ...years across our NYC headquarters and Santa... ...hiring a Business Operations Manager to work... ...Compensation: The expected base salary for this...Work at officeImmediate startFlexible hoursNight shiftAvoca AI
New York, NY1 day ago$103.49k - $137.13k
...achieve. Together.SummaryThe Client Account Operations Lead is an advanced level Legal Biller with... ...and international accrual information based on client requirements.· Research and resolve... ...otherwise move objects, including the human body. Sedentary work involves sitting...Full timeTemporary workWork at officeRemote workRelocationVisa sponsorshipRelocation package$170k - $190k
...restaurants across the US, UK, and France, helping operators turn tables faster, increase tips, and... ...in the US. About the Role As a Team Lead in the US Operations team at sunday, you... ...and improvement of systems and processes based on daily operations and feedback from the...Work at officeRemote workSunday Defunct
New York, NY2 days ago$145k - $165k
...prominent staffing agency in New York City is seeking a Senior Office Operations Project Manager to join their team. This full-time role offers an annual salary of $145K to $165K, plus a performance-based bonus and excellent benefits. Responsibilities include planning and...Full timeWork at office- ...About the Role Taktile builds AI products for the world's most... ...looking for an AI Enablement Lead to make this the reality at Taktile... ...-leverage, internal-facing operations role: you won't be building features... .... Evolve AI architecture based on internal customer needs and...Work at officeHome office3 days per week
Taktile GmbH
New York, NY19 days ago - ...and providers connect, driven by AI, built to embrace the... ...where AI is embedded into how we operate, not layered on top. We're looking... ...APIs, and no/low‑code platforms based on what ships fastest without compromising... ...‑on‑one with each department lead to shape their quarterly AI...Work at office
Assort Health
New York, NY5 days ago $140k - $190k
...Compliance Operations Lead GovSignals New York, NY • Full-time • Hybrid (3+ days/week in... ...ABOUT GOVSIGNALS GovSignals is the AI system of work for government contracting... ...experience supporting an IC or DoD customer base; a background in government contracting,...Full timeContract workFor contractorsWork at officeShift work3 days per weekGovSignals
New York, NY5 days ago$132k - $163k
.... With proprietary AI built on over a decade... .... Backed by leading investors like Google... ...team’ alongside our human specialist teams, growing... ...team includes US-based Senior Specialists... ...and hit our core operational KPIs. You will contribute... ...on human‑in‑the‑loop (HITL) workflows...Full timeFor contractorsWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Operations Lead (Human-in-the-Loop) - NYC-based. Be the first to apply!
Related searches
- network operations center team lead New York, NY
- operations leader New York, NY
- clinical operations lead New York, NY
- operations lead New York, NY
- revenue operations New York, NY
- service operations leadership development program New York, NY
- vice president of operations New York, NY
- operations agent New York, NY
- engineering operations technician New York, NY
- finance operations New York, NY