AI Operations Lead (Human-in-the-Loop) - NYC-based
Temporary
Welo Data
Lead the Teams Shaping the Future of AI – On-Site [NYC]
Are you a strategic leader who thrives at the intersection of data quality and people operations? Welo Data is seeking a Data Quality Lead to oversee high-impact teams of analysts dedicated to AI model evaluation.
This isn’t just a management role—it’s an opportunity to define how quality is measured in a human-in-the-loop environment. You will act as the bridge between technical stakeholders and analyst teams, translating complex AI guidelines into clear, actionable operational excellence.
The Mission: Quality Leadership at Scale
- Team Architecture : Lead and mentor a specialized team of Data Quality Analysts, fostering growth and managing high-performance output.
- Quality Ownership : Own the end-to-end quality loop, including audits, calibrations, and the identification of model performance trends.
- Strategic Translation : Turn ambiguous, evolving AI guidelines into structured direction for your teams.
- Stakeholder Partnership : Act as the primary representative for your team, aligning with global stakeholders on quality standards and program goals.
- Operational Innovation : Drive continuous improvement across tooling, evaluation methods, and hiring for specialized linguistic talent.
Project Details
- Job Title: AI Operations Lead
- Employment Type: W2 Full-Time Employee
- Hours: 40 hrs/week
- Location: New York City
Premium Perks & Benefits
This role offers more than just a paycheck—it includes a world-class workspace experience:
- Gourmet Dining: Free breakfast, lunch, and dinner with a wide variety of cuisines.
- Wellness & Insurance: Comprehensive Medical, Dental, and Vision coverage + 401(k) and HSA.
- Time Off: 15 days of combined Paid Sick/Holiday time + Memorial Day and Labor Day.
- Campus Culture: Access to micro-kitchens, premium coffee, and unique features like rooftop nature parks.
- Commuter Support: Free shuttles, transport benefits, and bike-to-work perks.
Who We’re Looking For
- Industry Veteran : 5–8 years of experience in Data Quality, QA, or AI/ML operations.
- Proven Leader : 2+ years of experience managing teams in a high-scale data or AI environment.
- Strategic Mindset : Ability to "zoom out" to see patterns while maintaining deep attention to detail.
- Operational Agility : Comfortable navigating ambiguity and balancing speed with rigorous quality standards.
- Technical Interest : A genuine curiosity about how human feedback shapes the behavior of Large Language Models (LLMs).
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the AI Operations Lead (Human-in-the-Loop) - NYC-based in New York, NY vacancy
- A healthcare communication startup is seeking an Operations Manager to support strategic initiatives and drive AI agent deployment. As a key player in the team, you... ...are eager to work collaboratively in-person at the NYC office. This role offers mentorship, substantial equity...SuggestedWork at office
- ...is a new kind of claims operations partner for health... ...clinicians and transparent AI, we deliver deeper insights... ...B healthtech startup based in NYC and are actively... ...RoleAs our Internal AI Lead, you will sit within Business... ...knowledge so that both humans and agents can build on...SuggestedVisa sponsorshipWork visaShift work
- ...the Role We're looking for a hands‑on AI Operations Lead to help us move faster and smarter as we... ...and demonstrate business impact. Iterate based on data and feedback. Build Internal AI... ..., and structuring knowledge so that humans and agents can build on your work. You...SuggestedFull timeWork at officeWork from homeFlexible hoursShift work
P2P
New York, NY2 days ago $90k - $110k
...AI Operations Lead Location: US-NY-New York Job ID: 2026-15715 Type: NYU IT (WS1170) # of Openings: 1 Category: Business... ...technical writing. Salary and Benefits In compliance with NYC's Pay Transparency Act, the annual base salary range for this position is USD $90,000.00 to...SuggestedNew York University
New York, NY2 days ago$140k - $185k
...build proprietary technology and human‑in‑the‑loop workflows to radically... ...an in‑person culture at our NYC office. The Role: This is not your typical bizops role. Operations are core to our business and... ...employer. We do not discriminate based upon race, religion, color, national...SuggestedWork at officeCrosby Legal, Inc.
New York, NY2 days ago$75k - $85k
...model for how people enter the AI economy. Through our AI... ...Factory™, offering exposure to AI operations, innovation management,... ...This is a hybrid role based across the NYC Tri-State Area and our Jersey... ...job title. Is comfortable leading in ambiguity and applies Agile...Relocation packageAgile Apprentice University
New York, NY4 days ago$175k - $215k
...platform for the AI era. As people... ...moving team across NYC, SF, Buenos... ...first Recruiting Operations Manager hire, you... ...You'll build and lead a team of Recruiting... ...step into a loop Who you are Experienced... .... what requires human judgment... ...an on-site role based in our NYC...Work at officeShift work- Lev seeks an AI-fluent Finance & Operations Manager to oversee budgeting, performance tracking, and vendor management in NYC. Responsibilities include developing financial forecasts, managing external bookkeepers, and leading AI-driven operational efficiency initiatives...
- Network Operations Lead - Washington, DC and NYC Dfuse Technologies is an award-winning digital transformation company. By harnessing bold, next-generation... ...Provide end-to-end operational support for Cisco-based routing, switching, and related infrastructure across DFC...Remote work
$56k - $65k
...Select how often (in days) to receive an alert: Human Resources Operations Coordinator (Multiple Locations- LA, NYC & Nashville) 45894 Los Angeles, CA, US, 90038 New... ...Skydance Corporation (NASDAQ: PSKY) is a leading global media and entertainment company that creates...Full timeInternshipWork at officeWorldwideShift workParamount Pictures
New York, NY1 day ago- ...in New York City is looking for a highly organized Executive Operations Coordinator to support their executive team. This role... ...thrive in a fast-paced startup environment. Applicants should be based in the NYC metro area and able to work on-site a few days a week. #J-1...Work at office
- ...century — manually, by humans, in six-minute... ...delivery model around AI, and helping in‑house... ...are a lean, in‑person based in New York City, backed by leading investors and... ...with the founders, operate across every function... ...company. In‑person in NYC: Collaborative, talent...Contract workRemote work
$170k - $190k
...restaurants across the US, UK, and France, helping operators turn tables faster, increase tips, and... ...in the US. About the Role As a Team Lead in the US Operations team at sunday, you... ...and improvement of systems and processes based on daily operations and feedback from the...Work at officeRemote workSunday App, Inc
New York, NY3 days ago- ...and providers connect, driven by AI, built to embrace the... ...where AI is embedded into how we operate, not layered on top. We're looking... ...APIs, and no/low‑code platforms based on what ships fastest without compromising... ...‑on‑one with each department lead to shape their quarterly AI...Work at office
Assort Health
New York, NY2 days ago $150k - $200k
...growing Behavioral AI company on a mission... ...models of human behavior grounded in... ...and decisioning for leading brands and agencies... ...Bay Area, Seattle, NYC) World‑class team of... ...Benefits Competitive Base Salary Meaningful equity... ...Head of Business Operations & Strategy to identify...Remote workYobi AI
New York, NY1 day ago$150k - $200k
...growing Behavioral AI company on a mission... ...models of human behavior grounded... ...and decisioning for leading brands and agencies... ...Bay Area, Seattle, NYC) World-class team... ...~ Competitive Base Salary ~ Meaningful... ...the Head of Business Operations & Strategy to identify...Remote workYOBI, LLC
New York, NY2 days ago- Director of Site Operations Full Time, NYC Area Preferred About Montauk Capital Montauk... ...of consequence. About Edge AI Inc Co‑founded by Montauk... ...routes traffic based on demand proximity and real... ...capacity, existing condenser water loops, and electrical systems for...Full timeFor contractorsShift work
- Distributed Spectrum is looking for a Mission Operations Lead to deploy and operate AI-driven RF sensors in various environments. The ideal candidate has... ...benefits package, including flexible PTO and daily lunches in NYC. U.S. citizenship is required. #J-18808-Ljbffr...Flexible hours
$100k - $145k
...investment firm is seeking an Office Manager to oversee daily operations in New York. This role involves managing office logistics, supporting... ...comes with a competitive salary range of $100,000 to $145,000 based on experience, and offers a variety of benefits including...Work at office$120k - $150k
A tech-driven company based in New York is seeking a CX Operations Manager to enhance customer support processes. The ideal candidate will manage Zendesk workflows, implement AI tools, and collaborate with leadership. Applicants must have at least 3 years of Zendesk experience...- skape Industries LLC is seeking an Operations Lead to manage our marketplace operations in the NYC/Long Island area. You'll recruit and onboard landscaping professionals, ensure high service quality, and handle customer escalations swiftly. This role is ideal for someone...Remote job
$109k - $128k
Daloopa, Inc. is looking for an Office Operations & Administrative Manager to ensure our NYC headquarters run smoothly. You will coordinate logistics, manage vendors, and support senior leadership while fostering a calm and efficient office environment. The ideal candidate...Full timeWork at office$68k - $73k
Columbia University is seeking a Program Administrator for the Smith Family Human Rights Clinic in New York. This role involves managing operations, assisting the Director, and coordinating events related to human rights advocacy. Ideal candidates will have a Bachelor's...Work at office$70k - $130k
Redemptive Studios is seeking a versatile operator for a hybrid role in the Greater New York City Area. You will partner closely with the... ...compensation ranging from $70K to $130K with performance-based multipliers. Candidates should have 3-5 years of relevant experience...- byebyeoffice in New York is looking for an experienced Fraud Operations Manager to lead their fraud prevention program. You will define strategies,... ...management. This hybrid role requires attendance at the NYC office 3-4 days a week. #J-18808-Ljbffr byebyeofficeWork at office3 days per week
$124k - $206k
Payoneer Inc. is seeking a Regional Senior Manager, Workplace Operations, based in New York City. This role involves overseeing daily operations, managing teams to ensure efficient office management, and optimizing space utilization. The ideal candidate has over 6 years...Work at office$85k - $150k
...Oppenheimer & Co. Inc. (“Oppenheimer”) is a leading middle‑market investment bank and full‑... ...The firm is seeking a Senior Branch Operations Manager to join Oppenheimer’s flagship branch... ...needs. A reasonable estimate of the current base salary range is $85,000.00 - $150,000.00...Work at officeLocal area$140k - $185k
...proprietary technology and human-in-the-loop workflows to... ...way to deploy AI in law isn’t by selling... ...culture at our NYC office. About the... ...Strategic Project Lead, you will be at the... ..., Lawyers and Operations teams to implement... ...not discriminate based upon race, religion...Work at officeFlexible hoursCrosby Legal, Inc.
New York, NY1 day ago$110k - $180k
...Elayne is hiring a Customer Operations Lead to own the post-loss... ...process mapping, and AI-enabled workflow automation... ...work, and make sure humans are present for the... ...3. A product feedback loop rooted in user feedback... ...This is a full-time role based with the rest of the team...Full timeWork experience placementLocal areaRemote workShift work3 days per weekElayne
New York, NY3 days ago$130k - $150k
.... Location: NYC Metropolitan Area... ...high-quality operations that align with... ...Build strong, trust-based relationships... ...Process Improvement: Lead the rollout of... ...and closing the loop on all next... ...artificial intelligence (AI) tools to... ...do not replace human judgment. Final...Full timeTemporary workWork at officePlaybook
New York, NY4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Operations Lead (Human-in-the-Loop) - NYC-based. Be the first to apply!
Related searches
- operations lead New York, NY
- operations leader New York, NY
- network operations center team lead New York, NY
- clinical operations lead New York, NY
- vice president technical operations New York, NY
- senior vice president of operations New York, NY
- deposit operations New York, NY
- field operations technician New York, NY
- engineering operations technician New York, NY
- operations chef New York, NY