AI Quality Platform PM Observability & Evaluation
Ridge Line Services
Ridgeline, Inc. is seeking an AI Product Manager for the AI Platform - Quality and Evaluation to define and drive the strategy for our AI quality capabilities. You will lead initiatives spanning LLM evaluation, model benchmarking, evaluation harnesses, and observability to improve production AI performance across Ridgeline’s products. You will work with engineering, AI researchers, design, and product teams to deliver scalable platform features that quantify AI quality, enable continuous #J-18808-Ljbffr Ridge Line Services
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Quality Platform PM Observability & Evaluation in New York, NY vacancy
$163.1k - $218.7k
...building the products and platforms that will power our... ..., media engineering, quality assurance, engineering... ...lifecycle, and identity.The Observability & Insights group... ...and build intelligent, AI driven systems that... ...prompt design, model evaluation, and fine-tuning foundation...PlatformQuality$258k - $376k
...accessible to all. Figma’s platform helps teams bring... ...code, or iterating with AI. From idea to product,... ..., join us!Figma’s Observability engineering team builds... ...raising the bar on signal quality and operational... ...data infrastructure, or evaluation systems for AI or machine...PlatformQualityMinimum wageFull timeLocal areaRemote workFlexible hours$136k - $170k
...passionate about building AI products that customers can trust by making quality measurable rather than subjective... ...and researchers to evaluate large language models, improve... ...the future of AI quality, observability, and evaluation platforms that power intelligent applications...PlatformQuality$192k - $240k
...mission to build the best platform in the world for... ...problems the right way.The Observability Data Platform (ODP) is... ...market trends relating to AI-native infrastructure... ...quickly with engineers, PM peers, designers, and... ...and committed to high quality standardsBonus: Experience...PlatformQualityWork at office- ...a Senior Vice President, AI Governance - Safety & Observability to help mature the firm’s... ...AI adoption scales across platforms, workflows, and business... ...including usage, output quality, safety signals, policy adherence... ...evidence, and move from evaluation to production with...PlatformQualityWorldwideFlexible hours
$229.9k - $262.4k
Senior Lead AI Engineer (SDK's: Gen AI Evaluation and MCP) Overview At Capital One, we are... .... Our AI models and platforms empower teams across Capital... ...experimentation, governance, and observability, etc. Leverage a broad... ..., take pride in the quality of your work, and also...PlatformQualityFull timePart timeLocal area- ...product scenarios and create high-quality reference deliverables reflecting senior-level PM work. The role focuses on PRDs,... ...functional communication. No prior AI experience is required. The... ...assignment emphasizes designing and evaluating PM work, with remote US-based locations...QualityRemote jobContract work
- ...engagement management service enablement platforms.Inherent throughout our tech... ...experiences and client partnerships.As a QA / AI Evaluation Engineer, you will join a highly motivated... ...the platform actually improves answer quality. You will run evaluations at scale — from...PlatformQualityImmediate start
$192k - $240k
...mission to build the best platform in the world for... ...problems the right way. The Observability Data Platform (ODP) is... ...trends relating to AI‑native infrastructure patterns... ...with engineers, PM peers, designers, and commercial... ...and committed to high quality standards. Bonus:...PlatformQualityWork at office- Bloomberg is seeking a Technical Product Manager for AI Platforms within the CTO Office in New York. You will shape the GenAI quality infrastructure, defining foundational capabilities to evaluate, remediate, and govern AI systems at scale. You will drive end-to-end user...PlatformQualityWork at office
$280k - $350k
...Director of Product Management to lead our AI Observability portfolio and shape how organizations... ...while ensuring the delivery of high-quality, AI-powered features.Collaborate with cross... ...the leading observability and security platform for the AI era, providing businesses...PlatformQualityTemporary workWork at office$100k - $160k
...role sits at the intersection of data, AI, and PM Infrastructure—driving the MAS data strategy... ...& AI Strategy to deliver core platform builds. Working day‑to‑day with Portfolio... ...Infrastructure & AI initiatives, including data quality thresholds, validation rules, and...PlatformQualityFull timeTemporary workPart time- ...is building the agentic operating system for AI deployment across the world’s most important organizations. The Platform PM determines foundational needs and sets the bar... ...patterns for core graduation, maintaining quality, and enabling delivery teams to focus on solving...PlatformQuality
$60 - $80 per hour
...technical talent with leading AI research labs. Headquartered in... ...in real retail practice. Evaluate AI model outputs against structured... ..., judgment, and reasoning quality. Develop and refine... ...about the interview process and platform information, please check:...PlatformQualityContract workSummer workRemote workWeekday workMercor
New York, NY3 days ago$225k - $275k
...DescriptionThe VP, AI Product Manager is... ...that builds the platform to solve them.This... ...partner with vertical PM tech teams and run... ...through build, evaluation, staged rollout, and... ...case — retrieval quality benchmarks, output... ..., monitoring of observability metrics, and iteration...PlatformQualityFull timeTemporary workWork experience placementFlexible hours- Webflow is seeking a Senior Product Manager for AI surfaces, focusing on the AI Assistant, 3rd-party agents... ...agent instructions, and shape the underlying platform primitives. You’ll establish quality bars, evaluations, and guardrails for non-deterministic products while...PlatformQuality
$70 per hour
...technical talent with leading AI research labs.... ...Role Responsibilities Evaluate AI-generated... ...improve training data quality and downstream performance... ...beyond surface-level observations. Apply strict attention... ...interview process and platform information, please...PlatformQualityContract workSummer workRemote work- ...contributor to shaping the "brain" of our AI. Working closely with the STEM Lead... ...create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity,... ...amenable to working with new tools and platforms for content creation and AI...PlatformQuality
- A leading data platform company located in New York is seeking a Senior Product Manager to lead the product roadmap for observability platforms. The role involves working closely with cross-functional teams, translating customer needs into product requirements, and making...Platform
- ...Number: 26-00001Title: AI EvangelistLocation:... ...for code security and quality assurance across SDLC.... ...production reliability and observability.RAG frameworks like... ...vector search, vector DB platforms (FAISS, Pinecone,... ...retrievalObservability & Evaluation: Setting up logging,...PlatformQualityFull timeBank staff
$30 per hour
...not just another player in the AI space - we are building the biggest pool of quality human data in the world. About Prolific... ...Experts for a high-level AI evaluation project. AI models are evolving... .... Why Prolific is a great platform to join as a Participant Joining...PlatformQualityRemote jobWork from homeFlexible hours$70 - $110 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated financial plans , budgets, and forecasts for quality and accuracy. Compare AI-generated... ...the interview process and platform information, please check:...PlatformQualityHourly payContract workSummer workWork at officeImmediate startRemote workMercor
New York, NY7 days ago$139k - $220k
...You’ll Do: Join CoreWeave’s Observability team, responsible for building... ...unparalleled visibility into complex AI workloads. Our team empowers... .... You’ll also contribute to platform strategy and participate in... ..., robust systems with high‑quality code, automated testing, and...PlatformQualityPermanent employmentTemporary workCasual workWork at officeFlexible hours$153.71k - $267.03k
...currently seeking a Manager, AI Engineer to join our... ...ML with enterprise platforms Manage AI projects including... ...; oversee deliverable quality and timelines, while... ..., and tools, and evaluate their applicability for... ...calendar of holidays to be observed during the year and...PlatformQualityFull timeH1bLocal areaKPMG
New York, NY10 days ago$143k - $210k
...The Essential Cloud for AI. Built for pioneers by... ...CoreWeave delivers a platform of technology, tools,... ...through orchestration, observability, and the broader AI... ...training, fine-tuning, evaluating, and deploying deep learning... ...match. Here are a few qualities we’ve found compatible...PlatformQualityPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$60 - $130 per hour
Job Title Finance & Consulting Expert (AI Training) Salary $60-$130/hr Company Description Venture-backed AI evaluation platform Job Description You will train and evaluate... ...prestigious backgrounds dedicated to elevating the quality and reasoning of AI outputs. What You...PlatformQualityRemote work- AI/ML Engineer**** Please note: This role is not eligible for 100% remote... ...leaders. We work across modern AI platforms, develop novel AI solutions, and... ....* Experience with AI validation, evaluation, observability, and production quality metrics such as accuracy, groundedness...PlatformQualityTemporary workWork at officeLocal area3 days per week
$143k - $210k
...The Essential Cloud for AI. Built for pioneers by... ...CoreWeave delivers a platform of technology, tools,... ...through orchestration, observability, and the broader AI... ...development, research velocity, evaluation, production deployment... ...match. Here are a few qualities we’ve found compatible...PlatformQualityPermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours- ...Engineer on the Search Platform team, you will own and... ..., and relevance quality.ML Model Development &... ...robust monitoring and evaluation harnesses.Agentic Search... ...Partner with Rovo and AI platform teams to evolve... ...Cost DisciplineDrive observability, monitoring, and incident...PlatformQualityWork at officeLocal area
$150k - $175k
...consumers. Our predictive AI orchestrates outcomes on any platform customers are on, across... ...strategies and develop, evaluate, and demonstrate prototypes... ..., Software Engineers, Quality Assurance Engineers, and... ...policy and company breaks11 observed Federal holidaysSummer Fridays...PlatformQualityTemporary workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Quality Platform PM Observability & Evaluation. Be the first to apply!
Related searches
- quality lead New York, NY
- water quality scientist New York, NY
- quality management nurse New York, NY
- quality manufacturing New York, NY
- vice president of quality New York, NY
- quality equipment New York, NY
- quality improvement nurse New York, NY
- quality advocate New York, NY
- rn quality New York, NY
- supplier quality New York, NY