AI Evaluation Platform Lead: Scale Agent Quality
Dormont Manufacturing Co
Dormont Manufacturing Co is seeking an experienced Engineering Manager for its Evaluation Platform team within Procore’s Construction Intelligence organization in Austin, Texas. This pivotal role involves building evaluation frameworks and delivering tools for assessing AI agent quality. The ideal candidate should have 5+ years of management experience and a strong technical background in software engineering, specifically in evaluation and observability platforms. #J-18808-Ljbffr Dormont Manufacturing Co
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Evaluation Platform Lead: Scale Agent Quality in Austin, TX vacancy
$60 per hour
...ethically shape the future of AI. What We Do The Mindrift platform, launched and powered by... ...AI systems are tested and evaluated, we want to hear from you.... ...experts for autonomous AI agents in a project focused on... ...project, you will balance quality assurance, research, and logical...PlatformQualityFreelanceRemote workFlexible hours$110k - $160k
...technical, high-agency AI Agent Product Manager to... ...using structured evaluation, testing, and real... ...end-to-end Lead delivery of net-new... ...timelines, ensure quality Own the customer-... ...using our internal platform—prompts, tools, guardrails... ...spent 3.5 years scaling Carbon Health's...PlatformQuality- ...now we’re expanding our platform to solve broader sales... .... About the Role AI agents are becoming central to... ...business metrics. You’ll lead the AI Platform team —... ...layer, and the evaluation and observability infrastructure... ...of delivering high‑quality results across the...PlatformQualityWork at officeRemote workFlexible hoursShift work3 days per week
Dormont Manufacturing Company
Austin, TX15 hours ago - ...Co-Founder & CEO to lead HawkAI, an enterprise AI venture for US logistics... ...databases. The platform handles track-and-trace... ...software to market at scale. You’ll co‑create with... ..., conversational AI quality, and autonomous workflow... ...familiarity in AI agents/LLMs How to Apply Please...PlatformQuality
- ...Investigate cross-platform component library technologies and build... ...proof‑of‑concept applications to evaluate their features and... ...Architect and develop multi‑step AI agents that integrate with UI component... ...independently to deliver high‑quality, well‑tested code. Ideal...PlatformQualityPermanent employmentContract workLocal area
Cloud Hybrid Technologies LLC
Austin, TX2 days ago - Opportunity As our AI Enablement & Quality Lead, you’ll be the central force driving... ...autonomous AI agents, going beyond simple LLM use... ...development principles and cloud platforms (AWS, Azure, GCP). Experience... ...Experience world‑class leadership Scale of impact and purpose A...PlatformQualityFlexible hours
- ...We are seeking an AI Agent Engineer to design, build... ...enterprise AI search/assistant platforms) is a strong plus.... ...and maintain evaluation frameworks, metrics, and... ...agent behavior and output quality. Document agent... ...the responsibility to lead the change that will make...PlatformQualityLocal areaWork from homeRelocationRelocation package
General Motors
Austin, TX4 days ago - ...around the globe. Our AI‑powered labor marketplace... ...helps local businesses scale, and enables global... ...through recording high‑quality video and sensor data of... ...Instawork is the nation’s leading online labor... ...and more. Our AI‑powered platform serves thousands of businesses...PlatformQualityHourly payLocal area10 hours per weekFlexible hoursShift workWeekend work
- ...data, machine learning, AI, and Industrial data... ...DataOps. What You'll Do Lead the system design, architectural... ...degree of ambiguity, scale and complexity. Build... ...the path forward to quality-driven production. Who... ...core Industrial DataOps platform, Cognite Data Fusion™,...PlatformQuality
$168.56k - $231.77k
...Engineering Manager for our Evaluation Platform team to join Procore’s... ...benchmark, and improve the quality of AI agents — including Search Agent, RFI... ...immediately. What you’ll do: Lead and grow a team of... ...pipelines to compute them at scale. Design and deliver user-facing...PlatformQualityWork at officeLocal areaImmediate start2 days per week$116k - $195k
...thrive with our open, AI-driven commerce... ...of conversational AI agents spanning the B2B commerce... ...ADK with Gemini, with evaluation infrastructure in Braintrust... ...to ship. Agent quality in this domain is won... ..., we provide the leading e-commerce platform. Our customers can then...PlatformQualityFull timeWork at officeLocal areaRemote work3 days per week$136.9k
Senior Software Engineer, AI Platform & Agents Coalition is the world's first... ...Senior Software Engineer to lead the development of our internal... ...RAG systems, ensuring high-quality, real-time data retrieval... ...principles including horizontal scaling, 12-factor application...PlatformQualityFixed term contractWork experience placementWork at officeRemote workHome officeFlexible hours$7,000 per month
...earth's finest AI Care Partner. In... ...Team Lead to drive the engineers... ...investigation quality, and building durable... ...reliable at scale. What you'll do... ...), and support platforms (Intercom). Experience... ...and LLM/agent‑enabled... ...permissioning, guardrails, evaluation). Bachelor’s...PlatformQualityLive inRemote workHome office$150k - $205k
...the definitive platform for intentional... ...strategy for data and AI/ML products at... ...leverage it at scale? You'll own... ...space. Lead the development... ...products such as agent-driven reporting... ...Lead ideation, evaluation, definition, and... ...can drive UX quality even without a...PlatformQuality$175k - $275k
...Applied Data Scientist, LLM Evaluation Introduction At Driver,... ...context engineering at scale. Driver builds the... ...layer for employees and AI agents alike to use in developing... ...is directly tied to the quality of our content at scale. The platform generates technical documentation...PlatformQualityRemote jobFull timeFlexible hours- GigaBrands is looking for an AI Full Stack Engineer to build and scale AI-powered infrastructure in... ...pipelines, automate lead qualifications, and improve content quality systems. Required skills include... ...systems in our fast-growing platform. #J-18808-Ljbffr GigaBrandsPlatformQuality
- ...developer to investigate and implement cross-platform technologies. The role involves architecting multi-step AI agents and enhancing component libraries. Ideal candidates... ...a self-driven approach to producing high-quality software. Join a diverse team committed to equal...PlatformQuality
$149.35k - $248.85k
..., and self-service platform — with a dotted line... ..., and influence at scale without the day-to-... ..., Cloud Strategy Lead, you set and drive... ...patterns, and module quality gates Architect and... ...Embed agentic AI capabilities into the... ...review, MCP-backed agents for internal data,...PlatformQualityWork experience placementWork from home$150k - $170k
...company on a path to become a leading U.S. retail platform. We believe every client and... ...to ensure implementation quality Create governance processes... ...to create brand systems that scale across digital and print Strong... ...Experience leveraging AI tools to accelerate design workflows...PlatformQuality- ...us? Handoff is the AI agent that runs a... ...flowing through our platform, we’re becoming the... ...other channels. Lead SEO strategy, including... ...elevate content quality across all outputs... ...external contributors to scale production... ...ability to produce and evaluate high‑quality...PlatformQualityFor contractorsRelocation packageFlexible hours
- ...generation computing experiences—from AI and data centers, to PCs,... ...one of AMD AECG's industry leading products. You will be driving... ...system definition, chip design, platform, product and/or program... ...product, software, ecosystem, quality and business functions Responsible...PlatformQuality
$110.9k - $122.6k
...environment. The role evaluates and authorizes change requests... ...items. Use ITSM platforms such as ServiceNow or similar... .../problem management leads to ensure change... ...improve documentation quality, and meet compliance expectations... ...managing large‑scale change portfolios in complex...PlatformQualityContract workWork experience placementWork at office$236k - $330k
...specifically sub-5nm or leading-edge nodes).... ...programs. Experience evaluating third‑party IP for... ...compliance, quality standards, and integration... .... The scale at which Google operates... ...SSCE) to support our AI and cloud... ...generation of Google platforms, we make Google's...PlatformQuality- ...Responsibilities: · Investigate cross-platform component library... ...proof-of-concept applications to evaluate their features and... ...Architect and develop multi-step AI agents that integrate with UI component... ...to deliver high-quality, well-tested code. Ideal Candidate...PlatformQuality
$60 per hour
...A leading AI firm in Austin is looking for QA experts to validate and improve AI systems. This remote... ...to detail. Candidates will review AI evaluation tasks, identify inconsistencies, and define expected behaviors for agents. Ideal applicants have experience in policy...FreelanceRemote workMind Rift
Austin, TX2 days ago- ...'ll drive the next generation of field application platform initiatives, leveraging your native iOS expertise to... ...s in Computer Science. You'll mentor teammates and lead architectural decisions while ensuring high-quality project completion. #J-18808-Ljbffr Procore...PlatformQuality
- ...operating digital businesses at scale. With a presence across 60 platforms, content distributed in 21... ...'s brand new business and AI platform that turns mid-... ...a Client Deployment Lead to embed on-site alongside... ...company. Our team carefully evaluates each application to identify...PlatformInterim roleLocal areaRemote workShift work
TheSoul Group
Austin, TX14 days ago $180k - $230k
...Patient is seeking a Prompting & AI Agent Research Engineer to bring... ...ll Do Experimentation & Evaluation Design structured... ...founding team spent 3.5 years scaling Carbon Health's technology during... ...in phone tag. Our AI platform proactively engages patients...PlatformLocal areaHello Patient
Austin, TX4 days ago$140k - $170k
...We’re looking for a Sr. Lead, Partner Management who... ...Define, build, and scale audit mechanisms and metrics... ...You Found It — raise quality, clarify systems, and document... ...reward and recognition platform empowers peers to... ...actionable goals and evaluating progress across the organization...PlatformQualityFull timeContract workFlexible hours$129.5k - $186.1k
...workforce operating platform. Helping people get... ...execution-oriented Lead Product Manager to... ...• Conversational AI and digital engagement... ...frameworks Data quality standards •... ...support both enterprise-scale campaigns and targeted... ...employer. We evaluate qualified applicants...PlatformQualityTemporary workLocal areaRemote workUKG
Austin, TX2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Platform Lead: Scale Agent Quality. Be the first to apply!
Related searches
- special agent Austin, TX
- freight agent no experience Austin, TX
- import export agent Austin, TX
- sourcing agent Austin, TX
- telemarketer - state farm agent team member Austin, TX
- operations agent Austin, TX
- state farm agent Austin, TX
- executive protection agent Austin, TX
- airport agent Austin, TX
- work from home chat agent Austin, TX