AI Evaluation Engineer
Insight Global
AI Evaluation Engineer
Required Skills & Experience - 5+ years of experience working in AI/Data Science
Evaluation framework and metric build/establishment for projects
Python (Ragas/DeepEval)
Job Description Insight Global is currently seeking an AI Evaluation Engineer for a large pharmaceutical client. This person will join a team responsible for AI project/platform builds supporting business groups. This person will focus on the establishment and build of evaluation frameworks to measure the success and reliability of innovative AI builds. This person should have extensive experience in AI evaluation project work in an enterprise environment.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer in Ambler, PA vacancy
- ...M3 USA. Due to our continued growth, we are hiring for an AI Engineer. Job Description The AI Engineer will build AI-powered... ...latest agentic coding techniques, tools, and best practices. Evaluate emerging capabilities and share informed opinions on what...SuggestedRemote jobWork experience placementLocal areaFlexible hours
M3USA
Fort Washington, PA6 days ago $122k - $240.5k
...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations... .../chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry.Deliver governed datasets and feature engineering/serving...SuggestedLocal areaVisa sponsorshipDeloitte
Philadelphia, PA4 days ago$91.1k - $179.5k
Position Summary Agentic AI is moving from experimentation to production, and... ...responsibly and at scale. We're growing a team of engineers who want to work at the center of that... ..., tool integration, state management, evaluation, guardrails, and human-in-the-loop...SuggestedWork at officeLocal areaVisa sponsorshipShift workDeloitte
Philadelphia, PA2 days ago- ...That work changes the operating model an engineering organization runs on, the ways of working... ...sets the target. What we design from it is AI-native by construction. We redesign... ...libraries, standards, and governance processes.Evaluate and optimize AI performance using...SuggestedFull timeWork experience placementLive inWork at officeLocal area
Accenture
Philadelphia, PA2 days ago $91.1k - $179.5k
...significant impact on our clients’ success. We are hiring an AI Engineer to build and operate the data, features, and GenAI foundations... .../chunking, embeddings, vector/hybrid search, and retrieval/evaluation telemetry.Deliver governed datasets and feature engineering/serving...SuggestedLocal areaDeloitte
Philadelphia, PA4 days ago- ...Job Description Job Description AI Engineer – Conversational AI – Own a Production Voice Agent End-to-End Philadelphia, PA Take... ...optimization for real-time voice interactions Automated evaluation of LLM quality and safety Production monitoring, incident...Contract workImmediate startShift workDay shift
Liberty Personnel Services, Inc.
Philadelphia, PA1 day ago - ...team.KPMG is currently seeking a Senior Engineer to join our Audit Technology Organization... ...implement core components of our generative AI solutions, focusing on building robust,... ...code reviews, and utilizing our enhanced evaluation framework. Drive product advancement by actively...Local area
KPMG
Philadelphia, PA3 days ago - ...digital core and unleashing the power of AI to create value at speed for... ...and Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities... ...memory, and human checkpoints, and write the evaluations that measure their behavior against accuracy...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Philadelphia, PA1 day ago $86.6k - $144.4k
...intelligent systems powered by cutting-edge AI technologies?Do you enjoy designing... ...customers, faster.About the role: As a Senior AI Engineer, you will build and ship AI-powered... ...enterprise systems, and contributing to evaluation, observability, and guardrails.You will hold...Full timeLocal areaImmediate startFlexible hoursElsevier
Philadelphia, PA1 day ago- ...well as India.Due to our continued growth, we are hiring for an AI Software Engineerto join MDLinx, an M3 company. About the... ...philosophy for physician engagement, shifting from delivery to belief engineering.Job DescriptionImplement features that improve MDLinx and drive...InternshipRemote workShift work
M3
Fort Washington, PA11 hours ago $91.1k - $179.5k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...such as orchestration, tool integration, state management, evaluation, guardrails, and human-in-the-loop controlsProfessional...Local areaVisa sponsorshipDeloitte
Philadelphia, PA2 days ago$130k - $160k
...We are looking for a Lead Python AI Engineer to build robust, AI-powered API services and agentic workflows. In this role, you will... ...Integrate LLMs with a strong engineering foundation-baking in evaluation, comprehensive observability, robust fallback handling, and cost...Temporary workRemote workFlexible hoursEPAM Systems Inc
Conshohocken, PA3 days ago- We Are:Accenture's Oracle Business Group AI Center of Excellence is one of the most... ...client conversation.You might come from engineering, consulting, product, or pre-sales — what... ..., including retrieval pipelines and evaluation frameworksAccelerate AI-assisted sales pursuits...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Philadelphia, PA1 day ago - ...countries, and we believe that scaling AI responsibly is what makes it durable. Technology... ...of deep industry knowledge, applied AI engineering, and trusted AI governance. We help the... ...and data governance, privacy, safety evaluations, and human oversight, and build these...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Philadelphia, PA4 days ago $91k - $321.5k
...LevelSenior ManagerJob Description & SummaryThe OpportunityAs a CTIO - AI Engineer- Senior Manager, you will play a pivotal role in transforming... ...assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted...Full timeH1bPwC
Philadelphia, PA4 days ago$124k - $280k
...Description & SummaryThe OpportunityAs an AML and Sanctions- AI Engineer- Senior Manager, you will leverage data and analytics to provide... ...assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace...Full timeH1bPwC
Philadelphia, PA11 hours ago- ...creating an exceptional place to work that is inclusive to all. Toll Brothers, America's leading luxury home builder, seeks an Applied AI Engineer to join our team at our Corporate office in Fort Washington, Pennsylvania.What is the opportunity?The Applied AI Engineer builds...Full timeWork at officeLocal area
Toll Brothers
Fort Washington, PA4 days ago $55k - $151.47k
...SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...team you will develop and implement AI solutions that enhance product offerings.... ...closely with team members. We evaluate these factors thoughtfully to establish a...Full timeH1bPwC
Philadelphia, PA3 days ago$115.4k - $192.3k
Are you a collaborative Software Engineering Lead looking to work for a mission driven global... .... About the team, This team supports CK AI Service team. The new Lead Engineer will... ...and standardize AI patterns, including evaluation, observability, and performance optimizationResponsibilitiesManaging...Full timeTemporary workLocal areaElsevier
Philadelphia, PA3 days ago$115.4k - $192.3k
...intelligent systems powered by innovative AI technologies?Do you enjoy designing... ...faster.About the role: As a Principal AI Engineer, you will be the technical lead for an embedded... ...infrastructure standards.Continuously evaluate emerging technologies and mentor and elevate...Full timeLocal areaImmediate startFlexible hoursElsevier
Philadelphia, PA4 days ago- ...thinking services company at the forefront of AI-native innovation. We partner with... ...next-generation, agent-powered workflows engineered to scale in real-world settings. Our... ..., Java, or equivalent; familiarity with evaluation tooling, logging, monitoring, and agent...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Philadelphia, PA4 days ago - ...solutions while pioneering the next generation of AI-empowered software development. You’ll lead teams in adopting AI-first engineering practices—bringing clarity, structure, and... ...and codify repeatable practices such as evaluation harnesses, code-review agents, context...Temporary workLocal area
Slalom
Philadelphia, PA4 days ago $73.5k - $212.28k
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...will lead the development of innovative AI solutions that drive remarkable client... ...collaborating closely with team members. We evaluate these factors thoughtfully to establish a...H1bPwC
Philadelphia, PA1 day ago$63k - $141.5k
...LevelAssociateJob Description & SummaryThe Opportunity As part of the AI Engineering team within the Digital Assurance & Technology team, you will... ...scalable. You will support workstreams involving testing and evaluation of AI-enabled systems, analyze technical evidence and control...Full timeH1bPwC
Philadelphia, PA4 days ago- We are:Accenture’s Global Responsible AI team within the Global Data & AI Practice. AI... ...AI team and if you’re an experienced RAI Engineer with a Responsible AI background, we’d... ...ethical and responsible practices.Detecting, evaluating and applying relevant RAI dimensions (...Full timeWork experience placementLive inWork at officeLocal area
Accenture
Philadelphia, PA3 days ago - ...growing companies for over 10 yearsJob DescriptionAI Developer: AI Program TeamAbout the team: The AI Program Team has a two-part mission... ...from Claude and other agentic coding tools.Keep experimenting: evaluate new models and tools as they appear, and share what works....Visa sponsorshipWork visa
CapTech
Philadelphia, PA1 day ago $75 - $80 per hour
...Job Description Job Description Job Title: AI Engineer Location-Type: Conshohocken, PA Start Date: July 2026 Duration:... ...guardrails, and responsible-AI practices including monitoring and evaluation. •Experience reducing LLM costs and token usage at scale. •...Mondo
Conshohocken, PAa month ago- ...This role operates within an AI-native delivery model where engineers use Claude to generate large volumes of production-bound code across the full stack, then own, review, and make that code production-ready.The Staff Engineer (AI) is a senior individual contributor...
Blue Ribbon Global Technologies
Blue Bell, PA2 days ago - ...Job Title: AI-Native Staff Engineer Location: Blue Bell, PA End Client: Cotiviti USA, LLC (US - Local) Branch / Location: Blue Bell, PA Position Type: Contract (C2C) Position Description & Objectives This role operates within an AI-native...Contract workLocal area
Argyllinfotech
Blue Bell, PA3 days ago - Software Guidance & Assistance, Inc., (SGA), is searching for an AI Application Engineer for a contract assignment with one of our premier... ...prompt engineering, agent orchestration, quality assurance, evaluation framework development, and AI observability. The ideal candidate...Contract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Engineer. Be the first to apply!
