US Tech - AI Evaluation Engineer (QA) Senior Associate
$55k - $151.47kPricewaterhouseCoopers
Specialty/Competency: Data Science
Industry/Sector: Not Applicable
Time Type: Full time
Travel Requirements: Up to 20%
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.
Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.
Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn't clear, you ask questions, and you use these moments as opportunities to grow.
Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:
Respond effectively to the diverse perspectives, needs, and feelings of others.
Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems.
Use critical thinking to break down complex concepts.
Understand the broader objectives of your project or role and how your work fits into the overall strategy.
Develop a deeper understanding of the business context and how it is changing.
Use reflection to develop self awareness, enhance strengths and address development areas.
Interpret data to inform insights and recommendations.
Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.
The Opportunity
As part of the People Tech & AI team you will develop, test, and validate Generative AI agents and data pipelines, promoting reliability, scalability, and alignment with PwC standards. As a Senior Associate you will analyze complex problems, mentor others, and maintain elevated standards while collaborating with multidisciplinary teams to support AI-enabled client solutions. This position provides an exciting opportunity to enhance your skills in automated testing and governance controls while contributing to innovative AI-driven solutions.
Responsibilities
Apply automated testing and governance controls effectively
Analyze complex issues and provide actionable insights
Mentor and guide junior associates in their tasks
Uphold rigorous standards of quality and technical excellence
What You Must Have
Bachelor's Degree in Computer Science, Data Processing/Analytics/Science
At least 2 years of experience in data engineering, AI/ML engineering, or quality engineering
In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college
What Sets You Apart
Demonstrating three years of specialized training in technology preferred
Experience with test automation and CI/CD pipelines
Familiarity with LLMs and prompt engineering concepts
Understanding enterprise data patterns and quality frameworks
Building and maintaining automated test suites for AI agents
Validating integrations with Power Automate platform
Executing LLM evaluation frameworks using defined metrics
Working with data scientists and ML engineers
Upholding professional standards and documentation expectations
The salary range for this position is: $55,000 - $151,470. For residents of Washington state the salary range for this position is: $55,000 - $187,000. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. All hired individuals are eligible for an annual discretionary bonus. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more. To view our benefits at a glance, please visit the following link:
As PwC is an?equal opportunity employer, all qualified applicants will receive consideration for employment at PwC without regard to race; color; religion; national origin; sex (including pregnancy, sexual orientation, and gender identity); age; disability; genetic information (including family medical history); veteran, marital, or citizenship status; or, any other status protected by law.?
PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy:
Learn more about how we work:
For only those qualified applicants that are impacted by the Los Angeles County Fair Chance Ordinance for Employers, the Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, San Diego County Fair Chance Ordinance, and the California Fair Chance Act, where applicable, arrest or conviction records will be considered for Employment in accordance with these laws. At PwC, we recognize that conviction records may have a direct, adverse, and negative relationship to responsibilities such as accessing sensitive company or customer information, handling proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace for all.
Applications will be accepted until the position is filled or the posting is removed, unless otherwise set forth on the following webpage. Please visit this link for information about anticipated application deadlines:
#LI-Remote
#LI-Hybrid
- ...About Us: Based in San Francisco, California, Turing... ...for frontier AI labs and a trusted partner... ...specialize in software engineering, logical reasoning, STEM... ..., UC Berkeley, Georgia Tech, and comparable institutions... ...a Software Engineering evaluator, you will create...SeniorFor contractorsRemote workFlexible hours
$40 per hour
A leading tech company is looking for experienced cybersecurity professionals to evaluate AI-generated security content and help improve AI systems. The role offers the flexibility... .... This position is open to residents of the US, Canada, UK, Ireland, Australia, and New...SuggestedHourly payRemote work- ...A healthcare technology company is seeking a Senior Full Stack Engineer to lead the development of AI-enhanced products. This role involves designing and maintaining... ...solutions. Flexibility in work location within the US is offered, along with competitive compensation and...SeniorRemote work
$123k - $215.25k
...Senior AI Engineer II - Agentic AI New York, NY, United States Sunrise... ...and together, you will help us define the future of American Express. Joining Amex Tech means discovering and shaping... ...orchestration frameworks, and evaluation and monitoring tooling, that...SeniorFull timeWork at officeLocal areaRemote workVisa sponsorshipFlexible hoursShift work$150k - $300k
...Senior AI Engineering Expert At Goldman Sachs, our Engineers don't just make... ...and external users. Evaluation & Governance: Establish robust... ...Leadership: Collaborate with tech leads, security leads, and software... ..., full-time and part-time US employees who work at least...SeniorFull timeTemporary workPart timeImmediate start$215k - $300k
...a security risk. About Us Quanata is on a mission... ...scientists and actuaries to engineers, designers and... ...a world class team of tech‑minded professionals from... ...role We’re looking for a Senior Data Engineer to help the... ...multiple sources to evaluate insured risk, deliver services...SeniorExtra incomeLocal areaRemote workWork from homeHome office$135.6k - $154.8k
...Senior Associate, Data Scientist - US Card (Applied GenAI) Data is at the center... ...source generative AI models and tooling, but... ...daily with product, tech, and business teams to... ...through training, evaluation, and validation; partnering with engineering teams to operationalize...SeniorFull timePart timeLocal area- ...technology firm is seeking an experienced software engineer to enhance AI-driven coding solutions. This role involves evaluating AI-generated code, collaborating with teams,... ...-edge AI projects remotely from locations in the US, Canada, or Western Europe. #J-18808-LjbffrSeniorContract workRemote work10 hours per weekFlexible hours
- ...A dynamic tech company is seeking a Senior AI Engineer to develop and deploy machine learning solutions that drive business outcomes. This remote position... ...functional teams to ensure scalable AI applications. Join us to leverage your skills in a fast-paced environment and...SeniorRemote work
$125k - $156.3k
...The Senior Generative AI Engineer is responsible for designing, building, and deploying Natera’s Generative AI and Machine Learning solutions.... ...for domain‑specific tasks when appropriate Set quality, evaluation, and reliability standards for GenAI systems, including testing...SeniorImmediate startRemote workWorldwide$230k - $300k
...the standard of care across the US healthcare system. We've built AI-powered technology that helps healthcare... ...THE ROLE We're hiring a Senior AI Engineer to own and evolve the... ...requires deep fluency in prompt design, evaluation frameworks, agentic systems, structured...Senior$204k - $259k
...across 15+ U.S. states. Waymo's Release Evaluation org ensures that each version of the... ...our logs and simulations that might help us to more efficiently discover rare and important... ...constraints. Collaborate with other engineers, data scientists, statisticians and the...SeniorFull timeRemote work- ..., data products, and AI capabilities that give... ...Role Summary The Senior AI/ML Engineer is a hands-on technical... ...fine-tuned model evaluations in the afternoon. You... ..., GCP Vertex AI) and associated infrastructure services... ...Minorities/Persons with Disabilities/US Veterans)...SeniorDay shift
- ...ImagineX is a tech company that deploys AI-assisted teams to build and secure mission-critical... ...enterprise scale. We’re looking for a Senior Software Engineer, AI/ML who combines a strong .NET... ...for AI‑driven capabilities. Evaluate and integrate LLMs, vector search,...Senior
$141.1k - $194k
...Senior Applied AI Engineer The Enterprise AI organization at Humana is a pioneering force, driving... ...are actively seeking top talent to join us in shaping the future of healthcare through... ...systematic experimentation and evaluation, implement sophisticated context management...SeniorBi-weekly payWork at officeWork from homeHome office- ...DESCRIPTION Joining Amex Tech means discovering... ...back the broader engineering community through... ...American Express, AI is reshaping the... ...The Role As a Senior Staff Data Engineer... ...model gateways Evaluation, observability, and... ...process. ABOUT US At American Express...SeniorWork at officeLocal areaVisa sponsorshipFlexible hours3 days per week
- ...Senior AI/ML & Data Engineer Gesture is where technology meets humanity -- a place where innovation... ...impact collide. We're a fast-growing tech company using AI, machine learning, and... ...Signal Processing Model Evaluation & Governance Data Infrastructure...SeniorPrice work
$150k - $200k
...About Us Fanatics is building a leading global digital... ...professional sports leagues, players associations, teams, colleges, college... ...partners, and creators. Senior AI Engineer, Finance Systems - Fanatics... ...when appropriate. Evaluate and experiment with emerging...SeniorTemporary workImmediate start$40 per hour
A tech company in the United States is seeking a Web Platform Engineer to enhance AI chatbot models. This role involves evaluating AI outputs and requires proficiency in programming languages such as Python or JavaScript. Candidates should be detail-oriented, experienced...Hourly payRemote workFlexible hours- ...A bit about us: Are you passionate about AI, machine learning, and software engineering? Do you have a knack for developing prototypes... ...potentially revolutionize the tech services industry? If so, we... ...opportunity for you! We are seeking a Senior AI Software Engineer to join...SeniorPermanent employmentLocal areaFlexible hours
- ...Gen AI Python Software Engineer Engineer the future of global finance. At Citi, our Tech team doesn't just support finance... ...assumptions, and help us build the right... ...approaches, and structured evaluation techniques... ...clarity, and rigor often associated with strongly typed...Casual workWork from home
$102.5k - $187.9k
...help to build a better working world. Consulting - Tech Consulting - FinTech - Blockchain and AI Engineering - Senior Whole industries have been disrupted and... ...range for this job in all geographic locations in the US is $102,500 to $187,900. The base salary range for...SeniorSummer holidayFlexible hours$216k - $270k
...As a Software Engineer on the Machine Learning Infrastructure team,... ...raw compute into breakthrough AI. You will: Architect and... ...isolate hardware failures Evaluate and integrate emerging technologies... ...the same role. This allows us to ensure a fair and thorough...SeniorFull time- ...for a SaaS-experienced Sales Engineer to drive business growth and customer... ...adoption of the Bluefish AI platform. This role blends... ...them through complex technical evaluations and implementation strategies... ...is a tight-knit group of mar-tech industry veterans who previously...SeniorImmediate startShift work
$105.8k - $174.8k
...and Decision Science – AI Native Engineering Physical AI Engineering Consultant, Senior Consultant The... ...will work to deliver tech at speed, innovate at... ...transforming data and evaluating results to make meaningful... ...geographic locations in the US is $105,800 to $174,80...SeniorFull timeWork experience placementSummer holidayFlexible hours$216k - $270k
...As a Software Engineer on the ML Infrastructure team, you will design and build... ...candidates for the same role. This allows us to ensure a fair and thorough evaluation of all applicants. About Us:... ...our mission is to develop reliable AI systems for the world's most...SeniorFull time- A leading financial tech startup is looking for an AI Engineer to shape its AI tech stack. The ideal candidate has expertise in AI tooling, model evaluation, and experience in building data pipelines. Responsibilities include working on backend systems and engaging with...Senior
$203.2k - $239.1k
Senior Architect, Software Engineering, US Are you ready to make an impact? West Monroe is seeking... ...and agents that use AI including machine learning... ...across various industries and tech stacks. Willingness to... ...salaries are determined by evaluating a variety of factors including...SeniorTraineeshipH1bLocal areaImmediate startRelocationVisa sponsorshipFlexible hours- ...A leading technology company is seeking AI Developers to design and implement AI/ML features in a remote role... ...AI services, developing data pipelines, and creating evaluations for LLMs. Ideal candidates have mid-senior experience in AI product development with strong Python...Hourly payRemote work
$150k - $250k
...About Distyl AI Distyl is an applied AI technology company partnering with the... ...At Distyl, we build AI systems using Evaluation-Driven Development -an approach where evaluation... ...behavior in production. AI Evaluation Engineers focus on designing and implementing the...3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to US Tech - AI Evaluation Engineer (QA) Senior Associate. Be the first to apply!
- machine learning ai engineer New York, NY
- senior ai engineer New York, NY
- ai engineer remote New York, NY
- ai ml engineer New York, NY
- ai engineer New York, NY
- ai developer New York, NY
- ai research engineer New York, NY
- ai prompt engineer New York, NY
- software quality assurance specialist New York, NY
- quality assurance specialist New York, NY

