Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

US Tech - AI Evaluation Engineer (QA) Senior Associate

$55k - $151.47k

PricewaterhouseCoopers

Specialty/Competency: Data Science

Industry/Sector: Not Applicable

Time Type: Full time

Travel Requirements: Up to 20%

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.

Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn't clear, you ask questions, and you use these moments as opportunities to grow.

Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:

Respond effectively to the diverse perspectives, needs, and feelings of others.

Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems.

Use critical thinking to break down complex concepts.

Understand the broader objectives of your project or role and how your work fits into the overall strategy.

Develop a deeper understanding of the business context and how it is changing.

Use reflection to develop self awareness, enhance strengths and address development areas.

Interpret data to inform insights and recommendations.

Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.

The Opportunity

As part of the People Tech & AI team you will develop, test, and validate Generative AI agents and data pipelines, promoting reliability, scalability, and alignment with PwC standards. As a Senior Associate you will analyze complex problems, mentor others, and maintain elevated standards while collaborating with multidisciplinary teams to support AI-enabled client solutions. This position provides an exciting opportunity to enhance your skills in automated testing and governance controls while contributing to innovative AI-driven solutions.

Responsibilities

  • Apply automated testing and governance controls effectively

  • Analyze complex issues and provide actionable insights

  • Mentor and guide junior associates in their tasks

  • Uphold rigorous standards of quality and technical excellence

What You Must Have

  • Bachelor's Degree in Computer Science, Data Processing/Analytics/Science

  • At least 2 years of experience in data engineering, AI/ML engineering, or quality engineering

  • In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college

What Sets You Apart

  • Demonstrating three years of specialized training in technology preferred

  • Experience with test automation and CI/CD pipelines

  • Familiarity with LLMs and prompt engineering concepts

  • Understanding enterprise data patterns and quality frameworks

  • Building and maintaining automated test suites for AI agents

  • Validating integrations with Power Automate platform

  • Executing LLM evaluation frameworks using defined metrics

  • Working with data scientists and ML engineers

  • Upholding professional standards and documentation expectations

The salary range for this position is: $55,000 - $151,470. For residents of Washington state the salary range for this position is: $55,000 - $187,000. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. All hired individuals are eligible for an annual discretionary bonus. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more. To view our benefits at a glance, please visit the following link:

As PwC is an?equal opportunity employer, all qualified applicants will receive consideration for employment at PwC without regard to race; color; religion; national origin; sex (including pregnancy, sexual orientation, and gender identity); age; disability; genetic information (including family medical history); veteran, marital, or citizenship status; or, any other status protected by law.?

PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy:

Learn more about how we work:

For only those qualified applicants that are impacted by the Los Angeles County Fair Chance Ordinance for Employers, the Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, San Diego County Fair Chance Ordinance, and the California Fair Chance Act, where applicable, arrest or conviction records will be considered for Employment in accordance with these laws. At PwC, we recognize that conviction records may have a direct, adverse, and negative relationship to responsibilities such as accessing sensitive company or customer information, handling proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace for all.

Applications will be accepted until the position is filled or the posting is removed, unless otherwise set forth on the following webpage. Please visit this link for information about anticipated application deadlines:

#LI-Remote

#LI-Hybrid

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the US Tech - AI Evaluation Engineer (QA) Senior Associate in Boston, MA vacancy
  •  ...About Us: Based in San Francisco, California, Turing is the world...  ...accelerator for frontier AI labs and a trusted partner for...  ...researchers who specialize in software engineering, logical reasoning, STEM,...  ...As a Software Engineering evaluator, you will create cutting-edge... 
    Senior
    For contractors
    Remote work
    Flexible hours

    Turing

    Quincy, MA
    2 days ago
  • $40 per hour

     ...seeking experienced cybersecurity professionals to help train AI models. In this role, you will evaluate AI-generated security content and solve technical...  ...hourly rates start at $40, with jobs available to candidates in the US and several other countries. #J-18808-Ljbffr
    Suggested
    Hourly pay
    Remote work

    DataAnnotation

    Boston, MA
    6 hours ago
  •  ...cybersecurity technology company is seeking experienced professionals to evaluate AI-generated content and solve technical cybersecurity problems....  ...strong communication skills. Opportunities are available for candidates in the US and several other countries. #J-18808-Ljbffr
    Suggested
    Hourly pay
    Remote work

    DataAnnotation

    Boston, MA
    6 hours ago
  • $144.5k - $230k

     ...Senior AI Engineer We are the better way to work in finance. As private equity's value creation...  ...This role can be based in any of our US office locations and is a hybrid role with...  ...architectures and RAG pipelines to evaluation frameworks and production observability... 
    Senior
    Work at office
    Local area
    Remote work
    2 days per week

    Accordion USA

    Boston, MA
    1 day ago
  •  ...Stack is developing revolutionary AI and advanced autonomous...  ...cloud technologies, empowering us to create innovative solutions...  ...About the Role: The Autonomy Evaluation team is responsible for measuring...  ...results. Work closely with systems engineers to ensure a safe, well tested... 
    Senior

    GrabJobs

    Boston, MA
    1 day ago
  •  ...ImagineX is a tech company that deploys AI-assisted teams to build and secure mission-critical...  ...enterprise scale. We’re looking for a Senior Software Engineer, AI/ML who combines a strong .NET...  ...for AI‑driven capabilities. Evaluate and integrate LLMs, vector search,... 
    Senior

    GrabJobs

    Boston, MA
    3 days ago
  • $141.1k - $194k

     ...Senior Applied AI Engineer The Enterprise AI organization at Humana is a pioneering force, driving...  ...are actively seeking top talent to join us in shaping the future of healthcare through...  ...systematic experimentation and evaluation, implement sophisticated context management... 
    Senior
    Bi-weekly pay
    Work at office
    Work from home
    Home office

    Humana

    Boston, MA
    14 hours ago
  • A leading SaaS company is looking for an individual to ensure the reliability and accuracy of AI Agents. Responsibilities include defining evaluation strategies, assessing LLM output integrity, and creating high-fidelity datasets. Candidates should have over 5 years of... 
    Senior
    Remote work

    Veeva Systems

    Boston, MA
    2 days ago
  • $120.12k - $214.5k

     ...industry and innovative technology empower us to help organizations reduce costs while...  ...development opportunities.As a lead AI/ML Engineer at Optum AI, you'll be designing and developing...  ...technologies, tools, and research, and evaluate their applicability to business problems... 
    Senior
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Boston, MA
    3 days ago
  • $150k - $180k

     ...and technology. Job Description Senior AI Platform Engineer Locations : San Francisco, CA /...  ...New York, NY (Hybrid) Get To Know Us: SS&C Advent's financial solutions...  ...tenant deployment of AI agents. Evaluate new agentic AI, LLM, and... 
    Senior
    Ongoing contract
    Casual work
    Flexible hours

    SS&C Technologies

    Boston, MA
    1 day ago
  • $105.8k - $174.8k

     ...and Decision Science – AI Native Engineering Physical AI Engineering Consultant, Senior Consultant The...  ...will work to deliver tech at speed, innovate at...  ...transforming data and evaluating results to make meaningful...  ...geographic locations in the US is $105,800 to $174,80... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Boston, MA
    1 day ago
  • $179k - $199k

     ...people. As a leading health tech company that’s founder-...  ...and accelerated by AI to create meaningful...  ...employee journey. Join us in redefining healthcare...  ...working closely with other engineering teams across the...  ...use this information to evaluate your candidacy for the... 
    Work at office
    Remote work
    Flexible hours

    GrabJobs

    Boston, MA
    4 days ago
  • $105.8k - $174.8k

     ...skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront...  ...role will work to deliver tech at speed, innovate at scale...  ...analysing, transforming data and evaluating results to make meaningful...  ...geographic locations in the US is $105,800 to $174,800. The... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Boston, MA
    5 days ago
  • $112k - $168k

     ...Automations) team is building the AI systems that transform how...  ...work. We are looking for a Senior AI Engineer to design, build, and scale production...  ...services, including model evaluation frameworks, A/B testing...  ...the position across all our US locations. The base salary offered... 
    Senior

    Klaviyo

    Boston, MA
    5 days ago
  • $106.9k - $176.5k

     ...and Decision Science – AI Native Engineering AI/Machine Learning Engineer, Senior Consultant The opportunity...  ...will work to deliver tech at speed, innovate at...  ..., transformation, and evaluation ~ Experience with...  ...locations in the US is $106,900 to $176,500... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Boston, MA
    4 days ago
  • A leading AI research company seeks a contractor with software engineering experience to evaluate AI-generated code and collaborate on AI-driven solutions. The ideal candidate...  ...engagement starts next week with a potential duration of 1 month, based in the US. #J-18808-Ljbffr
    Senior
    Contract work
    For contractors
    Remote work
    10 hours per week
    Flexible hours

    Turing

    Boston, MA
    4 days ago
  • $150k - $260k

     ...Staff/Senior/Principal Software Engineer (Elixir/AI Focus) Location: Remote (with occasional travel...  ...: Salt Lake City, UT, US Employment Type: Full-time...  ...a high-velocity, modern tech stack environment. We are...  ...embeddings ( pgvector ), and evaluation frameworks. Collaborate... 
    Senior
    Full time
    Contract work
    Remote work

    GrabJobs

    Boston, MA
    3 days ago
  • $163k - $246.5k

     ...AI Engineer As an AI engineer, you'll apply LLM technologies throughout our stack to enhance...  ...of AI-powered solutions and rigorously evaluate the efficacy of different prompts and models...  ...role with the expectation you join us 3+ days per week in our San Francisco, New... 
    Senior
    Currently hiring
    Local area
    Remote work
    Weekend work
    3 days per week

    Semgrep, Inc

    Boston, MA
    1 day ago
  • $98.81k - $148.16k

     ...people on Earth, we’d love to have you join us. Description Reusable launch systems...  ..., build, and test efficiently. As a Senior AI Engineer on theBoltlineteam, you will design, build...  ...knowledge.You'llarchitect evaluation frameworks to ensure AI reliability, build... 
    Senior
    Permanent employment
    Full time

    GrabJobs

    Boston, MA
    6 hours ago
  • $112k - $168k

     ...Automations) team is building the AI systems that transform how...  ...work. We are looking for a Senior AI Engineer to design, build, and scale production...  ...services, including model evaluation frameworks, A/B testing...  ...the position across all our US locations. The base salary offered... 
    Senior

    Klaviyo

    Boston, MA
    2 days ago
  •  ...building the first AI-powered platform built...  ...for a hands-on AI engineer to design and build...  ...You're comfortable evaluating new frameworks,...  ...approaches emerge. This senior engineer will work...  ...is restricted to US citizens or lawful...  ..., biotech, clean tech, chemicals, energy,... 
    Senior
    Permanent employment
    Contract work
    Remote work
    Shift work

    Re:Build Manufacturing

    Boston, MA
    2 days ago
  • $165k - $225k

     ...Description: DataRobot delivers AI that maximizes impact and...  ...and in the future. As an AI Engineer on our Professional Services...  ...There will be travel requirements associated with this position to visit...  ...our website ( and connect with us on LinkedIn ( . DataRobot... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Worldwide
    Flexible hours

    DataRobot

    Boston, MA
    3 days ago
  • $148k - $222k

     ...opportunity to build state-of-the-art AI and machine learning...  ...any business. As a Sr. AI Engineer at Klaviyo, you'll play a key...  ...shot learning, fine tuning and evaluation. ~ Experienced backend engineer...  ...for the position across all our US locations. The base salary... 
    Senior
    Full time

    Klaviyo

    Boston, MA
    a month ago
  • A leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure and reliable AI services that enhance productivity for users. Key responsibilities include designing scalable... 
    Senior

    Franklin Fitch

    Boston, MA
    5 days ago
  •  ...We need extraordinary database engineers to join our team. You will...  ...TimescaleDB. Improve infrastructure to evaluate and test database correctness...  ...to Thrive at Tiger Data Our Tech Stack We don't require...  ...options for you and your family (US‑based employees) Ready to join... 
    Senior
    Full time
    Remote work
    Flexible hours

    Tiger Data (creators of TimescaleDB)

    Boston, MA
    4 days ago
  • $40 per hour

     ...cybersecurity-focused company is looking for experienced professionals to evaluate AI-generated security content and provide feedback to improve AI...  ...for flexible project selection and work from anywhere in the US. Candidates should have at least 2 years of cybersecurity... 
    Hourly pay
    Full time
    Part time
    Remote work
    Flexible hours

    DataAnnotation

    Boston, MA
    6 hours ago
  • A leading technology company is seeking a Senior Software Engineer to develop the AI Inference Server. The role involves managing the full lifecycle of building...  ...skills in Python, Docker, and CI/CD practices. Join us to shape the future of AI with innovative open-source... 
    Senior

    Red Hat, Inc.

    Boston, MA
    3 days ago
  •  ...Senior Software Engineer - AI & Data Engineering Location: Boston, MA (Onsite every Thursday) About BigRio BigRio is a Boston...  ...refinement Prompt engineering enhancements LLM evaluation and response tuning Participate in scrum (stand-ups,... 
    Senior

    Saviance

    Boston, MA
    4 days ago
  • $229.9k - $262.4k

     ...Senior Lead AI Engineer (LLM Gateway, FM Hosting) Overview: At Capital...  ...machine learning — position us to be at the forefront of enterprises...  ...that change how our associates work and how our customers...  ...search, guardrails, model evaluation, experimentation,... 
    Senior
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    14 days ago
  •  ...enterprise networks. Our customers love us for reducing their cybersecurity risks...  ...insights for our customers. Position: Senior Software Engineer, Intelligence Services Location: US (Hybrid...  ...Azure. Experience in leveraging AI to increase yourimpact. Familiarity with... 
    Senior
    Contract work
    Remote work
    Shift work

    GrabJobs

    Boston, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to US Tech - AI Evaluation Engineer (QA) Senior Associate. Be the first to apply!