Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

US Tech - AI Evaluation Engineer (QA) Senior Associate

$55k - $151.47k

PricewaterhouseCoopers

Specialty/Competency: Data Science

Industry/Sector: Not Applicable

Time Type: Full time

Travel Requirements: Up to 20%

At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.

Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.

Focused on relationships, you are building meaningful client connections, and learning how to manage and inspire others. Navigating increasingly complex situations, you are growing your personal brand, deepening technical expertise and awareness of your strengths. You are expected to anticipate the needs of your teams and clients, and to deliver quality. Embracing increased ambiguity, you are comfortable when the path forward isn't clear, you ask questions, and you use these moments as opportunities to grow.

Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:

Respond effectively to the diverse perspectives, needs, and feelings of others.

Use a broad range of tools, methodologies and techniques to generate new ideas and solve problems.

Use critical thinking to break down complex concepts.

Understand the broader objectives of your project or role and how your work fits into the overall strategy.

Develop a deeper understanding of the business context and how it is changing.

Use reflection to develop self awareness, enhance strengths and address development areas.

Interpret data to inform insights and recommendations.

Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.

The Opportunity

As part of the People Tech & AI team you will develop, test, and validate Generative AI agents and data pipelines, promoting reliability, scalability, and alignment with PwC standards. As a Senior Associate you will analyze complex problems, mentor others, and maintain elevated standards while collaborating with multidisciplinary teams to support AI-enabled client solutions. This position provides an exciting opportunity to enhance your skills in automated testing and governance controls while contributing to innovative AI-driven solutions.

Responsibilities

  • Apply automated testing and governance controls effectively

  • Analyze complex issues and provide actionable insights

  • Mentor and guide junior associates in their tasks

  • Uphold rigorous standards of quality and technical excellence

What You Must Have

  • Bachelor's Degree in Computer Science, Data Processing/Analytics/Science

  • At least 2 years of experience in data engineering, AI/ML engineering, or quality engineering

  • In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college

What Sets You Apart

  • Demonstrating three years of specialized training in technology preferred

  • Experience with test automation and CI/CD pipelines

  • Familiarity with LLMs and prompt engineering concepts

  • Understanding enterprise data patterns and quality frameworks

  • Building and maintaining automated test suites for AI agents

  • Validating integrations with Power Automate platform

  • Executing LLM evaluation frameworks using defined metrics

  • Working with data scientists and ML engineers

  • Upholding professional standards and documentation expectations

The salary range for this position is: $55,000 - $151,470. For residents of Washington state the salary range for this position is: $55,000 - $187,000. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. All hired individuals are eligible for an annual discretionary bonus. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more. To view our benefits at a glance, please visit the following link:

As PwC is an?equal opportunity employer, all qualified applicants will receive consideration for employment at PwC without regard to race; color; religion; national origin; sex (including pregnancy, sexual orientation, and gender identity); age; disability; genetic information (including family medical history); veteran, marital, or citizenship status; or, any other status protected by law.?

PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy:

Learn more about how we work:

For only those qualified applicants that are impacted by the Los Angeles County Fair Chance Ordinance for Employers, the Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, San Diego County Fair Chance Ordinance, and the California Fair Chance Act, where applicable, arrest or conviction records will be considered for Employment in accordance with these laws. At PwC, we recognize that conviction records may have a direct, adverse, and negative relationship to responsibilities such as accessing sensitive company or customer information, handling proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace for all.

Applications will be accepted until the position is filled or the posting is removed, unless otherwise set forth on the following webpage. Please visit this link for information about anticipated application deadlines:

#LI-Remote

#LI-Hybrid

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the US Tech - AI Evaluation Engineer (QA) Senior Associate in Raleigh, NC vacancy
  •  ...About Us: Based in San Francisco, California, Turing is the world...  ...accelerator for frontier AI labs and a trusted partner for...  ...researchers who specialize in software engineering, logical reasoning, STEM,...  ...As a Software Engineering evaluator, you will create cutting-edge... 
    Senior
    For contractors
    Remote work
    Flexible hours

    Turing

    Raleigh, NC
    3 days ago
  • $148k - $356.5k

     ...Senior Software Engineer, Metrics and Evaluation - Autonomous Vehicles page is loaded Senior Software...  ...Apply locations US, CA, Santa Clara US, GA,...  ...proficient in Python and associated libraries (Pandas, Numpy,...  ...else can solve. Our work in AI and digital twins is transforming... 
    Senior
    Full time
    Remote work

    NVIDIA

    Raleigh, NC
    4 days ago
  • $105.8k - $174.8k

     ...and Decision Science – AI Native Engineering Physical AI Engineering Consultant, Senior Consultant The...  ...will work to deliver tech at speed, innovate at...  ...transforming data and evaluating results to make meaningful...  ...geographic locations in the US is $105,800 to $174,80... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Raleigh, NC
    1 day ago
  • $105.8k - $174.8k

     ...skills and ambitions. As a Senior AI Native Engineer, you will be at the forefront...  ...role will work to deliver tech at speed, innovate at scale...  ...analysing, transforming data and evaluating results to make meaningful...  ...geographic locations in the US is $105,800 to $174,800. The... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Raleigh, NC
    5 days ago
  • $150k - $185k

    A leading tech services company in Raleigh is searching for a Sr. Managed Services Engineer - AI & CoPilot. The role demands collaboration with customers to optimize services, manage AI solutions, and deliver exceptional performance across platforms. Candidates should... 
    Senior
    Remote work
    Work from home

    SHI GmbH

    Raleigh, NC
    2 days ago
  • $106.9k - $176.5k

     ...and Decision Science – AI Native Engineering AI/Machine Learning Engineer, Senior Consultant The opportunity...  ...will work to deliver tech at speed, innovate at...  ..., transformation, and evaluation ~ Experience with...  ...locations in the US is $106,900 to $176,500... 
    Senior
    Full time
    Work experience placement
    Summer holiday
    Flexible hours

    EY

    Raleigh, NC
    4 days ago
  • $40 per hour

     ...A technology company is seeking a DevOps Engineer to evaluate AI models and improve their performance. The position is remote, offering flexibility in scheduling and project selection. Ideal candidates will have proficiency in programming languages such as Python or JavaScript... 
    Hourly pay
    Remote work

    DataAnnotation

    Raleigh, NC
    4 days ago
  •  ...our customers. Lenovo is a US$69 billion revenue global...  ...with a full-stack portfolio of AI-enabled, AI-ready, and AI-optimized...  ...Role We are seeking a Senior AI Engineer to support Lenovo's global...  ...with complex requirements. Evaluate, prototype, and recommend... 
    Senior
    Full time
    Work at office
    Local area
    3 days per week

    Lenovo

    Morrisville, NC
    4 days ago
  •  ...building restaurant tech, we’re giving...  ...-of-sale to AI-powered profit tools...  ...a new 5-person engineering team with a singular...  ...technically senior AI practitioner...  ...multi‑day manual QA cycles with sub‑...  ...test harness and evaluate the output. You...  ...please contact us at ****@*****.***... 
    Shift work

    SpotOn

    Raleigh, NC
    4 days ago
  • $141k - $213k

     ...Do We're looking for a Senior AI Security Engineer II to join our Information...  ...and customer focus have made us a trusted leader for more than...  ...years. Who You Are ~ Associate's or bachelor's degree (...  ...levels. Candidates will be evaluated to determine the appropriate... 
    Senior
    Hourly pay
    Permanent employment
    Temporary work
    Work experience placement
    H1b
    Work at office
    Remote work
    Flexible hours

    Principal Financial Group

    Raleigh, NC
    3 days ago
  • $123.4k - $176.3k

     ...within EST business hours (9a-5p EST). Job Summary The Senior Data/AI Engineer is a senior individual contributor on the Data & AI...  ...through production, covering chunking, retrieval, prompting, evaluation, monitoring, and cost/performance tuning. Experience with... 
    Senior
    Temporary work
    Local area
    Immediate start
    Remote work
    Flexible hours

    Cardinal Health

    Raleigh, NC
    1 day ago
  •  ...looking for an experienced AI Engineer who will design and...  .... This setup helps us stay connected, work more...  ...value and insights Evaluating algorithmic results...  ...production code in Python with associated AI modules (LangChain,...  ...to Collibra’s Senior Manager of AI Engineering... 
    Senior
    Full time
    Work experience placement
    Work at office
    Flexible hours
    2 days per week

    Collibra

    Raleigh, NC
    1 hour ago
  • $132.5k - $366.3k

     ...services company at the forefront of AI-native innovation. We partner...  ..., agent-powered workflows engineered to scale in real-world...  ...based routing, tool invocation, evaluation harnesses, and lifecycle observability...  ...observance, please call us toll free at (***) ***-****... 
    Senior
    Live in
    Work at office
    Local area

    Accenture

    Raleigh, NC
    6 days ago
  • $96.8k - $251.6k

     ...Job Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level, hands-on technical...  ..., tools, APIs, memory, retrieval, evaluation, guardrails, and cloud services. The...  ...to the stated locations only US: Hiring Range in USD from: $96,800... 
    Senior
    Temporary work
    Flexible hours

    Oracle

    Raleigh, NC
    2 days ago
  • $30 per hour

    A technology company in North Carolina is seeking a Cloud Platform Engineer to enhance AI model quality. This role involves evaluating AI outputs through coding and writing tasks. Candidates must be proficient in programming languages like JavaScript or Python and have... 
    Hourly pay
    Remote work

    DataAnnotation

    Raleigh, NC
    4 days ago
  • Ara is seeking a highly qualified Research Engineer in Raleigh, North Carolina. The role focuses on developing advanced AI/ML algorithms for the Intelligence and Defense communities, engaging in software tool development and modeling. The ideal candidate will have significant... 
    Senior

    Ara

    Raleigh, NC
    3 days ago
  •  ...already have a profile with us, you can log in to check status...  ...job description: Senior Engineer/Platform Leader accountable for...  ...and operating secure, scalable AI/ML and Generative AI (GenAI)...  ...patterns, CI/CD automation, evaluation/testing, and observability) so... 
    Senior
    Full time
    Part time
    Shift work
    Day shift

    Truist Inc

    Raleigh, NC
    4 days ago
  • $86.5k - $142.7k

     ...prototypes and builds modern, AI‑enabled applications and digital...  ...‑of‑concept, and guiding engineering teams through complex technical...  ...search, prompt orchestration, evaluation and guardrails. • Author Architecture...  ...geographic locations in the US is $86,500 to $142,700.  The... 
    Senior
    Summer holiday
    Flexible hours

    EY

    Raleigh, NC
    4 days ago
  • $20 per hour

     ...seeking Data Annotation specialists to train AI chatbots. The role offers remote work and...  ...prompts, write quality responses, and evaluate AI outputs. A bachelor's degree and strong...  ...This independent contract position is for US-based applicants only, with opportunities... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    SupportFinity

    Raleigh, NC
    4 days ago
  • $60 per hour

    A leading tech company is seeking proficient programmers to contribute to groundbreaking AI development while enjoying the flexibility of remote work. This role involves designing...  ...remote but only available to individuals in certain countries including the US. #J-18808-Ljbffr
    Remote work

    DataAnnotation

    Raleigh, NC
    3 days ago
  • $60 per hour

    A pioneering tech company is seeking proficient programmers to join their remote team, contributing to innovative AI systems. You can work flexibly, choosing projects that match your...  ...include designing coding challenges, evaluating AI performance, and providing feedback... 
    Remote work

    DataAnnotation

    Raleigh, NC
    4 days ago
  • $112.7k - $193.2k

     ...serve as you help us advance health optimization...  ...production grade AI/ML and Generative...  ..., automation, and engineering productivity Design...  ..., vector indexing, evaluation frameworks, and...  ...Partner closely with senior engineers, architects...  ...with Product, QA, and Operations teams... 
    Minimum wage
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    UnitedHealth Group

    Raleigh, NC
    1 day ago
  • $102.5k - $187.9k

     .... Technology – Digital Engineering – Full Stack Engineer (Senior) Whole industries have been...  ..., operations, and applied AI across a wide range of...  ...teams in the world. Join us. Even if you do not check...  ...methods, techniques, and evaluation criteria for obtaining results... 
    Senior
    Summer holiday
    Local area
    Flexible hours

    EY

    Raleigh, NC
    2 days ago
  • A leading technology company is seeking experienced AI Engineers to join their team. This remote role involves designing and deploying production-grade AI systems for financial institutions, focusing on back-office workflow automation. Candidates should have 3-5+ years... 
    Senior
    Remote work

    Lumenalta

    Raleigh, NC
    4 days ago
  • $40 per hour

    A cybersecurity firm is seeking experienced professionals to train AI models by evaluating cybersecurity content and solving technical problems. The role offers flexible remote work options across various countries. Candidates should have 2+ years of cybersecurity experience... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Raleigh, NC
    4 days ago
  • $40 per hour

     ...company is seeking experienced professionals to help train AI models remotely. In this role, you'll evaluate AI-generated security content, solve technical...  ...analytical skills. This position is open to candidates in the US and several other countries, offering flexibility in... 
    Hourly pay
    Remote work

    DataAnnotation

    Raleigh, NC
    4 days ago
  •  ...We invite you to grow your career with us, experience our caring culture, and enjoy...  ...Services & Insurance Applied & Agentic AI Engineer Job Responsibilities Architect and...  ...steps, and tool executions. Develop evaluation frameworks to test reasoning accuracy,... 

    Sedgwick

    Raleigh, NC
    4 days ago
  • $60 per hour

     ...programmers to contribute to the development of AI systems. This remote position allows for a...  ...coding problems, writing code, and evaluating AI-generated code. Candidates should be fluent...  ...role is suitable for those based in the US, Canada, UK, Ireland, Australia, and New... 
    Hourly pay
    Remote work
    Flexible hours

    DataAnnotation

    Raleigh, NC
    2 days ago
  • $100k

     ...ready to make your mark in tech? For more than 14 years...  ..., Computer Science or Engineering or candidates with gaps...  .../Devops Positions Associate or Bachelors degree or...  ...Science/Data Analyst/AI/Machine learning Positions...  ...of all visa types and US citizens. Are you... 
    H1b

    SynergisticIT

    Raleigh, NC
    4 days ago
  •  ...mission is to leverage the power of data, AI, and emerging GenAI and Agentic AI...  ...Data and Decision Science - AI Native Engineering AI Engineering, Senior Manager, Consultant The opportunity EY...  ...range of paid time off options. Join us in our team‑led and leader‑enabled... 
    Senior
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Raleigh, NC
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to US Tech - AI Evaluation Engineer (QA) Senior Associate. Be the first to apply!