Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Quality Assurance Analyst Associate(Fellowship Program)

Texas State Agency Business Administrators Association

AI Quality Assurance Analyst Associate(Fellowship Program) The Information Technology (IT) Division lays the foundation for TRS to deliver excellent service experiences across the organization and with our members. We serve with purpose through mentorship and collaboration across a broad variety of teams unified by innovation to create technology and information solutions that have a positive impact on our members' lives. We invite you to join one of Austin's Top Workplaces. TRS offers a best-in-class combination of technology and continuous learning opportunities to equip you to solve problems, expand your knowledge, and create impact for 1 in 20 Texans. The AI QA Analyst Associate will support the Testing and Quality Assurance team within the AI Technology Platform (AITP) program. The incumbent will focus on validating AI-enabled solutions, including LLM agents, and intelligent automation solutions. Responsibilities include evaluating model behavior, prompt effectiveness, response accuracy, system reliability, as well as testing AI workflows, data pipelines, and system integrations, assist in developing automated testing strategies, supporting CI/CD pipelines, and improving regression test coverage. This Fellowship Program position is a full-time, temporary, limited term assignment not to exceed three years from the date of hire. It is intended for applicants that have graduated with a bachelor's degree or a master's degree from an accredited college or university in Computer Science, Information Technology, Software Engineering, Data Science, or a closely related field awarded within the last 12 months. This position requires onsite work at our Austin TX headquarters. AI Quality Assurance & Test Automation • Assists in designing, developing, and executing automated test strategies for AI-enabled applications. • Supports testing of AI workflows, data pipelines, and system integrations. • Assists with prompt testing, hallucination detection, and evaluation of AI model performance using defined metrics. • Supports basic bias and safety validation activities and participates in human-in-the-loop review processes to ensure accurate and appropriate AI outputs. • Identifies and documents defects, inconsistencies, and risks during testing cycles. • Assists with validating AI model inputs, outputs, and data flows to ensure accuracy and reliability. • Supports testing of AI-driven features, including conversational agents and workflow automation. Support Functions • Supports data analysis related to AI system performance, including reviewing evaluation outputs, identifying trends, Assisting with reporting model quality metrics. Fellowship Curriculum • Participates in trainings and projects related to the TRS Fellowship Program including webinars, quarterly check-ins, classes or other learning activities, book group, projects, and the mentoring program. • Meets TRS Fellowship Program deadlines and goals for completion of trainings in deliverables in a timely manner. Performs related work as assigned. Required Education • Bachelor's degree or Master's degree in Computer Science, Information Technology, Software Engineering, Data Science, or a closely related field awarded within the last 12 months. Required Experience • None. Required Registration, Certification, Licensure • None. Preferred Qualifications • Experience with prompt engineering • Proficiency in Python or a similar programming language • Experience with database queries (e.g., SQL) for validating data integrity • Familiarity with testing AI workflows or data-driven applications • Exposure to Microsoft Copilot Studio, including testing conversational agents and integrations • Familiarity with Azure AI services (e.g., Azure AI Foundry) and understanding of AI data flows • Exposure to CI/CD tools and automated testing frameworks Knowledge of: • Fundamentals of Machine Learning and Large Language Models • AI system evaluation techniques • Prompt engineering concepts and conversational AI design • Responsible AI principles • Basic QA methodologies, software testing concepts, and automation approaches • Software development lifecycle and modern DevOps practices Skill in: • Evaluating AI generated outputs using quantitative and qualitative methods • Writing effective prompts for conversational AI systems • Using evaluating datasets and defining expected AI behavior • Writing and executing test cases (manual and automated) • Analyzing data and identifying defects or inconsistencies • Communicating technical findings to technical and non-technical stakeholders • Managing multiple tasks in a structured, team-based environment Ability to: • Analyze AI system behavior and identify non deterministic issues • Evaluate ambiguous outputs and apply judgement based validation • Collaborate with data scientists and AI engineers on model improvements • Work with business users on requirement clarification, user acceptance tests, and troubleshooting issues. • Plan, organize, and coordinate work assignments to effectively meet frequent and/or multiple deadlines; handling multiple tasks simultaneously; and managing conflicting priorities and demands. • Work in a team test environment. • Analyze problems and devising effective solutions. • Effective verbal and written communication of complex technical information • Establish and maintain harmonious working relationships with co-workers, agency staff, and external contacts. • Work effectively in a professional team environment. Military Occupational Specialty (MOS) Codes: Veterans, Reservists or Guardsmen with experience in the Military Occupational Specialty along with the minimum qualifications listed above may meet the minimum requirements and are highly encouraged to apply. Please contact Talent Acquisition at View email address on click.appcast.io with questions or for additional information. Texas State Agency Business Administrators Association

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Quality Assurance Analyst Associate(Fellowship Program) in Austin, TX vacancy
  • PROLIM ( is currently seeking QA Associate/Analyst 3 for one of our top Client for Location- 701...  ...description: Investigate and diagnose quality complaints, track down components, and...  ...record test results post execution by the program. • Coordinate UAT schedules and... 
    Suggested
    Local area
    Remote work

    PROLIM Corporation

    Austin, TX
    1 day ago
  • Software Quality Assurance Tester Develop, enhance, maintain, and execute existing and new test plans and scenarios for performing software...  ...support for testing and implementation efforts. Participate in program design, coding and test walk-through meetings to provide... 
    Suggested

    TexcelVision Inc.

    Austin, TX
    1 day ago
  • $50k - $60k

     ...Summary We are seeking a QA Analyst to support testing...  ...a combination of AI-assisted, automated, and...  ...test outcomes, escalate quality concerns, and...  ...years of software quality assurance experience, including...  ...frameworks. Basic scripting or programming skills in JavaScript,... 
    Suggested
    Local area

    Harris Local Government Solutions Inc.

    Austin, TX
    1 day ago
  • $73.79k - $92.24k

    Testing & Quality Assurance Analyst Or Sr. The Information Technology (IT) Division lays the foundation...  ...and constructive feedback to the programming team regarding defects discovered as...  ...staff, and external contacts. Texas State Agency Business Administrators Association
    Suggested
    Full time
    Work experience placement

    Texas State Agency Business Administrators Association

    Austin, TX
    1 day ago
  • $75 - $105 per hour

     ...About the Opportunity Our client, a leading AI research organization, is looking for engineers and computational researchers to...  ..., or a completed STEM master’s degree or PhD with intensive programming and computational research experience. Strong Python code-reading... 
    Suggested
    Hourly pay
    Immediate start

    Braintrust

    Austin, TX
    3 days ago
  • $38 per hour

     ...Data Quality Analyst Welo Data is looking for experienced, detail-oriented...  ...— bridging Data Labeling Associates (DLAs) and Team Leads to ensure...  ...closely with both people and AI systems — auditing outputs,...  ...Plan ~ Employee Assistance Program ~ Additional voluntary benefits... 
    Full time
    Contract work
    Remote work
    Visa sponsorship

    Welocalize

    Austin, TX
    3 days ago
  •  ...Data Quality Analyst – Hungarian Language Specialist Are you fluent in...  ...quality, content evaluation, and AI-related initiatives that help...  ...innovative technology programs. Please Note: This posting is...  ...data collection and quality assurance audits. Conduct internal research... 
    Weekly pay
    Immediate start
    Remote work
    Flexible hours

    Experis

    Austin, TX
    1 day ago
  •  ...Dedicated to supporting quality systems through the focused evaluation of raw materials used in the packaging process. This position...  ...Vacation, Sick, Flex Time Paid Parental Leave Adoption Assistance Program Dependent Care Flexible Spending Account Health Savings Account... 
    Work at office
    Monday to Thursday
    Flexible hours
    Shift work

    Tito's

    Austin, TX
    1 day ago
  •  ...JOB SUMMARY The Quality Assurance Specialist performs routine monitoring work and uses statistical...  ...and maintains documentation on program reviews. Compiles required monitoring...  ...High School Diploma or GED required. Associates or Undergraduate degree preferred. (1-... 
    Temporary work
    Work experience placement
    Work at office
    Local area
    Flexible hours

    C2 GPS Rural Capital Area

    Round Rock, TX
    1 day ago
  • $49.7k - $81.65k

     ...Quality Assurance SpecialistBy joining Bio-Techne, you'll join a company with a powerful and positive purpose of enabling cutting-edge research...  ...training and development, tuition reimbursement, internship programs, and more. We offer employee resource groups, volunteer paid... 
    Temporary work
    Internship
    Work at office
    Worldwide
    Flexible hours

    Bio-Techne

    Austin, TX
    10 hours ago
  •  ...Workplaces in Financial Services & InsuranceQuality Assurance Specialist - AutoPRIMARY PURPOSE: To assess, promote and confirm data quality and/or performance of investigative service...  ....Supports the organization's quality program(s).QUALIFICATIONSEducation &... 
    Full time
    Contract work
    Work at office
    Local area

    Sedgwick

    Austin, TX
    2 days ago
  •  ...genetic diseases. We are a global pioneer in AI-driven genetic diagnostics, leveraging...  ...looking for a dedicated and meticulous Quality Assurance Specialist to be the regulatory force...  ...monitoring of all proficiency testing (PT) programs. Quality Metrics & KPIs: Develop... 
    Full time
    Worldwide

    3billion, Inc.

    Austin, TX
    1 day ago
  •  ...Quality Assurance Specialist Duties Designs/implements/maintains a risk-based surveillance program and assessment plan associated with the quality assurance provisions of contracts. Identifies opportunities for process improvements by analyzing data. As a member... 
    Full time
    Part time
    For contractors
    Overseas

    Clearance Jobs

    Austin, TX
    2 days ago
  •  ...Invoice Quality Assurance Specialist Invoice Quality Assurance Specialist is responsible for reviewing construction contractor invoices...  ...disability insurance (90 day waiting period) ~ Employee Assistance Program ~ Sick and Vacation time (Flex time for salary positions,... 
    Hourly pay
    Daily paid
    Full time
    Temporary work
    For contractors
    Flexible hours

    Tesla

    Austin, TX
    1 day ago
  •  ...our team. We are looking to add a Quality Assurance Associate II   to our team. In this position, you...  .... You will be responsible for programming and using inspection/analysis equipment...  ...We may use artificial intelligence (AI) tools to support parts of the hiring... 
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Local area

    CesiumAstro

    Austin, TX
    18 days ago
  •  ...efforts.We are looking for a world-class Quality Analyst (QA) to join the Data Solutions & Initiatives...  ...will need a strong foundation in quality assurance, data analysis, and system testing, with the ability to evaluate and support AI-powered and LLM-based features. This role... 

    Apple

    Austin, TX
    1 day ago
  •  ...Grow with us ASIC Quality Data Analyst Austin, Texas Hybrid, on-site work schedule Ericsson Silicon...  ...ASIC Quality Data Analyst with strong AI and analytical capabilities to analyze...  ...paid benefits such as financial wellness programs, educational assistance, matching gifts... 
    Full time
    Temporary work

    Ericsson

    Austin, TX
    7 days ago
  • $76.73k - $150k

     ...We are seeking a Data Governance & Data Quality Analyst with 5+ years of experience in data governance...  ..., master data management (MDM), AI readiness, and data quality initiatives...  ...lineage, and stewardship. Assist MDM programs through data mapping, validation rules,... 
    Full time
    Local area

    Capgemini Service SAS

    Austin, TX
    14 days ago
  • $65.5k - $98.2k

     ...authorization. External applicants must be eligible to work in the US. Your Role: MilliporeSigma has an opening as a Quality Assurance (QA) Specialist at our Round Rock location. In this role you will efficiently review and release quality production documents... 
    Local area

    Merck Group

    Round Rock, TX
    1 day ago
  •  ...Quality Assurance Specialist (Full-Time)Employer type: Biotech (antibody therapeutics, in-house manufacturing).What the work involves:Ensure that all products and processes comply with regulatory standards. Conduct audits, review quality control documentation, and implement... 
    Full time

    MLee Healthcare Staffing and Recruiting, Inc

    Austin, TX
    1 day ago
  • $75k - $80k

     ...Netherlands. As a recognized leader in AI and machine learning, our team...  ...logistics.    Job Overview The Quality Assurance & Advocacy Lead Analyst investigates customer escalations, analyzes...  ...participates in the E-Verify program for all locations.   A friendly reminder... 
    Remote work
    Monday to Friday
    Flexible hours
    Shift work
    Weekend work
    Afternoon shift

    Airspace

    Austin, TX
    12 days ago
  • Company DescriptionIDEALFORCE have a Contractposition available immediately for a QA Analyst/SR to join our customer in Phoenix Arizona. This is an ONSITE position. Please find below additional details about this job. Kindly respond with your most up to date resume if you... 
    Immediate start

    idealforce

    Austin, TX
    3 days ago
  •  ....More about our mission and what we offer.Job DescriptionAs a Quality Assurance Specialist with a focus on SAR Reporting at Wise, you are responsible...  ...missing information, issues, trends and root causes, using AI and data as appropriate. Systems and Tools: Competent using... 

    Wise

    Austin, TX
    16 hours ago
  •  ...parents are already doing by increasing student engagement with high-quality, standards-aligned practice that reinforces classroom learning....  ...effort over time. Level is looking for a Senior Release QA Analyst to own release quality: giving the team clear, evidence-based... 

    Le-Vel

    Austin, TX
    1 day ago
  • POSITION SUMMARY: The Senior Quality Assurance Analyst is responsible for ensuring that the application software that IT places into production...  ...report Good understanding of quality assurance methodologies in a high-tech environment Texas Windstorm Insurance Association

    Texas Windstorm Insurance Association

    Austin, TX
    3 days ago
  • Wise is hiring a Quality Assurance Specialist focusing on SAR reporting in Austin. You will conduct risk-based QA reviews of AML processes, identify root causes, and advise on policy-aligned improvements. Strong English communication and experience with SAR/AML are required... 

    Wise

    Austin, TX
    16 hours ago
  • $68.8k - $113.6k

     ...help EY deliver exceptional quality service to our clients, win...  ...manage EY's risk. As an Associate in the Data Analyst role within Fair Employment...  ...relevant data, EY tools, approved AI tools, and other resources...  ...spectrum of services in assurance, consulting, tax, strategy... 
    Work experience placement
    Summer holiday
    Immediate start
    Flexible hours

    EY

    Austin, TX
    1 day ago
  • $80 - $120 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Austin, TX
    7 days ago
  • Welocalize is seeking a Slovak Localization QA Tester / Proofreader to join our long-term team. You will review and refine localized content, ensure it reads naturally, and catch grammar, punctuation, and formatting issues across software, mobile apps, and documentation...

    Welocalize

    Austin, TX
    16 hours ago
  •  ...updated procedures. Reviews legislative and program proposals/changes to determine impact on...  ...Assistance Center (TAC) and the quality of service to the taxpayer.Evaluates current...  ...Works closely with the CQRS management and analysts and develops communication with... 

    Treasury Department

    Austin, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Quality Assurance Analyst Associate(Fellowship Program). Be the first to apply!