AI Quality Assurance Analyst Associate(Fellowship Program)
Texas State Agency Business Administrators Association
AI Quality Assurance Analyst Associate(Fellowship Program) The Information Technology (IT) Division lays the foundation for TRS to deliver excellent service experiences across the organization and with our members. We serve with purpose through mentorship and collaboration across a broad variety of teams unified by innovation to create technology and information solutions that have a positive impact on our members' lives. We invite you to join one of Austin's Top Workplaces. TRS offers a best-in-class combination of technology and continuous learning opportunities to equip you to solve problems, expand your knowledge, and create impact for 1 in 20 Texans. The AI QA Analyst Associate will support the Testing and Quality Assurance team within the AI Technology Platform (AITP) program. The incumbent will focus on validating AI-enabled solutions, including LLM agents, and intelligent automation solutions. Responsibilities include evaluating model behavior, prompt effectiveness, response accuracy, system reliability, as well as testing AI workflows, data pipelines, and system integrations, assist in developing automated testing strategies, supporting CI/CD pipelines, and improving regression test coverage. This Fellowship Program position is a full-time, temporary, limited term assignment not to exceed three years from the date of hire. It is intended for applicants that have graduated with a bachelor's degree or a master's degree from an accredited college or university in Computer Science, Information Technology, Software Engineering, Data Science, or a closely related field awarded within the last 12 months. This position requires onsite work at our Austin TX headquarters. AI Quality Assurance & Test Automation • Assists in designing, developing, and executing automated test strategies for AI-enabled applications. • Supports testing of AI workflows, data pipelines, and system integrations. • Assists with prompt testing, hallucination detection, and evaluation of AI model performance using defined metrics. • Supports basic bias and safety validation activities and participates in human-in-the-loop review processes to ensure accurate and appropriate AI outputs. • Identifies and documents defects, inconsistencies, and risks during testing cycles. • Assists with validating AI model inputs, outputs, and data flows to ensure accuracy and reliability. • Supports testing of AI-driven features, including conversational agents and workflow automation. Support Functions • Supports data analysis related to AI system performance, including reviewing evaluation outputs, identifying trends, Assisting with reporting model quality metrics. Fellowship Curriculum • Participates in trainings and projects related to the TRS Fellowship Program including webinars, quarterly check-ins, classes or other learning activities, book group, projects, and the mentoring program. • Meets TRS Fellowship Program deadlines and goals for completion of trainings in deliverables in a timely manner. Performs related work as assigned. Required Education • Bachelor's degree or Master's degree in Computer Science, Information Technology, Software Engineering, Data Science, or a closely related field awarded within the last 12 months. Required Experience • None. Required Registration, Certification, Licensure • None. Preferred Qualifications • Experience with prompt engineering • Proficiency in Python or a similar programming language • Experience with database queries (e.g., SQL) for validating data integrity • Familiarity with testing AI workflows or data-driven applications • Exposure to Microsoft Copilot Studio, including testing conversational agents and integrations • Familiarity with Azure AI services (e.g., Azure AI Foundry) and understanding of AI data flows • Exposure to CI/CD tools and automated testing frameworks Knowledge of: • Fundamentals of Machine Learning and Large Language Models • AI system evaluation techniques • Prompt engineering concepts and conversational AI design • Responsible AI principles • Basic QA methodologies, software testing concepts, and automation approaches • Software development lifecycle and modern DevOps practices Skill in: • Evaluating AI generated outputs using quantitative and qualitative methods • Writing effective prompts for conversational AI systems • Using evaluating datasets and defining expected AI behavior • Writing and executing test cases (manual and automated) • Analyzing data and identifying defects or inconsistencies • Communicating technical findings to technical and non-technical stakeholders • Managing multiple tasks in a structured, team-based environment Ability to: • Analyze AI system behavior and identify non deterministic issues • Evaluate ambiguous outputs and apply judgement based validation • Collaborate with data scientists and AI engineers on model improvements • Work with business users on requirement clarification, user acceptance tests, and troubleshooting issues. • Plan, organize, and coordinate work assignments to effectively meet frequent and/or multiple deadlines; handling multiple tasks simultaneously; and managing conflicting priorities and demands. • Work in a team test environment. • Analyze problems and devising effective solutions. • Effective verbal and written communication of complex technical information • Establish and maintain harmonious working relationships with co-workers, agency staff, and external contacts. • Work effectively in a professional team environment. Military Occupational Specialty (MOS) Codes: Veterans, Reservists or Guardsmen with experience in the Military Occupational Specialty along with the minimum qualifications listed above may meet the minimum requirements and are highly encouraged to apply. Please contact Talent Acquisition at View email address on click.appcast.io with questions or for additional information. Texas State Agency Business Administrators Association
- PROLIM ( is currently seeking QA Associate/Analyst 3 for one of our top Client for Location- 701... ...description: Investigate and diagnose quality complaints, track down components, and... ...record test results post execution by the program. • Coordinate UAT schedules and...SuggestedLocal areaRemote work
- Software Quality Assurance Tester Develop, enhance, maintain, and execute existing and new test plans and scenarios for performing software... ...support for testing and implementation efforts. Participate in program design, coding and test walk-through meetings to provide...Suggested
$50k - $60k
...Summary We are seeking a QA Analyst to support testing... ...a combination of AI-assisted, automated, and... ...test outcomes, escalate quality concerns, and... ...years of software quality assurance experience, including... ...frameworks. Basic scripting or programming skills in JavaScript,...SuggestedLocal area$73.79k - $92.24k
Testing & Quality Assurance Analyst Or Sr. The Information Technology (IT) Division lays the foundation... ...and constructive feedback to the programming team regarding defects discovered as... ...staff, and external contacts. Texas State Agency Business Administrators AssociationSuggestedFull timeWork experience placement$75 - $105 per hour
...About the Opportunity Our client, a leading AI research organization, is looking for engineers and computational researchers to... ..., or a completed STEM master’s degree or PhD with intensive programming and computational research experience. Strong Python code-reading...SuggestedHourly payImmediate start$38 per hour
...Data Quality Analyst Welo Data is looking for experienced, detail-oriented... ...— bridging Data Labeling Associates (DLAs) and Team Leads to ensure... ...closely with both people and AI systems — auditing outputs,... ...Plan ~ Employee Assistance Program ~ Additional voluntary benefits...Full timeContract workRemote workVisa sponsorship- ...Data Quality Analyst – Hungarian Language Specialist Are you fluent in... ...quality, content evaluation, and AI-related initiatives that help... ...innovative technology programs. Please Note: This posting is... ...data collection and quality assurance audits. Conduct internal research...Weekly payImmediate startRemote workFlexible hours
- ...Dedicated to supporting quality systems through the focused evaluation of raw materials used in the packaging process. This position... ...Vacation, Sick, Flex Time Paid Parental Leave Adoption Assistance Program Dependent Care Flexible Spending Account Health Savings Account...Work at officeMonday to ThursdayFlexible hoursShift work
- ...JOB SUMMARY The Quality Assurance Specialist performs routine monitoring work and uses statistical... ...and maintains documentation on program reviews. Compiles required monitoring... ...High School Diploma or GED required. Associates or Undergraduate degree preferred. (1-...Temporary workWork experience placementWork at officeLocal areaFlexible hours
$49.7k - $81.65k
...Quality Assurance SpecialistBy joining Bio-Techne, you'll join a company with a powerful and positive purpose of enabling cutting-edge research... ...training and development, tuition reimbursement, internship programs, and more. We offer employee resource groups, volunteer paid...Temporary workInternshipWork at officeWorldwideFlexible hours- ...Workplaces in Financial Services & InsuranceQuality Assurance Specialist - AutoPRIMARY PURPOSE: To assess, promote and confirm data quality and/or performance of investigative service... ....Supports the organization's quality program(s).QUALIFICATIONSEducation &...Full timeContract workWork at officeLocal area
- ...genetic diseases. We are a global pioneer in AI-driven genetic diagnostics, leveraging... ...looking for a dedicated and meticulous Quality Assurance Specialist to be the regulatory force... ...monitoring of all proficiency testing (PT) programs. Quality Metrics & KPIs: Develop...Full timeWorldwide
- ...Quality Assurance Specialist Duties Designs/implements/maintains a risk-based surveillance program and assessment plan associated with the quality assurance provisions of contracts. Identifies opportunities for process improvements by analyzing data. As a member...Full timePart timeFor contractorsOverseas
- ...Invoice Quality Assurance Specialist Invoice Quality Assurance Specialist is responsible for reviewing construction contractor invoices... ...disability insurance (90 day waiting period) ~ Employee Assistance Program ~ Sick and Vacation time (Flex time for salary positions,...Hourly payDaily paidFull timeTemporary workFor contractorsFlexible hours
- ...our team. We are looking to add a Quality Assurance Associate II to our team. In this position, you... .... You will be responsible for programming and using inspection/analysis equipment... ...We may use artificial intelligence (AI) tools to support parts of the hiring...Permanent employmentFull timeContract workWork experience placementLocal area
- ...efforts.We are looking for a world-class Quality Analyst (QA) to join the Data Solutions & Initiatives... ...will need a strong foundation in quality assurance, data analysis, and system testing, with the ability to evaluate and support AI-powered and LLM-based features. This role...
- ...Grow with us ASIC Quality Data Analyst Austin, Texas Hybrid, on-site work schedule Ericsson Silicon... ...ASIC Quality Data Analyst with strong AI and analytical capabilities to analyze... ...paid benefits such as financial wellness programs, educational assistance, matching gifts...Full timeTemporary work
$76.73k - $150k
...We are seeking a Data Governance & Data Quality Analyst with 5+ years of experience in data governance... ..., master data management (MDM), AI readiness, and data quality initiatives... ...lineage, and stewardship. Assist MDM programs through data mapping, validation rules,...Full timeLocal area$65.5k - $98.2k
...authorization. External applicants must be eligible to work in the US. Your Role: MilliporeSigma has an opening as a Quality Assurance (QA) Specialist at our Round Rock location. In this role you will efficiently review and release quality production documents...Local area- ...Quality Assurance Specialist (Full-Time)Employer type: Biotech (antibody therapeutics, in-house manufacturing).What the work involves:Ensure that all products and processes comply with regulatory standards. Conduct audits, review quality control documentation, and implement...Full time
$75k - $80k
...Netherlands. As a recognized leader in AI and machine learning, our team... ...logistics. Job Overview The Quality Assurance & Advocacy Lead Analyst investigates customer escalations, analyzes... ...participates in the E-Verify program for all locations. A friendly reminder...Remote workMonday to FridayFlexible hoursShift workWeekend workAfternoon shift- Company DescriptionIDEALFORCE have a Contractposition available immediately for a QA Analyst/SR to join our customer in Phoenix Arizona. This is an ONSITE position. Please find below additional details about this job. Kindly respond with your most up to date resume if you...Immediate start
- ....More about our mission and what we offer.Job DescriptionAs a Quality Assurance Specialist with a focus on SAR Reporting at Wise, you are responsible... ...missing information, issues, trends and root causes, using AI and data as appropriate. Systems and Tools: Competent using...
- ...parents are already doing by increasing student engagement with high-quality, standards-aligned practice that reinforces classroom learning.... ...effort over time. Level is looking for a Senior Release QA Analyst to own release quality: giving the team clear, evidence-based...
- POSITION SUMMARY: The Senior Quality Assurance Analyst is responsible for ensuring that the application software that IT places into production... ...report Good understanding of quality assurance methodologies in a high-tech environment Texas Windstorm Insurance Association
- Wise is hiring a Quality Assurance Specialist focusing on SAR reporting in Austin. You will conduct risk-based QA reviews of AML processes, identify root causes, and advise on policy-aligned improvements. Strong English communication and experience with SAR/AML are required...
$68.8k - $113.6k
...help EY deliver exceptional quality service to our clients, win... ...manage EY's risk. As an Associate in the Data Analyst role within Fair Employment... ...relevant data, EY tools, approved AI tools, and other resources... ...spectrum of services in assurance, consulting, tax, strategy...Work experience placementSummer holidayImmediate startFlexible hours$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...Contract workSummer workWork at officeRemote work- Welocalize is seeking a Slovak Localization QA Tester / Proofreader to join our long-term team. You will review and refine localized content, ensure it reads naturally, and catch grammar, punctuation, and formatting issues across software, mobile apps, and documentation...
- ...updated procedures. Reviews legislative and program proposals/changes to determine impact on... ...Assistance Center (TAC) and the quality of service to the taxpayer.Evaluates current... ...Works closely with the CQRS management and analysts and develops communication with...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Quality Assurance Analyst Associate(Fellowship Program). Be the first to apply!
- qa associate Austin, TX
- qa specialist Austin, TX
- quality assurance specialist Austin, TX
- quality assurance associate Austin, TX
- supplier quality Austin, TX
- quality assurance quality control engineer Austin, TX
- rn quality Austin, TX
- quality reviewer Austin, TX
- quality Austin, TX
- quality environment health safety manager Austin, TX




