Agentic Testing
CitiusTech Inc.
Agentic testing + ETL Testing
Who we are: -
At CitiusTech , we constantly strive to solve the industry's greatest challenges with technology, creativity, and agility. With over 8,500 healthcare technology professionals worldwide, CitiusTech powers healthcare digital innovation, business transformation, and industry-wide convergence for over 140 organizations through next-generation technologies, solutions, and products. We aim to accelerate the transition to a human-first, sustainable, and digital healthcare ecosystem with the world's leading Healthcare and life sciences organizations and our partners.
Here is an opportunity for you to make a difference and collaborate with global leaders to shape the future of healthcare and positively impact human lives.
Our vision: -
To inspire new possibilities for the health ecosystem with technology and human ingenuity.
What is in it for you?
Looking for a Senior QA professional skilled in ETL, SQL, Azure Databricks, Agentic AI evaluation, web testing, and test automation tools , driving data integrity, compliance, and scalable validation strategies to join our team in Chicago, IL
Roles and Responsibilities: -
· We are building AI agents that generate the extraction queries and transformation logic instead plus the Workbench through which humans review and approve everything they produce.
· The agents emit metadata; the client's existing data platform executes it. What you'll do Own test strategy and reconciliation methodology Define the equivalence standard: what must match exactly, what may vary within tolerance, and at which layer each applies Design source-to-target validation across the redesigned path — raw ingestion, consolidated transformation, domain refined
· Establish risk-based prioritisation; the schedule does not permit exhaustive coverage of hundreds of tables Author the Test Strategy and Test Plan for review with the client in Phase 2 Own agent evaluation Build and maintain a golden reference set from existing production extracts, validated with the Epic SME, with strict separation between evaluation data and anything used to develop or tune the agents Stand up the evaluation harness in MLflow — scoring runs, versioning, candidate comparison
· Define and report the measures that matter mapping precision and recall, override rate, confidence calibration, run-to-run consistency, escalation correctness and cost per case Operate the regression gate — no prompt, skill or model change is promoted without passing evaluation.
· A prompt change can silently degrade quality with no data-level symptom Characterise how agents fail, not just how often: hallucinated tables, plausible-but-wrong column selection, silent omission of required fields, mis-selected join grain.
· Own the automated regression harness Automated comparison of new-path output against current production extracts Row counts, aggregate reconciliation, field-level comparison, type and precision validation, null and duplicate profiling, referential integrity Repeatable execution so every agent revision can be re-validated cheaply
· Design the control-critical test suites Member, health-system and facility isolation. Facility mapping is moving downstream, creating real regression risk against the guarantee that one member cannot see another member's data.
· A cross-member leak is the highest-severity failure mode on this engagement Contract-scope validation.
· Data-sharing contracts restrict access at facility, column and product level. Verifying that generated queries stay inside permitted scope is a testable control with legal consequences if missed Acquisition cost validation.
· Confirm optimised queries touch fewer source tables than baseline and that facility consolidation genuinely works Lead and report Direct two QA engineers; set standards, review coverage, own the defect taxonomy
· Confirm downstream compatibility across Databricks, SQL Server and Vertica Produce evidence packs suitable for client executive review, and defend methodology, sample sizes and statistical claims under scrutiny.
Experience: -
10+ Years
Location: -
Chicago, IL (Hybrid – 3 days' Work from Office)
Duration: -12+ Months
Educational Qualifications: -
Engineering Degree – BE/ME/BTech/MTech/BSc/MSc.
Technical certification in multiple technologies is desirable.
Skills: -
Mandatory skills
· 10+ years in data / ETL testing, including strategy ownership on at least one large migration or re-platforming programme
· Proven reconciliation and equivalence testing — demonstrating that a rebuilt pipeline produces output equivalent to a legacy one, and defending that conclusion to stakeholders
· Expert SQL — complex analytical validation queries written independently against unfamiliar schemas Databricks / PySpark for validation at data volume Python for test automation and harness development
· Data quality and test automation frameworks — Great Expectations, dbt tests, pytest or equivalent Test strategy authorship — coverage models, risk-based prioritisation, entry and exit criteria, defect taxonomy multi-target validation across at least two of Databricks, SQL Server, Vertica or comparable
· Experience testing PHI-scoped healthcare data, including de-identified or synthetic test data Defect management and reporting in Azure Boards Team leadership — setting standards and reviewing others' coverage
· Ability to state an uncomfortable quality position to senior stakeholders and hold it Preferred Experience evaluating LLM or GenAI systems — MLflow, LangSmith, Weights & Biases or equivalent; LLM-as-judge design and its failure modes Applied statistics — sampling design, confidence intervals, significance testing, calibration measurement Epic EHR data experience
· Caboodle or Clarity Clinical coding systems: ICD, CPT, SNOMED, LOINC Multi-tenant data isolation testing Experience testing code- or SQL-generation systems Prior work where test evidence was presented directly to client executives
· Software Design and Best Practices: Apply software design principles such as SOLID and Domain-Driven Design.
· Understand code patterns and practices.
· Maintain currency in technical skills and industry trends.
Skills
ETL, SQL, Azure Databricks, Agentic AI testing, Web testing Any Data Automation tool.
Life at CitiusTech
We focus on building highly motivated engineering teams and thought leaders with an entrepreneurial mindset, centred on our core values of Passion, Respect, Openness, Unity, and Depth (PROUD) of knowledge . Our success lies in creating a fun, transparent, non-hierarchical, diverse work culture that focuses on continuous learning and work-life balance.
Rated by our employees as the 'Great Place to Work for' according to the Great Place to Work survey. We offer you a comprehensive set of benefits to ensure that you have a long and rewarding career with us.
Equal Opportunity Employer
CitiusTech is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, colour, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.
Our EVP
Be You Be Awesome is our EVP and it reflects our continuing efforts to create CitiusTech as a great place to work where our employees can thrive, both personally and professionally. It encompasses the unique benefits and opportunities we offer to support your growth, well-being, and success throughout your journey with us and beyond. Together with our clients, we are solving some of the greatest healthcare challenges and positively impacting human lives. Welcome to the world of Faster Growth, Higher Learning, and Stronger Impact.
Join CitiusTech. Be You. Be Awesome.
$150k - $200k
...Forward Deployed Engineer – Agentic AI_New York, Bay Area, Dallas, or Chicago_Full-time_Hybrid Common Employment and Process Details... ..., reliability, security, latency and cost; iterate based on testing and user feedback. Support production deployment, monitoring...SuggestedFull timeRemote work- ...generation of software — and we're looking for a Principal Engineer, Agentic AI to join our Core Platform Team Most Lead roles at "Big... .... Code Excellence: Champion best practices in security, test automation, and maintainability. Conduct deep-dive code reviews...SuggestedLocal areaRemote workWork from homeHome officeFlexible hoursShift work
- ...documenting source?to?target requirements Assist with UAT planning, test case development, and defect triage Ensure requirements... ...syndication Stay up to date on industry trends related to Agentic Commerce and leverage of GenAI and Agentic solutions to automate...Suggested
$113.3k - $226.7k
...engineering role that sets technical direction for production agentic systems at Abbott. This role leads the design of complex multi... ...production systems. ~ Hands-on experience designing, coding, testing, deploying, and operating agentic or LLM-based applications in...SuggestedFull timeWorldwide- ...prompts, and verification techniques. Partner with architects, AI Test Leads, security, infrastructure, and application teams to... ...of complex production and P1 incidents. Mentor developers in agentic engineering, AI-assisted development, secure coding, code review...SuggestedContract work
$100k - $130k
...our industry leading success in mergers and acquisitions Job Summary: HUB International Limited is looking for an experienced Test Lead (Job Title: Quality Engineer II) to join our Enterprise Testing Team. In this role, you will have the opportunity to work with...Full time- ...across high-performance trading, clearing, and instrument management systems. Design, develop, and execute automated and manual test cases based on functional and technical requirements. Identify opportunities to improve test coverage, automation efficiency, and...Full timeContract work
- *No C2C* IT Software Engineer 4 – Senior SDET Key Responsibilities Extend and enhance existing test automation frameworks using Java and JavaScript. Take ownership of understanding business requirements and acceptance criteria to develop comprehensive test strategies...Full timeFlexible hours
- ...transformation by advancing intelligent automation, continuous testing, predictive quality analytics, and engineering excellence practices... ...AI-powered quality transformation, implementing Generative AI, Agentic AI, predictive analytics, and intelligent automation to improve...
- ...Overview DecisionPoint seeks a Performance & Resilience Test Engineer to evaluate the scalability, stability, responsiveness, failover behavior, and recovery capabilities of mission-critical software supporting the USMEPCOM ENLIST program. This role develops...Contract workFor contractorsLocal areaRemote work
- ...and adapt to new tools and technologies is essential. ### Responsibilities: * Develop, implement, and maintain comprehensive **test plans** and **test cases** based on trucking industry knowledge. * Execute **manual testing** for **web and mobile applications**,...Remote work
- ...opportunities where AI can accelerate requirements, design, development, testing, and delivery processes. Establish AI evaluation frameworks,... ...(AI-DLC). Practical knowledge of LLMs, Generative AI, Agentic AI, RAG, and Context Engineering. Experience with AI...
- ...Overview DecisionPoint seeks a QA/Test Automation Engineer to validate complex accession-processing workflows, business rules, integrations, and exception paths for the USMEPCOM ENLIST program. This senior role develops traceable functional test cases and test...Contract workFor contractorsLocal areaRemote work
- ...Chicago is seeking a full-time Software Development Engineer in Test to support next-generation trading, market data, analytics, and... ...or AI testing exposure Experience with LLMs, Claude, Copilot, or agentic coding tools Knowledge of REST API testing and Rest Assured C# development...Full timeFlexible hours
- ...Description: AKA Senior SDET Extend testing automation framework using JAVA/JAVA Script. Take ownership in understanding business requirements/ACs and develop test strategy/test plan Develop automation test cases using existing automation framework Responsibilities...Flexible hours
- ...criteria for new capabilities and interface changes. ~ Conduct accessibility evaluations using manual reviews, automated testing tools, keyboard testing, and assistive-technology testing as appropriate. ~ Support compliance with applicable Section 508...Contract workFor contractorsLocal areaRemote work
- ...requirements, user stories, functional specifications, and technical designs to ensure requirements are testable and complete. Develop test strategies, test plans, test cases, test scripts, and test data for application enhancements and new functionality. Design,...
- ...negotiable salary. The role involves ensuring the quality and reliability of our software products. As a QA Tester, you will execute test cases, identify bugs, and report issues. You will also collaborate with developers to resolve problems and ensure software meets...Full time
- ...Role : Test Lead Location: Chicago, Illinois (F2F Interview) Key Responsibilities: Testing & Quality Assurance • Lead and execute end-to-end manual testing activities across multiple SFCM modules. • Review and analyze business and technical requirements...
- ...Job Overview We are seeking a mid-to-senior-level Python Test Automation Engineer with strong hands-on experience in Python-based test framework development and automated test script creation. The ideal candidate will have excellent troubleshooting and problem-solving...
- ...Agentic Ai Architect With Azure Databricks Jd Top 5 must-have areas: # Azure Databricks / Lakehouse # Strong Data Engineering... ...assisted requirements, data modeling, code/pipeline generation, testing, code review, documentation, deployment, and monitoring. Governance...Work at office3 days per week
- ...electronic trading business. You'll work closely with engineering and operations teams to improve the reliability of development and testing platforms used to build and validate trading systems. What You'll Do Support Linux-based development and UAT environments...Work at office3 days per week
- ...software solutions emphasizing reliability, stability, fault tolerance, and maintainability. • Specify, develop, and execute unit tests, integration tests, and automated test procedures. • Participate in code reviews, software design reviews, and technical discussions...Local area
- ...'ll enable teams by providing them with the environment and knowledge to run a robust quality program. You'll execute by performing tests where appropriate. You are a software engineer first, a quality practitioner second. You'll change the way we develop and ship reliable...Work experience placementRemote workFlexible hoursShift work
$48k - $52k
...SGS is the global leader and innovator in inspection, verification, testing and certification services. Founded in 1878, SGS is recognized as the global benchmark in quality and integrity. With over 97,000 employees in 130 countries and operating a network of more than...Full timeWork experience placementLocal areaImmediate startRelocation- ...Test Automation Engineer Designing and developing test automation scripts. Convert manual tests to automated tests. Using test automation guidelines. Researching issues in software through testing. Collaborating with QA Analysts and Software Developers...
- ...Possibility for Extension or Conversion) Position Summary: The Technology Quality Assurance Specialist is an experienced software testing professional that ensures solutions perform at a level of excellence and maintains focus on client needs. This position is...Full timeContract workLocal areaRemote work
$200k - $220k
...prototyping process, including creating proof-of-concept designs and agentic workflows to illustrate solution design options, gain... ...business requirements; Designs UAT process and conducts or oversees testing, ensuring high performance and mitigation of AI risk....Visa sponsorship- ...Overview DecisionPoint seeks a Test & Evaluation Lead to own the test strategy, Test and Evaluation Master Plan (TEMP) alignment, requirements coverage, verification evidence, defect triage, and release testing for the USMEPCOM ENLIST program. This senior role...Contract workTemporary workFor contractorsLocal areaRemote work
- ...DescriptionJob Description The Senior Software Developer designs, develops, tests, and maintains software applications and services while serving... ...Developer is expected to effectively leverage AI-assisted and agentic software development tools to improve delivery speed and...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Agentic Testing. Be the first to apply!








