Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity)
HAN Staffing
Job ID: 29182714Reference Number: 26-00877Title: Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity)Posted Date: 2026-08-28Contact: Vishika ChaudharyContact Email: View email address on click.appcast.io Phone: (551) 795-0621Company: HAN Staffing Job Description: Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity) Location: Saint Lois, MO/ Dallas (Brillio)/ New York (Brillio)/ Last option is remote Experience- 7+ Years We are seeking an experienced Senior Quality Analyst to support the project initiative. The ideal candidate will have strong experience testing cloud-native, configuration-driven, event-based, and data-processing platforms. This role requires hands-on expertise in Python-based test automation, AWS services, Kafka, data pipeline validation, API testing, database testing, CI/CD, containerization, observability, and production-quality engineering. Experience 7+ years of overall experience in software quality engineering or software engineering. 5+ years of hands-on experience testing AWS-based applications, Kafka integrations, and data pipelines. Demonstrated experience designing and implementing automated testing frameworks using Python. Key Responsibilities Develop and execute comprehensive test strategies for the PISCES HUB platform. Design and maintain Python-based automation frameworks for API, integration, data pipeline, and end-to-end testing. Validate AWS-based data pipelines, event-driven workflows, and distributed application components. Test Kafka producers, consumers, topics, partitions, schemas, offsets, retries, and failure-recovery scenarios. Validate data accuracy, completeness, consistency, transformation logic, lineage, and reconciliation across pipelines. Test configuration-driven solutions, including metadata-driven workflows, dynamic business rules, and configurable integration frameworks. Validate JSON-, YAML-, and XML-based configurations, including schema validation, version compatibility, error handling, and backward compatibility. Perform functional, integration, regression, system, and negative testing. Validate REST APIs, asynchronous services, batch processes, and event-based integrations. Test SQL and NoSQL databases for data integrity, rule-configuration storage, versioning, auditability, and rollback capabilities. Integrate automated test suites with CI/CD pipelines and GitOps workflows. Test containerized workloads deployed using Docker, Kubernetes, Amazon EKS, and Amazon ECS. Use Dynatrace to monitor application behavior, analyze logs and traces, identify performance bottlenecks, and support root-cause analysis. Collaborate with developers, architects, product owners, DevOps engineers, and data engineers to define acceptance criteria and improve overall product quality. Track defects through resolution and provide clear reporting on testing progress, quality risks, and release readiness. Use Windsurf and other AI-assisted engineering tools to accelerate test-case creation, automation development, troubleshooting, and documentation. Required Technical Skills Strong proficiency in Python, including the development of reusable automation frameworks and test utilities. Hands-on experience with Python testing tools such as Pytest, unittest, requests, or equivalent frameworks. Strong experience testing AWS data pipelines and cloud-native applications. Hands-on knowledge of the following AWS services: o Amazon EKS o AWS Lambda o Amazon ECS o Amazon S3 o Amazon RDS o Amazon DynamoDB Strong experience testing Apache Kafka-based event-driven architectures. Proven experience validating: o Metadata-driven pipelines and workflows o Dynamic business-rule engines o Configuration-driven applications o Configurable APIs and data-integration frameworks Experience testing JSON-, YAML-, and XML-based configuration interpreters. Strong SQL skills and experience validating relational and NoSQL data stores. Understanding of database models used to store, version, audit, and retrieve rule configurations. Experience with API testing tools and frameworks such as Postman, REST Assured, or Python Requests. Strong understanding of CI/CD pipelines, Git, and GitOps practices. Hands-on experience with Docker, Kubernetes, and containerized application testing. Strong working knowledge of Dynatrace for monitoring, observability, performance analysis, and troubleshooting. Working knowledge of Windsurf or similar AI-assisted development tools. Preferred Qualifications Experience testing high-volume, distributed, event-driven platforms. Experience with data reconciliation, schema evolution, data-contract testing, and data-quality validation. Familiarity with Kafka schema management and serialization formats such as Avro, JSON, or Protobuf. Experience with performance-testing tools such as JMeter, Locust, or Gatling. Familiarity with infrastructure-as-code and deployment tools such as Terraform, Helm, or Argo CD. AWS or software-testing certifications are an advantage. Key Competencies Strong analytical and problem-solving abilities. Quality-first mindset with strong attention to detail. Ability to understand complex data flows and distributed system architectures. Strong debugging and root-cause-analysis skills. Ability to work independently and collaborate across engineering teams. Clear written and verbal communication skills. Ability to identify quality risks and communicate release-readiness recommendations to stakeholders.
- ...firm, is seeking a Data Integration Engineer with strong enterprise payment systems... ...and optimize data pipelines, work with SQL, Python (Pandas, PySpark... ...data platforms (AWS, Snowflake, Redshift... ...series data, data quality and lineage, and... ...processing with Kafka, Spark, #J-1880...Amazon Web ServicePipelineDataPython
- ...Scientist to join the Payment Solutions team in New... ...designing scalable data processing pipelines and developing models... ...improve transaction integrity and customer experience... ...and have expertise in Python, machine learning... ...processing, particularly in AWS environments. This...Amazon Web ServicePipelineDataSeniorPython
- ...on automation pipelines, data integrations, and the market... ...with other senior engineers to design... ...platforms (Kafka, Pulsar, RabbitMQ... ...to code quality: Participate in... ...proficiency in Python or Go (preferred... ...environments (AWS/GCP) and using... ...matchHardware setup — new MacBook...Amazon Web ServicePipelineDataSeniorPython
- Devoted Health is seeking a Senior Payment Integrity Program Development Manager to architect and invent the clinical claim edit and audit pipeline. You will lead ground-up development of automated... ...logic, validate hypotheses with data, and drive cross-functional policy...PipelineDataSeniorRemote job
- ...team owns. As a Senior Backend... ...primarily in Go, with Python or Java where appropriate... ...event-driven data pipelines and APIs using... ...platforms like Kafka or Pulsar,... ..., and data to integrate exchange... ...environments such as AWS or GCP, using containers... ...matchHardware setup: new MacBook...Amazon Web ServicePipelineDataSeniorPython
- ...Kafka Administrator New York, NY (Hybrid... ...connectivity problems, and data inconsistencies.... ...teams to integrate Kafka with enterprise... ...applications and data pipelines. Develop scripts... ...experience (Shell, Python, or similar) for automation... ...environments (AWS/Azure/GCP) is a...Amazon Web ServicePipelineDataPython
$160k - $195k
...Senior Integration EngineerDuet empowers Nurse Practitioners... ...we build runs on data that moves... ...Engineer, you'll own the pipelines that power Duet's... ...how data quality and pipeline reliability... ...discipline.Strong Python programming skills... ...infrastructure experience (AWS or GCP).Prior...Amazon Web ServicePipelineDataSeniorPythonLocal area- ...shape the future of data-driven innovation in Banking Payments. As a Data Owner Senior Associate, you’ll... ..., ensuring data quality, and protecting... ...ensuring data is integrated into analytics platforms... ..., data pipelines, data modeling, data... ...platforms such as AWS, Google, or Azure...Amazon Web ServicePipelineDataSenior
$140k - $160k
...looking for a Senior Data Engineer to... ...-time data pipelines and APIs that... ...ensure data quality,... ...performance and integrate solutions into... ...architectures (AWS preferred),... ...with Apache Kafka, Apache Flink... ...APIs using Python frameworks (... ...information or for payment, and will...Amazon Web ServicePipelineDataSeniorPythonFull timeLocal areaFlexible hours$126k - $149k
...Graph—to turn data insights... ...technical setup required to... ...Role:As a Senior Solutions Architect... ...successful integrations with their... ...APIs, and python.Adoption... ...platforms (AWS, Azure, GCP... ...Streaming (Kafka or similar)... ...SQL, data pipelines & ETL processes... ...enhance quality of day to...Amazon Web ServicePipelineDataSeniorPythonFull timeWork at officeLocal areaImmediate startRemote workWorldwideFlexible hours- ...Bank, J.P. Morgan Payments enables... ...transitioning high-quality machine learning... ...scalable and dependable data processing pipelines, conducting analysis... ...concepts to senior management and stakeholders... ..., PySpark, and AWS Cloud Services is... ...ML.Proficient in Python with hands-on...Amazon Web ServicePipelineDataSeniorPython
- ...rolePolymarket is looking for a senior backend engineer to... ...and scale the payments infrastructure that... ...money movement.Integrate with financial... ...fintech, or financial-data integrations (... ...cloud environments (AWS/GCP) and using containers... ...401k matchHardware setup — new MacBook Pro,...Amazon Web ServiceDataSenior
- ..., high-scale payments workflows. You... ...partner with senior stakeholders... ...Web Services (AWS) with strong... ...that improve quality, reliability,... ..., continuous integration and continuous... ...including data and text mining... ...secure data pipelines to support model... ...of advanced Python development...Amazon Web ServicePipelineDataPython
$110k - $130k
...project managers, data scientists,... ...and integrations, including systems... ...generation (RAG) pipelines and agentic... ...high-quality, maintainable... ...languages like Python or GoEnsure a... ...like GCP or AWS and their associated... ...such as Kafka or Pub/SubFamiliarity... ...or for payment, and will not...Amazon Web ServicePipelineDataPythonWork at officeLocal area2 days per week- ...looking for a senior/staff backend engineer... ...world — market data distribution,... ...event pipelines that keep trading... ...driven systems (Kafka, gRPC, DynamoDB... ...protocol-level integrations, driving 10x+ improvements... ...environments (AWS/GCP).... ...matchHardware setup — new MacBook Pro...Amazon Web ServicePipelineDataSenior
- ...Engineer- Java / AWS / Terraform / Kafka at JPMorganChase... ...Bank, you are an integral part of an agile... ...secure and high-quality production code,... ...workflows, including data sensitivity considerations... ...both Java and Python development... ...mortgages, credit cards, payments, auto finance and...Amazon Web ServiceDataPython
- ...looking for a data scientist who... ...safety, platform integrity, payments,... ...Implement robust data quality checks, reconciliation... ...maintain ETL pipelines, reusable... ...audiences, including senior leadership.-... ...language (Python or R).- 5+ years... ...(e.g., AWS, GCP, Azure, Snowflake...Amazon Web ServicePipelineDataSeniorPython
- ...searching for a Senior Data Engineer -... ...Investment Technology (Python) for a Direct... ...data pipelines ingesting data... ...Develop production-quality Python and SQL... ...Experience with AWS and cloud-based... ...Kubernetes/EKS, Kafka, and/or Redis .... ...and quality and integrity in everything we...Amazon Web ServicePipelineDataSeniorPythonRemote work
$240k - $310k
...issues. We’re data-driven and... ..., owning the pipelines, platform infrastructure... ..., cost, and quality. You're as... ...strategy to senior leadership.... ...attitude.Integrity - Simply put,... ...proficiency in SQL and Python; recognized... ...with AWS services (S3,... ...technologies (Estuary, Kafka, Debezium)...Amazon Web ServicePipelineDataSeniorPythonCasual workWork at officeLocal area$188k - $242k
...solve HR issues. We’re data-driven and never stop iterating... ...You Will Work OnAs a Senior Software Engineer for Workforce Payments, you will work with the... ..., improving the integrity of our financial ledger,... ...Rails, Javascript, MySQL, Kafka, AWS, Git, Memcache, Redis, ElasticSearch...Amazon Web ServiceDataSeniorCasual workWork at officeLocal area$160k - $175k
...Director, MDM Integrations based out of... ...insights, robust data, and dynamic... ...experience (AWS, Azure) and... ...Functions, MSK/Kafka, Event Bridge... ...) ~ Strong Python for data... ...Build ETL/ELT pipelines for batch and... ...generation, data quality checks, and... ...effectively with senior management...Amazon Web ServicePipelineDataPythonContract workTemporary workWork at officeImmediate start- ...seamless platform integration, and... ...consistent, high-quality platform... ...Java, Python, and cloud-... ...technologies (AWS/Azure/GCP).... ...custodial/payment systems. Ensure... ...-latency data processing... ...(Kafka, RabbitMQ).... ...with quant analysts and data scientists... ...Optimize data pipelines for client...Amazon Web ServicePipelineDataPython
- ...Senior Software Engineer – Multi-Asset Order... ...-party trading integrations Developing high-... ...performance market data and execution pipelines Scaling the... ...systems Expert-level Python for backend services... ...Experience with Kafka, RabbitMQ, SQS or... ...experience AWS and cloud architecture...Amazon Web ServicePipelineDataSeniorPython
- ...currently seeks a " Senior Data Practitioner/... ..., and high-quality data solutions.... ...real-time data pipelines using modern distributed... ...KPIs, data integrity, and platform... ...using Python and SQL. Strong... ...business events using Kafka or similar... ...Experience with AWS data services...Amazon Web ServicePipelineDataSeniorPythonWork at office3 days per week
$181k - $220k
...Senior Infrastructure Engineer At... ...smarter use of data is essential to... ...-native stack (AWS, Kubernetes, Terraform... ...improve CI/CD pipelines (GitHub Actions... ...skills in Python, Go, or Bash, plus... ...expect you to integrate AI into your... ...Whatever your setup, expectations will...Amazon Web ServicePipelineDataSeniorPythonWork experience placementWork at officeLocal areaFlexible hours$142.32k - $213.48k
...are looking for a Senior Generative AI... ...operations leads, data engineers, product... ...end Generative AI pipelines including LLM integrations, Retrieval-Augmented... ...frameworks.Python Development: Develop... ...OpenAI, Anthropic, AWS Bedrock, or... ...mitigationExposure to Kafka, Spark, or...Amazon Web ServicePipelineDataSeniorPythonFull time$86.7k - $170.9k
...Summary Integration Engineer II, API... ...in software, data, AI, network, and... ...and APIs using Python (e.g., FastAPI,... ...to detail and quality of work productAbility... ...(Azure, AWS, or GCP), including... ...CI/CD pipelines, testing strategies... ...level employees to senior leaders, we...Amazon Web ServicePipelineDataPythonLocal areaFlexible hours- ...looking for a Senior Java Developer (with Python skills) to... ...components as part of integrated... ...ensure code quality and adherence... ...practices via GitLab pipelines and modern DevOps... ...Boot, Spring Data JPA/Hibernate... ...platforms (AWS or Azure)... ...driven systems (Kafka, RabbitMQ)...Amazon Web ServicePipelineDataSeniorPythonWork at officeRemote workFlexible hours
$158.5k - $172k
...innovate—from integrated grocery delivery... ...OpportunityAs a Senior Engineer on the... ...across AWS and GCP, and driving... ...-critical card payment environment. This... ...cloud deployment pipelines using Jenkins... ...highest standards of data security,... ...automation utilizing Python and Bash to...Amazon Web ServicePipelineDataSeniorPythonFull timeTemporary workWork at officeFlexible hours3 days per week$150k - $185k
...smart audience data to change the game... ...’re seeking a Senior Software... ...modular systems that integrate third-party... ...microservices in an AWS environment.... ...contribute to a high-quality engineering... ..., Go, Scala, Python, TypeScript) Deep... ...-scale data pipelines (Kafka, Spark, Airflow...Amazon Web ServicePipelineDataSeniorPythonFull timeContract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity). Be the first to apply!
- quality analyst New York, NY
- quality improvement analyst New York, NY
- remote call center quality analyst New York, NY
- srs distribution New York, NY
- senior operations coordinator New York, NY
- senior associate architect New York, NY
- senior revenue operations analyst New York, NY
- senior dynamics crm developer New York, NY
- senior application security New York, NY
- senior account director New York, NY


