Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity)

HAN Staffing

Job ID: 29182714Reference Number: 26-00877Title: Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity)Posted Date: 2026-08-28Contact: Vishika ChaudharyContact Email: View email address on click.appcast.io Phone: (551) 795-0621Company: HAN Staffing Job Description: Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity) Location: Saint Lois, MO/ Dallas (Brillio)/ New York (Brillio)/ Last option is remote Experience- 7+ Years We are seeking an experienced Senior Quality Analyst to support the project initiative. The ideal candidate will have strong experience testing cloud-native, configuration-driven, event-based, and data-processing platforms. This role requires hands-on expertise in Python-based test automation, AWS services, Kafka, data pipeline validation, API testing, database testing, CI/CD, containerization, observability, and production-quality engineering. Experience 7+ years of overall experience in software quality engineering or software engineering. 5+ years of hands-on experience testing AWS-based applications, Kafka integrations, and data pipelines. Demonstrated experience designing and implementing automated testing frameworks using Python. Key Responsibilities Develop and execute comprehensive test strategies for the PISCES HUB platform. Design and maintain Python-based automation frameworks for API, integration, data pipeline, and end-to-end testing. Validate AWS-based data pipelines, event-driven workflows, and distributed application components. Test Kafka producers, consumers, topics, partitions, schemas, offsets, retries, and failure-recovery scenarios. Validate data accuracy, completeness, consistency, transformation logic, lineage, and reconciliation across pipelines. Test configuration-driven solutions, including metadata-driven workflows, dynamic business rules, and configurable integration frameworks. Validate JSON-, YAML-, and XML-based configurations, including schema validation, version compatibility, error handling, and backward compatibility. Perform functional, integration, regression, system, and negative testing. Validate REST APIs, asynchronous services, batch processes, and event-based integrations. Test SQL and NoSQL databases for data integrity, rule-configuration storage, versioning, auditability, and rollback capabilities. Integrate automated test suites with CI/CD pipelines and GitOps workflows. Test containerized workloads deployed using Docker, Kubernetes, Amazon EKS, and Amazon ECS. Use Dynatrace to monitor application behavior, analyze logs and traces, identify performance bottlenecks, and support root-cause analysis. Collaborate with developers, architects, product owners, DevOps engineers, and data engineers to define acceptance criteria and improve overall product quality. Track defects through resolution and provide clear reporting on testing progress, quality risks, and release readiness. Use Windsurf and other AI-assisted engineering tools to accelerate test-case creation, automation development, troubleshooting, and documentation. Required Technical Skills Strong proficiency in Python, including the development of reusable automation frameworks and test utilities. Hands-on experience with Python testing tools such as Pytest, unittest, requests, or equivalent frameworks. Strong experience testing AWS data pipelines and cloud-native applications. Hands-on knowledge of the following AWS services: o Amazon EKS o AWS Lambda o Amazon ECS o Amazon S3 o Amazon RDS o Amazon DynamoDB Strong experience testing Apache Kafka-based event-driven architectures. Proven experience validating: o Metadata-driven pipelines and workflows o Dynamic business-rule engines o Configuration-driven applications o Configurable APIs and data-integration frameworks Experience testing JSON-, YAML-, and XML-based configuration interpreters. Strong SQL skills and experience validating relational and NoSQL data stores. Understanding of database models used to store, version, audit, and retrieve rule configurations. Experience with API testing tools and frameworks such as Postman, REST Assured, or Python Requests. Strong understanding of CI/CD pipelines, Git, and GitOps practices. Hands-on experience with Docker, Kubernetes, and containerized application testing. Strong working knowledge of Dynatrace for monitoring, observability, performance analysis, and troubleshooting. Working knowledge of Windsurf or similar AI-assisted development tools. Preferred Qualifications Experience testing high-volume, distributed, event-driven platforms. Experience with data reconciliation, schema evolution, data-contract testing, and data-quality validation. Familiarity with Kafka schema management and serialization formats such as Avro, JSON, or Protobuf. Experience with performance-testing tools such as JMeter, Locust, or Gatling. Familiarity with infrastructure-as-code and deployment tools such as Terraform, Helm, or Argo CD. AWS or software-testing certifications are an advantage. Key Competencies Strong analytical and problem-solving abilities. Quality-first mindset with strong attention to detail. Ability to understand complex data flows and distributed system architectures. Strong debugging and root-cause-analysis skills. Ability to work independently and collaborate across engineering teams. Clear written and verbal communication skills. Ability to identify quality risks and communicate release-readiness recommendations to stakeholders.

Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity) in New York, NY vacancy
  •  ...firm, is seeking a Data Integration Engineer with strong enterprise payment systems...  ...and optimize data pipelines, work with SQL, Python (Pandas, PySpark...  ...data platforms (AWS, Snowflake, Redshift...  ...series data, data quality and lineage, and...  ...processing with Kafka, Spark, #J-1880... 
    Amazon Web Service
    Pipeline
    Data
    Python

    Synechron

    New York, NY
    2 days ago
  •  ...Scientist to join the Payment Solutions team in New...  ...designing scalable data processing pipelines and developing models...  ...improve transaction integrity and customer experience...  ...and have expertise in Python, machine learning...  ...processing, particularly in AWS environments. This... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python

    J.P. Morgan

    New York, NY
    2 days ago
  •  ...on automation pipelines, data integrations, and the market...  ...with other senior engineers to design...  ...platforms (Kafka, Pulsar, RabbitMQ...  ...to code quality: Participate in...  ...proficiency in Python or Go (preferred...  ...environments (AWS/GCP) and using...  ...matchHardware setup — new MacBook... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python

    Polymarket

    New York, NY
    1 day ago
  • Devoted Health is seeking a Senior Payment Integrity Program Development Manager to architect and invent the clinical claim edit and audit pipeline. You will lead ground-up development of automated...  ...logic, validate hypotheses with data, and drive cross-functional policy... 
    Pipeline
    Data
    Senior
    Remote job

    Remote Jobs

    New York, NY
    1 day ago
  •  ...team owns. As a Senior Backend...  ...primarily in Go, with Python or Java where appropriate...  ...event-driven data pipelines and APIs using...  ...platforms like Kafka or Pulsar,...  ..., and data to integrate exchange...  ...environments such as AWS or GCP, using containers...  ...matchHardware setup: new MacBook... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python

    Polymarket

    New York, NY
    17 hours ago
  •  ...Kafka Administrator New York, NY (Hybrid...  ...connectivity problems, and data inconsistencies....  ...teams to integrate Kafka with enterprise...  ...applications and data pipelines. Develop scripts...  ...experience (Shell, Python, or similar) for automation...  ...environments (AWS/Azure/GCP) is a... 
    Amazon Web Service
    Pipeline
    Data
    Python

    Staffing the Universe

    New York, NY
    21 hours ago
  • $160k - $195k

     ...Senior Integration EngineerDuet empowers Nurse Practitioners...  ...we build runs on data that moves...  ...Engineer, you'll own the pipelines that power Duet's...  ...how data quality and pipeline reliability...  ...discipline.Strong Python programming skills...  ...infrastructure experience (AWS or GCP).Prior... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Local area

    Duet Technologies Inc

    New York, NY
    2 days ago
  •  ...shape the future of data-driven innovation in Banking Payments. As a Data Owner Senior Associate, you’ll...  ..., ensuring data quality, and protecting...  ...ensuring data is integrated into analytics platforms...  ..., data pipelines, data modeling, data...  ...platforms such as AWS, Google, or Azure... 
    Amazon Web Service
    Pipeline
    Data
    Senior

    JP Morgan Chase

    New York, NY
    4 days ago
  • $140k - $160k

     ...looking for a Senior Data Engineer to...  ...-time data pipelines and APIs that...  ...ensure data quality,...  ...performance and integrate solutions into...  ...architectures (AWS preferred),...  ...with Apache Kafka, Apache Flink...  ...APIs using Python frameworks (...  ...information or for payment, and will... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Full time
    Local area
    Flexible hours

    The New York Times

    New York, NY
    21 hours ago
  • $126k - $149k

     ...Graph—to turn data insights...  ...technical setup required to...  ...Role:As a Senior Solutions Architect...  ...successful integrations with their...  ...APIs, and python.Adoption...  ...platforms (AWS, Azure, GCP...  ...Streaming (Kafka or similar)...  ...SQL, data pipelines & ETL processes...  ...enhance quality of day to... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Worldwide
    Flexible hours

    Celonis

    New York, NY
    4 days ago
  •  ...Bank, J.P. Morgan Payments enables...  ...transitioning high-quality machine learning...  ...scalable and dependable data processing pipelines, conducting analysis...  ...concepts to senior management and stakeholders...  ..., PySpark, and AWS Cloud Services is...  ...ML.Proficient in Python with hands-on... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python

    JP Morgan Chase

    New York, NY
    3 days ago
  •  ...rolePolymarket is looking for a senior backend engineer to...  ...and scale the payments infrastructure that...  ...money movement.Integrate with financial...  ...fintech, or financial-data integrations (...  ...cloud environments (AWS/GCP) and using containers...  ...401k matchHardware setup — new MacBook Pro,... 
    Amazon Web Service
    Data
    Senior

    Polymarket

    New York, NY
    1 day ago
  •  ..., high-scale payments workflows. You...  ...partner with senior stakeholders...  ...Web Services (AWS) with strong...  ...that improve quality, reliability,...  ..., continuous integration and continuous...  ...including data and text mining...  ...secure data pipelines to support model...  ...of advanced Python development... 
    Amazon Web Service
    Pipeline
    Data
    Python

    J.P. Morgan

    New York, NY
    2 days ago
  • $110k - $130k

     ...project managers, data scientists,...  ...and integrations, including systems...  ...generation (RAG) pipelines and agentic...  ...high-quality, maintainable...  ...languages like Python or GoEnsure a...  ...like GCP or AWS and their associated...  ...such as Kafka or Pub/SubFamiliarity...  ...or for payment, and will not... 
    Amazon Web Service
    Pipeline
    Data
    Python
    Work at office
    Local area
    2 days per week

    The New York Times

    New York, NY
    17 hours ago
  •  ...looking for a senior/staff backend engineer...  ...world — market data distribution,...  ...event pipelines that keep trading...  ...driven systems (Kafka, gRPC, DynamoDB...  ...protocol-level integrations, driving 10x+ improvements...  ...environments (AWS/GCP)....  ...matchHardware setup — new MacBook Pro... 
    Amazon Web Service
    Pipeline
    Data
    Senior

    Polymarket

    New York, NY
    1 day ago
  •  ...Engineer- Java / AWS / Terraform / Kafka at JPMorganChase...  ...Bank, you are an integral part of an agile...  ...secure and high-quality production code,...  ...workflows, including data sensitivity considerations...  ...both Java and Python development...  ...mortgages, credit cards, payments, auto finance and... 
    Amazon Web Service
    Data
    Python

    JP Morgan Chase

    New York, NY
    17 hours ago
  •  ...looking for a data scientist who...  ...safety, platform integrity, payments,...  ...Implement robust data quality checks, reconciliation...  ...maintain ETL pipelines, reusable...  ...audiences, including senior leadership.-...  ...language (Python or R).- 5+ years...  ...(e.g., AWS, GCP, Azure, Snowflake... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python

    TikTok

    New York, NY
    3 days ago
  •  ...searching for a Senior Data Engineer -...  ...Investment Technology (Python) for a Direct...  ...data pipelines ingesting data...  ...Develop production-quality Python and SQL...  ...Experience with AWS and cloud-based...  ...Kubernetes/EKS, Kafka, and/or Redis ....  ...and quality and integrity in everything we... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Remote work

    Software Guidance & Assistance

    New York, NY
    3 days ago
  • $240k - $310k

     ...issues. We’re data-driven and...  ..., owning the pipelines, platform infrastructure...  ..., cost, and quality. You're as...  ...strategy to senior leadership....  ...attitude.Integrity - Simply put,...  ...proficiency in SQL and Python; recognized...  ...with AWS services (S3,...  ...technologies (Estuary, Kafka, Debezium)... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Casual work
    Work at office
    Local area

    Justworks

    New York, NY
    21 hours ago
  • $188k - $242k

     ...solve HR issues. We’re data-driven and never stop iterating...  ...You Will Work OnAs a Senior Software Engineer for Workforce Payments, you will work with the...  ..., improving the integrity of our financial ledger,...  ...Rails, Javascript, MySQL, Kafka, AWS, Git, Memcache, Redis, ElasticSearch... 
    Amazon Web Service
    Data
    Senior
    Casual work
    Work at office
    Local area

    Justworks

    New York, NY
    2 days ago
  • $160k - $175k

     ...Director, MDM Integrations based out of...  ...insights, robust data, and dynamic...  ...experience (AWS, Azure) and...  ...Functions, MSK/Kafka, Event Bridge...  ...) ~ Strong Python for data...  ...Build ETL/ELT pipelines for batch and...  ...generation, data quality checks, and...  ...effectively with senior management... 
    Amazon Web Service
    Pipeline
    Data
    Python
    Contract work
    Temporary work
    Work at office
    Immediate start

    Fitch Group

    New York, NY
    more than 2 months ago
  •  ...seamless platform integration, and...  ...consistent, high-quality platform...  ...Java, Python, and cloud-...  ...technologies (AWS/Azure/GCP)....  ...custodial/payment systems. Ensure...  ...-latency data processing...  ...(Kafka, RabbitMQ)....  ...with quant analysts and data scientists...  ...Optimize data pipelines for client... 
    Amazon Web Service
    Pipeline
    Data
    Python

    Intellibus

    New York, NY
    1 day ago
  •  ...Senior Software Engineer – Multi-Asset Order...  ...-party trading integrations Developing high-...  ...performance market data and execution pipelines Scaling the...  ...systems Expert-level Python for backend services...  ...Experience with Kafka, RabbitMQ, SQS or...  ...experience AWS and cloud architecture... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python

    Certus Recruitment Group

    New York, NY
    3 days ago
  •  ...currently seeks a " Senior Data Practitioner/...  ..., and high-quality data solutions....  ...real-time data pipelines using modern distributed...  ...KPIs, data integrity, and platform...  ...using Python and SQL. Strong...  ...business events using Kafka or similar...  ...Experience with AWS data services... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Work at office
    3 days per week

    Saransh Inc

    New York, NY
    1 day ago
  • $181k - $220k

     ...Senior Infrastructure Engineer At...  ...smarter use of data is essential to...  ...-native stack (AWS, Kubernetes, Terraform...  ...improve CI/CD pipelines (GitHub Actions...  ...skills in Python, Go, or Bash, plus...  ...expect you to integrate AI into your...  ...Whatever your setup, expectations will... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Komodo Health

    New York, NY
    21 hours ago
  • $142.32k - $213.48k

     ...are looking for a Senior Generative AI...  ...operations leads, data engineers, product...  ...end Generative AI pipelines including LLM integrations, Retrieval-Augmented...  ...frameworks.Python Development: Develop...  ...OpenAI, Anthropic, AWS Bedrock, or...  ...mitigationExposure to Kafka, Spark, or... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Full time

    Citigroup

    New York, NY
    1 day ago
  • $86.7k - $170.9k

     ...Summary Integration Engineer II, API...  ...in software, data, AI, network, and...  ...and APIs using Python (e.g., FastAPI,...  ...to detail and quality of work productAbility...  ...(Azure, AWS, or GCP), including...  ...CI/CD pipelines, testing strategies...  ...level employees to senior leaders, we... 
    Amazon Web Service
    Pipeline
    Data
    Python
    Local area
    Flexible hours

    Deloitte

    New York, NY
    21 hours ago
  •  ...looking for a Senior Java Developer (with Python skills) to...  ...components as part of integrated...  ...ensure code quality and adherence...  ...practices via GitLab pipelines and modern DevOps...  ...Boot, Spring Data JPA/Hibernate...  ...platforms (AWS or Azure)...  ...driven systems (Kafka, RabbitMQ)... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Work at office
    Remote work
    Flexible hours

    EPAM Systems, Inc.

    New York, NY
    21 hours ago
  • $158.5k - $172k

     ...innovate—from integrated grocery delivery...  ...OpportunityAs a Senior Engineer on the...  ...across AWS and GCP, and driving...  ...-critical card payment environment. This...  ...cloud deployment pipelines using Jenkins...  ...highest standards of data security,...  ...automation utilizing Python and Bash to... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Full time
    Temporary work
    Work at office
    Flexible hours
    3 days per week

    GrubHub

    New York, NY
    1 day ago
  • $150k - $185k

     ...smart audience data to change the game...  ...’re seeking a Senior Software...  ...modular systems that integrate third-party...  ...microservices in an AWS environment....  ...contribute to a high-quality engineering...  ..., Go, Scala, Python, TypeScript) Deep...  ...-scale data pipelines (Kafka, Spark, Airflow... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Python
    Full time
    Contract work
    Remote work

    OUTFRONT Media

    New York, NY
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity). Be the first to apply!