Senior AWS Python Developer - Kafka (AWS-based solutions, Kafka integrations, and data pipelines), P
HAN Staffing
Job ID: 29314331Reference Number: 26-00958Title: Senior AWS Python Developer – Kafka (AWS-based solutions, Kafka integrations, and data pipelines), PPosted Date: 2026-09-17Contact: Vishika ChaudharyContact Email: View email address on click.appcast.io Phone: (551) 795-0621Company: HAN StaffingJob requirementsJob Title: Senior AWS Python Developer – Kafka (AWS-based solutions, Kafka integrations, and data pipelines), Python + Java, Payment integritySaint Louis, MO/ Dallas (Brillio)/ New York (Brillio)/ Last option is remote We are seeking an experienced Senior Developer to support the project initiative. The ideal candidate will have strong hands-on experience developing cloud-native, configuration-driven, event-based, and data-processing solutions using AWS, Kafka, Python, and Java. This role requires the ability to design scalable data pipelines, configurable business-rule frameworks, APIs, microservices, and containerized applications while ensuring performance, reliability, observability, and maintainability.Experience7+ years of experience in software engineering and application development.4+ years of hands-on experience building AWS-based solutions, Kafka integrations, and data pipelines.Demonstrated experience designing and developing distributed, cloud-native applications.Key ResponsibilitiesDesign, develop, and maintain scalable components for the PISCES HUB platform.Build AWS-based data pipelines, event-driven workflows, APIs, microservices, and integration services.Develop Kafka producers and consumers, including appropriate topic, partitioning, schema, offset-management, retry, and error-handling strategies.Design and implement configuration-driven systems, including: Metadata-driven pipelines and workflowsDynamic business-rule enginesConfigurable APIs and data-integration frameworksTemplate-based code-generation solutionsParameterized services and reusable componentsDesign and optimize configuration interpreters using JSON, YAML, and XML.Implement configuration validation, versioning, auditing, rollback, backward compatibility, and error-handling capabilities.Develop high-quality, reusable, and maintainable software using Python and/or Java.Design SQL and NoSQL data models for storing, retrieving, auditing, and versioning business rules and system configurations.Build and integrate solutions using Amazon EKS, AWS Lambda, Amazon ECS, Amazon S3, Amazon RDS, and Amazon DynamoDB.Develop REST APIs, asynchronous services, batch-processing components, and event-based integrations.Implement automated unit, integration, component, and contract testing.Integrate application components with CI/CD pipelines and GitOps deployment workflows.Build, package, and deploy applications using Docker and Kubernetes.Implement application logging, monitoring, distributed tracing, dashboards, and alerting using Dynatrace.Troubleshoot production issues and perform root-cause analysis across application, integration, data, and infrastructure layers.Conduct code reviews and enforce engineering, security, performance, and maintainability standards.Collaborate with architects, product owners, quality analysts, data engineers, DevOps engineers, and other developers.Use Windsurf and other AI-assisted engineering tools to accelerate development, refactoring, automated testing, troubleshooting, and technical documentation.Required Technical SkillsStrong proficiency in Python or Java; hands-on experience with both is preferred.Strong experience developing AWS-based pipelines and cloud-native applications.Hands-on experience with Apache Kafka and event-driven architectures.Proven experience building: Metadata-driven pipelines and workflowsDynamic business-rule enginesConfiguration-driven applicationsConfigurable API and data-integration frameworksTemplate-based code-generation frameworksParameterized and reusable servicesStrong experience designing and optimizing JSON-, YAML-, and XML-based configuration interpreters.Strong understanding of configuration schemas, validation, versioning, auditability, backward compatibility, and rollback.Strong knowledge of SQL and NoSQL database modeling.Experience designing data models for business rules, metadata, configuration versioning, and audit history.Hands-on experience with: Amazon EKSAWS LambdaAmazon ECSAmazon S3Amazon RDSAmazon DynamoDBStrong understanding of REST APIs, microservices, asynchronous processing, and distributed systems.Experience with CI/CD pipelines, Git, and GitOps practices.Hands-on experience with Docker, Kubernetes, and container orchestration.Strong working knowledge of Dynatrace for observability, monitoring, performance analysis, and troubleshooting.Working knowledge of Windsurf or similar AI-assisted development tools.Preferred QualificationsExperience developing high-volume, fault-tolerant, distributed platforms.Experience with Kafka schema management and serialization formats such as Avro, JSON, or Protobuf.Knowledge of data lineage, schema evolution, data contracts, and data-quality controls.Experience with infrastructure-as-code and deployment tools such as Terraform, Helm, Argo CD, or equivalent technologies.Familiarity with design patterns for retry management, dead-letter queues, idempotency, caching, and fault tolerance.Experience implementing secure APIs and cloud services using authentication, authorization, encryption, and secrets-management practices.AWS Developer, AWS Solutions Architect, Kubernetes, Java, or Python certifications are an advantage.Key CompetenciesStrong software-design and problem-solving abilities.Ability to translate business requirements into configurable and reusable technical solutions.Strong understanding of scalable and resilient distributed-system design.Effective debugging and root-cause-analysis skills.Commitment to clean code, automated testing, documentation, and engineering standards.Ability to work independently and mentor junior developers.Strong collaboration and communication skills.Ability to deliver effectively within an Agile product-engineering environment.
- ...Number: 26-00877Title: Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity)Posted Date: 2026-0... ...-driven, event-based, and data-processing... ...Responsibilities Develop and execute comprehensive... ...-driven solutions, including metadata...Amazon Web ServicePipelineDataSeniorContract workRemote work
$160k - $180k
Senior Solution Architect (Data & AI Solution Specialist)... ...Experience across AWS, GCP, Azure,... ...source tech based data services... ...in data integration, reporting, and... ...Architecture & Design: Develop end-to-end... ..., processing pipelines, analytics... ...(e.g., Kafka) o Data Modeling...Amazon Web ServicePipelineDataSenior- ...Overview: As an Integration Tech Lead... ...integration solutions that power... ...architectures on AWS, and API-led... ...seamless data exchange... ...microservices and API-based ecosystems... ...and enhance developer productivity... ...CI/CD pipelines, DevOps practices... ...platforms (Kafka, MQ)...Amazon Web ServicePipelineDataSeniorLocal area3 days per week
$126k - $149k
...process data, business... ...The Team: Solutions... ...Role: As a Senior Solutions... ...successful integrations with their... ...APIs, and python. Adoption... ...platforms (AWS, Azure, GCP... ...(Kafka or similar... ...SQL, data pipelines & ETL processes... ...standard developer tools (... ...time The base salary...Amazon Web ServicePipelineDataSeniorFull timeWork at officeLocal areaRemote workWorldwideFlexible hours- ...searching for a Senior Data Engineer -... ...(Python) for a Direct... ...production data pipelines ingesting... ...research. Develop production... ...browser-based tools... ...Experience with AWS and cloud-... .../EKS, Kafka, and/or Redis... ...resource solutions provider... ...quality and integrity in...Amazon Web ServicePipelineDataSeniorRemote work
- ...Description Base pay is... ...PA." The solution architect proactively... ..., data flow diagrams, and integration patterns. Collaborates... ...to developers within agile... ..., C# and Python, JavaScript... ...like Apache Kafka. Strong knowledge... ...like AWS, Azure (preferred... ...CI/CD pipelines using tools...Amazon Web ServicePipelineDataSeniorFlexible hours
$165k - $200k
...challenges and developing cutting-edge solutions that... ...Real! The Senior Solutions Architect... ...States based position,... ...with AI/ML on AWS Currently... ...Collaborate with data scientists,... ...architect integrated solutions... ...to pipeline development... ...using Apache Kafka or other types...Amazon Web ServicePipelineDataSeniorFull timeTemporary workFor contractorsLocal areaRemote workHome officeFlexible hours$185k - $264.5k
...UnitTechnology, Data, AI and... ...businesses. We build solutions that power... ...Head of Integrated Solutions Engineering... ...credibility developed through... ...development of senior technical talent... ...such as AWS, Azure, or Google... ...such as Kafka or Event Hubs... ...eligible: No Actual base salary will...Amazon Web ServiceDataSeniorLocal area3 days per week$100k - $143k
...UnitTechnology, Data, AI and... ...businesses. We build solutions that power... ...seeking a Python AI Developer to design,... ...layer that integrates with our... ...build Python-based AI services... ...evaluation pipelines to ensure AI... ...(GCP and/or AWS) and containerized... ...such as Kafka, enterprise...Amazon Web ServicePipelineDataSeniorLocal area3 days per week- ...Seeking a hands-on Senior Security Data Solution Architect with 7+ years... ...Snowflake on AWS. Must have proven experience... ...modern AI/agentic integration capabilities.... ...analysts on data modeling, pipeline development, and... ...processing tools (e.g., Kafka). ~ Strong...Amazon Web ServicePipelineDataSeniorRemote work
- ...requirement. Python , Streamlit and API & UI integration to manage ddashboard... ...Open Source Developer with strong... ...scalable data-driven applications... ...high-quality solutions that support... ...data pipelines. Build interactive... ..., and cloud-based data solutions (AWS, GCP, or...Amazon Web ServicePipelineDataSenior
- ...Description Lumen Solutions Group Inc. is a... ...Services company based in Florida. We provide... ..., systems integration, or data platform work - before... ...and streaming (Kafka or equivalent), and... ...platforms (AWS, Azure, or GCP);... ...operational data pipelines - real-time streaming...Amazon Web ServicePipelineDataSeniorContract workFor contractorsRemote work
$197.3k - $225.1k
...Overview Lead Data Engineer (Python, AWS, Spark, Kafka, SQL, Snowflake, Databricks... ...and building data pipelines with emerging... ...Agile teams to design, develop, test, implement,... ...support technical solutions using data movement... ...databases and cloud-based data warehousing services...Amazon Web ServicePipelineDataFull timePart timeInternshipH1bLocal area- J.P. Morgan is looking for a Sr. Associate... ...the Payment Solutions team in New York... ...scalable data processing pipelines and developing models that improve transaction integrity and customer experience... ...expertise in Python, machine... ...particularly in AWS environments. This...Amazon Web ServicePipelineDataSenior
$175k - $225k
...expectations, integrity,... ...seeking a Senior Software... ...consolidates data and... ...comprehensive solution, accelerating... ...) to develop innovative... ...based on data.... ...scalable pipelines and platforms... ...experience with Python and/or... ...Iceberg, Kafka, Airflow... ...deployments: AWS, Docker,...Amazon Web ServicePipelineDataSeniorFull timeTemporary workWork experience placementFlexible hours- ...Be an integral part of an agile... ...As a Senior Lead Software... ...vendors Develops secure and high... ...low latency data pipelines using Apache Kafka, KSQL and Kafka... ...to provision AWS cloud services... ..., delivering solutions to solve all... ...package including base salary determined...Amazon Web ServicePipelineDataSeniorFull timeFor contractors
$168k - $200k
...Datavant is the data... ...critical data solutions for organizations... ...for a Senior Site Reliability... ...of data pipelines, ML workflows... ...Lake, and Kafka.... ...management, and integration with CI/CD... ...infrastructure on AWS (or similar... ...and Python. ~ Experience... ...may differ based on their level...Amazon Web ServicePipelineDataSenior- ..., and reliable data to power various... ...and AI solutions across the enterprise... ...maintain dbt data pipelines to deliver... ...using PySpark and AWS Glue.• Apply software... ..., testing, and integration—to all... ...Experience with Kafka and streaming data... ...: No Actual base salary will be...Amazon Web ServicePipelineDataSeniorLocal area3 days per week
- ...looking for a Senior Full-Stack... ...in developing technology... ...experienced Senior Data Engineer... ...AI-driven solutions.The ideal... ..., Kafka, and AWS, while also... ...time data pipelines.Develop and... ...implement cloud-based data... ...expertise with: Python, PySpark,... ..., MCP integrations.Experience...Amazon Web ServicePipelineDataSenior
- Senior Data Engineer This is a remote... ...scalable cloud-based data solutions that enable... ...scalable data pipelines, integrations, and data products... ...utilizing AWS Services, Snowflake, dbt, Python, SQL, and... ...environments. Develop advanced ETL... ...technologies such as Kafka, Amazon...Amazon Web ServicePipelineDataSeniorRemote work
$133.22k - $199.84k
Our Senior Data Engineer will play an... ...of the data pipeline and data models... ...focus will be on developing and integrating systems that... ...This role is based in the New... ...Technologies stack: Python, Spark, Airflow, DBT, Kafka, AWS, Docker,... ...-side Data solutions Proven experience...Amazon Web ServicePipelineDataSeniorFull timeWork experience placementWork at office2 days per week$149k - $195.3k
...it As a Senior Software Engineer... ...-quality solutions, scope... ...the software developer role and... ...and handle data in accordance... ...with CI/CD pipeline tooling (BuildKite... ...with cloud-based... ...Knowledge of AWS with API gateway... ...(Kafka is nice to... ...testing tools, integrating testing and...Amazon Web ServicePipelineDataSeniorFull timeTemporary workLocal areaWorldwideFlexible hours$70 - $85 per hour
Senior Data Engineer Remote (Eastern or... ...within AWS. Build normalization... ...pipelines that reconcile... ...technologies such as Kafka, Flink, and Debezium... ...batch/export-based ingestion.... ...business solutions teams on data integration points, including... ...in Java or Python for data application...Amazon Web ServicePipelineDataSeniorHourly payContract workRemote work- ...advantage through Data Management.... ...innovative solutions. Our goal is... ...excellence, integrity and respect.... ...Role Name: AWS Data &... ...primary skills on Python & PySpark... ...build Data pipelines by developing several AWS... ...and PySpark based applications... ...integration with Kafka Topics,...Amazon Web ServicePipelineDataSeniorFull timeWork at office
- ...advise, design, develop and implement... ...& technology solutions. With... ...supply chain, data & analytics,... ...experienced Senior Solution Architect... ...and systems integrators to modernize... ...designing file-based and live... ...Telestream Vantage, AWS Elemental,... ...Azure) for media pipelines. ~...Amazon Web ServicePipelineDataSeniorInternshipWork at officeRemote workFlexible hours
$180k - $220k
...Datavant is the data... ...critical data solutions for... ...healthcare. Senior Software... ...Backend: Python, Go, Java... ...& Cloud: AWS (EC2, S3,... ...ETL & Pipelines: Airflow/... ...Streaming: Kafka or Kinesis... ...experience developing and... ...to data integrity, privacy,... ...may differ based on their...Amazon Web ServicePipelineDataSenior$130k - $150k
The Senior Data Engineer is responsible... ...the data pipelines,... ...robust ELT/ETL solutions and serving... ...Apache Spark, Kafka, and Flink... ...Iceberg) • Develop and optimize... ...datasets • Integrate structured,... ...in Python and SQL; PySpark... ...services: AWS Glue, Azure... ...laws. The base salary range...Amazon Web ServicePipelineDataSeniorFull time$61k - $101k
...certification in data engineering... ...Terraform, Kafka, Python or Scala,... ..., and AI developer automation... ...data pipelines and platforms... ...including AWS S3, Databricks... ...architecture solutions that can be... ...and senior stakeholders... ...opportunity at J.P. Morgan.... ...package, with base pay...Amazon Web ServicePipelineDataSeniorFull timeWork at office- ...Description Lumen Solutions Group Inc.... ...company based in Florida.... ...Job Role: Senior Java Backend Developer Job Location... ...experience with Kafka, and deep knowledge of AWS cloud... ...and maintain data models to ensure data integrity across enterprise... ...Gateway EC2, Data Pipeline, CloudWatch...Amazon Web ServicePipelineDataSeniorLong term contractRemote work
- Senior AI Engineer Provectus... ...is an AWS Premier Partner... ...own data into... ...working AI solution, present... ...workflows, graph-based... ...infrastructure. Python and/or... ...applied to AI pipelines. You... ...to a REST integration. Having authored... ...Airflow, Kafka What We... ...actively develop our...Amazon Web ServicePipelineDataSeniorWork at officeRemote workWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AWS Python Developer - Kafka (AWS-based solutions, Kafka integrations, and data pipelines), P. Be the first to apply!
- python developer New York, NY
- entry level python developer New York, NY
- senior python developer New York, NY
- python developer data analytics New York, NY
- python developer part time New York, NY
- full stack / python developer (remote) New York, NY
- python developer with big data New York, NY
- python programmer New York, NY
- python developer remote New York, NY
- python engineer New York, NY



