Senior AWS Python Developer - Kafka (AWS-based solutions, Kafka integrations, and data pipelines), P
HAN Staffing
Job ID: 29314331Reference Number: 26-00958Title: Senior AWS Python Developer – Kafka (AWS-based solutions, Kafka integrations, and data pipelines), PPosted Date: 2026-09-17Contact: Vishika ChaudharyContact Email: View email address on click.appcast.io Phone: (551) 795-0621Company: HAN StaffingJob requirementsJob Title: Senior AWS Python Developer – Kafka (AWS-based solutions, Kafka integrations, and data pipelines), Python + Java, Payment integritySaint Louis, MO/ Dallas (Brillio)/ New York (Brillio)/ Last option is remote We are seeking an experienced Senior Developer to support the project initiative. The ideal candidate will have strong hands-on experience developing cloud-native, configuration-driven, event-based, and data-processing solutions using AWS, Kafka, Python, and Java. This role requires the ability to design scalable data pipelines, configurable business-rule frameworks, APIs, microservices, and containerized applications while ensuring performance, reliability, observability, and maintainability.Experience7+ years of experience in software engineering and application development.4+ years of hands-on experience building AWS-based solutions, Kafka integrations, and data pipelines.Demonstrated experience designing and developing distributed, cloud-native applications.Key ResponsibilitiesDesign, develop, and maintain scalable components for the PISCES HUB platform.Build AWS-based data pipelines, event-driven workflows, APIs, microservices, and integration services.Develop Kafka producers and consumers, including appropriate topic, partitioning, schema, offset-management, retry, and error-handling strategies.Design and implement configuration-driven systems, including: Metadata-driven pipelines and workflowsDynamic business-rule enginesConfigurable APIs and data-integration frameworksTemplate-based code-generation solutionsParameterized services and reusable componentsDesign and optimize configuration interpreters using JSON, YAML, and XML.Implement configuration validation, versioning, auditing, rollback, backward compatibility, and error-handling capabilities.Develop high-quality, reusable, and maintainable software using Python and/or Java.Design SQL and NoSQL data models for storing, retrieving, auditing, and versioning business rules and system configurations.Build and integrate solutions using Amazon EKS, AWS Lambda, Amazon ECS, Amazon S3, Amazon RDS, and Amazon DynamoDB.Develop REST APIs, asynchronous services, batch-processing components, and event-based integrations.Implement automated unit, integration, component, and contract testing.Integrate application components with CI/CD pipelines and GitOps deployment workflows.Build, package, and deploy applications using Docker and Kubernetes.Implement application logging, monitoring, distributed tracing, dashboards, and alerting using Dynatrace.Troubleshoot production issues and perform root-cause analysis across application, integration, data, and infrastructure layers.Conduct code reviews and enforce engineering, security, performance, and maintainability standards.Collaborate with architects, product owners, quality analysts, data engineers, DevOps engineers, and other developers.Use Windsurf and other AI-assisted engineering tools to accelerate development, refactoring, automated testing, troubleshooting, and technical documentation.Required Technical SkillsStrong proficiency in Python or Java; hands-on experience with both is preferred.Strong experience developing AWS-based pipelines and cloud-native applications.Hands-on experience with Apache Kafka and event-driven architectures.Proven experience building: Metadata-driven pipelines and workflowsDynamic business-rule enginesConfiguration-driven applicationsConfigurable API and data-integration frameworksTemplate-based code-generation frameworksParameterized and reusable servicesStrong experience designing and optimizing JSON-, YAML-, and XML-based configuration interpreters.Strong understanding of configuration schemas, validation, versioning, auditability, backward compatibility, and rollback.Strong knowledge of SQL and NoSQL database modeling.Experience designing data models for business rules, metadata, configuration versioning, and audit history.Hands-on experience with: Amazon EKSAWS LambdaAmazon ECSAmazon S3Amazon RDSAmazon DynamoDBStrong understanding of REST APIs, microservices, asynchronous processing, and distributed systems.Experience with CI/CD pipelines, Git, and GitOps practices.Hands-on experience with Docker, Kubernetes, and container orchestration.Strong working knowledge of Dynatrace for observability, monitoring, performance analysis, and troubleshooting.Working knowledge of Windsurf or similar AI-assisted development tools.Preferred QualificationsExperience developing high-volume, fault-tolerant, distributed platforms.Experience with Kafka schema management and serialization formats such as Avro, JSON, or Protobuf.Knowledge of data lineage, schema evolution, data contracts, and data-quality controls.Experience with infrastructure-as-code and deployment tools such as Terraform, Helm, Argo CD, or equivalent technologies.Familiarity with design patterns for retry management, dead-letter queues, idempotency, caching, and fault tolerance.Experience implementing secure APIs and cloud services using authentication, authorization, encryption, and secrets-management practices.AWS Developer, AWS Solutions Architect, Kubernetes, Java, or Python certifications are an advantage.Key CompetenciesStrong software-design and problem-solving abilities.Ability to translate business requirements into configurable and reusable technical solutions.Strong understanding of scalable and resilient distributed-system design.Effective debugging and root-cause-analysis skills.Commitment to clean code, automated testing, documentation, and engineering standards.Ability to work independently and mentor junior developers.Strong collaboration and communication skills.Ability to deliver effectively within an Agile product-engineering environment.
- ...Observability and Data Lineage Position... ...a hands-on Senior Python and Kafka Engineer to join... ...depositors. The pipeline is event-driven,... ...stopped or failed Develop reconciliation and... ...an OpenLineage-based lineage solution, with Marquez... ...MongoDB Apache Solr AWS S3 or other S3-...Amazon Web ServicePipelineDataSeniorMinimum wageTemporary workLocal area
- ...Senior Quality Analyst Location... ..., event-based, and data-processing platforms... ...in Python-based test automation, AWS services, Kafka, data pipeline validation,... ...Responsibilities Develop and execute... ...for API, integration, data... ...configuration-driven solutions, including...Amazon Web ServicePipelineDataSeniorContract work
- ...Overview: This Senior Python Developer with PL/SQL role... ...build and scale data-driven financial... ...-load (ETL) data pipelines for critical systems... ...ensuring rigorous data integrity, audit trails,... ...& Events: Apache Kafka, RabbitMQ, or IBM... ...like AWS or Snowflake In-depth...Amazon Web ServicePipelineDataSenior
- ...Job Title: Data Quality Engineer... ...experienced AWS Data Engineer... ...on with AWS, Python/PySpark, and... ...complex data pipelines. This role requires... ...quality data solutions that drive... ...AWS and SQL-based technologies.... ...quality and integrity across... ...SQS, Kinesis, Kafka). - CI/CD...Amazon Web ServicePipelineDataSeniorLong term contractWork from homeFlexible hours
$150k - $180k
Senior Data Engineer Location: Richardson... ...-$180,000 base + bonus... ...data solutions using... ...ingestion pipelines, transformation... ...Develop and maintain... ...cloud-native integration patterns... ...well-tested Python and SQL solutions... ...(AWS preferred)... ...PySpark Kafka or streaming...Amazon Web ServicePipelineDataSenior- ...designing, developing, and implementing... ...to cloud-based deployments... ...deployment pipeline... ...Languages: Java, Python, C#, Javascript... ...DevOps Data management:... ..., Redis Integration/APIs Technologies: Kafka, REST,... ...Azure and AWS Test Automation... ...optimize solutions for performance...Amazon Web ServicePipelineDataSenior
- ...of Interest: Data; Information... ...Description The AWS Data... ...defining data integration patterns for... ...viable options based on both short... ..., and find solutions. We support and... ...latency data pipelines using Apache Kafka. You will... ...discipline such as developing and...Amazon Web ServicePipelineDataSeniorTemporary workInterim roleWork at office
- ...'re looking for a Senior Solution Architect who operates... ...progression. This pipeline was architected... ...Marketing, and Data Solutions — and operates... ...of large, integrated programs where the... ...automationParticipate in outcome-based accountability... ...cloud experience (AWS preferred) —...Amazon Web ServicePipelineDataSeniorFull timeLive in
- Job Title: Data Engineer Location... ...: Design, develop, and support... ...ETL pipelines, data integration processes, and database solutions using modern... ...SnapLogic, Kafka, or comparable... ...Proficiency in Python and/or Java... ...building cloud-based data solutions on AWS, Azure, or Google...Amazon Web ServicePipelineDataSeniorContract workWork at officeRemote work
- ...AvidXchange, based in Charlotte, NC, seeks a Principal Data Engineer to lead modern data platforms and cloud-native architectures on Databricks. You... ...migration from Azure SQL Server, design real-time pipelines with Kafka, and enable AI capabilities such as Databricks...PipelineDataSenior
- Azure - Data Factory, Databricks... ..., ADLS Senior Data... ..., developing, and maintaining... ...and data pipelines. The... ...expertise in Python, SQL, ETL... ...data solutions and enable... ...frameworks. Integrate data from... ...such as AWS, Azure, or... ...Apache Kafka or other... ...location based on business...Amazon Web ServicePipelineDataSeniorFull timeWork at officeRemote work
$125.76k - $188.64k
...are seeking a Senior Data Developer /Lead to join... ...-time data solutions within our Hadoop... ...with Kafka, and a proven... ...keen focus on integrating and advancing... ...complex Hadoop-based data pipelines and real-time... ...knowledge of Python, PySpark, FastAPI... ...such as AWS, Azure, and Google...Amazon Web ServicePipelineDataSeniorFull time- ...experienced AI and Data Solution Architect,... ...outcomes.Develop technology... ...data pipelines and ETL... ...solutions using Python and... ...Serve as a senior technical... ...and operate integrated/... ...Medallion, Kafka, Flink, Data... ...average, based on the work... ...platforms (AWS, Azure, or...Amazon Web ServicePipelineDataNight shift
- Senior Software Engineer This role... ...and other developers. A major... ...hybrid Cloud-based solutions supporting critical... ...into a data-driven organization... ...unit and integration tests based... ..., AWS preferred Previous... ...Apache Spark, Kafka Streams,... ...Artifactory and CI/CD pipeline etc....Amazon Web ServicePipelineDataSeniorImmediate startWork from home2 days per week3 days per week
- ...client seeks a Senior Software... ...-native data platforms that... ...Java, Python, Spark, Angular, AWS, and event-... ...-effective solutions for Customer... ...Kubernetes-based distributed... ...tech such as Kafka, SNS, SQS,... ...automated pipelines. ~ Robust... ...including unit, integration, and...Amazon Web ServicePipelineDataSeniorHourly payWork at officeLocal area2 days per week
- ...convenience. The Senior Solution Architect defines... ..., spanning data, decisioning, content... ...and establishes the integration patterns, standards... ...architecture certification (AWS or Azure)... ..., cloud-based data and application... ...Databricks), streaming (Kafka), reverse-ETL/activation...Amazon Web ServiceDataSeniorWork experience placement
$189.3k - $290.7k
...Cloud and AI Solutions Engineer... ...with data-platform... ...use cloud-based intelligence... ...systems, developer tooling,... ...is a senior individual... ...transformation pipelines, APIs,... ...deliver integrated solutions... ...as Azure, AWS, or... ...such as Python, Go, Java... ...PySpark, Kafka or other...Amazon Web ServicePipelineDataFull timeLocal areaWork from homeFlexible hours$96.49k - $144.74k
NTT DATA strives to hire exceptional... ...(Spark/Kafka/Flink/Scala/Java... ...will design and develop streaming and batch... ...Kafka/Flink/Spark-based processing... ...and cloud-native solutions on Azure and Kubernetes... ...and batch data pipelines using Apache... ...-service data integration platforms and...PipelineDataFull timeTemporary workWork experience placementWork at officeRemote workFlexible hours$125.76k - $188.64k
...technology solutions are the foundations... ...based on merit, and... ...intelligence integration, and... ...platforms such as AWS (EC2, S3,... ...such as Java, Python 3.10+,... ...experience developing and maintaining... ...as Apache Kafka, TIBCO, MuleSoft... ...automation pipelines using tools... ...enterprise data stores,...Amazon Web ServicePipelineDataFull time- ...looking for a Senior Data Engineer with... ...designing and developing scalable cloud... ...platforms, ETL/ELT pipelines, and batch/streaming solutions. Key... ...Snowflake, SQL, Python, and cloud technologies... ...using Kafka and ETL/integration tools . Design... ...standards. Work with AWS, Azure, or GCP...Amazon Web ServicePipelineDataSenior
$82.08k - $193.44k
Senior Software Engineer Choosing... ...based in Dallas,TX... ...technology solutions that drive... ...React.js, AWS Serverless,... ...coaching. Develop scalable Node... ...Drive API integrations, event-driven... ...and CI/CD Pipelines. Experience... ...DynamoDB, Kafka, and RabbitMQ... ...cloud and data, combined with...Amazon Web ServicePipelineDataSeniorPermanent employmentFull timeContract workLocal area- ...DescriptionThe Data Solutions Engineer IV works... ...collaboration to design, develop, implement, and... ...ETL / ELT pipelines, leveraging... ...governanceDefine and drive Python, PySpark, and... ....Design and integrate CI/CD pipelines... ...dbt, Snowflake, Kafka ecosystem, AWS services) with a...Amazon Web ServicePipelineDataSenior
$101.7k - $335.1k
...Delivery Senior Manager,... ...you’ll be based in our Service... ...solutions. This position... ...channel integration, API Management... ...design, develop,... ...like Java, Python, Node.js,... ...technologies like AWS, or Azure... ..., CI/CD pipelines)... ...Scala Kafka/RabbitMQ... ...Enabled by data, AI and advanced...Amazon Web ServicePipelineDataSeniorFull timeSummer holidayFlexible hours$100k - $120k
...Salesforce Developer with python Location... ...Summary The Senior Salesforce... ...middleware/data ecosystems.... ...API-first integrations, data pipeline engineering,... ...certificate-based mutual authentication... ..., Apache Kafka, AWS EventBridge,... ...technical solutions. Create...Amazon Web ServicePipelineDataFull time- ...Title: Sr. DATA Engineer Work... ...motivated AWS Certified Engineer... ...data solutions within the Amazon... ...involves developing deploying and... ...secure data pipelines and... ...efficiently and integrating with Iceberg... ...scripts using Python and shell scripting... ...like Apache Kafka Flink or...Amazon Web ServicePipelineDataSenior
$106.6k - $200k
...innovative ad tech solutions powered by... ...for a Staff Python Engineer to... ...and financial integrity. This is a... ...revenue-critical pipelines. Thrives in... ...Product, Data Engineering,... ...like Celery, Kafka, or Airflow.... ...experience with AWS and Kubernetes... ...We expect the base salary for...Amazon Web ServicePipelineDataTemporary workLocal areaWorldwide$150k - $200k
...role is for a Senior Data Engineer at... ...data pipelines and supporting... ...position is based in Dallas, TX... ...across SQL, Python, data engineering... .... You will integrate data from... ...pipelines. Develop data ingestion... .../ PySpark AWS / Azure / GCP... ...Snowflake Kafka AWS S3 Redshift...Amazon Web ServicePipelineDataSeniorFull timeInternshipRelocation package$102.68k - $171.13k
Solution Architect (Java, Cloud & AI) NTT DATA strives to hire exceptional... ...across AWS, Microsoft... ..., integration patterns,... ...technologies based on scalability... ..., developers, data teams... ...OpenShift, CI/CD pipelines,... ...experience with Kafka or other messaging... ...with Python and AI...Amazon Web ServicePipelineDataTemporary workWork experience placementWork at officeRemote workFlexible hours$107.12k - $160.68k
...is hiring a Senior Software... ...end software solutions that are robust... ...teams.Develop foundational... ....Drive the integration and enterprise... ...in Java, Python, or both,... ...and optimize data models.... ...platforms such as Kafka or JMS/MQ,... ...on AWS, GCP, or Azure... ...alongside CI/CD pipelines using...Amazon Web ServicePipelineDataSeniorFull timeWork at officeRemote work- Senior Data Engineer Experience Required... ...data pipelines and ETL/ELT... ...Snowflake. Develop, maintain, and... ...and manage integrations using SnapLogic... ...documented data solutions. Implement... ...platforms (AWS/Azure/GCP) and... ...(Python preferred) for... ...streaming data (Kafka, Snowpipe Streaming...Amazon Web ServicePipelineDataSenior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AWS Python Developer - Kafka (AWS-based solutions, Kafka integrations, and data pipelines), P. Be the first to apply!
- full stack / python developer (remote) Dallas, TX
- python engineer Dallas, TX
- python developer data analytics Dallas, TX
- python developer Dallas, TX
- python developer remote Dallas, TX
- python programmer Dallas, TX
- senior living director Dallas, TX
- senior manager customer operations Dallas, TX
- senior support engineer Dallas, TX
- senior java developer Dallas, TX



