Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AWS Python Developer - Kafka (AWS-based solutions, Kafka integrations, and data pipelines), P

HAN Staffing

Job ID: 29314331Reference Number: 26-00958Title: Senior AWS Python Developer – Kafka (AWS-based solutions, Kafka integrations, and data pipelines), PPosted Date: 2026-09-17Contact: Vishika ChaudharyContact Email: View email address on click.appcast.io Phone: (551) 795-0621Company: HAN StaffingJob requirementsJob Title: Senior AWS Python Developer – Kafka (AWS-based solutions, Kafka integrations, and data pipelines), Python + Java, Payment integritySaint Louis, MO/ Dallas (Brillio)/ New York (Brillio)/ Last option is remote We are seeking an experienced Senior Developer to support the project initiative. The ideal candidate will have strong hands-on experience developing cloud-native, configuration-driven, event-based, and data-processing solutions using AWS, Kafka, Python, and Java. This role requires the ability to design scalable data pipelines, configurable business-rule frameworks, APIs, microservices, and containerized applications while ensuring performance, reliability, observability, and maintainability.Experience7+ years of experience in software engineering and application development.4+ years of hands-on experience building AWS-based solutions, Kafka integrations, and data pipelines.Demonstrated experience designing and developing distributed, cloud-native applications.Key ResponsibilitiesDesign, develop, and maintain scalable components for the PISCES HUB platform.Build AWS-based data pipelines, event-driven workflows, APIs, microservices, and integration services.Develop Kafka producers and consumers, including appropriate topic, partitioning, schema, offset-management, retry, and error-handling strategies.Design and implement configuration-driven systems, including: Metadata-driven pipelines and workflowsDynamic business-rule enginesConfigurable APIs and data-integration frameworksTemplate-based code-generation solutionsParameterized services and reusable componentsDesign and optimize configuration interpreters using JSON, YAML, and XML.Implement configuration validation, versioning, auditing, rollback, backward compatibility, and error-handling capabilities.Develop high-quality, reusable, and maintainable software using Python and/or Java.Design SQL and NoSQL data models for storing, retrieving, auditing, and versioning business rules and system configurations.Build and integrate solutions using Amazon EKS, AWS Lambda, Amazon ECS, Amazon S3, Amazon RDS, and Amazon DynamoDB.Develop REST APIs, asynchronous services, batch-processing components, and event-based integrations.Implement automated unit, integration, component, and contract testing.Integrate application components with CI/CD pipelines and GitOps deployment workflows.Build, package, and deploy applications using Docker and Kubernetes.Implement application logging, monitoring, distributed tracing, dashboards, and alerting using Dynatrace.Troubleshoot production issues and perform root-cause analysis across application, integration, data, and infrastructure layers.Conduct code reviews and enforce engineering, security, performance, and maintainability standards.Collaborate with architects, product owners, quality analysts, data engineers, DevOps engineers, and other developers.Use Windsurf and other AI-assisted engineering tools to accelerate development, refactoring, automated testing, troubleshooting, and technical documentation.Required Technical SkillsStrong proficiency in Python or Java; hands-on experience with both is preferred.Strong experience developing AWS-based pipelines and cloud-native applications.Hands-on experience with Apache Kafka and event-driven architectures.Proven experience building: Metadata-driven pipelines and workflowsDynamic business-rule enginesConfiguration-driven applicationsConfigurable API and data-integration frameworksTemplate-based code-generation frameworksParameterized and reusable servicesStrong experience designing and optimizing JSON-, YAML-, and XML-based configuration interpreters.Strong understanding of configuration schemas, validation, versioning, auditability, backward compatibility, and rollback.Strong knowledge of SQL and NoSQL database modeling.Experience designing data models for business rules, metadata, configuration versioning, and audit history.Hands-on experience with: Amazon EKSAWS LambdaAmazon ECSAmazon S3Amazon RDSAmazon DynamoDBStrong understanding of REST APIs, microservices, asynchronous processing, and distributed systems.Experience with CI/CD pipelines, Git, and GitOps practices.Hands-on experience with Docker, Kubernetes, and container orchestration.Strong working knowledge of Dynatrace for observability, monitoring, performance analysis, and troubleshooting.Working knowledge of Windsurf or similar AI-assisted development tools.Preferred QualificationsExperience developing high-volume, fault-tolerant, distributed platforms.Experience with Kafka schema management and serialization formats such as Avro, JSON, or Protobuf.Knowledge of data lineage, schema evolution, data contracts, and data-quality controls.Experience with infrastructure-as-code and deployment tools such as Terraform, Helm, Argo CD, or equivalent technologies.Familiarity with design patterns for retry management, dead-letter queues, idempotency, caching, and fault tolerance.Experience implementing secure APIs and cloud services using authentication, authorization, encryption, and secrets-management practices.AWS Developer, AWS Solutions Architect, Kubernetes, Java, or Python certifications are an advantage.Key CompetenciesStrong software-design and problem-solving abilities.Ability to translate business requirements into configurable and reusable technical solutions.Strong understanding of scalable and resilient distributed-system design.Effective debugging and root-cause-analysis skills.Commitment to clean code, automated testing, documentation, and engineering standards.Ability to work independently and mentor junior developers.Strong collaboration and communication skills.Ability to deliver effectively within an Agile product-engineering environment.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AWS Python Developer - Kafka (AWS-based solutions, Kafka integrations, and data pipelines), P in Dallas, TX vacancy
  •  ...Number: 26-00877Title: Senior Quality Analyst (Kafka Pipeline, AWS setup, Data Pipelines, Python, Payment integrity)Posted Date: 2026-0...  ...-driven, event-based, and data-processing...  ...Responsibilities Develop and execute comprehensive...  ...-driven solutions, including metadata... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Contract work
    Remote work

    HAN Staffing

    Dallas, TX
    2 days ago
  •  ...Observability and Data Lineage Position...  ...a hands-on Senior Python and Kafka Engineer to join...  ...depositors. The pipeline is event-driven,...  ...stopped or failed Develop reconciliation and...  ...an OpenLineage-based lineage solution, with Marquez...  ...MongoDB Apache Solr AWS S3 or other S3-... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Minimum wage
    Temporary work
    Local area

    Fujitsu Careers

    Dallas, TX
    3 days ago
  • $50 - $58 per hour

     ...Data Quality EngineerLocation:...  ...experienced AWS Data Engineer...  ...on with AWS, Python/PySpark, and...  ...complex data pipelines. This role requires...  ...quality data solutions that drive...  ...AWS and SQL-based technologies....  ...quality and integrity across multiple...  ...SQS, Kinesis, Kafka).CI/CD... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Hourly pay
    Work from home
    Flexible hours

    SelectMinds

    Dallas, TX
    1 day ago
  •  ...Overview: This Senior Python Developer with PL/SQL role...  ...build and scale data-driven financial...  ...-load (ETL) data pipelines for critical systems...  ...ensuring rigorous data integrity, audit trails,...  ...& Events: Apache Kafka, RabbitMQ, or IBM...  ...like AWS or Snowflake In-depth... 
    Amazon Web Service
    Pipeline
    Data
    Senior

    Prophecy Technologies

    Dallas, TX
    5 days ago
  •  ...Senior Data Architect Are you passionate...  ...you! The AWS Data...  ...defining data integration patterns for...  ...viable options based on both short...  ...questions, and find solutions. We support...  ...latency data pipelines using Apache Kafka. You will integrate...  ...such as developing and implementing... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Temporary work
    Interim role

    BOK Financial

    Dallas, TX
    4 days ago
  •  ...Senior Software Engineer Chicago...  ...and other developers. A major...  ...hybrid cloud-based solutions supporting critical...  ...into a data-driven...  ...Writes unit and integration tests based...  ...environment, AWS preferred...  ...Apache Spark, Kafka Streams, Apache...  ...and CI/CD pipeline etc. Familiarity... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Immediate start
    Work from home
    2 days per week
    3 days per week

    1872 Consulting

    Dallas, TX
    1 day ago
  • $150k - $180k

    Senior Data Engineer Location: Richardson...  ...-$180,000 base + bonus...  ...data solutions using...  ...ingestion pipelines, transformation...  ...Develop and maintain...  ...cloud-native integration patterns...  ...well-tested Python and SQL solutions...  ...(AWS preferred)...  ...PySpark Kafka or streaming... 
    Amazon Web Service
    Pipeline
    Data
    Senior

    Harnham

    Richardson, TX
    1 day ago
  •  ...Dallas-based / Hybrid...  ...experienced Senior MLOps...  ...deployment pipelines, monitoring...  ...ML solutions reliably...  ...closely with Data Scientists...  ...learning models developed by Data...  .... Integrate ML workloads...  ...optimize Python- and SQL-...  ...AWS SageMaker...  ...Spark Kafka Grafana... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Immediate start

    KAPI LLC

    Dallas, TX
    25 days ago
  • $67.5k - $172.5k

     ...you will be based in...  ...development and integration to design,...  ...primarily focus on developing robust APIs...  ...-level to senior developers....  ...with Kafka• Build scalable...  ...with CI/CD pipelines and GitOps...  ...familiarity (AWS, Azure, GCP...  ...software solutions.Proposes &...  ...location, market data and on... 
    Amazon Web Service
    Pipeline
    Data
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office

    The PNC Financial Services Group

    Dallas, TX
    3 days ago
  • $125.76k - $188.64k

     ...are seeking a Senior Data Developer /Lead to join...  ...-time data solutions within our Hadoop...  ...with Kafka, and a proven...  ...keen focus on integrating and advancing...  ...complex Hadoop-based data pipelines and real-time...  ...knowledge of Python, PySpark, FastAPI...  ...such as AWS, Azure, and Google... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Full time

    Jobleads-US

    Irving, TX
    4 days ago
  •  ...convenience. The Senior Solution Architect defines...  ..., spanning data, decisioning, content...  ...and establishes the integration patterns, standards...  ...architecture certification (AWS or Azure)...  ..., cloud-based data and application...  ...Databricks), streaming (Kafka), reverse-ETL/activation... 
    Amazon Web Service
    Data
    Senior
    Work experience placement

    Jobleads-US

    Irving, TX
    3 days ago
  • $106.6k - $200k

     ...innovative ad tech solutions powered by...  ...for a Staff Python Engineer to...  ...and financial integrity. This is...  ...-critical pipelines. Thrives...  ...with Product, Data Engineering,...  ...like Celery, Kafka, or Airflow....  ...experience with AWS and Kubernetes...  ...expect the base salary for this... 
    Amazon Web Service
    Pipeline
    Data
    Temporary work
    Local area
    Worldwide

    SiriusXM

    Irving, TX
    2 days ago
  • Senior Full Stack .NET Developer Location: Dallas, Tx Job...  ..., scalable solutions using .NET...  ...APIs and integrate with external...  ...and data protection...  ...platforms (Azure, AWS) is a plus....  ...(RabbitMQ, Kafka). -Strong understanding...  ...and CI/CD pipelines. -Knowledge...  ...based on any protected... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Contract work

    InterSources

    Dallas, TX
    5 days ago
  •  ...Full Stack Developer The Java Full...  ...-based applications...  ...RESTful APIs and integrate microservices...  ...technical solutions Implement CI/CD pipelines and promote...  ...a lead or senior role Strong...  ...(RabbitMQ, Kafka) Hands-on experience...  ...platforms (AWS, Azure, GCP...  ..., data, AI, and automation... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Local area

    Techstra Solutions

    Dallas, TX
    5 days ago
  • $83.52k - $125.28k

     ...68 NTT DATA strives to...  ...seeking a Senior Digital Experience...  .../ Mobile / Python) to join...  ...), SDK integration patterns, app...  ...developer ~5+ years...  ...with CI/CD pipelines, Git/GitHub...  ...web views) AWS certifications...  ...compensation for U.S.-based positions....  ...Industry solutions help... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA, Inc.

    Irving, TX
    23 days ago
  • $104k - $204k

     ...MongoDB Pre-Sales Solution Architects...  ...using our data platform. Our...  ...entrepreneurs, and developers who take...  ...role will be based remotely in Austin...  ...(e.g. Python, Node.js, SQL...  ...qualification and pipeline generation...  ...such as Apache Kafka and...  ...available across AWS, Google Cloud... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Local area
    Remote work
    Worldwide
    Flexible hours

    MongoDB

    Dallas, TX
    3 days ago
  • $160k - $185k

     ...recruiting a Senior Data Architect for...  ...the chance to integrate cutting-edge AI...  ...recommend solutions; you will own...  ...modern, automated AWS data ecosystem...  ...advanced data pipelines and AI capabilities...  .... Apache Kafka: Proven...  ...discipline, such as developing and... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Remote work

    Harnham

    Dallas, TX
    3 days ago
  •  ...Summary The Sr. Solution Architect, Data, Analytics & AI...  ...and oversee the integration between...  ...warehouses, and data pipelines in coordination...  ...ingestion patterns based on business requirements...  ...actively tracks developments in data...  ...architectures — Kafka, Azure Event Hubs... 
    Pipeline
    Data
    Senior

    Jobleads-US

    Dallas, TX
    2 days ago
  •  ...Title: Sr. DATA Engineer Work...  ...and motivated AWS Certified...  ...scalable data solutions within the...  ...role involves developing deploying...  ...secure data pipelines and analytics...  ...efficiently and integrating with Iceberg...  ...using Python and shell scripting...  ...like Apache Kafka Flink or... 
    Amazon Web Service
    Pipeline
    Data
    Senior

    LTM

    Irving, TX
    29 days ago
  •  ...feel valued, develop skills and...  ...leveraging Apache Kafka as the core...  ....Technical Solutioning & Product...  ...by actively integrating AI assistance...  ...CI/CD pipelines, automated testing...  ...preferred, AWS, or Azure).Advanced...  ...(MCP), CLI-based AI coding...  ..., Property Data, Mortgage,... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Full time
    Work experience placement
    Local area
    Flexible hours

    CoreLogic

    Dallas, TX
    6 days ago
  • $96.49k - $144.74k

    NTT DATA strives to hire exceptional...  ...(Spark/Kafka/Flink/Scala/Java...  ...will design and develop streaming and batch...  ...Kafka/Flink/Spark-based processing...  ...and cloud-native solutions on Azure and Kubernetes...  ...and batch data pipelines using Apache...  ...-service data integration platforms and... 
    Pipeline
    Data
    Full time
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Dallas, TX
    5 days ago
  •  ...seeking a Senior Database Architect...  ...AI-native data...  ...vector database solutions for RAG implementations...  ...embedding pipelines that...  ...and graph-based retrieval...  ...data flows: Kafka-based event...  ...development Develop prompts,...  ...(C#, Java, Python) for...  ...Snowflake, or AWS equivalents... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Flexible hours

    WEX

    Dallas, TX
    4 days ago
  • Senior Data Engineer Experience Required...  ...data pipelines and ETL/ELT...  ...Snowflake. Develop, maintain, and...  ...and manage integrations using SnapLogic...  ...documented data solutions. Implement...  ...platforms (AWS/Azure/GCP) and...  ...(Python preferred) for...  ...streaming data (Kafka, Snowpipe Streaming... 
    Amazon Web Service
    Pipeline
    Data
    Senior

    Infovision

    Richardson, TX
    5 days ago
  • $95k - $152.5k

     ...Senior Software Engineer Apply...  ...specialization in Python-based API...  ...high-quality API solutions. Position Summary...  ...Responsibilities • Design, develop, test, deploy,...  ...(preferably AWS), CI/CD pipelines, and...  ...programming, data structures,...  ...Experience with Apache Kafka and event... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Hourly pay

    7-Eleven

    Irving, TX
    3 days ago
  • $100k - $130k

     ...Motorola Solutions, we believe...  ...experienced Senior Software Developer with deep...  ...in Python and a strong...  ...as MQTT, Kafka, RabbitMQ,...  ...automated CI/CD pipelines and cloud-...  .... Data & Security...  ...providers (AWS/Azure), including...  ...gRPC) and integrating...  ...Target Base Salary Range... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Relocation

    Motorola Solutions

    Richardson, TX
    1 day ago
  • Senior Cloud Solution Architect The Boeing Company is currently...  ...solutions that integrate on-premises data centers with Microsoft...  ...risk evaluations Develop and enforce best practices...  ...Azure with AWS or Google Cloud) or...  ...DevOps practices, CI/CD pipelines (e.g., Azure DevOps... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Local area

    Boeing

    Dallas, TX
    1 day ago
  •  ...We are seeking a Data Solutions Engineer IV to design, develop, implement, and support...  ...ETL / ELT pipelines using Fivetran for...  ...Define and drive Python, PySpark, and SQL...  ...manner. Design and integrate CI/CD pipelines...  ...dbt, Snowflake, Kafka ecosystem, AWS services) with focus... 
    Amazon Web Service
    Pipeline
    Data
    Senior

    BOK Financial

    Richardson, TX
    2 days ago
  •  ...for advancement Senior AI / Python Solutions Engineer...  ...designing AI solutions, developing intelligent agents, integrating enterprise APIs, and...  ...Develop dynamic form-based applications for...  ...Collaborate with Data Scientists, Product...  ...* Experience with Kafka or RabbitMQ. * Experience... 
    Data
    Senior
    Work from home
    Flexible hours

    Select Minds LLC

    Dallas, TX
    24 days ago
  •  ...permanent, contract & project-based staffing services for...  ...job for you. Role: Senior Solution Architect Location:...  ...DFD diagrams, OOP/OOD, data-structures, algorithms,...  ...cloud hyper-scalers like AWS 5+ years of hands-on experience...  ...Functions, Glue, Data Pipeline, Lake Formation, Aurora... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Permanent employment
    Contract work
    Remote work

    Tekfortune Inc

    Dallas, TX
    5 days ago
  •  ...rewriting how data moves and...  ...:As a Senior Software...  ...and integrity by standardizing...  ..., and develop cloud-native...  ...for Kafka and real-...  ...microservices-based...  ...-the-art solutions.Take responsibility...  ...100+ AWS, GCP, and...  .../C++, or Python) and strong...  ...data pipelines. A strong... 
    Amazon Web Service
    Pipeline
    Data
    Senior
    Immediate start
    Remote work

    Confluent

    Dallas, TX
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AWS Python Developer - Kafka (AWS-based solutions, Kafka integrations, and data pipelines), P. Be the first to apply!