Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Data Engineer (Airflow, Kafka, Spark) - Q125

R2 Technologies

Overview: R2 Technologies Corporation (R2) , headquartered in Alpharetta, GA, is a leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure), Artificial Intelligence (AI), Machine Learning (ML), software development, project management, SAP, and enterprise resource planning (ERP). We empower clients-from startups to Fortune 1000 companies-with scalable, platform-based solutions and data-driven insights using modern cloud technologies. Our commitment to blending highly skilled talent with innovative productivity platforms ensures rapid delivery of business value, making us one of the most respected and trusted technology companies in the United States. At R2, we're passionate about driving operational excellence and competitive advantage for our clients through cutting-edge AI, ML, and cloud solutions. Join our team and help shape the future of technology innovation! Python Data Engineer (Airflow, Kafka, Spark) Location: Alpharetta, GA (willing to travel to client locations) Employment Type: Full-Time (W2) Role Overview We are seeking a proficient Python Data Engineer to build and manage data pipelines using Airflow, Kafka, and Spark. This role focuses on developing scalable ETL/ELT workflows for streaming and batch data processing. Key Responsibilities Design and implement data pipelines using Python with Airflow for orchestration and scheduling. Integrate Kafka for streaming data and Spark for processing large-scale datasets. Develop ETL/ELT workflows to transform and load data into storage or analytics systems. Optimize pipelines for performance, reliability, and scalability in distributed environments. Collaborate with data teams to ensure data quality and availability for downstream applications. Monitor and troubleshoot data workflows to maintain seamless operations. Required Qualifications Bachelor's degree in Computer Science, Software Engineering, or a related field (or equivalent experience). 3 years of experience as a Data Engineer with Python, focusing on Airflow, Kafka, and Spark. Proficiency in building ETL/ELT pipelines for streaming and batch data processing. Experience with Kafka for real-time data streaming and Spark for distributed data processing. Strong understanding of data engineering principles and pipeline automation. Preferred Qualifications Familiarity with alternative orchestration tools like Luigi for data workflow management. Exposure to cloud platforms like AWS or GCP for hosting data pipelines. Knowledge of monitoring tools like Grafana for pipeline observability. Compensation & Benefits Competitive salary and comprehensive benefits package (healthcare, PTO, 401k). Opportunities for professional growth and upskilling in AI and cloud technologies. R2 Technologies Corporation is an equal opportunity employer and values diversity in the workplace. Skills: Python, Airflow, Kafka, Spark, Data Engineer, ETL, ELT, Streaming R2 Technologies

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Python Data Engineer (Airflow, Kafka, Spark) - Q125 in Alpharetta, GA vacancy
  •  ...provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure),...  ...technology innovation! Senior Big Data Engineer (AWS EMR & Spark) Location: Alpharetta, GA (willing to...  ...Knowledge of scripting languages like Python or Scala for Spark job development.... 
    Suggested
    Full time

    R2 Technologies

    Alpharetta, GA
    3 days ago
  • $99k - $164.8k

     ...POSITION SUMMARY:Kemper is seeking a Data Quality Engineer specializing in Data Testing and...  ..., Informatica, IICS, Snowflake, and Python.Data Validation and Quality AssuranceDevelop...  ...data architectures.Experience with Spark, Kafka, Airflow, DBT, and Infrastructure as Code... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    Kemper Corporation

    Alpharetta, GA
    2 days ago
  •  ...leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure), Artificial Intelligence...  ...and help shape the future of technology innovation! Senior Python AI/ML Engineer (TensorFlow/PyTorch) Location: Alpharetta, GA (willing to travel... 
    Suggested
    Full time

    R2 Technologies

    Alpharetta, GA
    3 days ago
  •  ...Job Description: Java Data Engineer Job Title Java Data...  ...processing applications using Spark or Hadoop....  ...Flink. Knowledge of Kafka or other messaging platforms...  ...Experience with Airflow or workflow orchestration...  .../11/17 SQL Python (Preferred) Scala... 
    Suggested
    Full time
    Immediate start
    Remote work

    Ova Technologies

    Alpharetta, GA
    26 days ago
  • $50 - $55 per hour

     ...Hadoop MapReduce jobs for complex data processing tasks. Utilize...  ...datasets within Hadoop. Leverage Spark for real-time data processing...  ...: Strong proficiency in Python, Java, and SQL. Big Data Frameworks...  ...and query optimization. Data Engineering Concepts: Knowledge of data ingestion... 
    Suggested
    Temporary work
    Local area

    CYNET SYSTEMS

    Alpharetta, GA
    5 days ago
  • Alpharetta, GANA G&A - GBITS /Full-time /Remote Data Engineer, Marketing TechnologyAbout Us:Foxit is...  ..., sales, and operational systems using Python and SQL.• Implement field-level...  ...ETL/ELT pipelines using Databricks, dbt, Airflow, Azure Data Factory, or equivalent.• Hands... 
    Full time
    Remote work
    Worldwide

    Foxit Software

    Alpharetta, GA
    2 days ago
  •  ...and resume at ****@*****.*** AWS Data Engineer (In-Person Interview) Alpharetta, GA...  ...Description: Qualifications (Data Engineer/Python Developer) 10+ years hands-on Python...  ...data technologies, such as Hadoop/EMR, Spark, Hive. Strong development experience in... 
    Permanent employment
    Full time
    Work experience placement
    H1b
    Weekend work

    Centraprise

    Alpharetta, GA
    3 days ago
  •  ...experience in designing, building, and maintaining robust data pipelines using Python and SQL. Expert in writing complex SQLs Develop reusable...  ...your skills Grow with the best – Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving... 

    Cloud Analytics Technologies LLC

    Alpharetta, GA
    27 days ago
  • Senior Data Engineer ***Sponsorship is not provided*** ***No Third Party Resumes*** Onsite in...  ...reliability, and accessibility. Optimize Apache Spark jobs, cluster configurations, serverless...  ...and Azure Data Factory. Proficiency in Python, PySpark, and SQL. Experience with... 
    Temporary work

    Capstone Logistics LLC

    Peachtree Corners, GA
    12 hours ago
  •  ...Fiserv.Job TitleSenior Director- Data EngineeringAbout your role:You...  .... You will lead talented data engineering and development teams to...  ...teams.4+ years of experience in Python, Java, or similar programming...  ...hands-on experience with Apache Spark for large-scale distributed data... 
    Full time
    Temporary work
    H1b
    Work at office
    Monday to Friday

    Fiserv

    Alpharetta, GA
    12 hours ago
  •  ...technologies. R2 specializes in Java, Dot Net, Big Data, Cloud Computing, artificial intelligence...  ...1000 companies. Job Title: Big Data Engineer Location: Alpharetta, GA. Type: Full-...  ...code (IaC) using Ansible, Terraform, and Python. • Experience with one or more container... 
    Full time
    Work experience placement

    R2 Technologies

    Alpharetta, GA
    3 days ago
  •  ...innovative enterprise solutions and data insights, Zinnia simplifies...  ...ARE: As a seasoned Data Engineer specializing in data...  ...and have a strong command of Python for data manipulation and automation...  ..., Snowflake, DBT, Python, and Airflow. Responsible for designing and... 

    Zinnia

    Alpharetta, GA
    3 days ago
  • $145.6k - $209.3k

     ...United StatesTravel: Up to 25%Role: Sr. Staff Data EngineerDepartment: Software & Product...  ...the teamThe FinOps team partners with Engineering, Finance, Data & Analytics, and Product teams...  .../or GCP data ecosystems.Advanced SQL and Python development experience.Experience with... 

    UKG

    Alpharetta, GA
    4 days ago
  •  ...shape the future of education. Senior Data Engineer Overview: We are seeking an...  ...pipelines using tools like dbt, Apache Airflow, Azure Data Factory, or similar orchestration...  ...Programming: Proficiency in languages such as Python, Scala, or C# for data manipulation and... 
    Full time
    Interim role
    Work at office

    Incident IQ

    Alpharetta, GA
    22 days ago
  • $120.5k - $231k

     ...#VTeamLife.What you’ll be doing...The Principal Engineer - Data Science joins the high-visibility Impact...  ...across big data systems using SQL and Python.Advanced ML & Predictive Modeling:...  ...consulting.Experience with Big Data frameworks (Spark, Splunk, Hadoop) and cloud analytics... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office
    Work from home
    Shift work
    3 days per week

    Verizon

    Alpharetta, GA
    1 day ago
  •  ...mandatory Machine Learning Engineer Location: Alpharetta-...  ...work experience in data ingestion on streaming...  ...developer using Java/C++/Python • Must have 7+ years of...  ..., Apache Flink, or Spark Streaming • Must have 7...  ...technologies like Pub/Sub, Kafka and Rabbit MQ • Must... 
    Work experience placement
    3 days per week
    Weekday work

    Maintec Technologies

    Alpharetta, GA
    3 days ago
  • Agentforce - GCP DevOps & Data Engineer Location: Onsite - Alpharetta, Georgia (Onshore) Required Qualifications Bachelor's degree in Computer...  ...as Code using Terraform. Experience with Pub/Sub, Kafka, and API development. Understanding of GCP IAM, encryption, and... 

    Highbrow Technology Inc

    Alpharetta, GA
    3 days ago
  • $20 - $25 per hour

     ...Veeam is the Data and AI Trust Company, specializing in helping organizations ensure...  ...Your Role   In the Data & Analytics Engineering Internship, you’ll get hands on experience...  ...Qualifications   Knowledge of SQL, Python, or Spark Familiarity Azure or other cloud... 
    Hourly pay
    Summer work
    Internship
    Summer internship
    Work at office
    Local area
    Worldwide
    Work visa
    2 days per week
    3 days per week

    Veeam Software

    Alpharetta, GA
    6 days ago
  •  ...Senior Manager, Data Platforms & Governance At MiniMed, you can begin a lifelong career...  ...Platforms & Governance, you will manage engineering teams responsible for maintaining a...  ...CRM, third-party feeds) Proficiency in Python, PySpark, Scala, or SQL for technical fluency... 

    Mini Med

    Alpharetta, GA
    2 days ago
  • $122.9k - $204.9k

     ...strategies. The ideal candidate will have a strong background in data analytics, experience with Adobe CJA, and a passion for...  ...implementation. Familiarity with data analysis tools (e.g., SQL, Python, R) and data visualization software (e.g., Tableau, Power BI).... 
    Summer holiday
    Immediate start
    Flexible hours

    EY

    Alpharetta, GA
    2 days ago
  •  ...provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP, Azure), Artificial...  ..., and event-driven architectures like Kafka. Optimize scalability and performance of...  ...'s degree in Computer Science, Software Engineering, or a related field (or equivalent experience... 
    Full time

    R2 Technologies

    Alpharetta, GA
    3 days ago
  •  ...Employer committed to fostering an inclusive work environment.Job RequirementsMinimum Education: Bachelor's degree in Computer Science, Engineering or other related technical field or an equivalent combination of education and experience.Minimum Experience: 5 to 7 years of... 
    Work at office

    Synovus

    Roswell, GA
    3 days ago
  •  ...ID29416035Reference26-27824TECH SVCS - Data Solutions Engineer Must Have List: • 6-10+ years...  ...hands-on Databricks experience: PySpark, Spark SQL, Delta Lake, and experience with...  ...which layer and why. • Advanced SQL, Python, and a Git-based development workflow.... 

    Mindlance

    Lawrenceville, GA
    1 day ago
  • $80 - $83.65 per hour

     ...Data Solutions Engineer Pharma (Hybrid- Lawrenceville, NJ) We are seeking a Data Solutions...  ...understanding of of Databricks tools, (PySpark, Spark SQL, Delta Lake, etc.) ~...  ...pod. ~ Advanced SQL, Python, and a Git-based development workflow.... 
    Full time
    Contract work
    Work at office

    Stage 4 Solutions Inc

    Lawrenceville, GA
    5 days ago
  •  ...Description Job Description Request ID: 113966-1 Title: Python with Agentic AI Engineer Locations: Alpharetta, GA Duration: 6 months Pay...  ...microservices using FastAPI, Flask, or Django. Build data pipelines for ingestion, processing, and enrichment of... 

    Artech LLC

    Alpharetta, GA
    5 days ago
  •  ...Job Description Job Description Senior Test Data Management Engineer Location: Alpharetta, GA – Hybrid (3 days onsite) Experience:...  ...Server / PostgreSQL / DB2 Jenkins / Git / Azure DevOps Python, Java, or Shell scripting ETL/data integration and API testing... 

    Georgia IT Inc.

    Alpharetta, GA
    26 days ago
  •  ..., Alpharetta, GA Overview We are seeking a highly skilled Data Engineer / Cloud Data Solutions engineer with experience in Google Cloud...  ...and analytics solutions, utilizing your skills in BigQuery, Python, PySpark, LookML, SQL, GCP Data Studio, and GCP Data Flow. Your... 
    Local area

    Cedent Consulting

    Alpharetta, GA
    12 hours ago
  •  ...Assistance, Inc., (SGA), is searching for a Python Developer – Data Protection Services for a CONTRACT...  ...Strategy by architecting, engineering, deploying, and operating technical data...  ...Orchestration: Docker, Kubernetes, Kafka SRE: Flux, Grafana, Loki Products... 
    Contract work

    SGA Inc.

    Alpharetta, GA
    24 days ago
  • $99k - $164.8k

     ...Auto is seeking a highly skilled Resident Actuarial Engineer Manager to integrate solution development and data engineering practices within actuarial processes....  ...and expected performance. Develop solutions using Python in a cloud-based ecosystem.Actuarial Data Support:... 
    Full time
    Remote work

    Kemper Corporation

    Alpharetta, GA
    12 hours ago
  • $24 - $31 per hour

     ...Siemens Corp., IT Americas is seeking a motivated and curious Data Science Intern to join our team in Alpharetta, GA. In...  ...support data-driven decision-making. Write SQL and Python code to support data engineering, analytics, and machine learning projects. Develop... 
    Hourly pay
    Internship
    Summer internship
    Local area

    Siemens

    Alpharetta, GA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Data Engineer (Airflow, Kafka, Spark) - Q125. Be the first to apply!