Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer (Python, AWS Glue, Airflow, Lambda)

$34.67 - $54.18 per hour

Capgemini

Fort Mill, SC, United States (On-site) Contract (6 months 16 days) Published 5 days ago The Senior API Engineer (Python / AWS) is a critical member of the Data Modernization & Integration organization. This role is responsible for designing, building, securing, and operating high quality, cloud native REST APIs that power LPL’s core business platforms and integrations. This engineer will focus primarily on Python-based API development on AWS, leveraging services such as API Gateway, Lambda, and related AWS components, with all infrastructure managed through Terraform. The role plays an important part in modernizing legacy integrations and defining engineering standards for reliable, secure, and scalable API services. The ideal candidate combines deep hands‑on Python API engineering expertise with strong cloud architecture skills, a passion for automation, and the ability to collaborate across platform, data, security, and application teams. Responsibilities Design, develop, and maintain Python based REST APIs that support business critical workflows. Build APIs using AWS Lambda and Amazon API Gateway, following API first and REST best practices. Implement clean, testable, and well documented Python code suitable for enterprise production environments. Optimize API performance, reliability, scalability, and error handling. Ensure proper API versioning, contract stability, and backward compatibility. Implement secure authentication and authorization mechanisms such as OAuth2, JWT, and IAM based access; enforce request validation, throttling, rate limiting, and auditing; partner with security teams to meet enterprise security and compliance standards. Provision and manage AWS infrastructure using Terraform, including reusable modules for API Gateway, Lambda, IAM roles and policies, and CloudWatch logging and monitoring; maintain environment consistency across DEV, QA, UAT, and PROD. Design and maintain CI/CD pipelines for build, test, and deployment of Python APIs; support automated testing, packaging, versioning, and release management. Implement observability through logging, metrics, alerts, and tracing. Participate in troubleshooting, root cause analysis, and production support activities. Collaborate closely with application teams, platform engineering, cloud, and security teams; align API design and implementation with enterprise architectural standards. Actively contribute to code reviews, design discussions, and technical documentation; promote best practices and a culture of engineering excellence. Influence API engineering standards, patterns, and best practices across the organization; contribute to architectural reviews and modernization efforts. What Are We Looking For We are looking for strong collaborators who deliver reliable, secure, and high quality API solutions in fast paced, team oriented environments. Ideal candidates pursue technical excellence, act with integrity, and are motivated to build scalable platforms that enable business growth. We value continuous improvement, curiosity, and individuals who take ownership and pride in their work. Requirements 7+ years of experience in software engineering, API engineering, or cloud application development. Bachelor’s degree in Computer Science, Engineering, or related field (Master’s preferred). Hands‑on experience with Python for backend and API development, REST API design and implementation, AWS Lambda and Amazon API Gateway, and Terraform for Infrastructure as Code. Experience building and operating APIs in large scale, production environments. Strong understanding of authentication, authorization, and secure API design. Experience with CI/CD, Git based workflows, and automated testing. Ability to troubleshoot production issues and support on‑call rotations when required. Core Competencies API Design Mindset — builds clean, consistent, and consumer friendly APIs. Builder Mindset — emphasizes automation, reuse, and simplicity. Systems Thinking — understands how APIs integrate with distributed systems. Collaboration — works effectively across engineering, security, and platform teams. Ownership & Accountability — takes responsibility for design, delivery, and reliability. Preferences Experience with OAuth providers and identity platforms. Familiarity with AWS SAM or Serverless Framework (tooling experience). Exposure to event driven architectures (EventBridge, SNS/SQS). Experience operating APIs in regulated or enterprise environments (financial services preferred). Knowledge of observability tools such as CloudWatch, Dynatrace, Datadog, OpenTelemetry. Why This Role Is Different This position is not a Data Engineer role. It is focused entirely on Python API engineering on AWS, supported by Terraform based cloud infrastructure, and ownership of secure, scalable, and production‑ready API services. The pay range that the employer in good faith reasonably expects to pay for this position is $34.67/hour - $54.18/hour. Our benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis. Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations. #J-18808-Ljbffr Capgemini

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer (Python, AWS Glue, Airflow, Lambda) in Fort Mill, York County, SC vacancy
  • $39.86 - $62.29 per hour

    Capgemini is seeking a skilled Data Engineer (AWS Glue, Airflow, Lambda, Postgres) in Fort Mill, South Carolina. The role involves designing and building scalable data pipelines and performing analytics on AWS and Postgres platforms. The ideal candidate should have 6+... 
    Amazon Web Service

    Capgemini

    Fort Mill, York County, SC
    6 days ago
  • $39.86 - $62.29 per hour

    Data Engineer (AWS Glue, Airflow, Lambda, Postgres) We are seeking a skilled Data Engineer with strong hands‑on experience in AWS‑native data services,...  ...processing. Build and maintain AWS Glue ETL jobs (PySpark/Python) for data ingestion, transformation, and curation... 
    Amazon Web Service
    Contract work

    Capgemini

    Fort Mill, York County, SC
    6 days ago
  • $39.86 - $62.29 per hour

    Capgemini in Fort Mill, SC is looking for a skilled Data Engineer. The role focuses on building scalable data pipelines using AWS services like Glue, Lambda, and EventBridge. Candidates should have strong hands-on experience with these technologies and proficiency in SQL... 
    Amazon Web Service
    Hourly pay

    Capgemini

    Fort Mill, York County, SC
    5 days ago
  •  ...AWS ETL Technical Lead The role focuses on designing...  ...end-to-end data pipelines to deliver...  ...pipelines using AWS Glue, orchestrated with Airflow, ensuring data quality...  ...services like Glue, Lambda, EventBridge, S3, RDS...  ...Solutions Architect, Data Engineer). #J-18808-Ljbffr... 
    Amazon Web Service

    Signature IT World Inc

    Fort Mill, York County, SC
    5 hours ago
  • Role Data Engineer (Snowflake, AWS) - Location: Fort Mill, SC / ONSITE -...  ...processes using AWS Glue. This role involves working...  .... AWS services Airflow - hand‑on experience...  ...pipelines. AWS services Lambda - proficiency in AWS...  ...with Fivetran HVR. Python - strong programming... 
    Amazon Web Service

    Tech Mirrors

    Fort Mill, York County, SC
    2 days ago
  •  ...defining its future.# Data Engineer (AWS & Snowflake)AtlantaChoosing...  ...processes using AWS Glue.This role involves...  ...a plus 3 AWS services Airflow The candidate should have...  ...4 AWS services Lambda Proficiency in AWS Lambda...  ...experience on Fivetran HVR 7 Python Strong programming... 
    Amazon Web Service
    Full time
    Local area

    Capgemini

    Fort Mill, York County, SC
    6 days ago
  •  ...AWS Data Engineer Location: Austin Tx, Fort Mill or NY – hybrid Contract Visa: USC & GC Job Description...  ...and implement data pipelines using AWS Glue for ETL processes. Design event-driven workflows using AWS Lambda and Step Functions. Ensure high... 
    Amazon Web Service
    Contract work

    AceStack LLC

    Fort Mill, York County, SC
    1 day ago
  • We are seeking a Mid-Senior Data Engineer with strong expertise in AWS-based data engineering, real-time streaming...  ...ETL/ELT pipelines using AWS Glue, PySpark, and Python Design and manage real-time...  ...PySpark Proven expertise in AWS Glue, Lambda, and other cloud-native data... 
    Amazon Web Service

    eOne Infotech

    Fort Mill, York County, SC
    6 days ago
  • $34.67 - $54.18 per hour

     ...modern cloud native event driven and data engineering ecosystems. This role goes...  ...deploy and manage EDM solutions on AWS or Azure; orchestrate with Glue and Lambda, manage S3 data lake integration,...  ...Advanced Data Engineering: Work with Python, PySpark and Spark SQL to... 
    Amazon Web Service

    Capgemini

    Fort Mill, York County, SC
    2 days ago
  •  ...RESOURCES Whitepapers CAREERS Contact Us Sr. Data Engineer (Mid-Senior Level) - AWS & Streaming Full Time Fort Mill, SC (3...  ...scalable ETL/ELT pipelines using AWS Glue, PySpark, and Python Build event-driven workflows using AWS Lambda Design and manage real-time streaming... 
    Amazon Web Service
    Full time

    EOne Infotech

    Fort Mill, York County, SC
    5 days ago
  • A tech recruitment firm is searching for an ETL/Data Tester in Fort Mills, SC with a hybrid work model. The ideal...  ...required include Snowflake, Automation using Selenium or Python, AWS, and experience with Dag and Airflow (preferred). This is a contract position lasting 12... 
    Amazon Web Service
    Contract work

    ClifyX

    Fort Mill, York County, SC
    3 days ago
  • $39.86 - $62.29 per hour

     ...Published 13 days ago Snowflake aws Job Summary We are seeking...  ...and deep expertise in data engineering and cloud-based data platforms...  ...Strong expertise in SQL and Python . Experience with: Infrastructure...  ...Orchestration tools like Airflow Deep understanding of: Snowflake... 
    Amazon Web Service
    Contract work

    Capgemini

    Fort Mill, York County, SC
    4 days ago
  • Tech Mirrors in Fort Mill, SC is seeking a Data Engineer specializing in Snowflake and AWS. The ideal candidate will design, develop, and maintain scalable data pipelines and ETL processes using AWS Glue, and collaborate with data professionals to ensure data quality.... 
    Amazon Web Service

    Tech Mirrors

    Fort Mill, York County, SC
    6 days ago
  •  ...Mill, South Carolina is seeking an AWS ETL Technical Lead to design and develop scalable data pipelines and warehouse...  ...development of ETL pipelines with AWS Glue and ensuring data quality and performance...  ...Solutions Architect and Data Engineer. #J-18808-Ljbffr Signature IT... 
    Amazon Web Service

    Signature IT World Inc

    Fort Mill, York County, SC
    5 days ago
  • $106.1k - $176.9k

     ...their financial goals.Job Overview:The Senior API Engineer (Python / AWS) is a critical member of the Data Modernization & Integration organization. This role...  ...development on AWS, leveraging services such as API Gateway, Lambda, and related AWS components, with all... 
    Amazon Web Service
    Contract work
    Work from home

    LPL Financial

    Fort Mill, York County, SC
    3 days ago
  • Capgemini is seeking a Data Engineer in Fort Mill, SC, to design and maintain scalable data pipelines using AWS and Snowflake. The ideal candidate will have extensive experience...  ...ETL processes, and proficiency in Python. Responsibilities involve collaborating with... 
    Amazon Web Service

    Capgemini

    Fort Mill, York County, SC
    6 days ago
  •  ...with over 10 years of IT experience, particularly in data engineering and cloud platforms like Snowflake and AWS. The ideal candidate will design, implement, and...  ...CI/CD pipelines and requires strong skills in SQL, Python, and Terraform. #J-18808-Ljbffr Capgemini
    Amazon Web Service

    Capgemini

    Fort Mill, York County, SC
    4 days ago
  •  ...are seeking a skilled Quality Engineer with hands-on experience in Behavior...  ...and reliability of our data ingestion and pipeline solutions...  ...and results. Proficiency in Python, Java or another programming language...  ...cloud data platforms (e.g., AWS Glue) and Snowflake. Experience... 
    Amazon Web Service

    eOne Infotech

    Fort Mill, York County, SC
    5 days ago
  •  ...Developer based in South Carolina to design, implement, and optimize data engineering solutions. With over 10 years of IT experience, the ideal...  ...deep expertise in Snowflake and cloud platforms including AWS and Azure. This role involves leading database migration initiatives... 
    Amazon Web Service

    Capgemini

    Fort Mill, York County, SC
    6 days ago
  • $119.07k - $198.38k

    Job Overview The AVP, Data Reporting Manager leads the strategy, governance, and delivery of LPL’s enterprise Business Intelligence capabilities...  ...skills and attention to detail Preferences Tableau Certification AWS GenAI Certification Bachelors degree Pay Range $119,068.00 - $198... 
    Amazon Web Service

    LPL Financial LLC

    Fort Mill, York County, SC
    3 days ago
  •  ...looking for a detail-oriented and technically strong Python Data Testing Engineer who specializes in data validation, automation,...  ...analysis with actionable insights. Work with AWS services (Glue, S3, RDS, DynamoDB, Lambda) for testing cloud‑based data workflows. Build... 
    Amazon Web Service
    Full time

    Capgemini

    Fort Mill, York County, SC
    5 days ago
  • $175.92k - $293.14k

    Job Overview VP, Principal Engineer / Tech Lead LPL Financial...  ...modern, cloud‑based data and application capabilities...  ...compensation systems using AWS‑native services and Python‑driven data pipelines. Responsibilities...  ...using Python, AWS Glue, Lambda, Step Functions, and S3... 
    Amazon Web Service
    Work from home

    LPL Financial

    Fort Mill, York County, SC
    4 days ago
  • $34.67 - $54.18 per hour

    Capgemini is seeking a Senior API Engineer in Fort Mill, SC to design and maintain Python-based REST APIs. This role emphasizes collaboration across teams while...  ...Science or a related field. Hands-on experience with AWS, Python, and Terraform is required. Competitive pay... 
    Amazon Web Service

    Capgemini

    Fort Mill, York County, SC
    3 days ago
  •  ...message the job poster from ClifyX Position Title: ETL/Data Tester Location: Fort Mills, SC (3 days hybrid) Duration:...  ...ETL/Data Testing Mandatory Skills Snowflake Selenium or Python Automation Dag AWS Airflow (Preferred) Thanks & Best Regards, Vishal Swami -... 
    Amazon Web Service
    Contract work

    ClifyX

    Fort Mill, York County, SC
    3 days ago
  •  ...and maintain C#/.NET Core microservices and RESTful APIs .Develop cloud-native workloads on AWS (ECS/EKS/Lambda, API Gateway, SQS/SNS, DynamoDB/RDS, S3, CloudWatch) .Implement data models for portfolio, positions, transactions, orders, entitlements, performance, fees,... 
    Amazon Web Service
    For subcontractor

    Compunnel

    Fort Mill, York County, SC
    5 hours ago
  •  ...Role: Senior Cloud Engineer Location: Fort Mill SC Need Hybrid...  ...infrastructure solutions in AWS. The Cloud Engineering team, part...  ...including VPC, EC2, ECS/EKS, Lambda, RDS, S3, IAM, CloudWatch...  ...Strong scripting skills: Python, Bash, or PowerShell... 
    Amazon Web Service
    Contract work
    Work experience placement
    Remote work

    E-Solutions

    Fort Mill, York County, SC
    3 days ago
  • $50 per hour

     ...of consistency to the company data standard policies and procedures...  ...web applications using React and Python. Write clean, maintainable,...  ...Skills Hands-on experience with AWS, Azure, or other cloud...  ...Experience with Databricks, ADF, Glue, ETL, and ELT processes. Proven... 
    Amazon Web Service
    Hourly pay
    Work at office

    Creative Solutions Services, LLC

    Fort Mill, York County, SC
    5 days ago
  •  ...a US-based consulting, data science and technology...  ...bringing together strong engineering, data science, and...  ...cloud-native solutions on AWS with a strong focus on...  ...workloads on AWS (ECS/EKS/Lambda, API Gateway, SQS/SNS,...  ...Nice to have Bonus: Python for data pipelines, Snowflake... 
    Amazon Web Service
    Full time

    Qode

    Fort Mill, York County, SC
    2 days ago
  •  ...generation technologies Understanding of ASPNET Core Entity Framework Core and modern NET patterns AWS Strong hands on experience with AWS services Kubernetes EC2 Lambda RDS etc and cloud architecture Problem Solving Proven ability to design solutions for complex technical... 
    Amazon Web Service
    Permanent employment
    Contract work
    Local area

    Robotics Technologies LLC

    Fort Mill, York County, SC
    1 day ago
  •  ...Overview We are looking for an experienced .NET Lead with strong AWS expertise to design, develop, and lead scalable enterprise...  ..., security Experience with AWS services: ECS, EKS, API Gateway, Lambda, IAM Knowledge of ElastiCache (Redis/Memcached) Experience with... 
    Amazon Web Service
    Permanent employment
    Contract work
    Local area

    Cloud Analytics Technologies, LLC

    Fort Mill, York County, SC
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer (Python, AWS Glue, Airflow, Lambda). Be the first to apply!