Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AWS Data Engineer

Diverse Lynx

Role Descriptions: Design and manage AWS-based data infrastructure using services such as S3| Glue| EMR| Redshift| Athena| Lambda| Kinesis| and RDS
Build and maintain scalable| fault-tolerant data pipelines (batch and streaming)Implement Infrastructure as Code (IaC) using Terraform Cloud Formation
Optimize data storage| compute| and query performance for cost and efficiency
Ensure data security| governance| and compliance (IAM| encryption| VPC| logging)Design and implement monitoring| alerting| and observability for data platforms and pipelines
Integrate and manage monitoring tools such as Datadog| Prometheus| Grafana| Cloud Watch Create dashboards| alerts| and SLIs SLOs to ensure pipeline reliability and performance
Collaborate with data engineers| analysts| and platform teams to support analytics use case
Automate deployments| scaling| and operational tasks via CICD pipelines Participate in architecture reviews and recommend best practices for AWS data platforms
Proficiency in Python SQL (Scala optional)Solid understanding of data modeling| ETLELT| and distributed systems
Experience with Apache Spark| EMR| Kafka Hands on with AWS Kendra would be good
.Experience with Data Lake
Familiarity with Airflow| Step Functions| or other orchestration tools
Essential Skills: Design and manage AWS-based data infrastructure using services such as S3| Glue| EMR| Redshift| Athena| Lambda| Kinesis| and RDS
Build and maintain scalable| fault-tolerant data pipelines (batch and streaming)Implement Infrastructure as Code (IaC) using Terraform Cloud Formation
Optimize data storage| compute| and query performance for cost and efficiency
Ensure data security| governance| and compliance (IAM| encryption| VPC| logging)Design and implement monitoring| alerting| and observability for data platforms and pipelines
Integrate and manage monitoring tools such as Datadog| Prometheus| Grafana| Cloud Watch Create dashboards| alerts| and SLIs SLOs to ensure pipeline reliability and performance Collaborate with data engineers| analysts| and platform teams to support analytics use case
Automate deployments| scaling| and operational tasks via CICD pipelines
Participate in architecture reviews and recommend best practices for AWS data platforms
Proficiency in Python SQL (Scala optional)Solid understanding of data modeling| ETLELT| and distributed systems
Experience with Apache Spark| EMR| Kafka
Hands on with AWS Kendra would be good.
Experience with Data Lake
Familiarity with Airflow| Step Functions| or other orchestration tool

Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.
Vacancy posted 23 hours ago
Similar jobs that could be interesting for youBased on the AWS Data Engineer in San Francisco, CA vacancy
  •  ...About the job AWS Data Engineer AWS Data Engineer needs 7+ years of experience in Amazon Web Services (AWS) Cloud Computing AWS Data Engineer requires: Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and... 
    Amazon Web Service

    Global Channel Management

    San Francisco, CA
    3 days ago
  •  ...Overview: JOB DESCRIPTION: • AWS, Glue, PySpark, Redshift/S3, Data Modelling, Git • Strong experience in ETL/data pipeline development and data integration from FLEX, Agiloft, CARS systems. • Proficient in SQL, Python, and QlikView/Qlik Sense data models.... 
    Amazon Web Service
    Flexible hours

    Purple Drive

    San Francisco, CA
    2 days ago
  •  ...AWS Data Engineer Location: San Francisco and jersey city ( 3 days onsite 2 days remote) look for nearby Candidates only ( Only w2 Required) Must Have Skills : Spark, AWS, data lake, data pipelining python Job Description: As an... 
    Amazon Web Service
    Remote work

    Apex Informatics

    San Francisco, CA
    2 days ago
  •  ...Big Data Engineer CA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco...  ...Experience with delivering Big Data Solutions in the cloud with AWS or Azure • Ability to configure and support API and... 
    Amazon Web Service
    Work experience placement

    ClifyX

    San Francisco, CA
    23 hours ago
  •  ...field , 5+ years of experience in backend engineering, specializing in microservices, APIs, and...  ...of cloud-based architectures (AWS preferred), including serverless frameworks...  ...designing, implementing, and optimizing data services, ensuring that our data services... 
    Amazon Web Service

    Crunchyroll

    San Francisco, CA
    1 day ago
  •  ...Responsibilities Help us advance our robotics moonshot by scaling our data engineering efforts. Drive design and development of data infrastructure...  ...Python and SQL Experience working with cloud platforms like AWS, GCP, Azure Fast learner with a strong work ethic, high... 
    Amazon Web Service
    Full time
    Weekend work

    Nimble Robotics

    San Francisco, CA
    6 hours ago
  • $135k - $180k

    Samba TV, Inc. is looking for an experienced Data Engineer to build scalable data product architecture and optimize cloud-based data infrastructure...  ..., with strong knowledge of Databricks, Apache Spark, and AWS services. You will work in a collaborative environment driving... 
    Amazon Web Service

    Samba TV, Inc.

    San Francisco, CA
    5 days ago
  • $185k - $221.4k

     ...What You’ll Do Build and own production data infrastructure. Design, implement, and operate...  ...shape at the right time. Uphold high engineering standards and collaborate broadly. Lead code...  ...-on cloud data stack experience across AWS or GCP (e.g., managed Postgres, object... 
    Amazon Web Service
    Remote work
    Flexible hours

    Foresite Labs

    San Francisco, CA
    1 day ago
  • $185k - $225k

    # Data EngineerYou.comPosted by Mariane Bekker · Head of Developer RelationFull-timeAlready...  ..., and useful.Our team includes engineers, researchers, product builders, and operators...  ...processing using technologies like Databricks, AWS, and Kafka, while helping ensure data... 
    Amazon Web Service
    Full time
    Immediate start
    Remote work
    Work from home

    Founders Bay Inc.

    San Francisco, CA
    4 days ago
  •  ...with a leading consumer marketplace platform to find a Senior Data Engineer in San Francisco. In this pivotal role, you will manage data pipelines...  ...like Airflow or Jenkins, and the ability to build pipelines in AWS, GCP, or Azure. #J-18808-Ljbffr Strategic Employment Partners
    Amazon Web Service

    Strategic Employment Partners

    San Francisco, CA
    5 days ago
  • $156k - $195k

    Turo Inc. is seeking a skilled data engineer to join their team in San Francisco. The role involves identifying stakeholder needs, developing...  .... Strong experience in Python and cloud technologies such as AWS, Kubernetes, and Docker is essential. The position offers a competitive... 
    Amazon Web Service

    Turo Inc.

    San Francisco, CA
    4 days ago
  • A leading technology firm in San Francisco is looking for an experienced AWS Data Engineer to design and maintain data pipelines using AWS services. This role requires strong skills in Python and Spark, along with expertise in ETL development and data quality assurance.... 
    Amazon Web Service

    Global Channel Management

    San Francisco, CA
    1 day ago
  • Arena Club is looking for a Senior Data Engineer to join their team in San Francisco, California. In this role, you will enhance operational...  ...building and maintaining data pipelines. You’ll work with tools like AWS Glue and Redshift to ensure data quality and support meaningful... 
    Amazon Web Service

    Arena Club

    San Francisco, CA
    4 days ago
  • $106.9k - $176.5k

     ...working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically...  ...engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP). Collaborate with clients to understand their data... 
    Amazon Web Service
    Summer holiday
    Flexible hours

    EY

    San Francisco, CA
    17 hours ago
  • $123.7k - $254.67k

    A leading social media platform in San Francisco is seeking a Senior Data Engineer to implement and optimize data infrastructure using AWS. This role requires strong proficiency in Spark and Scala, alongside a Bachelor’s degree in Computer Science or a related field. You... 
    Amazon Web Service

    Pinterest

    San Francisco, CA
    4 days ago
  • Harnham is seeking a Senior Data Engineer in San Francisco to take ownership of the data pipelines essential to their data ecosystem. The candidate...  ...dbt, and familiarity with cloud-native architectures across AWS, GCP, or Azure. Join a recognized platform and collaborate with... 
    Amazon Web Service

    Harnham

    San Francisco, CA
    5 days ago
  • Founders Bay Inc. is looking for a hands-on Data Engineer in San Francisco to build and scale our modern data platform. You will work closely...  .... The role requires strong experience with Databricks, AWS, and Kafka, along with skills in Python and SQL. You will have... 
    Amazon Web Service

    Founders Bay Inc.

    San Francisco, CA
    4 days ago
  • A leading data collaboration company in San Francisco is seeking a Senior Software Engineer to join their Identity Engineering team. This role involves leading complex projects...  ..., Hadoop, and cloud platforms such as GCP or AWS. The position offers flexibility with remote... 
    Amazon Web Service
    Remote work

    LiveRamp

    San Francisco, CA
    4 days ago
  • $185k - $221.4k

    Foresite Labs is seeking an experienced Data Engineer in San Francisco, CA. This role focuses on building production data infrastructure, ensuring...  ...Python and SQL, and a strong grasp of cloud technologies like AWS or GCP. The position offers a competitive salary range of $185,... 
    Amazon Web Service

    Foresite Labs

    San Francisco, CA
    4 days ago
  •  ...partnering with a large consumer marketplace platform to find a Senior Data Engineer to join their growing data engineering team in San Francisco....  ...Experience building data pipelines in the public cloud (AWS, GCP, or Azure) Strong stakeholder communication - you push back... 
    Amazon Web Service
    3 days per week

    Strategic Employment Partners

    San Francisco, CA
    5 days ago
  • $156k - $195k

    A leading car sharing marketplace is seeking an experienced data-focused professional to join their team in San Francisco. This role involves...  ...data pipelines, utilizing cutting-edge technologies like AWS and Docker, and working closely with stakeholders in the Marketing... 
    Amazon Web Service
    Work at office
    3 days per week

    Turo Inc

    San Francisco, CA
    3 days ago
  • A progressive technology company in San Francisco is looking for a Data Infrastructure Engineer to design and operate data and ML infrastructure on AWS. The ideal candidate will have strong software engineering fundamentals and experience building production systems, particularly... 
    Amazon Web Service

    Matter Intelligence

    San Francisco, CA
    1 day ago
  •  ...enterprise engagements. You will bridge the gap between sophisticated Data Engineering architectures and cutting-edge AI/ML applications to solve...  ...-level proficiency in at least one major cloud provider (AWS, Azure, or GCP), specifically around data and AI services (e.g... 
    Amazon Web Service

    Talent Sutra

    San Francisco, CA
    5 days ago
  •  ...Lead Data Integration Engineer - Medicaid & MDM Location: San Francisco, CA - Onsite Duration: 6 months IT experience in Requirements...  ...Integration Solutions. Expertise: • Cloud Technologies: Aws, Palantir • Databases: Oracle 12c/11g, MS SQL 2000,... 
    Amazon Web Service

    AceStack LLC

    San Francisco, CA
    3 days ago
  • AWS Lake Formation Implementation: Configure and manage AWS Lake Formation to establish secure, scalable data lakes, ensuring robust data governance and access control. IAM Configuration: Implement and manage AWS IAM solutions, including role-based access control (RBAC)... 
    Amazon Web Service
    Permanent employment
    Contract work
    Local area

    Robotics Prcocess Automation, LLC

    San Francisco, CA
    3 days ago
  •  ...developer platforms in the world, trusted by engineering teams at OpenAI, Meta, Netflix, and Adobe, who are scaling their data platform and looking to hire a Senior Data Engineer...  ...Cloud‑native architecture experience across AWS, GCP, or Azure Exposure to designing data... 
    Amazon Web Service

    Harnham

    San Francisco, CA
    5 days ago
  • $145k - $215k

    Founding Data Engineer Salary: $145,000 - $215,000 + Equity Company Description: VC-backed healthtech AI startup Job Description: You will...  ...medical record formats. Design and maintain scalable data models on AWS optimized for AI retrieval and processing. Extract structured... 
    Amazon Web Service

    Jack & Jill/External ATS

    San Francisco, CA
    1 day ago
  • Job Description RadiumOne is seeking a Data Engineer to join our Data Technology team with the responsibility of designing and implementing...  .... You will be responsible with the migration from the current AWS to our in-house servers (Kafka - Spark) allowing for the portal... 
    Amazon Web Service
    Local area

    Stepping Up Solutions

    San Francisco, CA
    2 days ago
  • APPIT Software Solutions is hiring a Senior Data Engineer (Apache Spark) in San Francisco, USA . Lead the design of large-scale distributed...  ...of data daily Design data lake and lakehouse architectures on AWS S3 or Azure Data Lake Storage Mentor junior data engineers on distributed... 
    Amazon Web Service
    Flexible hours

    Appit LLC

    San Francisco, CA
    4 days ago
  • We are seeking a Data Engineer - III to design, build, and maintain scalable, secure, and repeatable data pipelines across multiple platforms...  ...-structured data using Spark. Data engineering experience in AWS, including familiarity with relevant services and tools. Preferred... 
    Amazon Web Service

    Compunnel, Inc.

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AWS Data Engineer. Be the first to apply!