AWS Data Engineer
Diverse Lynx
Role Descriptions: Design and manage AWS-based data infrastructure using services such as S3| Glue| EMR| Redshift| Athena| Lambda| Kinesis| and RDS
Build and maintain scalable| fault-tolerant data pipelines (batch and streaming)Implement Infrastructure as Code (IaC) using Terraform Cloud Formation
Optimize data storage| compute| and query performance for cost and efficiency
Ensure data security| governance| and compliance (IAM| encryption| VPC| logging)Design and implement monitoring| alerting| and observability for data platforms and pipelines
Integrate and manage monitoring tools such as Datadog| Prometheus| Grafana| Cloud Watch Create dashboards| alerts| and SLIs SLOs to ensure pipeline reliability and performance
Collaborate with data engineers| analysts| and platform teams to support analytics use case
Automate deployments| scaling| and operational tasks via CICD pipelines Participate in architecture reviews and recommend best practices for AWS data platforms
Proficiency in Python SQL (Scala optional)Solid understanding of data modeling| ETLELT| and distributed systems
Experience with Apache Spark| EMR| Kafka Hands on with AWS Kendra would be good
.Experience with Data Lake
Familiarity with Airflow| Step Functions| or other orchestration tools
Essential Skills: Design and manage AWS-based data infrastructure using services such as S3| Glue| EMR| Redshift| Athena| Lambda| Kinesis| and RDS
Build and maintain scalable| fault-tolerant data pipelines (batch and streaming)Implement Infrastructure as Code (IaC) using Terraform Cloud Formation
Optimize data storage| compute| and query performance for cost and efficiency
Ensure data security| governance| and compliance (IAM| encryption| VPC| logging)Design and implement monitoring| alerting| and observability for data platforms and pipelines
Integrate and manage monitoring tools such as Datadog| Prometheus| Grafana| Cloud Watch Create dashboards| alerts| and SLIs SLOs to ensure pipeline reliability and performance Collaborate with data engineers| analysts| and platform teams to support analytics use case
Automate deployments| scaling| and operational tasks via CICD pipelines
Participate in architecture reviews and recommend best practices for AWS data platforms
Proficiency in Python SQL (Scala optional)Solid understanding of data modeling| ETLELT| and distributed systems
Experience with Apache Spark| EMR| Kafka
Hands on with AWS Kendra would be good.
Experience with Data Lake
Familiarity with Airflow| Step Functions| or other orchestration tool
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AWS Data Engineer. Be the first to apply!
- staff data engineer San Francisco, CA
- data visualization developer San Francisco, CA
- data science developer San Francisco, CA
- senior data center engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- aws data engineer San Francisco, CA
- data engineer manager San Francisco, CA
