Data Engineer II: Cloud Pipelines & PySpark
Emory University
Emory University in Atlanta is seeking a Data Engineer II to advance the Unified Data Platform on Azure-based technologies. You will collaborate with researchers, architects, and cross-functional teams to design scalable data solutions supporting research, analytics, and clinical insights. Strong hands-on experience with Azure Synapse, Databricks, or Azure Fabric is valued. The role requires a solid foundation in data engineering, data governance, and HIPAA compliance, with responsibilities #J-18808-Ljbffr Emory University
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer II: Cloud Pipelines & PySpark in Atlanta, GA vacancy
- ...Atlanta is looking for an experienced Data Engineer to drive enterprise data... ...legacy data processes into scalable cloud solutions using technologies like Snowflake, Talend, and PySpark. You will design and optimize ETL/ELT pipelines, ensuring data quality and performance...Pipeline
- ...community. Description The Data Engineer II is a key contributor to the... ...with complex datasets, modern cloud data platforms, and emerging... ...Synapse or Databricks with PySpark will be equally considered.... ...and maintain scalable data pipelines, ETL/ELT processes, and data...PipelineRemote work
- LAHZO in Atlanta seeks a Data Engineer I/II to develop and manage ETL pipelines, ensuring data integrity and availability. The successful candidate will work on end-to-end data infrastructure, delivering reliable systems that enhance client revenue. Responsibilities include...Pipeline
$100k - $130k
...into revenue. We're seeking a seasoned Data Engineer I/II to join our rapidly growing tech... ...That means building and maintaining ETL pipelines, writing data transformations and table... ...Every new Lahzo client gets a dedicated cloud project, service accounts, permissions,...PipelineLocal area- ## Data Engineer II (Healthcare Data Systems)Atlanta#### About The Position**The Mission**At OMNY... ...will be to architect and scale the pipelines that transform raw, messy clinical data... ...schemas in our Common Data Model (CDM).* **Cloud-Native Orchestration:** Deploy and...Pipeline
OMNY
Atlanta, GA4 days ago - ...looking for a highly-skilled and motivated Data Engineer to join our team. In this role, you will... ...and build scalable and robust data pipelines to collect, process, and distribute large... ...techniques, and manipulation including Cloud platforms, programming languages, and a...PipelineImmediate start
The Travelers Companies, Inc.
Atlanta, GA4 days ago - ...creators. About This Role The Data & Analytics team consists of data analysts, data engineers and analytics engineers working... ...infrastructure. Building scalable data pipelines, managing transformation... ...optimization) Experience working in cloud environments (AWS preferred,...PipelineRemote work
Internetwork Expert Inc
Atlanta, GA3 days ago - The Travelers Companies, Inc. is seeking a highly-skilled Data Engineer in Atlanta, Georgia. This role is crucial for growing and transforming... ...our analytics landscape. You will design and build data pipelines, collaborate with AI/ML teams, and ensure data quality and...Pipeline
- ...looking for a skilled professional to design, build, and maintain data pipelines and data solutions that support enterprise analytics and... ...data management and processing, and offers a chance to work with cloud technologies like AWS, Azure, and GCP. #J-18808-Ljbffr Beazer...PipelineWork at office
- McKinsey & Company in Atlanta, Georgia is seeking a skilled Data Engineer to build foundational data infrastructure for AI applications.... ...You'll collaborate with cross-functional teams, maintain data pipelines and contribute to innovative AI capabilities. Ideal...Pipeline
- MathCo is seeking an experienced Data Engineer to support enterprise data engineering and analytics initiatives. The ideal candidate will... ...expertise and collaboration to support critical data pipelines. Candidates should have a Bachelor's or Master's degree in a...PipelineRemote job
- ...Technologies Corp is seeking a Senior Software Data Engineer (Python) in Atlanta, GA, to design and optimize cloud-based data solutions. The role demands 5+ years... ...this position focuses on building serverless data pipelines, maintaining data workflows, and ensuring quality...Pipeline
- A data analytics company in Atlanta seeks individuals passionate about innovative technologies and data engineering. Responsibilities include defining project requirements, implementing data pipelines, and developing solutions for complex supply chain challenges. Qualified...Pipeline
- The Weather Company in Atlanta is seeking a Senior Data Engineer to design and build large-scale, data-intensive platforms. You will develop reliable data pipelines and high-availability architectures using AWS and modern big data technologies. The ideal candidate should...PipelineFlexible hours
$146.6k - $150k
...will build the foundational data infrastructure that powers cutting... ...and maintain scalable data pipelines, manage secure data... ...translate simple hypotheses into engineered features, manage secure data... ...) and deploying across major cloud platforms (AWS, Azure, GCP)...PipelineApprenticeshipWork at officeLocal areaEasy work- A leading technology firm is seeking a Senior Data Engineer to design and operate data-intensive platforms in the cloud. You will be responsible for developing reliable data pipelines, utilizing AWS services, and mentoring junior engineers. Ideal candidates have extensive...Pipeline
- Prestige Staffing is seeking a Senior Data Engineer in Atlanta, Georgia, to lead the design and development of scalable data pipelines and models. The ideal candidate should have extensive experience with cloud data platforms, specifically Snowflake and Azure Data Factory...Pipeline
- ...family. Your Impact As a Data Scientist II, you will collaborate... ...data scientists, engineers, designers, and domain... ...production-grade RAG pipelines and assess LLM output... ...with Spark/PySpark for distributed workloads... ...Kubernetes, and the major clouds (AWS, GCP, Azure, Oracle...PipelineApprenticeshipWork at officeLocal areaEasy work
$80.42k - $106.05k
Data Engineering & Pipeline Development Job Location: Charlotte, NC; Irvine, TX; Edison, NJ; Phoenix, AZ... ...BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Functions (Gen2), Cloud Composer (... ...Qualifications Experience with Dataproc (Spark/PySpark) for large‑scale processing...PipelineLocal area- Position Purpose: The Software Engineer II - EDW is responsible for building and maintaining the data pipelines and structures that power our enterprise analytics. Working... ...transformation and automation. Hands‑on experience with Cloud Data Warehouses (BigQuery preferred)....PipelineRemote jobWork experience placement
$118k
...Research team is a group of data scientists and content... ...Along with Product and Engineering partners, we design... ...seeking a Data Scientist II with experience... ...experience building ML pipelines and working with distributed... ...experience with SQL or PySpark. Bachelors or Masters...PipelineFull timeFor contractorsLocal areaHome officeFlexible hours$132.1k - $178.8k
...Job Summary Job ID: 10431920 | Amazon Web Services, Inc. - A97 Employer: Amazon Web Services, Inc. Position: Data Engineer II Location: Atlanta, GA Multiple Positions Available. Design, develop, implement, test, document, and operate large‑scale, high‑volume, high‑performance...Amazon
Atlanta, GA4 days ago$100k - $150k
...reimagine the DFS industry together? As a Data Platform Engineer, you will contribute to building the... ..., monitoring, and CI/CD for Data pipeline deployment. You will enable complete observability... ...Python and Go. Deep experience with Cloud services, preferred with GCP services...PipelineFull timeRemote workWork visaFlexible hoursPrizePicks
Atlanta, GA12 days ago- ...It’s Services ETL/ELT Python Data Warehousing Key Responsibilities... ...batch and streaming ETL/ELT pipelines using AWS services (Glue, Lambda... ...Strong experience with AWS cloud services: S3, Glue, Redshift,... ...Proficiency in SQL, Python and PySpark. Knowledge of data modeling, schema...Pipeline
JPC Techno Inc
Atlanta, GA35 minutes ago - ...Transfer at this time. We are seeking a skilled Data Engineer to design, develop, and maintain scalable batch-based data pipelines and external system integrations. This role... ...and notebook-driven transformations using PySpark and Spark SQL Build and maintain...PipelineFull time
Hirewell
Atlanta, GA4 days ago - ...We are seeking a skilled Data Engineer with strong AWS Glue experience to support... ...development of scalable data pipelines within the Amazon Web Services (AWS) cloud environment. This role will focus... ..., Amazon Redshift, and Python/PySpark to support enterprise analytics...Pipeline
Applied Resource Group
Atlanta, GA3 days ago - ...We are seeking an experienced Senior Data Engineer with 10+ years of expertise in designing... ..., and optimizing scalable data pipelines and cloud-based data platforms. The ideal candidate... ...Required Skills Python, SQL Apache Spark / PySpark ETL Tools (Informatica, Talend, SSIS,...PipelineContract work
Raas Infotek
Atlanta, GA33 minutes ago - ...interactions with you. Job Summary The Data Engineer is responsible for the end-to... ...high-frequency ingestion pipelines to ensuring reliable delivery... ...external sources into our cloud data ecosystem. Working... ...and hands-on experience with PySpark for large-scale data processing...Pipeline
Atlanta Hawks
Atlanta, GA3 days ago - ...help drive enterprise data modernization initiatives... ...into scalable cloud-based solutions. We are... ...seeking an experienced Data Engineer with expertise in Snowflake... ...Talend, SAS migration, PySpark, SQL, and cloud... ...and optimize modern data pipelines. This role is ideal for...PipelineLocal area
Computer Task Group
Atlanta, GA17 hours ago - ...The Senior Data Engineer will serve as a key contributor and technical... ...and developing scalable data pipelines, data models, and ingestion frameworks... ..., software engineers, and cloud architects to deliver... ...Vault. Experience with Python, PySpark, or other scripting languages...Pipeline
Prestige Staffing
Atlanta, GA17 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer II: Cloud Pipelines & PySpark. Be the first to apply!
Related searches
- senior data center engineer Atlanta, GA
- data operations engineer Atlanta, GA
- data engineer machine learning Atlanta, GA
- remote data engineer Atlanta, GA
- azure data engineer Atlanta, GA
- data engineer graduate Atlanta, GA
- data science developer Atlanta, GA
- big data engineer Atlanta, GA
- data engineering intern summer Atlanta, GA
- senior data engineer Atlanta, GA