Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Cloud Data Engineer

GAP Solutions, Inc. (GAPSI)

Position Objective: A key DMI objective is to "expand foundational infrastructure to provide scalable, flexible services for timely and appropriate access to actionable data in the public health ecosystem." Currently, public health programs operating across CDC have myriad investments in divergent and overlapping systems to collect, process, and analyze data to support public health decision making and administrative functions. Systems are of varying age, complexity, and quality and this creates a burden for public health partners to provide and use data, for programs to use their data, and for CDC to secure shared data with its partners and deidentified data with the public.

EDAV helps alleviate this problem by designing, developing, and operating shared, enterprise data services to help programs modernize and integrate these services with their existing and planned systems. However, EDAV needs to expand the quantity and quality of these services and assist programs to integrate their systems with EDAV to create new public health data products using the shared EDAV platform. Data products include data collections, storage, reports, dashboards, metadata collection, analytics (including artificial intelligence [AI]/machine learning [ML]), public use data, indicators, measures, and decision-making systems.

CDC's Center for Forecasting Outbreaks and Analytics (CFA) is tasked with collaborating with internal and external partners to track public health event disease outbreaks and forecast their directions. To do this, CFA needs to extend EDAV's capabilities to cloud spaces where it can collaborate with CDC and non-CDC groups to share data, develop machine learning models, exchange models and algorithms, and jointly author analytics and visualization products. Absent this, CFA cannot perform its mission.

Duties and Responsibilities:

  • Working with a multi-disciplinary team of scientists, data engineers, developers, and data consumers in a fast-paced, Agile environment

  • Monitor and optimize data pipelines for performance, scalability, and cost-effectiveness

  • Opportunity to sharpen skills in analytical exploration and data examination while support the assessment, design, developing, and maintenance of scalable platforms for the clients

Qualifications

Basic Qualifications:

  • Bachelor's Degree required

  • 3+ years of experience with extract, transform, load (ETL) operations with a focus on Azure technologies

  • 2+ years of experience with source control and collaboration software, including Git or Atlassian tools

  • Knowledge of Azure Batch and its application in processing large data sets

  • Experience with SQL and relational databases (e.g., Azure SQL Database, SQL Server)

  • Experience with Python or R including experience with data manipulation libraries (e.g., Pandas, NumPy, Polars, Tidyverse)

  • Strong problem-solving skills and ability to work independently and in a team environment

  • Proficiency in Azure Data Factory and its components

Preferred Qualifications:

  • Experience with developing pipeline utilizing Azure Batch and Azure Data Factory

  • Familiarity with Apache Airflow or similar workflow orchestration tools

  • Experience with Azure Synapse Analytics, Azure Databricks, or Azure Blob Storage

  • Familiarity with cloud security best practices and data governance

  • Ability to quickly learn technical concepts and communicate with multiple functional groups

* This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required by this position.

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed above are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

GAP Solutions provides reasonable accommodation for qualified individuals with disabilities. If you need accommodation to apply for a job, email us at View email address on click.appcast.io . You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned.

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by law.

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Cloud Data Engineer in Atlanta, GA vacancy
  • $111k - $138.7k

     ...generations. Role Summary Our data is at the core of our mission, and the...  ...supply chain. As a Senior Data Platform Engineer, you will own and scale the infrastructure...  ...the observability, self-service access, cloud automation, and abstractions that help get... 
    Suggested
    Full time
    Contract work
    Temporary work
    Part time
    Local area
    Flexible hours
    Shift work

    Rivian

    Atlanta, GA
    19 hours ago
  • $140.6k - $175.8k

     ...generations. Role Summary Our data is at the core of our mission, and the...  ...supply chain data. As a Staff Data Platform Engineer, you will define the technical vision for...  ...love decoupled architectures, optimizing cloud spend, and raising engineering standards,... 
    Suggested
    Full time
    Contract work
    Temporary work
    Part time
    Local area
    Flexible hours
    Shift work

    Rivian

    Atlanta, GA
    19 hours ago
  •  ...Role: Data Engineer Duration: FULL TIME (Accepting H1B Transfer ) Location: Atlanta, GA - On-Site ( Hybrid) Job...  ...business requirements to Technical requirements, be a SME for Azure Cloud and Databricks, bring Industry best practices to RT... 
    Suggested
    Full time
    Work experience placement
    H1b

    ACI Infotech

    Atlanta, GA
    4 days ago
  •  ...Overview: We are seeking a GCP Data Engineer with hands-on experience with Google Cloud Platform (GCP) services, particularly BigQuery, and be proficient in DBT (Data Build Tool) for data transformation and modeling. This role requires strong SQL skills , a solid... 
    Suggested

    Purple Drive

    Atlanta, GA
    1 day ago
  •  ...and mid-market firms, rely on SS&C for expertise, scale, and technology.Job DescriptionSenior Data Platform EngineerRole SummaryWe are seeking a Senior Data Platform Engineer to help build, scale, and operate our bespoke enterprise data platform, the foundational infrastructure... 
    Suggested
    Ongoing contract
    Full time
    Remote work
    Worldwide

    SS&C Technologies

    Atlanta, GA
    1 day ago
  •  ...a list that spans across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and maintain advanced data...  ...solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to... 
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Atlanta, GA
    2 days ago
  •  ...a list that spans across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and maintain advanced data...  ...solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to... 
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Atlanta, GA
    2 days ago
  • $105.04k - $130.03k

     ...technical initiatives and mentor junior engineers.The engineer combines strong expertise in...  ...Server, Oracle, database performance tuning, data modeling, ETL/ELT development, API...  ...and migration of on-premises databases to cloud-native and hybrid architectures.• Enablement... 
    Full time
    Part time
    Shift work
    Day shift

    Truist

    Atlanta, GA
    18 hours ago
  •  ...Charlotte, Cincinnati, Dallas, Minnesota, ChicagoDigital Analytics Platform EngineerThe ideal candidate will have deep expertise in digital data collection, third-party digital analytics platforms (e.g., Adobe Analytics, Google Analytics), and enterprise architecture. They... 
    Full time

    SRI Tech

    Atlanta, GA
    3 days ago
  • $116.2k - $229.1k

    Position Summary Data-driven organizations need modern cloud analytics solutions that turn information into insight and action. As a Sr Consultant, GCP Cloud Analytics, you will help clients design, build, and scale Google Cloud Platform-enabled data ecosystems that... 
    Local area
    Visa sponsorship

    Deloitte

    Atlanta, GA
    3 days ago
  • $98.5k - $206.8k

    Job Title: Cloud Pipeline Data EngineerJob Category: EngineeringTime Type: Full timeMinimum Clearance Required to Start: SecretEmployee Type...  ...NoneType of Travel: None* * *The Opportunity:The Cloud Pipeline Engineer will support data ingest and transformation for a government... 
    Contract work
    Work experience placement
    Flexible hours

    CACI International

    Atlanta, GA
    4 days ago
  • $133k - $188k

     ...the following job description:The Senior Manager, MarTech Data & Platforms Engineering is responsible for leading the architecture, engineering,...  ...Manager drives the modernization of customer data platforms, cloud data infrastructure, digital data collection, identity... 
    Permanent employment
    Full time
    Contract work
    Part time
    H1b
    Work visa
    Shift work
    Day shift

    Truist

    Atlanta, GA
    10 hours ago
  •  ...while leading the development and deployment of AI models and data architectures to improve business processes and system performance...  ...’s degree in Computer Science, Data Science, AI, Software Engineering, a related field, or equivalent education, training, and work-related... 
    Permanent employment
    Full time
    Part time
    H1b
    Work at office
    Work visa
    Shift work
    Day shift

    Truist

    Atlanta, GA
    4 days ago
  • $116.8k - $208.3k

     ...technology who wants to work in a collaborative environment? As a Data Platform Engineering Manager, you will have the ability to share new ideas and...  ...service, and manage operational risk in partnership with cloud, security, architecture, and client stakeholders. Lead... 
    Remote work
    Flexible hours

    Deloitte

    Atlanta, GA
    10 hours ago
  • $110k - $130k

     ...We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python...  ...data ingestion frameworks, and optimizing cloud-based data platforms. The role also involves... 
    Full time

    Neshent Technologies

    Atlanta, GA
    11 days ago
  • $101.66k

     ...our tech isn't just a tool, it's your playground. Our engineers work on scalable systems, cloud services, and customer-facing products that operate at...  ...disciplinary staff to provide full life-cycle support to AWS Data Centers from design inception through site improvement... 
    Full time
    Summer work
    Internship
    Relocation
    Monday to Friday

    Amazon

    Atlanta, GA
    1 day ago
  • $186.07k - $218.9k

     ...Learn more about working at Coinbase. As a Senior Software Engineer on the Data Platform team within the Platform group, you will help build...  ..., and operation of foundational data services spanning cloud data warehouses, data lakes, orchestration (Airflow), batch... 
    Local area

    Coinbase

    Atlanta, GA
    3 days ago
  •  ...: Kforce has a client in Atlanta, GA that seeking a Senior Data Engineer to join their team, to design and develop scalable data solutions...  ...candidates have strong experience with SQL, Python, Google Cloud Platform/BigQuery, Airflow, and data warehousing in a fast-paced... 
    Hourly pay
    Contract work

    Kforce Technology Staffing

    Atlanta, GA
    3 days ago
  • $77.5k - $176k

     ...Job Number: R0252582 Palantir Data Engineer The Opportunity: As a data scientist, you're excited at the prospect of unlocking the secrets held by a data set, and you're fascinated by the possibilities presented by IoT, machine learning, and artificial intelligence... 
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Atlanta, GA
    2 days ago
  • $116k - $145k

     ...has an opening with your name on it We are looking for a Data Engineer to join our growing data engineering team and help build the...  ...warehousing, and ETL/ELT best practices. ~ Experience working with cloud-based data platforms (AWS, Google Cloud Platform, or Azure).... 
    Temporary work
    Local area
    Worldwide

    FanDuel

    Atlanta, GA
    3 days ago
  • $61.9k - $141k

     ...Job Number: R0253589 Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l...  ...Sof tware Engineering, Electrical Engineering, or Physics Cloud Development Certification such as AWS Solutions Architect or Azure... 
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Atlanta, GA
    3 days ago
  • $100k - $160k

    Data & AI Engineer As a Data & AI Engineer, you'll build and deploy modern data pipelines and generative AI solutions on AWS — from scalable ETL/ELT workflows and cloud data platforms to production-grade RAG systems and AI agents. One engagement you may be designing and... 

    Innovative Solutions

    Atlanta, GA
    1 day ago
  • $139.73k - $209.59k

     ...mission is to enable innovation through the responsible use of data and AI. We believe that ensuring data is trusted shouldn’t slow...  ...and society. The ChallengeOneTrust is seeking a Staff Software Engineer to join the Reporting and Data Platform team. This is a hands-on... 
    Work experience placement
    Work at office
    Local area
    Worldwide
    Flexible hours
    3 days per week
    1 day per week

    OneTrust

    Atlanta, GA
    3 days ago
  • $55 - $61.4 per hour

    job summary: Seeking a full-time Data Engineer with 3-5 years of experience to support data modernization, develop ETL/ELT pipelines, migrate legacy SSIS packages, and build curated datasets for Power BI using Microsoft Fabric and Azure Databricks. Candidates should... 
    Hourly pay
    Full time
    Contract work
    Temporary work
    Work experience placement

    Randstad Digital

    Atlanta, GA
    1 day ago
  • $150k - $190k

     ...for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development...  ...large amounts of financial data in a scalable fashion Public cloud expertise and/or certifications - Azure, AWS, GCP Hands-on... 
    Full time
    Work experience placement
    Remote work
    Worldwide
    Flexible hours
    Shift work

    SHI GmbH

    Atlanta, GA
    3 days ago
  •  ...Data Engineer (Hybrid in Atlanta) We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline...  ...distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong... 
    Permanent employment

    Software Technology Inc

    Atlanta, GA
    1 day ago
  • $61.9k - $141k

     ...Data Engineer Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and...  ..., Software Engineering, Electrical Engineering, or Physics Cloud Development Certification such as AWS Solutions Architect or Azure... 
    Full time
    Contract work
    Part time

    Booz Allen Hamilton

    Atlanta, GA
    18 hours ago
  •  ...Data Engineer Big Data & AI Bootcamp · Atlanta, GA · Full-Time W2 Employment Stop waiting for the right opportunity. In 9 weeks, go...  ...and can write structured, maintainable code Have exposure to cloud platforms or big data tooling — even at a basic level Are... 
    Full time
    Internship
    Relocation

    Tech Consulting

    Atlanta, GA
    18 hours ago
  •  ...just modifying existing queries) including building an application in SQL. Strong experience working with large sets of complex data such as financial, sales, supply chain, logistics data, etc. Hands-on experience with ETL, preferably with Azure Data Factory (ADF... 

    Insight Global

    Atlanta, GA
    1 day ago
  • $101.5k - $169.1k

     ...Company Cox Automotive - USA Job Family Group Engineering / Product Development Job Profile Sr Data Engineer Management Level Individual Contributor Flexible Work Option Hybrid - Ability to work remotely part of the week Travel... 
    Remote work
    Relocation
    Visa sponsorship
    Flexible hours
    Shift work

    Cox Communications

    Atlanta, GA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Cloud Data Engineer. Be the first to apply!