Cloud Data Engineer
GAP Solutions, Inc. (GAPSI)
Position Objective: A key DMI objective is to "expand foundational infrastructure to provide scalable, flexible services for timely and appropriate access to actionable data in the public health ecosystem." Currently, public health programs operating across CDC have myriad investments in divergent and overlapping systems to collect, process, and analyze data to support public health decision making and administrative functions. Systems are of varying age, complexity, and quality and this creates a burden for public health partners to provide and use data, for programs to use their data, and for CDC to secure shared data with its partners and deidentified data with the public.
EDAV helps alleviate this problem by designing, developing, and operating shared, enterprise data services to help programs modernize and integrate these services with their existing and planned systems. However, EDAV needs to expand the quantity and quality of these services and assist programs to integrate their systems with EDAV to create new public health data products using the shared EDAV platform. Data products include data collections, storage, reports, dashboards, metadata collection, analytics (including artificial intelligence [AI]/machine learning [ML]), public use data, indicators, measures, and decision-making systems.
CDC's Center for Forecasting Outbreaks and Analytics (CFA) is tasked with collaborating with internal and external partners to track public health event disease outbreaks and forecast their directions. To do this, CFA needs to extend EDAV's capabilities to cloud spaces where it can collaborate with CDC and non-CDC groups to share data, develop machine learning models, exchange models and algorithms, and jointly author analytics and visualization products. Absent this, CFA cannot perform its mission.
Duties and Responsibilities:
Working with a multi-disciplinary team of scientists, data engineers, developers, and data consumers in a fast-paced, Agile environment
Monitor and optimize data pipelines for performance, scalability, and cost-effectiveness
Opportunity to sharpen skills in analytical exploration and data examination while support the assessment, design, developing, and maintenance of scalable platforms for the clients
Qualifications
Basic Qualifications:
Bachelor's Degree required
3+ years of experience with extract, transform, load (ETL) operations with a focus on Azure technologies
2+ years of experience with source control and collaboration software, including Git or Atlassian tools
Knowledge of Azure Batch and its application in processing large data sets
Experience with SQL and relational databases (e.g., Azure SQL Database, SQL Server)
Experience with Python or R including experience with data manipulation libraries (e.g., Pandas, NumPy, Polars, Tidyverse)
Strong problem-solving skills and ability to work independently and in a team environment
Proficiency in Azure Data Factory and its components
Preferred Qualifications:
Experience with developing pipeline utilizing Azure Batch and Azure Data Factory
Familiarity with Apache Airflow or similar workflow orchestration tools
Experience with Azure Synapse Analytics, Azure Databricks, or Azure Blob Storage
Familiarity with cloud security best practices and data governance
Ability to quickly learn technical concepts and communicate with multiple functional groups
* This job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required by this position.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed above are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
GAP Solutions provides reasonable accommodation for qualified individuals with disabilities. If you need accommodation to apply for a job, email us at View email address on click.appcast.io . You will need to reference the requisition number of the position in which you are interested. Your message will be routed to the appropriate recruiter who will assist you. Please note, this email address is only to be used for those individuals who need accommodation to apply for a job. Emails for any other reason or those that do not include a requisition number will not be returned.
Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by law.
$111k - $138.7k
...generations. Role Summary Our data is at the core of our mission, and the... ...supply chain. As a Senior Data Platform Engineer, you will own and scale the infrastructure... ...the observability, self-service access, cloud automation, and abstractions that help get...SuggestedFull timeContract workTemporary workPart timeLocal areaFlexible hoursShift work$140.6k - $175.8k
...generations. Role Summary Our data is at the core of our mission, and the... ...supply chain data. As a Staff Data Platform Engineer, you will define the technical vision for... ...love decoupled architectures, optimizing cloud spend, and raising engineering standards,...SuggestedFull timeContract workTemporary workPart timeLocal areaFlexible hoursShift work- ...Role: Data Engineer Duration: FULL TIME (Accepting H1B Transfer ) Location: Atlanta, GA - On-Site ( Hybrid) Job... ...business requirements to Technical requirements, be a SME for Azure Cloud and Databricks, bring Industry best practices to RT...SuggestedFull timeWork experience placementH1b
- ...Overview: We are seeking a GCP Data Engineer with hands-on experience with Google Cloud Platform (GCP) services, particularly BigQuery, and be proficient in DBT (Data Build Tool) for data transformation and modeling. This role requires strong SQL skills , a solid...Suggested
- ...and mid-market firms, rely on SS&C for expertise, scale, and technology.Job DescriptionSenior Data Platform EngineerRole SummaryWe are seeking a Senior Data Platform Engineer to help build, scale, and operate our bespoke enterprise data platform, the foundational infrastructure...SuggestedOngoing contractFull timeRemote workWorldwide
- ...a list that spans across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and maintain advanced data... ...solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...a list that spans across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and maintain advanced data... ...solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud infrastructure to...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
$105.04k - $130.03k
...technical initiatives and mentor junior engineers.The engineer combines strong expertise in... ...Server, Oracle, database performance tuning, data modeling, ETL/ELT development, API... ...and migration of on-premises databases to cloud-native and hybrid architectures.• Enablement...Full timePart timeShift workDay shift- ...Charlotte, Cincinnati, Dallas, Minnesota, ChicagoDigital Analytics Platform EngineerThe ideal candidate will have deep expertise in digital data collection, third-party digital analytics platforms (e.g., Adobe Analytics, Google Analytics), and enterprise architecture. They...Full time
$116.2k - $229.1k
Position Summary Data-driven organizations need modern cloud analytics solutions that turn information into insight and action. As a Sr Consultant, GCP Cloud Analytics, you will help clients design, build, and scale Google Cloud Platform-enabled data ecosystems that...Local areaVisa sponsorship$98.5k - $206.8k
Job Title: Cloud Pipeline Data EngineerJob Category: EngineeringTime Type: Full timeMinimum Clearance Required to Start: SecretEmployee Type... ...NoneType of Travel: None* * *The Opportunity:The Cloud Pipeline Engineer will support data ingest and transformation for a government...Contract workWork experience placementFlexible hours$133k - $188k
...the following job description:The Senior Manager, MarTech Data & Platforms Engineering is responsible for leading the architecture, engineering,... ...Manager drives the modernization of customer data platforms, cloud data infrastructure, digital data collection, identity...Permanent employmentFull timeContract workPart timeH1bWork visaShift workDay shift- ...while leading the development and deployment of AI models and data architectures to improve business processes and system performance... ...’s degree in Computer Science, Data Science, AI, Software Engineering, a related field, or equivalent education, training, and work-related...Permanent employmentFull timePart timeH1bWork at officeWork visaShift workDay shift
$116.8k - $208.3k
...technology who wants to work in a collaborative environment? As a Data Platform Engineering Manager, you will have the ability to share new ideas and... ...service, and manage operational risk in partnership with cloud, security, architecture, and client stakeholders. Lead...Remote workFlexible hours$110k - $130k
...We are looking for an experienced Senior Data Engineer with strong expertise in Databricks, Python... ...data ingestion frameworks, and optimizing cloud-based data platforms. The role also involves...Full time$101.66k
...our tech isn't just a tool, it's your playground. Our engineers work on scalable systems, cloud services, and customer-facing products that operate at... ...disciplinary staff to provide full life-cycle support to AWS Data Centers from design inception through site improvement...Full timeSummer workInternshipRelocationMonday to Friday$186.07k - $218.9k
...Learn more about working at Coinbase. As a Senior Software Engineer on the Data Platform team within the Platform group, you will help build... ..., and operation of foundational data services spanning cloud data warehouses, data lakes, orchestration (Airflow), batch...Local area- ...: Kforce has a client in Atlanta, GA that seeking a Senior Data Engineer to join their team, to design and develop scalable data solutions... ...candidates have strong experience with SQL, Python, Google Cloud Platform/BigQuery, Airflow, and data warehousing in a fast-paced...Hourly payContract work
$77.5k - $176k
...Job Number: R0252582 Palantir Data Engineer The Opportunity: As a data scientist, you're excited at the prospect of unlocking the secrets held by a data set, and you're fascinated by the possibilities presented by IoT, machine learning, and artificial intelligence...Full timeContract workPart timeLocal areaRemote work$116k - $145k
...has an opening with your name on it We are looking for a Data Engineer to join our growing data engineering team and help build the... ...warehousing, and ETL/ELT best practices. ~ Experience working with cloud-based data platforms (AWS, Google Cloud Platform, or Azure)....Temporary workLocal areaWorldwide$61.9k - $141k
...Job Number: R0253589 Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artifi cia l... ...Sof tware Engineering, Electrical Engineering, or Physics Cloud Development Certification such as AWS Solutions Architect or Azure...Full timeContract workPart timeLocal areaRemote work$100k - $160k
Data & AI Engineer As a Data & AI Engineer, you'll build and deploy modern data pipelines and generative AI solutions on AWS — from scalable ETL/ELT workflows and cloud data platforms to production-grade RAG systems and AI agents. One engagement you may be designing and...$139.73k - $209.59k
...mission is to enable innovation through the responsible use of data and AI. We believe that ensuring data is trusted shouldn’t slow... ...and society. The ChallengeOneTrust is seeking a Staff Software Engineer to join the Reporting and Data Platform team. This is a hands-on...Work experience placementWork at officeLocal areaWorldwideFlexible hours3 days per week1 day per week$55 - $61.4 per hour
job summary: Seeking a full-time Data Engineer with 3-5 years of experience to support data modernization, develop ETL/ELT pipelines, migrate legacy SSIS packages, and build curated datasets for Power BI using Microsoft Fabric and Azure Databricks. Candidates should...Hourly payFull timeContract workTemporary workWork experience placement$150k - $190k
...for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development... ...large amounts of financial data in a scalable fashion Public cloud expertise and/or certifications - Azure, AWS, GCP Hands-on...Full timeWork experience placementRemote workWorldwideFlexible hoursShift work- ...Data Engineer (Hybrid in Atlanta) We are looking for a Data Engineer for the Enterprise Data Organization to build and manage data pipeline... ...distribution, quality rules, data storage etc.) for Azure cloud-based data platform. The candidate will require to possess strong...Permanent employment
$61.9k - $141k
...Data Engineer Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and... ..., Software Engineering, Electrical Engineering, or Physics Cloud Development Certification such as AWS Solutions Architect or Azure...Full timeContract workPart time- ...Data Engineer Big Data & AI Bootcamp · Atlanta, GA · Full-Time W2 Employment Stop waiting for the right opportunity. In 9 weeks, go... ...and can write structured, maintainable code Have exposure to cloud platforms or big data tooling — even at a basic level Are...Full timeInternshipRelocation
- ...just modifying existing queries) including building an application in SQL. Strong experience working with large sets of complex data such as financial, sales, supply chain, logistics data, etc. Hands-on experience with ETL, preferably with Azure Data Factory (ADF...
$101.5k - $169.1k
...Company Cox Automotive - USA Job Family Group Engineering / Product Development Job Profile Sr Data Engineer Management Level Individual Contributor Flexible Work Option Hybrid - Ability to work remotely part of the week Travel...Remote workRelocationVisa sponsorshipFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Cloud Data Engineer. Be the first to apply!
- cloud engineering manager Atlanta, GA
- senior devops cloud engineer Atlanta, GA
- senior cloud engineer Atlanta, GA
- cloud security engineer Atlanta, GA
- senior cloud security engineer Atlanta, GA
- principal cloud engineer Atlanta, GA
- senior cloud infrastructure engineer Atlanta, GA
- senior cloud network engineer Atlanta, GA
- cloud network engineer Atlanta, GA
- senior aws cloud engineer Atlanta, GA




