Data Engineer
Full-time
Siri Info Solutions Inc
Role: Data Engineer
Location: Atlanta, GA
Term: Full Time
Job Description
Must Have Technical/Functional Skills
Must Have Skills:
- Databricks (Notebooks, Delta Lake, Delta Live Tables, Unity Catalog)
- Python and PySpark
- Spark SQL and Apache Spark
- ETL/Data Pipeline Development
- Big Data technologies: Hadoop, Spark, Kafka, Hive, HDFS, Sqoop
- Strong SQL querying and data modeling
- Data ingestion, transformation, cleansing, and validation
- Cloud platforms (AWS/GCP)
- Data warehouse and large-scale data processing experience
- Experience with streaming data using Kafka and Spark Streaming
- Agile methodologies (Scrum, Kanban, SAFe)
Preferred Skills:
- Scala / Scala-Spark
- IBM DataStage, Tibco, or similar ETL tools
- AWS services: S3, Glue, Lambda, Kinesis/MSK
- BI Tools: Tableau, Power BI, Spotfire, OAC
- Databases: Teradata, DB2, BigQuery, Mainframe
- Git version control
- Data governance and retention modeling
Roles & Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL solutions.
- Build and optimize data ingestion frameworks for structured and unstructured data.
- Implement data quality, validation, standardization, and governance processes.
- Develop data infrastructure integrating multiple heterogeneous data sources.
- Support analytics, reporting, machine learning, and business intelligence initiatives.
- Work with Data Scientists and BI teams to prepare and curate data for analytics.
- Develop scalable solutions for Big Data processing and streaming workloads.
- Analyze data and provide actionable insights and recommendations to business stakeholders.
- Gather requirements from business teams and translate them into technical solutions.
- Lead and mentor junior data engineers.
- Collaborate across multiple projects as the Data Engineering SME.
- Drive adoption of Data Engineering best practices and standards.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Atlanta, GA vacancy
- ...government agencies, a list that spans across the country. Job Description CapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine...SuggestedFull timeWork at officeRemote workVisa sponsorshipWork visaFlexible hours
Captech Consulting
Atlanta, GA8 hours ago $110k - $169k
...real work: We offer generous compensation packages that recognize hard work and excellence. Job Description The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable consistent, data-driven pricing across the firm while modernizing...SuggestedFull timeWork at officeMcDermott Will & Schulte
Atlanta, GA4 days ago- ...we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full-time positions with clients.Who should apply? Recent computer science/engineering/mathematics/statistics...SuggestedFull timeH1bImmediate startRemote work
SynergisticIT
Atlanta, GA4 days ago $100k
...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023.All positions are open for all... ..., data analysts/data scientists, and machine learning engineers for full-time positions with clients. Who should apply? Recent...SuggestedFull timeH1bSynergisticIT
Atlanta, GA4 days ago- ...Arete Technologies, Inc. is seeking a Big Data Engineering Lead in Atlanta, GA, specializing in data ingestion from diverse systems. The role involves collaboration in developing the NCR Data Lake and inspiring the engineering team towards technical excellence. The ideal...Suggested
Arete Technologies Inc
Atlanta, GA3 days ago - ...Atlanta, GeorgiaCompany: Georgia-PacificCareer Field: Information Systems & TechnologyJob Number: 191597Apply: JobAs a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and...Work at officeWorldwideFlexible hours
Georgia-Pacific
Atlanta, GAa month ago - ...Honeywell is accelerating its transformation from industrial automation to full autonomy and the data that powers that future starts here. As a Lead Data Engineer on our Industrial AI & Data Platforms team, you will architect and own the data foundations that enable physical...Permanent employmentTemporary workRelocation packageFlexible hours
Honeywell
Atlanta, GAa month ago - ...comprehensive electrical procurement, Ampacity specializes in expert-engineered, field-ready solutions that accelerate project timelines and... ...America. About this Role Ampacity is looking for a Lead Data Engineer to lead the rebuild and modernization of our data...Full timeWork at officeLocal area
Quanta Services
Atlanta, GA14 days ago - Job Summary Join us as a Lead Data Engineer on the Corporate Data Technology Team. Become an integral part of an agile team dedicated to enhancing, building, and delivering trusted market‑leading technology products in a secure, stable, and scalable way. As a core technical...Shift work
- Data Engineering Lead (Marketing) Position Description (General role information, job purpose, main objectives of the role) Location: Atlanta, GA Duration: FULL TIME / C2H Mode: Hybrid ( 2 days a Week) This Data Engineering Lead (Marketing) position is part of Client...Full timeFor contractorsWork experience placement2 days per week
- ...Job Description Job Description Job Title: DATA Engineer – GCP Work Time Zone: EST Rate: $58-60/hour on 1099/C2C Location: Atlanta, GA (Hybrid – 3 days on-site) We are looking for a highly capable Data Engineer to design, build, and maintain reliable...
Krest Global Solutions
Atlanta, GA26 days ago $40 - $45 per hour
...Seeking qualified high-level Data Center Technicians for a travel team opportunity with one of the largest technology companies in the US. Long-term opportunity with competitive salary, benefits, and conversion opportunities. Great opportunity to get reputable experience...Contract workTemporary workTEKsystems
Atlanta, GA4 days ago$116k - $145k
THE POSITIONOur roster has an opening with your name on itWe are looking for a Data Engineer to join our growing data engineering team and help build the pipelines and infrastructure that power analytics, machine learning, and business decision-making across the company...Temporary workLocal areaWorldwideFanDuel
Atlanta, GAa month ago- Job-ID28042269Reference26-10940 Modern Data Engineer (Enterprise + Lakehouse + AI‐Assisted) Experience 5+ years working with data in a software or data engineering role Experience in enterprise environments with a mix of on‐prem and cloud technologies Core...
Mindlance
Atlanta, GA14 days ago - ...Job Description Job Description Position: Data Engineer IV Location: Atlanta, GA Duration: 6 Months Client: Southern Company Services Southern Company Services is seeking an experienced Data Engineer IV to design, build, and support scalable data pipelines...
4P Consulting Inc.
Atlanta, GA26 days ago - ...job applications and your sensitive, personal information should only be submitted via our official job platform. Job Title: Data Engineer (hybrid) Location: US-GA-Atlanta (Sandy Springs) FLSA : Exempt #LI-Hybrid Job Overview : The Data Engineer leads...Contract workTemporary workLocal areaFlexible hours
Safe-Guard Products International LLC
Atlanta, GA18 days ago - We are looking for a Data Engineer to join a fast-paced IT consulting environment in Atlanta, Georgia. In this role, you will design and optimize modern data solutions that support analytics, machine learning, and business decision-making across a variety of client initiatives...
Robert Half
Atlanta, GA3 days ago - Data EngineerLocation: Must be onsite 2+ days per week out of either McLean, Atlanta, Dallas, or NY offices.Must Haves: Must have experience building data pipelines using Spark, Scala, and Python. Must have experience with S3, EC2, Docker, EKS, EMR.2 days per week
My3Tech Inc
Atlanta, GA4 days ago $105.6k - $132k
...Senior Data Center Engineer Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think...Local areaRemote workWorldwideOverseasFlexible hoursDigitalOcean
Atlanta, GA1 day ago$120k - $135k
...AWS Data EngineerLocation: Atlanta, GADuration: Full Time/Permanent RoleSalary Range: $120,000-$135,000 a year + benefitsMust Have... ...translate them into technical solutions.Lead and mentor junior data engineers.Collaborate across multiple projects as the Data Engineering...Permanent employmentFull timeDiverse Lynx
Atlanta, GA21 hours ago$120k - $165k
...Data Center Engineer Hybrid At Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world's largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers...Temporary workFor contractorsLocal areaRemote workFlexible hoursCloudflare Inc
Atlanta, GA1 day ago- ...United StatesZip/Postal Code: 30319Job DescriptionMust Have: AWS Data service experience (S3, GLUE, Lambda, Redshift, KMS etc.),... ...knowledge and Aws CDK knowledge. 8+ years of experience in Data Engineer with AWS services like Simple Storage Service(S3), Lambda, Glue...Remote workShift work
LVT Labs Consulting
Atlanta, GA4 days ago - ...Duties and Responsibilities Troubleshoot hardware and software issues in the data center. Implement and maintain server and network infrastructure. Monitor and optimize data center performance and capacity. Plan and execute data center migrations and...
Syntricate Technologies
Atlanta, GA1 day ago - One of our direct client is urgently looking for Data Engineer @ Atlanta, GA TITLE: Data Engineer LOCATION: Atlanta, GA Duration: 3 to 6+ Months Rate: DOE Description: Exp required: 1 to 5 years Skills: Good Knowledge of SQL Queries, PostgreSQL Good Knowledge in writing...
- Job Title: Data Engineer Location: Atlanta, GA ( Local Candidates Only No Remote ) We are looking for an experienced Data Engineer with strong expertise in Azure Synapse, Microsoft Fabric, Apache Spark, PySpark, Spark SQL, and Data Lake Architecture . Must-Have Skills Azure...Local areaRemote work
- Senior Software/Data Engineer Role Overview At CINC, we power the elite of real estate. As aSenior Software/Data Engineer on the TruBase platform, you will own the data transport, transformation, modeling, and analytics of real estate data points that drive institutional...Full timeH1bWork at officeMonday to Friday2 days per week
- ...position and will require 3 days onsite We are unable to provide Sponsorship or Visa Transfer at this time. We are seeking a skilled Data Engineer to design, develop, and maintain scalable batch-based data pipelines and external system integrations. This role will focus on...Full time
- We are seeking a skilled Data Engineer with strong AWS Glue experience to support the design and development of scalable data pipelines within the Amazon Web Services (AWS) cloud environment. This role will focus on building and optimizing ETL and data transformation processes...
$90k - $150k
Description Your role at GEI. The Data Engineer is responsible for designing, building, and maintaining the data pipelines and integrations that power GEI's AI solutions and digital initiatives. This role focuses on ensuring enterprise data is accessible, reliable, and...Work at officeFlexible hours$89k - $148k
What You Will Do Guidehouse seeks a Data Engineer with some AI experience to support in building, optimizing, and maintaining data pipelines, AI solutions, and analytics platforms. The ideal candidate will have hands-on experience with modern data engineering tools, AI...Temporary workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- aws data engineer Atlanta, GA
- director data engineering Atlanta, GA
- data engineer machine learning Atlanta, GA
- data science developer Atlanta, GA
- senior data engineer Atlanta, GA
- finance data engineer Atlanta, GA
- principal data engineer Atlanta, GA
- big data devops engineer Atlanta, GA
- data engineer analytics Atlanta, GA
- senior data integration developer Atlanta, GA