Principal Software Engineer Big Data & Cloud

Openkyber

Lead Software Engineer (Big Data, Spark, AWS, Full Stack) Location: Rockville, MD or Tysons Corner, VA Work Setting: Onsite

Job Descripton: We are seeking a highly experienced Lead Software Engineer to design, develop, and optimize enterprise-scale applications and big data platforms. The ideal candidate will have strong expertise in Apache Spark, AWS Cloud, Full Stack Development, System Design, and Software Engineering best practices.

Required Skills:

7+ years of Software Engineering experience
Strong System Design and Architecture experience
Expertise in Apache Spark, Hadoop, Hive, and Trino
Experience processing large-scale datasets (TB/PB scale)
Advanced SQL (Window Functions, Joins, Aggregations, Query Optimization)
Strong programming skills in Python or Scala
AWS Services: S3, EMR, Glue, Athena, Lambda, EKS
Full Stack Development (Frontend, Backend, APIs, Microservices)
Object-Oriented Design and Design Patterns
Data Storage Technologies (Relational & NoSQL)
Performance Tuning and Optimization
DevOps, CI/CD, and Infrastructure Automation
Test Automation, Unit Testing, and Quality Engineering
Software Security and Secure Coding Practices
Experience with AI tools such as GitHub Copilot, ChatGPT, Claude, Amazon Q

Leadership Responsibilities:

Lead architecture and technical design initiatives
Mentor and guide engineering teams
Drive engineering excellence and best practices
Collaborate across business and technology teams
Lead modernization, automation, and AI adoption efforts

Preferred Skills:

Kubernetes / EKS
Serverless Architectures
Financial Services experience
Agile/Scrum leadership
Cloud Certifications (AWS)
Large-scale distributed systems experience

Qualifications:

Bachelor's degree in Computer Science or related field
Strong communication and stakeholder management skills
Proven experience delivering enterprise-grade solutions

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Principal Software Engineer Big Data & Cloud in Atlanta, GA vacancy

Principal Software Engineer - Enterprise Customer
$196.5k - $294.75k
...through the responsible use of data and AI. We believe that... ...are looking for a Principal-level, US-based, customer-facing engineer who is deeply hands-on with... ...enterprise customers using our big-data and high-scale... ...latency APIs and services in a cloud environmentProven track...
Cloud
Big data
Work experience placement
Work at office
Local area
Worldwide
Flexible hours
3 days per week
1 day per week
OneTrust
Atlanta, GA
1 day ago
Senior Data Engineer - Periscope
$195.3k - $199.2k
...and maintain scalable data pipelines and systems using... ...and executing data engineering projects from inception... ...prescriptive analytics, and cloud-based tools to provide... ...a strong background in big data... ...architecturesExperience adopting software development best practices...
Cloud
Big data
Apprenticeship
Easy work
McKinsey & Company
Atlanta, GA
2 days ago
Senior Data Engineer
...Senior Data EngineerSkill - Last Used - Experience... ...Description: Senior Data Engineer who is passionate about... ...fast-paced world of Big Data technology and has... ...transformation and storageDevelop software utilizing open source... ....Exposure to cloud technologies with hands...
Cloud
Big data
Omni Inclusive
Atlanta, GA
1 day ago
Senior Data Engineer
...table for you...Position Summary:The Senior Data Engineer guides the development of GFS’ Data... ...data products. Identifies and translates Big Data challenges into technical approaches... ...technical solutions.Highly experienced with cloud computing platforms, preferably Google Cloud...
Cloud
Big data
Full time
Work at office
Monday to Friday
Gordon Food Service
Atlanta, GA
5 days ago
Senior AWS Data Engineer
Req ID:374073NTT DATA strives to hire exceptional,... ...seeking a Senior AWS Data Engineer to join our team in... ...build, and optimize our cloud-based data architecture... ...Business Analysts, and Software Engineers to deliver clean... ...or AWS Certified Big Data Specialty.Experience...
Cloud
Big data
Contract work
Work at office
Remote work
Flexible hours
NTT DATA
Atlanta, GA
2 days ago
Data Engineer (hybrid)
...Data Engineer (Hybrid)We are seeking a skilled Data Engineer to design, develop, and optimize scalable data pipelines... ...The ideal candidate will have strong expertise in cloud-based data engineering, ETL/ELT development, big data technologies, and data quality practices,...
Cloud
Big data
Axelon
Atlanta, GA
4 days ago
Healthcare Data Engineer
...Healthcare Data EngineerCategory: Analytics and Emerging Digital... ...Healthcare Data Scientist/Engineer to join our team supporting CGI... ...scalable analytics solutions using cloud and big data platforms such as AWS,... ...with data orchestration and software development tools such as...
Cloud
Big data
Work at office
CGI
Atlanta, GA
1 day ago
Sr Databricks Data Engineer
$116.2k - $229.1k
...Summary Join Deloitte’s AI & Engineering practice and help... ...technology platforms, modernize data environments, and unlock value... ...will design, build, and optimize cloud-based data engineering solutions... ...Evaluate, pilot, and integrate new big data and analytics...
Cloud
Big data
Local area
Visa sponsorship
Deloitte
Atlanta, GA
1 day ago
Google Data Engineer
$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI, and cloud products with clients who are ready to accelerate... ...into products, engineering systems that support learning... ...cloud-native platforms.* Big Data Platforms (Dataproc,...
Cloud
Big data
Temporary work
Work at office
Local area
Flexible hours
Slalom
Atlanta, GA
2 days ago
AWS Data Engineer
$55 per hour
...Role: Data Engineer(AWS, Python) Duration : Contract Location... ...integrating, and running business, big data and data science applications Software engineering with Python.... ...-as-code using AWS tools (e.g., Cloud Development Kit, Cloud Formation...
Cloud
Big data
Contract work
Immediate start
Concord IT Systems
Atlanta, GA
2 days ago
Data Engineer
...Senior Data Engineer With Databricks Remote, Anywhere in the Continental US... ...the very best consultants from the big data, machine learning, and software modernization space. At Data... ...Engineer with deep Databricks and cloud experience to support our Federal...
Cloud
Big data
Full time
Immediate start
Remote work
Data Surge
Atlanta, GA
2 days ago
Data Engineer
...Remote We are seeking an experienced Data Engineer to support challenging data engineering, data... ...2006! We specialize in everything data from big data to data science, data engineering, software engineering, and cloud design. We are a trusted technology partner in...
Cloud
Big data
Temporary work
Local area
Remote work
Illumination Works
Atlanta, GA
2 days ago
Data Engineer
...RESPONSIBILITIES: Work with data scientist team to migrate the... ...datasets and implement complex big data solutions (under senior... ...3+ years of professional data engineering or data wrangling experience... ...Experience with Hadoop based or Cloud based big data management environment...
Cloud
Big data
Full time
Contract work
Temporary work
For contractors
Work experience placement
Local area
Remote work
Flexible hours
Visionaire Partners
Atlanta, GA
2 days ago
Senior Data Engineer
...Senior Data EngineerThe Weather Company is the world... ...seeking a Senior Data Engineer to design, build, and operate... ...platforms in the cloud. In this role, you'll be... ...'ll work with modern big data technologies and AWS... ...sophisticated software systems using either object...
Cloud
Big data
Flexible hours
The Weather Company
Atlanta, GA
1 day ago
Lead Data Engineer
...We are seeking a Data Engineer with experience in projects emphasizing complex data solutions.... ...systems to data marts/lake Uses additional cloud technologies (e.g., understands concept of... ...such as: Oracle, SQL Server, MySQL Big data concepts and technologies such as Synapse...
Cloud
Big data
For contractors
Openkyber
Atlanta, GA
3 days ago
Sr. Lead Data Engineer
$205.32k
...DevelopmentJob ProfileSr Lead Data EngineerManagement... ...: Sr. Lead Data Engineer positions offered by Cox... ...architecture, solutions, and software to capture, manage,... ...store using distributed (cloud) structures, local databases... ...machine learning, and big data techniques to...
Cloud
Big data
Full time
Work at office
Local area
Remote work
Flexible hours
Cox Enterprises
Atlanta, GA
4 days ago
Azure Data Engineer
...Azure Data EngineerSeeking an Azure Data Engineer to support our public health division. The... ...implement and maintain a software application critical to the... ...developing and delivering Azure cloud based data analytics... ...perspective on storage, big data platform services,...
Cloud
Big data
Work experience placement
Software Technology Inc
Atlanta, GA
1 day ago
Senior Data Engineer
$153.58k
...technical leadership for data ingestion and... ...implementing data-driven cloud-based solutions. Work with... ...using a vast range of data engineering and cloud technologies.... ...of experience in a Software Development role or related... ...must include: Big data Tools: Spark, hdfs...
Cloud
Big data
Part time
Work experience placement
Local area
Remote work
Flexible hours
Go Direct Inc.
Atlanta, GA
2 days ago
Sr. Data Engineer
$60k - $135k
...Sr. Data EngineerWipro Limited is a leading technology... ...in consulting, design, engineering, and operations, we... ...through all phases of software development life cycle.... ...in Azure Data Services, Big Data, ETL/ELT, PySpark,... ...scalable data pipelines, cloud-based data platforms,...
Cloud
Big data
Minimum wage
Local area
Wipro
Atlanta, GA
3 days ago
Lead Data Engineer
...Job Title: Lead Data Engineer Work Location: Newark, New Jersey... ...degree in Computer Science, Software Engineering, MIS, or equivalent... ...ETL/ELT, data modeling, and big data technologies. ~ Familiarity... ...warehousing concepts and cloud-based architecture. ~...
Cloud
Big data
Long term contract
Contract work
Openkyber
Atlanta, GA
3 days ago
Senior Data Engineer (AWS, Azure, GCP)
...across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud... .../CD, Jira) Fundamental understanding of big data, open source, and data streaming concepts...
Cloud
Big data
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech
Atlanta, GA
4 days ago
Data Engineer
...Data EngineerBig Data & AI Bootcamp · Atlanta, GA... ...a fully deployed Data Engineer — paid from day one, trained... ..., warehouses, and big data systems that power... ...maintainable codeHave exposure to cloud platforms or big data... ...Science, Data Science, Software Engineering,...
Cloud
Big data
Full time
Internship
Relocation
Tech Consulting
Atlanta, GA
4 days ago
Lead Data Engineer
...Data Engineer Job Description We are looking for a Senior Data Engineer with 8+ years of experience... ...Azure, ETL/ELT, SQL, Python, and modern cloud data platforms . Responsibilities... ...Data Platforms, Data Warehousing, Power BI, Big Data/Distributed Processing....
Cloud
Big data
Openkyber
Atlanta, GA
3 days ago
GCP Data Engineer
$55 - $60 per hour
DescriptionThe EDW Finance engineering team is responsible for building... ...and maintaining the enterprise data pipelines, data models, and reporting... ...expertise in SQL, Python, Big Query, and data analytics.... ...technologies such as Dataform, Cloud Functions, and building data pipelines...
Cloud
Big data
Contract work
Temporary work
Immediate start
Remote work
TEKsystems
Atlanta, GA
4 days ago
Lead Data Engineer
...Role: Senior Data Engineer Location: Dallas, TX (Onsite) 6-12 Months Responsibilities Design and Implement scalable solutions for ever-increasing data volumes, using big data/cloud technologies like Pyspark, Kafka, etc. Collaborate with cross-functional...
Cloud
Big data
Openkyber
Atlanta, GA
3 days ago
Lead Data Engineer
...seeking an experienced Senior Data Engineer to design, develop, and... ...data engineering practices, cloud-native architectures, Lakehouse... ...across data ecosystems. Big Data & Streaming Solutions:... ...~8+ years of experience in software engineering, data engineering...
Cloud
Big data
Openkyber
Atlanta, GA
3 days ago
Lead Data Engineer
...skill set. The ideal candidate will have a strong Data Engineering background with extensive experience working with Big Data technologies . Day-to-Day Responsibilities:... ...environments. Hands-on experience with AWS and cloud technologies , including cloud-based data...
Cloud
Big data
Contract work
Work at office
Immediate start
Remote work
3 days per week
Openkyber
Atlanta, GA
3 days ago
Lead Data Engineer
...Job Title: Senior Databricks Engineer Location: 100% Remote Interview... ...Description Lead/Senior Databricks Data Engineer Position: Lead... ...PySpark, SQL, Delta Lake, and cloud-based data platforms . The candidate... .../workload optimization Big Data Apache Spark...
Cloud
Big data
Second job
Remote work
Openkyber
Atlanta, GA
3 days ago
Lead Data Engineer
...Seeking a data engineer for hybrid contract role in Westmont IL. If interested , share your word... ...into a unified, governed data layer on the cloud. The ideal candidate is a full-stack data... ...of experience in data engineering and Big Data development, including multiple large...
Cloud
Big data
Hourly pay
Contract work
For contractors
Monday to Friday
Shift work
2 days per week
3 days per week
Openkyber
Atlanta, GA
3 days ago
Lead Data Engineer
...Overview We are seeking an experienced Senior Data Engineer to join a large, enterprise healthcare... ...of data solutions across on-premise and cloud-based environments. Contribute to data... ...AWS or Microsoft Azure . Experience with big-data or distributed-data technologies such...
Cloud
Big data
Permanent employment
Contract work
Visa sponsorship
Openkyber
Atlanta, GA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer Big Data & Cloud. Be the first to apply!