Principal Software Engineer Big Data & Cloud

Openkyber

Lead Software Engineer (Big Data, Spark, AWS, Full Stack) Location: Rockville, MD or Tysons Corner, VA Work Setting: Onsite

Job Descripton:
We are seeking a highly experienced Lead Software Engineer to design, develop, and optimize enterprise-scale applications and big data platforms. The ideal candidate will have strong expertise in Apache Spark, AWS Cloud, Full Stack Development, System Design, and Software Engineering best practices.
Required Skills:

7+ years of Software Engineering experience

Strong System Design and Architecture experience

Expertise in Apache Spark, Hadoop, Hive, and Trino

Experience processing large-scale datasets (TB/PB scale)

Advanced SQL (Window Functions, Joins, Aggregations, Query Optimization)

Strong programming skills in Python or Scala

AWS Services: S3, EMR, Glue, Athena, Lambda, EKS

Full Stack Development (Frontend, Backend, APIs, Microservices)

Object-Oriented Design and Design Patterns

Data Storage Technologies (Relational & NoSQL)

Performance Tuning and Optimization

DevOps, CI/CD, and Infrastructure Automation

Test Automation, Unit Testing, and Quality Engineering

Software Security and Secure Coding Practices

Experience with AI tools such as GitHub Copilot, ChatGPT, Claude, Amazon Q

Leadership Responsibilities:

Lead architecture and technical design initiatives

Mentor and guide engineering teams

Drive engineering excellence and best practices

Collaborate across business and technology teams

Lead modernization, automation, and AI adoption efforts

Preferred Skills:

Kubernetes / EKS

Serverless Architectures

Financial Services experience

Agile/Scrum leadership

Cloud Certifications (AWS)

Large-scale distributed systems experience

Qualifications:
Bachelor"s degree in Computer Science or related field Strong communication and stakeholder management skills Proven experience delivering enterprise-grade solutions

For applications and inquiries, contact:View email address on us.fitly.work

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Principal Software Engineer Big Data & Cloud in Atlanta, GA vacancy

Principal Software Engineer - Enterprise Customer
$196.5k - $294.75k
...through the responsible use of data and AI. We believe that... ...are looking for a Principal-level, US-based, customer-facing engineer who is deeply hands-on with... ...enterprise customers using our big-data and high-scale... ...latency APIs and services in a cloud environmentProven track...
Cloud
Big data
Work experience placement
Work at office
Local area
Worldwide
Flexible hours
3 days per week
1 day per week
OneTrust
Atlanta, GA
3 days ago
Senior Data Engineer - Periscope
$195.3k - $199.2k
...and maintain scalable data pipelines and systems using... ...and executing data engineering projects from inception... ...prescriptive analytics, and cloud-based tools to provide... ...a strong background in big data... ...architecturesExperience adopting software development best practices...
Cloud
Big data
Apprenticeship
Easy work
McKinsey & Company
Atlanta, GA
4 days ago
Senior Data Engineer
...Senior Data EngineerSkill - Last Used - Experience... ...Description: Senior Data Engineer who is passionate about... ...fast-paced world of Big Data technology and has... ...transformation and storageDevelop software utilizing open source... ....Exposure to cloud technologies with hands...
Cloud
Big data
Omni Inclusive
Atlanta, GA
3 days ago
Data Engineer (hybrid)
...Data Engineer (Hybrid)We are seeking a skilled Data Engineer to design, develop, and optimize scalable data pipelines... ...The ideal candidate will have strong expertise in cloud-based data engineering, ETL/ELT development, big data technologies, and data quality practices,...
Cloud
Big data
Axelon
Atlanta, GA
1 day ago
Snowflake Data Engineer
...way. We are seeking a Senior Snowflake Data Engineer to join our development team. This... ...issues Integration: Connect Snowflake with cloud platforms (AWS, Azure, GCP) and third-... ...Cloud platform proficiency ~ Knowledge of big data technologies (Hadoop, Spark, Kafka)...
Cloud
Big data
Experient
Atlanta, GA
4 days ago
Senior AWS Data Engineer
Req ID:374073NTT DATA strives to hire exceptional,... ...seeking a Senior AWS Data Engineer to join our team in... ...build, and optimize our cloud-based data architecture... ...Business Analysts, and Software Engineers to deliver clean... ...or AWS Certified Big Data Specialty.Experience...
Cloud
Big data
Contract work
Work at office
Remote work
Flexible hours
NTT DATA
Atlanta, GA
4 days ago
Senior Data Engineer
...table for you...Position Summary:The Senior Data Engineer guides the development of GFS’ Data... ...data products. Identifies and translates Big Data challenges into technical approaches... ...technical solutions.Highly experienced with cloud computing platforms, preferably Google Cloud...
Cloud
Big data
Full time
Work at office
Monday to Friday
Gordon Food Service
Atlanta, GA
2 days ago
Sr Databricks Data Engineer
$116.2k - $229.1k
...Summary Join Deloitte’s AI & Engineering practice and help... ...technology platforms, modernize data environments, and unlock value... ...will design, build, and optimize cloud-based data engineering solutions... ...Evaluate, pilot, and integrate new big data and analytics...
Cloud
Big data
Local area
Visa sponsorship
Deloitte
Atlanta, GA
4 days ago
Google Data Engineer
$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom software, data, AI, and cloud products with clients who are ready to accelerate... ...into products, engineering systems that support learning... ...cloud-native platforms.* Big Data Platforms (Dataproc,...
Cloud
Big data
Temporary work
Work at office
Local area
Flexible hours
Slalom
Atlanta, GA
4 days ago
Data Engineer
...Location: Remote We are seeking an experienced Data Engineer to support challenging data engineering,... ...2006! We specialize in everything data from big data to data science, data engineering, software engineering, and cloud design. We are a trusted technology partner...
Cloud
Big data
Temporary work
Local area
Remote work
Illumination Works
Atlanta, GA
2 days ago
Azure Data Engineer
...Azure Data EngineerSeeking an Azure Data Engineer to support our public health division. The... ...implement and maintain a software application critical to the... ...developing and delivering Azure cloud based data analytics... ...perspective on storage, big data platform services,...
Cloud
Big data
Work experience placement
Software Technology Inc
Atlanta, GA
3 days ago
Lead Data Engineer
...We are seeking a Data Engineer with experience in projects emphasizing complex data solutions.... ...systems to data marts/lake Uses additional cloud technologies (e.g., understands concept of... ...such as: Oracle, SQL Server, MySQL Big data concepts and technologies such as Synapse...
Cloud
Big data
For contractors
Openkyber
Atlanta, GA
1 day ago
Senior Data Engineer (AWS, Azure, GCP)
...across the country.Job DescriptionCapTech Data Engineering consultants enable clients to build and... ...creative solutions for our clients. Cloud Data Engineers leverage the client’s cloud... .../CD, Jira) Fundamental understanding of big data, open source, and data streaming concepts...
Cloud
Big data
Work at office
Remote work
Visa sponsorship
Work visa
Flexible hours
CapTech
Atlanta, GA
6 days ago
Lead Data Engineer
...Job Title: Sr. Data Engineer Work Location: Newark, New Jersey 0... ...degree in Computer Science, Software Engineering, MIS, or equivalent... ...ETL/ELT, data modeling, and big data technologies. Familiarity... ...warehousing concepts and cloud-based architecture....
Cloud
Big data
Long term contract
Contract work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Data Engineer Job Description We are looking for a Senior Data Engineer with 8+ years of experience... ...Azure, ETL/ELT, SQL, Python, and modern cloud data platforms . Responsibilities... ...Data Platforms, Data Warehousing, Power BI, Big Data/Distributed Processing....
Cloud
Big data
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Role : AWS Lead Data Engineer (3 Open Positions) Location : Newark City, NJ (Hybrid)... ...functional partners, and ensure best practices in cloud data engineering. Candidate would be... ...with ETL/ELT processes, data modeling, and big data frameworks. ~ Demonstrated...
Cloud
Big data
Work at office
Openkyber
Atlanta, GA
3 days ago
GCP Data Engineer
$55 - $60 per hour
DescriptionThe EDW Finance engineering team is responsible for building... ...and maintaining the enterprise data pipelines, data models, and reporting... ...expertise in SQL, Python, Big Query, and data analytics.... ...technologies such as Dataform, Cloud Functions, and building data pipelines...
Cloud
Big data
Contract work
Temporary work
Immediate start
Remote work
TEKsystems
Atlanta, GA
2 days ago
Big/ Data Engineer - GA
...Position: Big Data Scientist Length: 24+ months (Possible extensions based of performance... ...! Job Description: Data Engineers own the architecture, design, and... ...including managed patterns such as Confluent Cloud), AWS services (for example S3 and...
Cloud
Big data
Local area
Remote work
Shift work
Nexiva Inc
Atlanta, GA
1 day ago
Log Analytics Engineer
...CTG is seeking to fill a Data Engineer - AI & Analytics position for our... ...APIs, relational databases, cloud storage, files, and streaming... ...Collaborate with data scientists, software engineers, analysts, and... ...engineering, cloud data platforms, or big data development....
Cloud
Big data
Remote work
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...skill set. The ideal candidate will have a strong Data Engineering background with extensive experience working with Big Data technologies . Day-to-Day Responsibilities:... ...environments. Hands-on experience with AWS and cloud technologies , including cloud-based data...
Cloud
Big data
Contract work
Work at office
Immediate start
Remote work
3 days per week
Openkyber
Atlanta, GA
1 day ago
Log Analytics Engineer
$84 per hour
...Job Title: Data Engineer Cloud Data & Cybersecurity Analytics Location: Charlotte, NC Duration: 6 Months + Extension Bill Rate... ...~5+ years of experience in cloud-based data engineering and big data processing. ~ Strong hands-on experience with AWS...
Cloud
Big data
Contract work
H1b
Local area
Openkyber
Atlanta, GA
2 days ago
Lead Data Engineer
...Seeking a data engineer for hybrid contract role in Westmont IL. If interested , share your word... ...into a unified, governed data layer on the cloud. The ideal candidate is a full-stack data... ...of experience in data engineering and Big Data development, including multiple large...
Cloud
Big data
Hourly pay
Contract work
For contractors
Monday to Friday
Shift work
2 days per week
3 days per week
Openkyber
Atlanta, GA
1 day ago
Lead Data Engineer
...Overview We are seeking an experienced Senior Data Engineer to join a large, enterprise healthcare... ...of data solutions across on-premise and cloud-based environments. Contribute to data... ...AWS or Microsoft Azure . Experience with big-data or distributed-data technologies such...
Cloud
Big data
Permanent employment
Contract work
Visa sponsorship
Openkyber
Atlanta, GA
1 day ago
Lead GCP Data Engineer : Atlanta, GA. (Hybrid - 3 days onsite)
...Role : Lead GCP Data Engineer Location : Atlanta, GA. (Hybrid 3 days onsite) Contract... ...technically proficient Data Engineer with Google Cloud Platform (GCP), and data pipeline... ...domain knowledge, hands-on experience with big data ecosystems, and a proven ability to...
Cloud
Big data
Contract work
Quantum World Technologies Inc
Atlanta, GA
1 day ago
Lead Data Engineer
$10,214.44 - $10,678.1 per month
....10 monthly SUMMARY The Data & Analytics Unit is responsible... .... Proven experience with big data technologies and... ...). Deep understanding of cloud-based data platforms such as AWS... ...methodology and its application to software and data product development....
Cloud
Big data
Openkyber
Atlanta, GA
1 day ago
Principal Software Engineer - (Kubernetes - AKS)
$155.4k - $261.1k
Principal Software Engineer - (Kubernetes - AKS)Join AT&T and reimagine the communications and technologies that connect the world. The Technology... ...Software Engineer, you will help design, build, and enhance cloud-native platform capabilities that support enterprise...
Cloud
Temporary work
Work at office
Local area
Relocation
AT&T
Atlanta, GA
2 days ago
Major Account Manager
...Networks is an industry leader in data-driven, client-to-cloud networking for large data... ...intelligence, and software-defined networking to provide... ...prestigious awards, such as Best Engineering Team, Best Company for... ...business challenges that AI/ML, Big Data, and siloed IT systems...
Cloud
Big data
Arista Networks
Atlanta, GA
2 days ago
Big Data/Cloud Consultant
...steady pace specializing in the fields of Software Development, Software Consultancy and... ...: At least 5 years of working on data management domain with big data, Oracle, SQL or other database... ...in Java, Python, Scala.Experience in cloud technologies preferred - AWS or Azure...
Cloud
Big data
Permanent employment
Full time
H1b
Sonsoft
Atlanta, GA
4 days ago
Principal Software Engineer, Splunk Analytics and Search
$241.4k - $322.6k
...massive amounts of machine data. As AI becomes an increasingly... ...ImpactWe're looking for a Principal Software Engineer who enjoys solving difficult... ...execution.Experience working with cloud, hybrid, or on-premises... ...with empathy to make really big things happen on a global scale...
Cloud
Full time
Temporary work
Local area
Flexible hours
CISCO Systems
Atlanta, GA
6 days ago
Generative AI Engineer
...serve as a Generative AI Engineer. You will leverage our data, technology, and analytics... ...large data sources on Google Cloud Platform (GCP) and Google... ...technology and a rich big data ecosystem.Location &... ...contributing to production-grade software or enterprise deployments....
Cloud
Big data
Full time
Work at office
Immediate start
Equifax
Atlanta, GA
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer Big Data & Cloud. Be the first to apply!