Lead Data Engineer
Openkyber
Role : AWS Lead Data Engineer
Location : Newark City, NJ (Hybrid)
Interview Process: (In-Person Interview at client site)
Job Summary : We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting, implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering. Candidate would be required to work from the NJ office as part of this role.
Key Responsibilities : Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS. Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.). Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture. Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions. Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses. Develop and enforce standards for data quality, security, and governance. Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team. Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy. Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption. Troubleshoot complex data issues and provide technical leadership in problem resolution.
Required Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 7+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer role. Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.). Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus. Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS. Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment. Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform). Excellent problem-solving, communication, and organizational skills.
Preferred Qualifications: AWS Solutions Architect or AWS Data Engineer certification. Experience with real-time streaming technologies. Knowledge of data governance, compliance, and security best practices. Familiarity with Lakehouse architecture and modern data platforms.
Location : Newark City, NJ (Hybrid)
Interview Process: (In-Person Interview at client site)
Job Summary : We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting, implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering. Candidate would be required to work from the NJ office as part of this role.
Key Responsibilities : Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS. Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.). Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture. Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions. Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses. Develop and enforce standards for data quality, security, and governance. Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team. Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy. Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption. Troubleshoot complex data issues and provide technical leadership in problem resolution.
Required Qualifications: Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 7+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer role. Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.). Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus. Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS. Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment. Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform). Excellent problem-solving, communication, and organizational skills.
Preferred Qualifications: AWS Solutions Architect or AWS Data Engineer certification. Experience with real-time streaming technologies. Knowledge of data governance, compliance, and security best practices. Familiarity with Lakehouse architecture and modern data platforms.
For applications and inquiries, contact:View email address on us.fitly.work
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in Massachusetts vacancy
- The Data Environments and Engineering Department (L176) in the Data and Human Centered Solutions Innovation Center is seeking highly motivated, adaptive... ...systems, or data engineering to join our department as a Lead Data Engineer. Candidates should have a strong interest...Suggested
- ...position sits within the newly consolidated Data and Analytics (D&A) organization... ...data infrastructure, data governance, data engineering, data modeling, data analysis to business... ...intelligence, data science, and AI. The Lead Data Engineer is crucial to D&A USB’s Eligibility...Suggested
$128k - $176k
...portfolio-facing IT organization, responsible for the cloud engineering, data and informatics engineering, research systems, lab systems, and... ...stage of company formation and growth. We are seeking a Lead Data Engineer to lead complex initiatives aimed at modernizing...Suggested$150k - $170k
...region's clean and reliable energy future and are looking for a Data Engineer to join our team. In this role, you will design, develop, and... ...will make an Impact Own Data Architecture & Solution Delivery Lead the design and implementation of scalable data platforms,...SuggestedH1bRelocationVisa sponsorshipWork visaRelocation packageFlexible hours3 days per week$99.79k - $139.72k
...qualifications and other job-related reasons. Description SUMMARY: The Data Engineer III will develop and scale our data ecosystem including our... ...provide technical mentorship to Data Engineers I & II as they lead all aspects of technical delivery. ESSENTIAL JOB FUNCTIONS &...SuggestedShift work- Capgemini is seeking a Lead Data Engineer to provide technical leadership for enterprise data modernization initiatives in Smithfield RI. You will define migration strategies and guide teams transforming legacy ETL into scalable data platforms, using Python, SQL, and Java...
- Job Title- Lead Data Engineer Location: Remote Duration: 6 Months Contract to Hire (Quarterly Onsite for a few days in Dallas TX) bout BigRio: BigR.io is a technology consulting firm empowering data to drive innovation and advanced analytics. We specialize in cutting...Contract workRemote work
$106.61k - $284.28k
...community at a time. POSITION SUMMARY At CVS Health, protecting customer, patient, member, and colleague data is fundamental to our mission. The Lead Data Privacy Engineer will play a critical role in advancing enterprise privacy engineering and data protection...Hourly payFull timeTemporary workWork experience placementLocal area$142k - $166k
..., MA, or the Brooklyn, NY office. Hybrid work expectations are subject to business needs and company policy. Job Purpose The Lead Data Engineer is a collaborative, hands-on role within the Digital Platform Data Engineering team. This individual is responsible for designing...Work at officeLocal area- Senior Lead Data Engineer (Intelligent Foundations and Experiences) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One...InternshipLocal area
- ...and citizen services. We’re a nonprofit engineering, applied research, and advanced technology... ...objectivity and integrity at our core, we lead federally funded research and development... ...future. Department Summary: MITRE’s Data Science and Engineering department is looking...InternshipLocal area3 days per week
- Capital One in Cambridge, MA is seeking a Lead Data Engineer to join a fast-paced, collaborative technology team. You will design, build, test, and support data-driven solutions across ML and full-stack systems using Java, Python, Scala and SQL. You will collaborate with...
$131k - $220k
...collects, stores, processes and builds applications within our big data platform. Responsible for integrating these applications with... ...to transfer a valid H1 visa. Primary Accountabilities *Leads an engineering team to meet project deadlines and priorities. *Supervises assigned...Full timeLocal areaRelocation package$197.3k - $225.1k
Lead Data Engineer (Intelligent Foundations and Experiences) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'...Full timePart timeInternshipH1bLocal area$103.33k - $128.66k
...able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more... ...(Day One Onsite - Hybrid)About The RoleWe are seeking a Lead Data Engineer to provide technical leadership for enterprise data modernization...Full timeLocal areaFlexible hours- Senior Data Engineer Analytics & Behavior Change is an innovation engine supporting the entire CVS Health organization by embedding deep insights into key decision processes and focusing on our biggest, most complex problems. Join Analytics & Behavior Change to make a meaningful...Remote jobLocal area
- Flagship Pioneering in Cambridge, MA is seeking a Lead Data Engineer to modernize data infrastructure, platforms, and pipelines. You will guide data platform implementations and set standards across Infrastructure & Operations, Lab IT, PI Tech, and bioinformatics teams...
- MetLife is seeking a Lead Data Engineer to design and implement end-to-end data architectures and reusable data products. You will lead a team, build scalable ETL pipelines, and collaborate with IT, analytics, and business teams across our U.S. data platforms. The role...
$110k - $158.5k
...who rely on us to help them build more secure and prosperous futures. THE ROLEIn conjunction with the Enterprise Data Management Office, the Lead Data Engineer contributes to a long-term strategic initiative to unify and harmonize our investment data. This initiative...Full timeWork at officeLocal areaRemote workFlexible hours- Boston, MAHybridFull Time$140k - $160kJob DescriptionA cutting-edge automation company is hiring a Lead Data Platform Engineer to help power the next generation of intelligent warehouse and distribution center technologies. The organization develops advanced robotic solutions...Full time
Motion Recruitment
Boston, MAa month ago $180k - $230k
...Description Job Description TetraScience is a Scientific Data and AI company with a mission to radically improve and... ..., and advantages. What You Will Do You will be leading a team of Scientific Data Engineers (SDE) and helping build Tetra Data and productizable...Immediate startTetraScience
Cambridge, MA5 days ago- ...and citizen services. We’re a nonprofit engineering, applied research, and advanced technology... ...objectivity and integrity at our core, we lead federally funded research and development... ...the future.Department Summary:MITRE’s Data Science and Engineering department is looking...InternshipLocal area3 days per week
$110k - $169k
...firm that does Big Law, Better. McDermott Will & Schulte is a leading global law firm that brings together more than 1,700+ lawyers... ...hard work and excellence. Job Description The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable...Full timeWork at officeMcDermott Will & Schulte
Boston, MA3 days ago- ...Job TitleMandatory Skills: Big Data Java, Scala, Apache SparkRequired Skills:+ 8 years exp in Bigdata with Java & Scala.Should have good experience in big data development projects in Java and ScalaShould have good experience in design and architecture of projects in...Work at officeImmediate start
Omni Inclusive
Boston, MA3 days ago - ...Datacenter Engineer The engineer in this position should have a wealth of experience engineering... ...include the complete engineering of data centers including, but not limited to,... ...field engineers, installation supervisors, lead installers, and installation techs....For contractorsWork at officeLocal area
ADEX
Boston, MA1 day ago $95.38k - $105.82k
...Information Assurance EngineerGeneral Dynamics Mission Systems has an opening for an Information Assurance Engineer supporting our site in Pittsfield, MA.Knowledge, Skills and Abilities:• Solid application of systems engineering concepts, principles, and theories• Solid...Work at officeImmediate startFlexible hoursProgeny Systems Corporation
Pittsfield, MA18 hours ago$165.56k - $188.09k
...Sr. Data Analytics Engineer Sr. Data Analytics Engineer Values & Innovation At Under Armour, we are committed to empowering those who... ...visualization and reporting requirements. Leverage industry-leading integration and analytics tools to build a modern data...Local areaRemote workRelocationUnder Armour
Boston, MA3 days ago- ...Principal Data Engineer Locations: Waltham, MA - Hybrid About the Role We are seeking a highly skilled and hands-on Principal Data Engineer to lead the design, and development of scalable real-time data platforms and distributed data processing systems. This...
Blue Prism Group
Waltham, MA3 days ago $100k - $130k
...can you. An impressive mission requires an equally impressive Data Analytics Engineer. Headquartered in Boston, Massachusetts, VIA is a mission-... ...engineers, data peers, and client delivery professionals to lead data initiatives end to end, in an environment where precision...Summer workRemote workWork from homeFlexible hoursvia.com
Boston, MA2 days ago$180k - $200k
...Staff Data Engineer Waltham, MA Xometry (NASDAQ: XMTR) powers the industries of today and tomorrow by connecting the people with big... ...organizational impact. You will own data architecture decisions, lead the design of scalable pipelines and platforms, and set the...Contract workXometry
Waltham, MA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches
- data capturer Massachusetts
- data loss prevention analyst Massachusetts
- data technician Massachusetts
- data recovery Massachusetts
- clinical data coordinator remote Massachusetts
- health data Massachusetts
- data analysis part time Massachusetts
- data network cabling Massachusetts
- data modeling Massachusetts
- ai data Massachusetts