Data Engineer
$165k - $175kRedbeard Solutions
Data Engineer
Boston, Massachusetts, United States Job Openings Data Engineer
Job Title: Data Engineer - AI Platform
Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC
Number of openings: 1
Experience: 5+ years of professional experience as a data engineer
Salary: $165,000 - $175,000
Clearance: Secret (prefer TS)
Position Summary
We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.
You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.
Key Responsibilities
- Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
- Develop and maintain high-quality Python-based data workflows, including testing and validation
- Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
- Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
- Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
- Utilize containerization technologies (Docker) to support scalable and portable deployments
- Contribute to the development and optimization of data systems used by generative AI applications
- Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics
What You'll Experience
- Opportunity to work on high-impact AI platform initiatives
- A fast-paced, performance-driven environment with strong technical mentorship
- Continuous learning through structured development programs and real-world problem solving
- A collaborative culture that values innovation, ownership, and diverse perspectives
- Exposure to globally distributed teams and modern engineering practices
- Competitive compensation along with a comprehensive benefits package
Required Qualifications
- U.S. Citizenship is required
- Prior experience supporting defense or government environments, including handling classified or sensitive data
- Active Secret clearance required (Top Secret or higher preferred)
- 5+ years of experience in data engineering, with a strong focus on cloud-based solutions
Technical Skills & Expertise
- Strong proficiency in Python for data engineering and pipeline development
- Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)
- Deep understanding of data modeling, data ingestion frameworks, and pipeline architecture
- Experience working with knowledge graphs, particularly using Neo4j, and familiarity with relational databases
- Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices
- Practical experience with Docker and containerized workflows
- Strong background in data pipeline performance tuning, monitoring, and troubleshooting
- Excellent analytical and problem-solving capabilities
- Effective communication skills and ability to collaborate within cross-functional teams
- Job Description: Must Have : DBT Core , Snowflake and Python, AWS Airflow , Container services(Docker) , Terraform Good to Have : BI tooling experience(Power BI or Tableau), understanding of Agile processes( Kanban or Jira) . We need strong person as this...Suggested
$170k - $210k
..., and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You will...SuggestedRemote workWork visaShift work$220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...SuggestedLocal areaRemote workFlexible hours- ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions in modern cloud environments. This role requires full lifecycle ownership across Snowflake pipelines, data modeling, and...Suggested
$175k - $255k
...deserve, we'd love to meet you. About the Role The Revenue Engine team at Charlie Health services all parts of our business... ...externally sourced datasets, and building user-facing products. As a data engineer on the Revenue Engine team, you will be responsible for...SuggestedFull timeWork at officeLocal area- ...About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions:2 Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office per week) Experience: 10+ years specifically Key Skills: Snowflake, SQL, Python, Spark, AWS-...Work experience placementWork at office3 days per week
- TBD Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information,...
- ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...
$160k - $220k
...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we...Full timeWorldwideRelocationFlexible hoursShift workNight shiftDay shift- ...Role: Lead Data Engineer Location: New York Mode of Work: Onsite 60/hour. Responsibilities - Lead the design and implementation of a robust, scalable, and reusable data ingestion framework using Microsoft Fabric - Building a...
- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location...Remote work
- ...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...
$220k - $230k
...Who We Are: Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress... ...Teams. Who You Are: You're a senior, hands-on data engineer with 8+ years of experience designing, building, and operating production...Local areaFlexible hours- ...Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ | Onsite Employment Type: Full-Time NOTE - Must have taken care of team size of Minimum of 10 or more people and sole contributer required...Full time
- ...hands-on skills in PySpark, Python, and SQL, with experience in building, operating, and optimizing data pipelines. Additionally, candidates with application engineering experience should have proficiency in building APIs using FastAPI or Flask and possess robust data modeling...
- ...Position: Data/Scala/Spark Engineering Specialist Location: NYC, NY (F2F) Duration: 12 Months We need Data engineering, Scala, Snowflake and Data modeling for this role. Need only resources who can do scala coding. Job Description: 8 to 10 years’...
- ...Job Title: Big Data Engineer Consultant Jr. Company Description: Tech Consulting provides advanced technology consulting solutions tailored to help ambitious organizations excel in competitive markets. By connecting top-tier consultants with businesses looking for...Full timeTemporary workRelocation
- ...leader in multi-screen audience ad-serving technology reaching over 100 million households. They are currently expanding their Data Engineering team based in New York City, NY. This role is hybrid on-site in the NYC Headquarters. Qualified candidates will have 3-5+...Immediate start
- ...Responsibilities: Build and maintain data pipelines using Python and SQL. Create and manage workflows in Databricks and... ...and fix issues to meet service goals. Work with analytics, engineering, and business teams to deliver clean, ready-to-use datasets....Work at office
- ...Job Title : Data Engineer with Mongo DB Job Location : Charlotte NC / Jersey City NJ / Plano TX (ONSITE) Job Type : Full-Time Job Description: Must Have Technical/Functional Skills Primary Skill: Data Engineer Secondary...Full time
$73.15k - $95k
...AI Engineer Zenith is one of Publicis Groupe's largest media agencies, spanning 95 markets globally with US offices in New York, Burbank... ...including content, commerce, multicultural, and future-proofed data capabilities. We are looking for an AI Engineer to lead the...Temporary workFreelanceFlexible hours- ...I have an opportunity for " Data Migration Engineer " and looking for a candidate who can join Immediately if you are interested reply me with your updated resume or consultant's contact details and if you could refer someone i really appreciate it. Job Role: Data...Immediate startRemote work
$115k - $130k
...JOB PURPOSE: The Data Engineer III will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient data...- ...Data Engineer As a Data Engineer you will get to play a key and a collaborative role in the delivery of powerful data-driven products that support 32BJ Health Fund's mission of providing high-quality and low-cost healthcare to its union members. The Data Engineer will...Flexible hours
- ...About the job Data Engineer - Palantir Job Description: Palantir Data Engineer We are seeking a seasoned Data Engineer with 3-7 years of experience in data engineering, cloud platforms and distributed systems, along with 2+ years of hands-on experience with...Work experience placement
$120k - $135k
...Data Engineer II US - East Coast (Remote) At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we're looking for people to help us tackle that responsibility with creativity...Work experience placementWork at officeLocal areaRemote workMonday to Friday$125k - $163.8k
...THE POSITION Our roster has an opening with your name on it We are looking for a Data Engineer to join our growing data platform team and take end-to-end ownership of designing, building, and scaling the foundational data infrastructure that powers analytics, machine...Temporary workLocal areaWorldwide- ...Role : Data Engineer Location : New York (Hybrid) Skills - Apptio, Big Data, ETL-Big Data/Data Warehousing, MS SQL, Oracle PL/SQL, Stored Proc Coding, Python, PySpark, Node/Node.JS, RDBMS, Data Analytics Job Description • Individual contributor to...
- ...Data Engineer The Department of City Planning (DCP) plans for the future of New York City, working to create thriving and dynamic neighborhoods with access to housing and jobs, resilient infrastructure, and a vibrant public realm. The Department engages communities...Full time
$90k - $96k
...technology and build a more sustainable, more inclusive world. Client Location: Charlotte, NC Job Description 5 to 7 years of data engineering experience with 1+ year of relevant GCP experience. Experience in Data Engineering, ETL Pipelines, Batch and Streaming...Full timeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data engineer manager New York, NY
- data science developer New York, NY
- junior data developer New York, NY
- etl data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- junior big data engineer New York, NY



