Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

$165k - $175k

Redbeard Solutions

Data Engineer

Boston, Massachusetts, United States Job Openings Data Engineer

Job Title: Data Engineer - AI Platform

Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC

Number of openings: 1

Experience: 5+ years of professional experience as a data engineer

Salary: $165,000 - $175,000

Clearance: Secret (prefer TS)

Position Summary

We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.

You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.

Key Responsibilities
  • Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
  • Develop and maintain high-quality Python-based data workflows, including testing and validation
  • Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
  • Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
  • Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
  • Utilize containerization technologies (Docker) to support scalable and portable deployments
  • Contribute to the development and optimization of data systems used by generative AI applications
  • Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics
What You'll Experience
  • Opportunity to work on high-impact AI platform initiatives
  • A fast-paced, performance-driven environment with strong technical mentorship
  • Continuous learning through structured development programs and real-world problem solving
  • A collaborative culture that values innovation, ownership, and diverse perspectives
  • Exposure to globally distributed teams and modern engineering practices
  • Competitive compensation along with a comprehensive benefits package
Required Qualifications
  • U.S. Citizenship is required
  • Prior experience supporting defense or government environments, including handling classified or sensitive data
  • Active Secret clearance required (Top Secret or higher preferred)
  • 5+ years of experience in data engineering, with a strong focus on cloud-based solutions
Technical Skills & Expertise
  • Strong proficiency in Python for data engineering and pipeline development
  • Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)
  • Deep understanding of data modeling, data ingestion frameworks, and pipeline architecture
  • Experience working with knowledge graphs, particularly using Neo4j, and familiarity with relational databases
  • Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices
  • Practical experience with Docker and containerized workflows
  • Strong background in data pipeline performance tuning, monitoring, and troubleshooting
  • Excellent analytical and problem-solving capabilities
  • Effective communication skills and ability to collaborate within cross-functional teams
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
  • Job Description: Must Have : DBT Core , Snowflake and Python, AWS Airflow , Container services(Docker) , Terraform Good to Have : BI tooling experience(Power BI or Tableau), understanding of Agile processes( Kanban or Jira) . We need strong person as this...
    Suggested

    ECHO IT SOLUTIONS INC .

    New York, NY
    8 days ago
  • $170k - $210k

     ..., and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You will... 
    Suggested
    Remote work
    Work visa
    Shift work

    Mark43

    New York, NY
    15 days ago
  • $220k - $300k

     ...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines... 
    Suggested
    Local area
    Remote work
    Flexible hours

    Bayview Asset Management

    New York, NY
    4 days ago
  •  ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions in modern cloud environments. This role requires full lifecycle ownership across Snowflake pipelines, data modeling, and... 
    Suggested

    TheStaffed

    New York, NY
    3 days ago
  • $175k - $255k

     ...deserve, we'd love to meet you. About the Role The Revenue Engine team at Charlie Health services all parts of our business...  ...externally sourced datasets, and building user-facing products. As a data engineer on the Revenue Engine team, you will be responsible for... 
    Suggested
    Full time
    Work at office
    Local area

    Charlie Health Outreach

    New York, NY
    3 days ago
  •  ...About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions:2 Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office per week) Experience: 10+ years specifically Key Skills: Snowflake, SQL, Python, Spark, AWS-... 
    Work experience placement
    Work at office
    3 days per week

    Inizio Partners

    Jersey City, NJ
    19 hours ago
  • TBD Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information,...

    Gen Digital Inc

    New York, NY
    1 day ago
  •  ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business...  ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science... 

    MetLife

    New York, NY
    2 days ago
  • $160k - $220k

     ...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we... 
    Full time
    Worldwide
    Relocation
    Flexible hours
    Shift work
    Night shift
    Day shift

    Deliberate AI

    New York, NY
    3 days ago
  •  ...Role: Lead Data Engineer Location: New York Mode of Work: Onsite 60/hour. Responsibilities - Lead the design and implementation of a robust, scalable, and reusable data ingestion framework using Microsoft Fabric - Building a... 

    Maintec Technologies

    New York, NY
    2 days ago
  •  ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location... 
    Remote work

    VBeyond

    Jersey City, NJ
    19 hours ago
  •  ...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical... 

    TMX Group

    New York, NY
    2 days ago
  • $220k - $230k

     ...Who We Are: Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress...  ...Teams. Who You Are: You're a senior, hands-on data engineer with 8+ years of experience designing, building, and operating production... 
    Local area
    Flexible hours

    Galaxy USA

    New York, NY
    1 day ago
  •  ...Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ | Onsite Employment Type: Full-Time NOTE - Must have taken care of team size of Minimum of 10 or more people and sole contributer required... 
    Full time

    Centraprise

    Jersey City, NJ
    3 days ago
  •  ...hands-on skills in PySpark, Python, and SQL, with experience in building, operating, and optimizing data pipelines. Additionally, candidates with application engineering experience should have proficiency in building APIs using FastAPI or Flask and possess robust data modeling... 

    Optomi

    Jersey City, NJ
    19 hours ago
  •  ...Position: Data/Scala/Spark Engineering Specialist Location: NYC, NY (F2F) Duration: 12 Months We need Data engineering, Scala, Snowflake and Data modeling for this role. Need only resources who can do scala coding. Job Description: 8 to 10 years’... 

    TALENDICA

    New York, NY
    1 day ago
  •  ...Job Title: Big Data Engineer Consultant Jr. Company Description: Tech Consulting provides advanced technology consulting solutions tailored to help ambitious organizations excel in competitive markets. By connecting top-tier consultants with businesses looking for... 
    Full time
    Temporary work
    Relocation

    HirePower Staffing Solution

    New York, NY
    19 hours ago
  •  ...leader in multi-screen audience ad-serving technology reaching over 100 million households. They are currently expanding their Data Engineering team based in New York City, NY. This role is hybrid on-site in the NYC Headquarters. Qualified candidates will have 3-5+... 
    Immediate start

    The Cypress Group

    New York, NY
    19 hours ago
  •  ...Responsibilities: Build and maintain data pipelines using Python and SQL. Create and manage workflows in Databricks and...  ...and fix issues to meet service goals. Work with analytics, engineering, and business teams to deliver clean, ready-to-use datasets.... 
    Work at office

    Texas State Library and Archives Commision

    New York, NY
    19 hours ago
  •  ...Job Title : Data Engineer with Mongo DB Job Location : Charlotte NC / Jersey City NJ / Plano TX (ONSITE) Job Type : Full-Time Job Description: Must Have Technical/Functional Skills Primary Skill: Data Engineer Secondary... 
    Full time

    Centraprise

    Jersey City, NJ
    19 hours ago
  • $73.15k - $95k

     ...AI Engineer Zenith is one of Publicis Groupe's largest media agencies, spanning 95 markets globally with US offices in New York, Burbank...  ...including content, commerce, multicultural, and future-proofed data capabilities. We are looking for an AI Engineer to lead the... 
    Temporary work
    Freelance
    Flexible hours

    MSLGROUP

    New York, NY
    19 hours ago
  •  ...I have an opportunity for " Data Migration Engineer " and looking for a candidate who can join Immediately if you are interested reply me with your updated resume or consultant's contact details and if you could refer someone i really appreciate it. Job Role: Data... 
    Immediate start
    Remote work

    Navtech

    Jersey City, NJ
    3 days ago
  • $115k - $130k

     ...JOB PURPOSE: The Data Engineer III will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient data... 

    CenterLight Health System

    New York, NY
    3 days ago
  •  ...Data Engineer As a Data Engineer you will get to play a key and a collaborative role in the delivery of powerful data-driven products that support 32BJ Health Fund's mission of providing high-quality and low-cost healthcare to its union members. The Data Engineer will... 
    Flexible hours

    Building Service 32BJ Benefit Funds

    New York, NY
    3 days ago
  •  ...About the job Data Engineer - Palantir Job Description: Palantir Data Engineer We are seeking a seasoned Data Engineer with 3-7 years of experience in data engineering, cloud platforms and distributed systems, along with 2+ years of hands-on experience with... 
    Work experience placement

    Inizio Partners

    Jersey City, NJ
    2 days ago
  • $120k - $135k

     ...Data Engineer II US - East Coast (Remote) At Magnite, we cultivate an environment of continuous growth and collaboration. Our work impacts what millions of people read, watch, and buy, and we're looking for people to help us tackle that responsibility with creativity... 
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday

    Magnite

    New York, NY
    19 hours ago
  • $125k - $163.8k

     ...THE POSITION Our roster has an opening with your name on it We are looking for a Data Engineer to join our growing data platform team and take end-to-end ownership of designing, building, and scaling the foundational data infrastructure that powers analytics, machine... 
    Temporary work
    Local area
    Worldwide

    FanDuel

    New York, NY
    2 days ago
  •  ...Role : Data Engineer Location : New York (Hybrid) Skills - Apptio, Big Data, ETL-Big Data/Data Warehousing, MS SQL, Oracle PL/SQL, Stored Proc Coding, Python, PySpark, Node/Node.JS, RDBMS, Data Analytics Job Description • Individual contributor to... 

    Inficare

    New York, NY
    2 days ago
  •  ...Data Engineer The Department of City Planning (DCP) plans for the future of New York City, working to create thriving and dynamic neighborhoods with access to housing and jobs, resilient infrastructure, and a vibrant public realm. The Department engages communities... 
    Full time

    New York City | Technology, Data & Innovation

    New York, NY
    4 days ago
  • $90k - $96k

     ...technology and build a more sustainable, more inclusive world. Client Location: Charlotte, NC Job Description 5 to 7 years of data engineering experience with 1+ year of relevant GCP experience. Experience in Data Engineering, ETL Pipelines, Batch and Streaming... 
    Full time
    Local area

    Capgemini

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!