Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

$165k - $175k

RedBeard Solutions

Data Engineer

Boston, Massachusetts, United States Job Openings Data Engineer

Job Title: Data Engineer - AI Platform

Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC

Number of openings: 1

Experience: 5+ years of professional experience as a data engineer

Salary: $165,000 - $175,000

Clearance: Secret (prefer TS)

Position Summary

We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.

You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.

Key Responsibilities
  • Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
  • Develop and maintain high-quality Python-based data workflows, including testing and validation
  • Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
  • Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
  • Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
  • Utilize containerization technologies (Docker) to support scalable and portable deployments
  • Contribute to the development and optimization of data systems used by generative AI applications
  • Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics
What You'll Experience
  • Opportunity to work on high-impact AI platform initiatives
  • A fast-paced, performance-driven environment with strong technical mentorship
  • Continuous learning through structured development programs and real-world problem solving
  • A collaborative culture that values innovation, ownership, and diverse perspectives
  • Exposure to globally distributed teams and modern engineering practices
  • Competitive compensation along with a comprehensive benefits package
Required Qualifications
  • U.S. Citizenship is required
  • Prior experience supporting defense or government environments, including handling classified or sensitive data
  • Active Secret clearance required (Top Secret or higher preferred)
  • 5+ years of experience in data engineering, with a strong focus on cloud-based solutions
Technical Skills & Expertise
  • Strong proficiency in Python for data engineering and pipeline development
  • Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)
  • Deep understanding of data modeling, data ingestion frameworks, and pipeline architecture
  • Experience working with knowledge graphs, particularly using Neo4j, and familiarity with relational databases
  • Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices
  • Practical experience with Docker and containerized workflows
  • Strong background in data pipeline performance tuning, monitoring, and troubleshooting
  • Excellent analytical and problem-solving capabilities
  • Effective communication skills and ability to collaborate within cross-functional teams
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
  • $189.59k

     ...monitoring, alerting tools, dashboards, and frameworks to support data-driven decision-making and manage potential risks. Support...  ...analytics systems through continuous performance tuning and re-engineering. Design and implement cloud-native solutions to leverage... 
    Suggested
    Hourly pay
    Remote work

    Barclays

    New York, NY
    20 days ago
  • $65 - $70 per hour

     ...Kelly Gosciminski Location: New York, NY / Hamilton Township, NJ - onsite Duration: 6 months GBaMS ReqID: 10373751 Data Engineer / Support Analyst - Databricks Job Description We are seeking an experienced Data Engineer / Support Analyst with... 
    Suggested

    Q1 Technologies

    New York, NY
    3 days ago
  • $160k - $220k

     ...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we... 
    Suggested
    Full time
    Worldwide
    Relocation
    Flexible hours
    Shift work
    Night shift
    Day shift

    Deliberate AI

    New York, NY
    1 day ago
  •  ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business...  ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science... 
    Suggested
    Temporary work
    Work at office
    Local area
    3 days per week

    MetLife

    New York, NY
    5 days ago
  •  ...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical... 
    Suggested

    TMX Group

    New York, NY
    5 days ago
  •  ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design... 
    Long term contract
    Work at office

    InterSources

    New York, NY
    1 day ago
  • Job Description Must Have: DBT Core, Snowflake and Python, AWS Airflow, Container services(Docker), Terraform Good to Have: BI tooling experience(Power BI or Tableau), understanding of Agile processes(Kanban or Jira) We need strong person as this position.

    Echo IT Solutions

    New York, NY
    16 hours ago
  • $140k - $160k

     ...Fitch Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more... 
    Temporary work
    Work at office
    Immediate start
    Worldwide
    Shift work
    2 days per week

    Fitch Ratings

    New York, NY
    3 days ago
  •  ...We are partnered with an established Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands‑on... 

    SO Digital Recruitment

    New York, NY
    3 days ago
  • $170k - $220k

     ...Fuel Card built on a cutting-edge spend management platform. About the Role We are looking for a leader of the Coast data engineering team to shape our company's data culture and underlying infrastructure. At Coast, the success of our data platform is driving... 
    Work at office
    Local area
    Relocation package
    Flexible hours

    Coast

    New York, NY
    5 days ago
  • $220k - $300k

     ...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines... 
    Local area
    Remote work
    Flexible hours

    Bayview Asset Management

    New York, NY
    2 days ago
  • $70 - $85 per hour

     ...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data... 
    Contract work
    Local area
    Remote work
    Flexible hours

    INSPYR Solutions

    New York, NY
    3 days ago
  •  ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15... 
    Contract work

    Argyle Infotech

    New York, NY
    16 hours ago
  •  ...Video Visa : USC, GC, GC EAD, H4, L2 This is onsite from day-1 Description : Client needs a forward-thinking Lead Data Engineer willing to work on-site) in New York NY. This opportunity is in the Asset Management/ Financial Services / Investment Management... 

    ShiftCode Analytics

    New York, NY
    5 days ago
  • $110k - $169k

     ...real work: We offer generous compensation packages that recognize hard work and excellence. Job Description: The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable consistent, data-driven pricing across the firm while... 
    Full time
    Work at office

    McDermott Will & Schulte

    New York, NY
    3 days ago
  • $215.2k - $245.6k

     ...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers... 
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    New York, NY
    4 days ago
  • $97.17k - $126.32k

     ...Data Engineer NYSTEC is a nonprofit technology consulting company, advising agencies, organizations, institutions, and businesses since 1996. We're independent and vendor-neutral, so we have our clients' best interests at heart. At NYSTEC, we know that we succeed when... 
    Local area
    Visa sponsorship

    NYSTEC

    New York, NY
    3 days ago
  •  ...issued ID. They are welcome to remove all personal information. All we need to see is just their name and their picture. Data Engineer New York City, NY Responsibilities Required daily participation in highly loaded data transformations. Manage... 

    Futran Tech Solutions Pvt. Ltd.

    New York, NY
    16 hours ago
  •  ...Data Engineer III The Data Engineer III will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient... 

    C2Q Health Solutions

    New York, NY
    16 hours ago
  • $100k

     ...also advises on citywide strategic and capital planning, analyzes data, conducts policy analysis, and creates open data and civic...  ...The division is comprised of experienced and talented software engineers, geographic specialists, service engineers, and technology leaders... 
    Full time

    City of New York

    New York, NY
    3 days ago
  • $116k - $152.25k

     ...THE POSITION Our roster has an opening with your name on it We are looking for a Data Engineer to join our growing data platform team and take end-to-end ownership of designing, building, and scaling the foundational data infrastructure that powers analytics, machine... 
    Temporary work
    Local area
    Worldwide

    FanDuel

    New York, NY
    5 days ago
  • $120k - $160k

     ...Data Engineer Los Angeles; New York; Remote; San Francisco EDO is the TV outcomes company. Our leading measurement platform connects convergent TV airings to the ad-driven consumer behaviors most predictive of future sales. EDO empowers the advertising industry to... 
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours

    EDO

    New York, NY
    1 day ago
  • $120k - $150k

     ...Data Engineer New York, New York, United States Courier Health is on a mission to solve one of the biggest and most meaningful opportunities in healthcare: reinvent how people living with chronic and rare diseases are supported. We are building the future of patient... 

    Courier Health

    New York, NY
    1 day ago
  • $320k - $405k

     ...Analytics Engineer Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial...  ...As an Analytics Engineer, you will be an early member of the Data Science & Analytics team building the foundation to scale... 
    Work at office
    Visa sponsorship
    Flexible hours

    Colorwave Inc

    New York, NY
    4 days ago
  •  ...Data Engineer As a Data Engineer at Client, you will develop a deep understanding of the company's diverse data landscape and collaborate closely with cross-functional teams to gather requirements and deliver data-driven solutions. You will be responsible for providing... 

    InterSources

    New York, NY
    3 days ago
  •  ...Data Engineer – Operational Risk & GRC (Snowflake) Location: NYC (Onsite) Key Responsibilities: Design and build Snowflake data models for Operational Risk and GRC data Support data needs for: Risk reporting and dashboards KRIs and risk metrics... 

    Georgia IT Inc

    New York, NY
    16 hours ago
  •  ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting Assignment **Onsite Interview Required Position Overview: The graph data engineer is responsible for developing and enhancing Jefferies knowledge graph to empower several applications... 

    3B Staffing LLC

    New York, NY
    4 days ago
  •  ...Data Engineer Open New York City, NY, United States 1 Opening Permanent Skills Required ~5+ years of software engineering experience with 2+ years in data engineering ~ Worked with Python and experience with either Java or Scala ~ Experience with... 
    Permanent employment

    ClifyX

    New York, NY
    3 days ago
  • $130k - $225k

     ...unable to work from either office location or are not willing to relocate will not be considered. About The Role As a Data & Backend Engineer building our Data Platform, you'll design and build our data infrastructure from the ground up: ingestion pipelines that... 
    Work at office
    Relocation
    Flexible hours
    3 days per week

    SafeLease Insurance Services LLC

    New York, NY
    4 days ago
  •  ...Data Engineer Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your... 

    Citigroup Inc

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!