Data Engineer
$165k - $175kRedBeard Solutions
Data Engineer
Boston, Massachusetts, United States Job Openings Data Engineer
Job Title: Data Engineer - AI Platform
Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC
Number of openings: 1
Experience: 5+ years of professional experience as a data engineer
Salary: $165,000 - $175,000
Clearance: Secret (prefer TS)
Position Summary
We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.
You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.
Key Responsibilities
- Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
- Develop and maintain high-quality Python-based data workflows, including testing and validation
- Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
- Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
- Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
- Utilize containerization technologies (Docker) to support scalable and portable deployments
- Contribute to the development and optimization of data systems used by generative AI applications
- Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics
What You'll Experience
- Opportunity to work on high-impact AI platform initiatives
- A fast-paced, performance-driven environment with strong technical mentorship
- Continuous learning through structured development programs and real-world problem solving
- A collaborative culture that values innovation, ownership, and diverse perspectives
- Exposure to globally distributed teams and modern engineering practices
- Competitive compensation along with a comprehensive benefits package
Required Qualifications
- U.S. Citizenship is required
- Prior experience supporting defense or government environments, including handling classified or sensitive data
- Active Secret clearance required (Top Secret or higher preferred)
- 5+ years of experience in data engineering, with a strong focus on cloud-based solutions
Technical Skills & Expertise
- Strong proficiency in Python for data engineering and pipeline development
- Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)
- Deep understanding of data modeling, data ingestion frameworks, and pipeline architecture
- Experience working with knowledge graphs, particularly using Neo4j, and familiarity with relational databases
- Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices
- Practical experience with Docker and containerized workflows
- Strong background in data pipeline performance tuning, monitoring, and troubleshooting
- Excellent analytical and problem-solving capabilities
- Effective communication skills and ability to collaborate within cross-functional teams
$189.59k
...monitoring, alerting tools, dashboards, and frameworks to support data-driven decision-making and manage potential risks. Support... ...analytics systems through continuous performance tuning and re-engineering. Design and implement cloud-native solutions to leverage...SuggestedHourly payRemote work$65 - $70 per hour
...Kelly Gosciminski Location: New York, NY / Hamilton Township, NJ - onsite Duration: 6 months GBaMS ReqID: 10373751 Data Engineer / Support Analyst - Databricks Job Description We are seeking an experienced Data Engineer / Support Analyst with...Suggested$160k - $220k
...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we...SuggestedFull timeWorldwideRelocationFlexible hoursShift workNight shiftDay shift- ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...SuggestedTemporary workWork at officeLocal area3 days per week
- ...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...Suggested
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano - TX / Chicago - IL / NYC - NY / Wilmington - DE (Preferred Location; Hybrid Role; Needs to work 3 days from Office in a week) Job Type: Long Term Contract Responsibilities: Lead the design...Long term contractWork at office
- Job Description Must Have: DBT Core, Snowflake and Python, AWS Airflow, Container services(Docker), Terraform Good to Have: BI tooling experience(Power BI or Tableau), understanding of Agile processes(Kanban or Jira) We need strong person as this position.
$140k - $160k
...Fitch Group is currently seeking a Associate Director/Lead Data Engineer based out of our Chicago office. As a leading, global financial information services provider, Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more...Temporary workWork at officeImmediate startWorldwideShift work2 days per week- ...We are partnered with an established Financial Services firm based in New York. They are hiring a Lead Data Engineer to lead the design and delivery of scalable data pipelines and cloud-based transformation frameworks across its Azure data platform. This is a hands‑on...
$170k - $220k
...Fuel Card built on a cutting-edge spend management platform. About the Role We are looking for a leader of the Coast data engineering team to shape our company's data culture and underlying infrastructure. At Coast, the success of our data platform is driving...Work at officeLocal areaRelocation packageFlexible hours$220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...Local areaRemote workFlexible hours$70 - $85 per hour
...Lead Data Engineer Location: Remote Duration: 6+ months Compensation: $70.00 - 85.00/hr Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S. Summary We are looking for a Lead Data Engineer who excels in data modeling and can build end-to-end data...Contract workLocal areaRemote workFlexible hours- ...Lead Data Engineer – Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10–15...Contract work
- ...Video Visa : USC, GC, GC EAD, H4, L2 This is onsite from day-1 Description : Client needs a forward-thinking Lead Data Engineer willing to work on-site) in New York NY. This opportunity is in the Asset Management/ Financial Services / Investment Management...
$110k - $169k
...real work: We offer generous compensation packages that recognize hard work and excellence. Job Description: The Pricing Data Engineer builds and maintains the data infrastructure and tools that enable consistent, data-driven pricing across the firm while...Full timeWork at office$215.2k - $245.6k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...Full timePart timeInternshipH1bLocal area$97.17k - $126.32k
...Data Engineer NYSTEC is a nonprofit technology consulting company, advising agencies, organizations, institutions, and businesses since 1996. We're independent and vendor-neutral, so we have our clients' best interests at heart. At NYSTEC, we know that we succeed when...Local areaVisa sponsorship- ...issued ID. They are welcome to remove all personal information. All we need to see is just their name and their picture. Data Engineer New York City, NY Responsibilities Required daily participation in highly loaded data transformations. Manage...
- ...Data Engineer III The Data Engineer III will play a pivotal role in designing, developing, and maintaining the data architecture for our organization. This individual will be responsible for T-SQL development, ETL processes, and Python scripting to ensure efficient...
$100k
...also advises on citywide strategic and capital planning, analyzes data, conducts policy analysis, and creates open data and civic... ...The division is comprised of experienced and talented software engineers, geographic specialists, service engineers, and technology leaders...Full time$116k - $152.25k
...THE POSITION Our roster has an opening with your name on it We are looking for a Data Engineer to join our growing data platform team and take end-to-end ownership of designing, building, and scaling the foundational data infrastructure that powers analytics, machine...Temporary workLocal areaWorldwide$120k - $160k
...Data Engineer Los Angeles; New York; Remote; San Francisco EDO is the TV outcomes company. Our leading measurement platform connects convergent TV airings to the ad-driven consumer behaviors most predictive of future sales. EDO empowers the advertising industry to...Full timeWork experience placementWork at officeImmediate startRemote workFlexible hours$120k - $150k
...Data Engineer New York, New York, United States Courier Health is on a mission to solve one of the biggest and most meaningful opportunities in healthcare: reinvent how people living with chronic and rare diseases are supported. We are building the future of patient...$320k - $405k
...Analytics Engineer Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial... ...As an Analytics Engineer, you will be an early member of the Data Science & Analytics team building the foundation to scale...Work at officeVisa sponsorshipFlexible hours- ...Data Engineer As a Data Engineer at Client, you will develop a deep understanding of the company's diverse data landscape and collaborate closely with cross-functional teams to gather requirements and deliver data-driven solutions. You will be responsible for providing...
- ...Data Engineer – Operational Risk & GRC (Snowflake) Location: NYC (Onsite) Key Responsibilities: Design and build Snowflake data models for Operational Risk and GRC data Support data needs for: Risk reporting and dashboards KRIs and risk metrics...
- ...Graph Data Engineer NYC, NY - 3 days on site Long Term Consulting Assignment **Onsite Interview Required Position Overview: The graph data engineer is responsible for developing and enhancing Jefferies knowledge graph to empower several applications...
- ...Data Engineer Open New York City, NY, United States 1 Opening Permanent Skills Required ~5+ years of software engineering experience with 2+ years in data engineering ~ Worked with Python and experience with either Java or Scala ~ Experience with...Permanent employment
$130k - $225k
...unable to work from either office location or are not willing to relocate will not be considered. About The Role As a Data & Backend Engineer building our Data Platform, you'll design and build our data infrastructure from the ground up: ingestion pipelines that...Work at officeRelocationFlexible hours3 days per week- ...Data Engineer Discover your future at Citi Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- junior data engineer remote New York, NY
- data engineering intern summer New York, NY
- hadoop big data developer New York, NY
- junior data developer New York, NY
- senior data quality engineer New York, NY
- aws data engineer New York, NY
- associate data engineer New York, NY
- staff data engineer New York, NY
- data engineer New York, NY
- finance data engineer New York, NY


