Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

$165k - $175k

Redbeard Solutions

Data Engineer

Boston, Massachusetts, United States Job Openings Data Engineer

Job Title: Data Engineer - AI Platform

Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC

Number of openings: 1

Experience: 5+ years of professional experience as a data engineer

Salary: $165,000 - $175,000

Clearance: Secret (prefer TS)

Position Summary

We are hiring a skilled Data Engineer to contribute to the development of a sophisticated AI-powered platform that supports advanced, data-driven solutions. This role offers the opportunity to work on cutting-edge initiatives involving generative AI, large-scale data systems, and cloud-native architectures.

You will partner with a multidisciplinary team of engineers, data scientists, and product stakeholders to design and implement scalable data infrastructure. The primary focus will be enabling platform capabilities tailored for government and defense-related environments.

Key Responsibilities
  • Design and build robust data ingestion and processing pipelines to support AI and GenAI applications
  • Develop and maintain high-quality Python-based data workflows, including testing and validation
  • Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers
  • Implement and enhance CI/CD pipelines (including GitHub Actions) to streamline deployment and integration processes
  • Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial)
  • Utilize containerization technologies (Docker) to support scalable and portable deployments
  • Contribute to the development and optimization of data systems used by generative AI applications
  • Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics
What You'll Experience
  • Opportunity to work on high-impact AI platform initiatives
  • A fast-paced, performance-driven environment with strong technical mentorship
  • Continuous learning through structured development programs and real-world problem solving
  • A collaborative culture that values innovation, ownership, and diverse perspectives
  • Exposure to globally distributed teams and modern engineering practices
  • Competitive compensation along with a comprehensive benefits package
Required Qualifications
  • U.S. Citizenship is required
  • Prior experience supporting defense or government environments, including handling classified or sensitive data
  • Active Secret clearance required (Top Secret or higher preferred)
  • 5+ years of experience in data engineering, with a strong focus on cloud-based solutions
Technical Skills & Expertise
  • Strong proficiency in Python for data engineering and pipeline development
  • Hands-on experience with AWS-based data engineering (experience with Azure or GCP is a plus)
  • Deep understanding of data modeling, data ingestion frameworks, and pipeline architecture
  • Experience working with knowledge graphs, particularly using Neo4j, and familiarity with relational databases
  • Expertise in writing clean, maintainable, and testable code, including automation and error handling best practices
  • Practical experience with Docker and containerized workflows
  • Strong background in data pipeline performance tuning, monitoring, and troubleshooting
  • Excellent analytical and problem-solving capabilities
  • Effective communication skills and ability to collaborate within cross-functional teams
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Chicago, IL vacancy
  • $180k - $200k

     ...harborcapital.com/careers, search for this position and click on "Apply" to start your application!Role DescriptionWe are seeking a Lead Data Engineer to drive the design, architecture, and delivery of scalable data platforms, AI-powered data products, and enterprise-grade data... 
    Suggested
    Full time
    Work at office

    Harbor Funds

    Chicago, IL
    2 days ago
  • $106.5k - $182.6k

     ...build-up and operationalization of an enterprise-class modern data environment, which may include various components within the Azure...  ...existing data pipelines on-prem, cloud and business engineering extractProvide technical support to meet application service level... 
    Suggested
    Full time
    Temporary work
    Part time

    Alliant Credit Union

    Chicago, IL
    2 days ago
  • $100.79k - $160.26k

     ...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into... 
    Suggested
    Full time
    Work at office
    Remote work
    Relocation
    Visa sponsorship
    Relocation package

    DLA Piper

    Chicago, IL
    12 hours ago
  • $150k - $200k

     ...Ethan HudsonEmail: ****@*****.***: (***) ***-****Data Engineer - Quantitative Trading SystemsLocation: Chicago, IL (Preferred)...  ...New York, NYAbout the Opportunity We are seeking a high-caliber Data Engineer to join a premier global proprietary trading firm. This... 
    Suggested
    Flexible hours

    Objective Paradigm

    Chicago, IL
    4 days ago
  • $150k - $200k

     ...expectations, integrity, innovation and a willingness to challenge consensus.About the TeamThe DRW Cumberland & FICC Options Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work... 
    Suggested
    Temporary work
    Flexible hours

    DRW

    Chicago, IL
    5 days ago
  • $89.21k - $144.96k

     ...happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.As a Data Engineer on the Platform Data Engineering team, you will be responsible for developing Python data pipelines that build business data... 
    Full time
    Part time
    Flexible hours

    Caterpillar

    Chicago, IL
    1 day ago
  •  ...maintain highly scalable, available, secure, and elastic cloud-ready data solutions using cutting-edge technologies to support our...  ...information science or a related field preferred.3+ years in data engineering building production data pipelines (batch and/or streaming)... 
    Relocation package

    HAVI Logistics

    Chicago, IL
    2 days ago
  • $100.96k - $151.44k

    Data Engineer - GE08AEWe’re determined to make a difference and are proud to be an insurance company that goes well beyond coverages and policies. Working here means having every opportunity to achieve your goals - and to help others accomplish theirs, too. Join our team... 
    Full time
    Temporary work
    Work at office
    3 days per week

    The Hartford Financial Services Group

    Chicago, IL
    3 days ago
  •  ...we Advance Human Ability, together.Job Description SummaryJob DescriptionData Engineers for Chicago, IL location.Develop secure, stable, scalable long-term plans for the flow of hospital data.Assist in the development of scalable data infrastructure and platforms to collect... 
    Full time
    Remote work

    Shirley Ryan AbilityLab

    Chicago, IL
    2 days ago
  • $74.07k - $133.9k

     ...Work closely with various business, IT, Analyst and Data Science groups to collect business requirements. Develop, deploy...  ...lineage and operational metadata. Troubleshoot and resolve data engineering issues as they arise. ***Applicants must be currently authorized... 
    Full time
    Work at office
    Visa sponsorship
    Work visa
    Flexible hours

    Covista

    Chicago, IL
    13 hours ago
  • $90k - $200k

     ..., and government agencies, a list that spans across the country.Job DescriptionCapTech Machine Learning Engineers are responsible for designing and implementing data-driven solutions for our clients, with a specific focus on building and deploying scalable machine learning... 
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    CapTech

    Chicago, IL
    12 hours ago
  • $134.5k - $265.1k

    Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant...  ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions... 
    Local area
    Visa sponsorship

    Deloitte

    Chicago, IL
    8 hours ago
  • Job ID: 25659978Reference Number: 25-00597Title: Data Analyst EngineerPosted Date: 2025-06-06Company: HAN Staffing Position : Data Analyst Engineer Location : Jersey City, Wilmington, Chicago, Plano, Seattle, Palo Alto. Contract : w2 Job Description: Experience : 7+ Experience... 
    Contract work

    HAN Staffing

    Chicago, IL
    1 day ago
  • $95k - $150k

     ...you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Senior Data Engineer you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel... 
    Permanent employment

    Deloitte

    Chicago, IL
    4 days ago
  • $120k - $130k

     ...leadership team at a time. Additional information on the firm can be found at .The RoleWe are seeking a highly skilled, hands‑on Senior Data Engineer with 4-5 years of experience to help shape and scale our data foundation in support of Heidrick & Struggles’ mission to... 
    Full time
    Work experience placement

    Heidrick & Struggles International

    Chicago, IL
    1 day ago
  • We are seeking a hands-on Senior Data Engineer to support Phase 0 data discovery, profiling, mapping, and engineering handoff activities for a large-scale customer data and marketing transformation initiative. This role will work closely with Data Strategists, Solution... 
    Hourly pay
    Freelance

    Solomon Page

    Chicago, IL
    2 days ago
  • $200k - $250k

     ...United StatesIndustry: Trading FirmPosted: 2026-07-28Contact: Ethan HudsonEmail: ****@*****.***: (***) ***-****Senior Data Engineer - Core Data PlatformLocation: Chicago, IL or New York, NY (Hybrid)About the OpportunityAre you ready to architect high-... 
    Temporary work
    Flexible hours

    Objective Paradigm

    Chicago, IL
    12 hours ago
  • THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham... 
    Work at office

    Harnham

    Chicago, IL
    4 days ago
  • Reporting to the Director of Business Intelligence, you will influence and grow our Business Intelligence practice by developing data engineering pipelines and analytic solutions that support our Advanced Analytics and Data Science teams. You will partner with... 
    Full time
    Work at office
    Local area
    Flexible hours

    Conagra Brands

    Chicago, IL
    5 days ago
  • $150k - $200k

     ...up. Our trading models and software systems are continually re-engineered, optimized, and maintained to stay on top of the industry. This...  ...continued success. Belvedere Trading is looking for a proven Senior Data Engineer to work directly with our trading desks to improve... 
    Full time

    Belvedere Trading

    Chicago, IL
    2 days ago
  •  ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Sr. Data Engineer Location(s): Chicago, IL (Hybrid) Key Skills: AWS (EMR, DynamoDB, S3, Lambda), Python, PySpark, Databricks, SQL Overview: We... 
    Local area
    Remote work

    Ampcus

    Chicago, IL
    5 days ago
  •  ...on innovation and automation, IBKR provides clients with access to over 150 markets across 200+ countries and territories. We are a data-driven organization that leverages cutting-edge technology to deliver best-in-class trading solutions, and our teams thrive in a fast... 
    Work at office
    Remote work

    Interactive Brokers

    Chicago, IL
    4 days ago
  • $120k - $160k

     ...opportunities to learn from peers in person, while also providing the flexibility needed for a meaningful work-life balance.Being a Senior Data Engineer at iManage Means…You get excited about data, and you believe in the democratization of data to support data-driven decision... 
    Work at office
    Local area
    Worldwide
    Flexible hours
    2 days per week

    Imanage

    Chicago, IL
    3 days ago
  • $137.4k - $161.7k

    Are you ready to make an impact?West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies... 
    Local area
    Immediate start
    Flexible hours

    West Monroe Partners

    Chicago, IL
    8 hours ago
  • $100k - $150k

     ...retail-focused trading platform in the world. What you'll do:Your data-driven mindset and ability to work with large-scale data systems...  ...opportunities, and improve processes. As an accomplished data engineer joining the Data & Analytics team, this is a terrific opportunity... 
    Work at office
    Remote work
    Worldwide
    Monday to Friday
    Flexible hours

    NinjaTrader Group

    Chicago, IL
    12 hours ago
  • $140k - $180k

     ...our team as we help shape a brighter way forward. About JLL and Data EngineeringJLL is a leading professional services firm that...  ...tomorrow for our clients, our people, and our communities.The Data Engineering team at JLL sits at the intersection of technology and business... 
    Full time
    Local area
    Shift work

    Jones Lang LaSalle

    Chicago, IL
    2 days ago
  • Newmark Group, Inc. (Nasdaq: NMRK), together with its subsidiaries ("Newmark"), is a world leading commercial real estate advisor and service provider to large institutional investors and other owners, global corporations and other occupiers, and lenders. Built with purpose...
    Full time

    Newmark

    Chicago, IL
    12 hours ago
  • Sr Data Engineering Architect Our talented Data & AI team is made up of globally recognized experts - and there's room for more analytical and ambitious data professionals. If you're passionate about helping clients transform their business with the latest AI and data... 

    Avanade

    Chicago, IL
    5 days ago
  •  ...Lead Data Engineer Firm Overview Hinshaw & Culbertson LLP is a national law firm with more than 500 attorneys and professionals across the United States. Founded in 1934 and headquartered in Chicago, the firm provides sophisticated legal counsel to clients in highly... 
    Casual work
    Remote work

    Hinshaw & Culbertson

    Chicago, IL
    3 days ago
  • $98k - $182k

     ...Epsilon Activation Delivery Platform Engineer The Epsilon Activation Delivery Platform team builds the core framework and connectors...  ...Connected TV publishers (LG, Samsung), your work directly connects our data ecosystem to the biggest platforms in the world. This role... 
    Local area
    Flexible hours

    Digitas

    Chicago, IL
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!