Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. IT Big Data Developer

Jobleads-US

TO-BH-3 Sr. IT Big Data Developer (Data Architect/Engineer)

Location: Washington, DC (100% On-site)
Client: Federal Reserve Board (Division of Research & Statistics)
Employment Type: Full-Time Contract
Period of Performance: July 27, 2026 – December 31, 2026 (Extension Possible)
Citizenship Requirement: U.S. Citizenship Required

About Diverse Agile Solutions

Diverse Agile Solutions (DAS) is a certified Minority Business Enterprise (MBE) providing innovative IT consulting, cloud, cybersecurity, software engineering, and data analytics solutions to federal, state, and commercial organizations. Our team partners with government agencies to modernize enterprise technology, improve mission outcomes, and deliver exceptional customer service.

At DAS, we invest in talented professionals who thrive on solving complex technical challenges while making a meaningful impact.

Position Overview

Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) organization within the Division of Research & Statistics.

The DATA team is responsible for transforming how economic research data is collected, managed, integrated, analyzed, and visualized across the organization.

This position is ideal for an experienced Data Architect and Data Engineer who enjoys designing scalable enterprise data platforms, building modern data pipelines, optimizing large-scale data processing systems, and supporting data-driven research initiatives.

The successful candidate will collaborate closely with economists, data scientists, researchers, and software engineers to design next-generation data architecture supporting critical economic policy research.

Key Responsibilities

  • Design and implement scalable enterprise data architectures supporting research and analytics initiatives.
  • Develop, optimize, and maintain enterprise data pipelines and automated ETL/ELT workflows.
  • Design conceptual, logical, and physical data models.
  • Build highly scalable data processing frameworks capable of supporting large datasets.
  • Develop data integration solutions for structured and unstructured data sources.
  • Optimize database performance across enterprise environments.
  • Design enterprise data lake and data warehouse solutions.
  • Implement Change Data Capture (CDC) methodologies.
  • Develop workflow orchestration using tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
  • Support migration of data platforms between on-premises and cloud environments.
  • Perform root cause analysis of data quality and business process issues.
  • Collaborate with economists and technical teams to deliver trusted, high-quality data assets.
  • Develop software solutions supporting enterprise data services.
  • Participate in application testing, deployment, and production support.
  • Build and maintain CI/CD pipelines supporting DataOps initiatives.
  • Document architecture, standards, and technical designs.
  • Recommend improvements to enterprise data strategy and governance.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
  • Minimum 7 years of professional experience in Data Engineering, Data Architecture, or Big Data Development.
  • Advanced experience developing complex SQL solutions.
  • Extensive experience with relational databases including:
    • PostgreSQL
    • Microsoft SQL Server
    • MySQL
  • Advanced programming experience with:
    • Python
    • R
  • Experience designing scalable enterprise data platforms.
  • Experience building automated ETL/ELT pipelines.
  • Experience developing scalable data processing solutions.
  • Experience with GitLab and/or GitHub source control.
  • Experience working in Linux environments.
  • Strong software engineering background including development, testing, and deployment.
  • Excellent written and verbal communication skills.
  • Strong analytical and troubleshooting abilities.

Preferred Qualifications

Experience with one or more of the following technologies is highly desirable:

Data Engineering

  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions

Cloud Platforms

  • Amazon Web Services (AWS)
  • Microsoft Azure
  • Snowflake

Enterprise Data Technologies

  • Enterprise Data Lakes
  • Data Warehouses
  • CDC (Change Data Capture)
  • DataOps
  • CI/CD Pipelines

Big Data

  • Distributed Computing
  • Large Scale Data Processing
  • High-Volume Data Optimization

Additional Technologies

  • NoSQL Databases
  • Graph Databases
  • Machine Learning
  • Java
  • Scala
  • JavaScript
  • Perl

Domain Experience

  • Time Series Data
  • Forecasting Analytics
  • Economic Research
  • Financial Data
  • Research Organizations

Technical Skills

Programming Languages

  • Python
  • R
  • SQL
  • Java (Preferred)
  • Scala (Preferred)
  • JavaScript (Preferred)
  • Perl (Preferred)

Databases

  • PostgreSQL
  • Microsoft SQL Server
  • MySQL
  • NoSQL
  • Graph Databases

Cloud

  • AWS
  • Microsoft Azure
  • Snowflake

Data Engineering

  • ETL / ELT
  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions
  • Data Lakes
  • Data Warehouses
  • Change Data Capture (CDC)
  • DataOps
  • CI/CD

Tools

  • GitLab
  • GitHub
  • Linux

Why Join Diverse Agile Solutions?

At DAS, you'll work alongside highly skilled professionals supporting one of the nation's most respected financial institutions. You'll contribute to enterprise-scale modernization initiatives that directly support economic research and national financial policy.

We offer:

  • Challenging, mission-critical projects
  • Collaborative technical teams
  • Opportunities to work with modern cloud and data technologies
  • Professional growth and career development
  • Competitive compensation

Work Location

On-site

Federal Reserve Board
Washington, DC

Equal Opportunity Employer

Diverse Agile Solutions is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity, or any other status protected by applicable law.

BreezyHR Knockout Questions

  1. Are you a U.S. Citizen?
  2. Are you able to work 100% on-site in Washington, DC?
  3. Do you have at least 7 years of experience in Data Engineering or Data Architecture?
  4. How many years of professional Python experience do you have?
  5. How many years of advanced SQL development experience do you have?
  6. Have you designed enterprise ETL/ELT data pipelines?
  7. Which cloud platforms have you used professionally? (AWS, Azure, Snowflake)
  8. Have you worked with Apache Airflow, Prefect, Dagster, or AWS Step Functions?
  9. Have you designed enterprise data warehouse or data lake solutions?
  10. Do you have experience supporting research, economic, or financial data environments?
  11. Have you worked with PostgreSQL, SQL Server, and MySQL?
  12. What is your earliest available start date?
#J-18808-Ljbffr Jobleads-US
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Sr. IT Big Data Developer in Washington DC vacancy
  •  ...Business Systems Inc. is a quickly developing worldwide System Integrator,...  ...and Product Development, IT Outsourcing and Technology assistance...  ..., Business Intelligence, Data Management, SOA, BPM, Data Warehousing...  ...or emerging trends such as Big Data, Columnar databases,... 
    Senior
    Big data
    Local area
    Worldwide

    USM Systems

    Washington DC
    2 days ago
  • $180k - $200k

     ...DescriptionEverforth ECS is seeking a Sr. Data and AI Engineer to work in our...  ...'s degree10+ years of IT experience including experience...  ...customer needs Ability to develop a roadmap that links the deployment...  ..., Data Warehousing and Big Data tools, Data Analytics and... 
    Senior
    Big data
    Work at office

    ECS Federal

    Arlington, VA
    3 days ago
  •  ...Big Data EngineerLocation: Arlington, VA (3 Days onsite/week)Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable itExperience building robust and efficient... 
    Senior
    Big data
    3 days per week

    Futran Tech Solutions Pvt. Ltd.

    Arlington, VA
    3 days ago
  •  ...Data EngineerAs part of the Data Management area, the Data Engineer will provide leadership...  ....Leads projects and small teams of ETL developers/engineers on complex effortsAssists in...  ...stream processing, and highly scalable ‘big data’ data stores. Experience supporting... 
    Senior
    Big data

    Software Technology Inc

    Washington DC
    3 days ago
  • $130k - $160k

     ...best-in-class artificial intelligence and big data analytics capabilities. Our capabilities...  ...opportunity for a Senior Data Analytics Developer supporting a contract with the Navy. This...  ...and working within regulated government IT environments. ~ Strong experience with... 
    Senior
    Big data
    Full time
    Contract work
    Part time
    Local area
    Flexible hours

    Greystones Consulting Group LLC

    Washington DC
    5 days ago
  •  ...Data EngineerLooking for a data engineer. Skills include:AWSPythonKafkaFlinkRequired skills, basic qualification, additional skills, background check, candidate must be your W2 employee, interview process, additional keywords, degree requirements, certification requirement... 
    Senior
    Big data

    Samprasoft

    McLean, VA
    3 days ago
  •  ...Senior IT Data EngineerAmpcus Inc. is a certified global provider of a broad range of Technology...  ...and manage cloud-based data and big data systems including: Amazon Aurora, Snowflake...  ...Data Engineer - AssociateAWS Developer – AssociateExperience:Experience with RDBMs... 
    Senior
    Big data

    Ampcus

    Washington DC
    3 days ago
  • $103.8k - $218.1k

    Job Title: Senior Data EngineerJob Category: Information TechnologyTime Type: Full timeMinimum...  ...The Opportunity:CACI is seeking a talented Sr. Data Engineer to join our dynamic team....  ...architecture, data warehousing, ETL processes and big data technologies. The Data Engineer will... 
    Senior
    Big data
    Contract work
    Work experience placement
    Flexible hours

    CACI International

    Arlington, VA
    8 hours ago
  •  ...Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join a dynamic team...  ...have a strong background in designing, developing, and maintaining scalable ETL data pipelines...  ...platforms, leveraging cloud services and big data technologies.Responsibilities:Design... 
    Senior
    Big data

    Kaav Inc.

    Washington DC
    3 days ago
  • $115k - $150k

     ...stronger results for our clients.As a Senior Data Engineer, you will architect, build, and...  ...Pipelines & ETL Development:Architect and develop end-to-end ETL/ELT pipelines for...  ...BigQuery, Dataflow)Hands-on experience with big data tools:Apache Spark, Kafka, Airflow, dbt... 
    Senior
    Big data
    Full time
    Visa sponsorship

    Insomniac Design

    Washington DC
    15 hours ago
  • $135k - $165k

     ...As a Senior Associate Data Engineer, you will be responsible for designing, developing, and maintaining scalable Big Data solutions. You will work with large datasets, real-time processing frameworks, and cloud-based data platforms to enable data-driven decision-making... 
    Senior
    Big data

    Sapient

    Arlington, VA
    5 days ago
  •  ...Data ArchitectSpear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support our nation...  ...obtain CI PolygraphExpertise in distributed computing frameworks and big data technologiesAdvanced knowledge of database systems, data... 
    Senior
    Big data
    Full time
    Remote work
    Home office
    Relocation package
    Flexible hours

    Spear AI

    Washington DC
    3 days ago
  • $140k - $220k

     ...fast.About the Role:We are seeking an experienced Sr Software Engineer to join our fast-paced, collaborative data team. In this role, you will have broad authority...  ...opportunity to solve challenging problems and make a big impact as we invest in making technographics a... 
    Senior
    Big data
    Worldwide

    ZoomInfo

    Bethesda, MD
    2 days ago
  •  ...Diverse Agile Solutions is seeking a Senior IT Big Data Developer to support the Federal Reserve Board's DATA program in Washington, DC. The role focuses on designing scalable data architectures, building modern data pipelines, and enabling data-driven economic research... 
    Senior
    Big data

    Jobleads-US

    Washington DC
    5 hours ago
  • $140k - $180k

     ...Senior Data EngineerWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks...  ...with experience in tools such as:Big data tools: Databricks, Apache Spark,... 
    Senior
    Big data

    Steampunk.com

    Washington DC
    2 days ago
  •  ...Big Data EngineerOur client is seeking an experienced Big Data Engineer to design, develop, and support large-scale data pipelines and transformation processes. The ideal candidate will have strong SQL, Python, ETL/ELT, and data engineering experience, along with the... 
    Senior
    Big data

    Omniscius

    Washington DC
    2 days ago
  •  ...Senior Data EngineerActifai is seeking experienced Senior Data Engineers.Actifai is an AI company helping broadband and telecom providers...  ...impact.You will work with engineers to build and operate a big data platform that processes and refines data and enables efficient... 
    Senior
    Big data
    Work experience placement
    Work at office
    Remote work

    Actifai

    Washington DC
    3 days ago
  •  ...Senior Data EngineerPublicis Sapient is a digital transformation partner helping established organizations get to their...  .../ Lead Engineer, you will be responsible for designing, developing, and maintaining scalable Big Data solutions. You will work with large datasets, real-... 
    Senior
    Big data
    Contract work

    Prodigious Worldwide

    Arlington, VA
    2 days ago
  •  ...Analyzes unstructured and semi-structured data, applying creativity to large-scale analysis...  ..., making discoveries in the realm of big data. Requires strong technical and computational...  ...strategic decision-making. Design, develop, and deploy advanced machine learning solutions... 
    Senior
    Big data

    Pyramid Systems, Inc.

    Washington DC
    2 days ago
  •  ...Role Overview  We are looking for a Senior Data Engineer (15+ years) with deep hands-on experience in database development, Oracle PL...  ...and design skills in MS SQL Server and Oracle.  ~ Experience with Big Data architecture concepts, data sourcing, ingestion, curation,... 
    Senior
    Big data

    Papigen

    Washington DC
    24 days ago
  • $106.9k - $176.5k

     ...Government and Public Sector - Technology Consulting - AI & Data - GenAI Developer - Senior ConsultantFrom strategy to execution, the Government...  ...working world.​​​​EY delivers unparalleled service in big data, business intelligence, and digital analytics built on... 
    Senior
    Big data
    For contractors
    Summer holiday
    Work at office
    Local area
    Flexible hours

    EY (Ernst & Young)

    McLean, VA
    4 days ago
  • $107.9k - $195.05k

     ...team at the forefront of federal IT modernization, delivering real...  ...maintains scalable, reliable data systems and pipelines to ingest...  ...with React, JavaScript, and HTML.Develops and manages data warehouses and...  ...environments.Experience with big data technologies and platforms... 
    Big data
    Full time
    Remote work

    Leidos

    Washington DC
    8 hours ago
  • $105k - $215k

     ...Careers. Senior Engineer - Data Position Summary GEICO is seeking...  ...transition from a traditional IT model to a tech organization...  ...Advanced programming experience and big data experience within Python,...  ...algorithms ~ Knowledge of developer tooling across the data... 
    Senior
    Big data
    Hourly pay
    Work experience placement
    Local area
    Shift work

    Jobleads-US

    Bethesda, MD
    2 days ago
  • $70k - $140k

     ...best-in-class artificial intelligence and big data analytics capabilities. Our capabilities...  ...research objectives, identify data sources, and develop analysis plans. Work with teams of...  ...Ability to coordinate effectively with IT and platform teams Minimum three (3)... 
    Senior
    Big data
    Permanent employment
    Remote work
    Flexible hours

    Greystones Consulting Group LLC

    Washington DC
    9 days ago
  • $150k - $200k

     ...and let’s redefine the future together. About the job As a Sr. Data Scientist, you will play a pivotal role in analyzing large...  ...programming languages (Python, C,C++, Java, SQL) Familiarity with Big Data frameworks and visualization tools (Cassandra, Hadoop, Spark... 
    Senior
    Big data
    Internship
    Live in
    Work at office

    US AI

    Silver Spring, MD
    5 days ago
  •  ...Description Vivo HealthStaff is recruiting for a Data Scientist with TS/SCI Clearance in the...  ...:Utilize the company's AI platform to develop and deploy production-ready solutions.Own...  ...implementation.Work with customer data and big data frameworks (e.g., Databricks) to... 
    Senior
    Big data
    Full time
    Immediate start

    Vivo HealthStaff

    Washington DC
    a month ago
  • $90k - $120k

     ...Systems comprises cyber and mission IT; electronic warfare; and C5ISR...  ...of national defense - the data evolution - by accelerating a...  ...range from C5ISR, AI and Big Data, cyber operations and synthetic...  ...candidates are expert Python developers with strong relational... 
    Senior
    Big data
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Worldwide
    Home office

    HII Mission Technologies Division

    Arlington, VA
    4 days ago
  •  ...Senior Big Data/Machine Learning EngineerOur client, a Financial company, is looking for a Senior Big Data/Machine Learning Engineer for their McLean, VA location. Responsibilities:RISK - AMLNexus is a data engineering team, that provides Customer data, Transaction, data... 
    Senior
    Big data

    ICONMA

    McLean, VA
    2 days ago
  • $125k - $165k

    OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines....  ...Data Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL... 
    Senior
    Big data

    Steampunk

    McLean, VA
    2 days ago
  • $125k - $165k

    OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines...  ...Data Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake,... 
    Senior
    Big data

    Steampunk

    McLean, VA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. IT Big Data Developer. Be the first to apply!