Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sr. IT Big Data Developer

Full-time

Diverse Agile Solutions

TO-BH-3 Sr. IT Big Data Developer (Data Architect/Engineer)

Location: Washington, DC (100% On-site)
Client: Federal Reserve Board (Division of Research & Statistics)
Employment Type: Full-Time Contract
Period of Performance: July 27, 2026 – December 31, 2026 (Extension Possible)
Citizenship Requirement: U.S. Citizenship Required

About Diverse Agile Solutions

Diverse Agile Solutions (DAS) is a certified Minority Business Enterprise (MBE) providing innovative IT consulting, cloud, cybersecurity, software engineering, and data analytics solutions to federal, state, and commercial organizations. Our team partners with government agencies to modernize enterprise technology, improve mission outcomes, and deliver exceptional customer service.

At DAS, we invest in talented professionals who thrive on solving complex technical challenges while making a meaningful impact.

Position Overview

Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) organization within the Division of Research & Statistics.

The DATA team is responsible for transforming how economic research data is collected, managed, integrated, analyzed, and visualized across the organization.

This position is ideal for an experienced Data Architect and Data Engineer who enjoys designing scalable enterprise data platforms, building modern data pipelines, optimizing large-scale data processing systems, and supporting data-driven research initiatives.

The successful candidate will collaborate closely with economists, data scientists, researchers, and software engineers to design next-generation data architecture supporting critical economic policy research.

Key Responsibilities

  • Design and implement scalable enterprise data architectures supporting research and analytics initiatives.
  • Develop, optimize, and maintain enterprise data pipelines and automated ETL/ELT workflows.
  • Design conceptual, logical, and physical data models.
  • Build highly scalable data processing frameworks capable of supporting large datasets.
  • Develop data integration solutions for structured and unstructured data sources.
  • Optimize database performance across enterprise environments.
  • Design enterprise data lake and data warehouse solutions.
  • Implement Change Data Capture (CDC) methodologies.
  • Develop workflow orchestration using tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
  • Support migration of data platforms between on-premises and cloud environments.
  • Perform root cause analysis of data quality and business process issues.
  • Collaborate with economists and technical teams to deliver trusted, high-quality data assets.
  • Develop software solutions supporting enterprise data services.
  • Participate in application testing, deployment, and production support.
  • Build and maintain CI/CD pipelines supporting DataOps initiatives.
  • Document architecture, standards, and technical designs.
  • Recommend improvements to enterprise data strategy and governance.

Required Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
  • Minimum 7 years of professional experience in Data Engineering, Data Architecture, or Big Data Development.
  • Advanced experience developing complex SQL solutions.
  • Extensive experience with relational databases including:

    • PostgreSQL
    • Microsoft SQL Server
    • MySQL
  • Advanced programming experience with:

    • Python
    • R
  • Experience designing scalable enterprise data platforms.
  • Experience building automated ETL/ELT pipelines.
  • Experience developing scalable data processing solutions.
  • Experience with GitLab and/or GitHub source control.
  • Experience working in Linux environments.
  • Strong software engineering background including development, testing, and deployment.
  • Excellent written and verbal communication skills.
  • Strong analytical and troubleshooting abilities.

Preferred Qualifications

Experience with one or more of the following technologies is highly desirable:

Data Engineering

  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions

Cloud Platforms

  • Amazon Web Services (AWS)
  • Microsoft Azure
  • Snowflake

Enterprise Data Technologies

  • Enterprise Data Lakes
  • Data Warehouses
  • CDC (Change Data Capture)
  • DataOps
  • CI/CD Pipelines

Big Data

  • Distributed Computing
  • Large Scale Data Processing
  • High-Volume Data Optimization

Additional Technologies

  • NoSQL Databases
  • Graph Databases
  • Machine Learning
  • Java
  • Scala
  • JavaScript
  • Perl

Domain Experience

  • Time Series Data
  • Forecasting Analytics
  • Economic Research
  • Financial Data
  • Research Organizations

Technical Skills

Programming Languages

  • Python
  • R
  • SQL
  • Java (Preferred)
  • Scala (Preferred)
  • JavaScript (Preferred)
  • Perl (Preferred)

Databases

  • PostgreSQL
  • Microsoft SQL Server
  • MySQL
  • NoSQL
  • Graph Databases

Cloud

  • AWS
  • Microsoft Azure
  • Snowflake

Data Engineering

  • ETL / ELT
  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions
  • Data Lakes
  • Data Warehouses
  • Change Data Capture (CDC)
  • DataOps
  • CI/CD

Tools

  • GitLab
  • GitHub
  • Linux

Why Join Diverse Agile Solutions?

At DAS, you'll work alongside highly skilled professionals supporting one of the nation's most respected financial institutions. You'll contribute to enterprise-scale modernization initiatives that directly support economic research and national financial policy.

We offer:

  • Challenging, mission-critical projects
  • Collaborative technical teams
  • Opportunities to work with modern cloud and data technologies
  • Professional growth and career development
  • Competitive compensation

Work Location

On-site

Federal Reserve Board
Washington, DC

Equal Opportunity Employer

Diverse Agile Solutions is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity, or any other status protected by applicable law.

BreezyHR Knockout Questions

  1. Are you a U.S. Citizen?
  2. Are you able to work 100% on-site in Washington, DC?
  3. Do you have at least 7 years of experience in Data Engineering or Data Architecture?
  4. How many years of professional Python experience do you have?
  5. How many years of advanced SQL development experience do you have?
  6. Have you designed enterprise ETL/ELT data pipelines?
  7. Which cloud platforms have you used professionally? (AWS, Azure, Snowflake)
  8. Have you worked with Apache Airflow, Prefect, Dagster, or AWS Step Functions?
  9. Have you designed enterprise data warehouse or data lake solutions?
  10. Do you have experience supporting research, economic, or financial data environments?
  11. Have you worked with PostgreSQL, SQL Server, and MySQL?
  12. What is your earliest available start date?
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Sr. IT Big Data Developer in Washington DC vacancy
  • $103.8k - $218.1k

     ...Job Title: Sr. Data Engineer Job Category: Information Technology Time Type: Full time Minimum...  ..., data warehousing, ETL processes, and big data technologies. The Sr. Data Engineer...  ...SQL Database, or Azure Synapse Analytics. Develop and maintain data pipelines using Azure... 
    Senior
    Big data
    Full time
    Local area
    Flexible hours

    CACI International

    Arlington, VA
    6 hours ago
  •  ...Data Engineer As part of the Data Management area, the Data Engineer will provide leadership...  ...Leads projects and small teams of ETL developers/engineers on complex efforts Assists...  ...stream processing, and highly scalable ‘big data’ data stores. Experience supporting... 
    Senior
    Big data

    Software Technology Inc

    Washington DC
    2 days ago
  •  ...best‑in‑class artificial intelligence and big data analytics capabilities. Our capabilities...  ...opportunity for a Senior Data Analytics Developer supporting a contract with the Navy. This...  ...and working within regulated government IT environments. Strong experience with full... 
    Senior
    Big data
    Contract work
    Flexible hours

    Greystones Consulting Group LLC

    Washington DC
    3 days ago
  •  ...Senior Data Engineer We are seeking a seasoned Senior Data Engineer to join a dynamic...  ...have a strong background in designing, developing, and maintaining scalable ETL data pipelines...  ...platforms, leveraging cloud services and big data technologies. Responsibilities... 
    Senior
    Big data

    Samprasoft

    Washington DC
    3 days ago
  •  ...technologies supporting the organization’s data analysis and analytics infrastructure. As...  ...requirements into effective data models. Design and develop scalable data models, including relational...  .... Architect and implement next-generation big data analytics frameworks. Expand and... 
    Senior
    Big data

    University of Maryland Medical System

    Silver Spring, MD
    4 days ago
  •  ...Data Engineering Lead Spear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support...  ...Polygraph ~ Expertise in distributed computing frameworks and big data technologies ~ Advanced knowledge of database systems, data... 
    Senior
    Big data
    Full time
    Remote work
    Home office
    Relocation package
    Flexible hours

    Spear AI

    Washington DC
    2 days ago
  •  ...Ex Parte provides our customers with the data and insight to make smart and informed decisions...  ...data engineers who share our passion for big data, AI, and machine learning and are...  ...Europe) Work with Azure cloud and Databricks Develop technical architectures and specific... 
    Senior
    Big data

    Ex Parte

    Bethesda, MD
    6 hours ago
  • $115k - $150k

     ...stronger results for our clients. As a Senior Data Engineer , you will architect, build, and...  ...& ETL Development: Architect and develop end-to-end ETL/ELT pipelines for structured...  ...BigQuery, Dataflow) Hands‑on experience with big data tools: Apache Spark, Kafka, Airflow,... 
    Senior
    Big data
    Visa sponsorship

    Insomniac Design, Inc.

    Washington DC
    4 days ago
  •  ...IntelliTech is seeking experienced Data Engineers to join our team. As a Data Engineer...  ...you will play a crucial role in designing, developing, and maintaining our client's data...  ...experience working with very large data sets/Big Data, like that of large federal agency.... 
    Senior
    Big data
    Interim role
    Remote work
    Flexible hours
    2 days per week
    3 days per week

    I - Tech Media

    Arlington, VA
    6 hours ago
  • $106.9k - $176.5k

     ...seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data...  ...for target data platform designs. Design, develop, and implement data engineering solutions...  ...Databricks and experience with Spark for big data processing. Proven experience in at least... 
    Senior
    Big data
    Summer holiday
    Flexible hours

    EY

    Washington DC
    3 days ago
  •  ...transportation industries. Our software engineers and data scientists apply the latest in emerging...  ...engineers, and other stakeholders to develop and implement data‑driven solutions that...  ...Familiarity with distributed systems and big data technologies such as Apache Spark... 
    Senior
    Big data
    Work at office
    Flexible hours

    6AM City

    Washington DC
    20 hours ago
  • $105k

     ...A day in the life: At Hertz, our senior data scientists are responsible developing and defining best practices for analytical methods to generate informative...  ...2 years of intensive experience with cloud-based Big Data, ML and Analytics technologies, preferably... 
    Senior
    Big data
    Worldwide

    The Hertz Corporation

    Washington DC
    19 hours ago
  •  ...Senior IT Data Engineer (TO-BH-2) Diverse Agile Solutions (DAS) Location: Washington, D.C. (Hybrid) Position Type: Full-Time...  ...visualizes data. This position is responsible for designing, developing, and optimizing enterprise data architectures, scalable data pipelines... 
    Senior
    Big data
    Full time
    Local area

    Diverse Agile Solutions

    Washington DC
    7 days ago
  •  ...impacting our national security in cyber as Senior Data Engineer at GDIT. Here, technologists have...  ...: Amazon Web Services (AWS) Certified: Big Data Specialty Security clearance level: TS...  ...your opportunity — Explore an enterprise IT career at GDIT and you’ll find endless... 
    Senior
    Big data
    Work at office

    General Dynamics Information Technology

    Falls Church, VA
    4 days ago
  • $116.9k - $243.1k

     ...Senior Data Scientist At Accenture Federal Services, nothing matters more than helping...  ...solutions. You will leverage skills in big data collection, cleaning, and exploratory...  ...insights and solutions. ~ Experience developing in python. ~ Hands-on experience within... 
    Senior
    Big data

    Accenture Federal Services

    Washington DC
    2 days ago
  •  ...Corner, VA or Rockville, MD locations The Data Engineer works with moderate supervision across...  ...across S3‑based data lake environments. Develop and optimize SQL for large‑scale datasets,...  ...complex aggregations. Build and engineer big data systems (EMR‑on‑EC2, EMR‑on‑EKS) and... 
    Big data

    Optomi

    Washington DC
    4 days ago
  •  ...An innovative firm is seeking a skilled Software Developer specializing in Bioinformatics and Big Data. This role involves developing and maintaining bioinformatics software for the National Institutes of Health. You'll collaborate with a diverse team to implement efficient... 
    Big data
    Remote work

    Ariadne Genomics Inc

    Bethesda, MD
    6 hours ago
  •  ...Professional services and system integration company delivering IT security, identity, access management and regulatory compliance solutions...  ...in either core Java or Spark 3 years of hands‑on experience in Data Warehousing and Data Marts and Data/Dimensional Modeling and ETL... 
    Big data
    Contract work
    Immediate start

    InfraMatix Inc

    Chevy Chase, MD
    2 days ago
  • $184.9k - $250.2k

     ...transformational - a greenfield, enterprise-grade data and insights platform that will redefine...  ...ETL/ELT pipelines using AWS‑native and big data technologies, ensuring data...  ...computer science or equivalent 5+ years of developing end‑to‑end analytics solutions, including... 
    Senior
    Big data
    Contract work
    Internship
    Flexible hours
    Day shift

    Amazon

    Arlington, VA
    4 days ago
  • $105k - $215k

     ...transition from a traditional IT model to a tech...  ...Engineer works with our Sr Staff Engineer and other...  ...Open-Source Observability, Data platform domain. Position...  ...our toughest problems Develop and execute technical software...  ...Trino etc. Knowledge or Big data formats such as... 
    Senior
    Big data
    Hourly pay
    Work experience placement
    Local area
    Flexible hours

    Dormont Manufacturing Company

    Bethesda, MD
    3 days ago
  •  ...are a solution-driven company delivering data insights and technology solutions to customers...  ...guidance, demonstrating initiative to develop solutions independently; review architecture...  ...5+ years of experience. Experience with big data systems, including Apache Spark and Databricks... 
    Big data
    Contract work

    Redhorse Corporation

    Arlington, VA
    2 days ago
  •  ...the ever-changing challenges that our clients face. Specialties: Big Data, Strategy and Business Architecture, Systems Engineering,...  ...testing. Perform unit and system-level testing of applications. Develop reusable loosely-coupled software components to deploy on cloud... 
    Big data

    ByteCubed

    Arlington, VA
    6 hours ago
  • $112k - $179k

     ...Peraton is seeking a Data Engineer to support our classified customer in Washington, DC. Peraton has been supporting our classified customer...  ...Development and Operations (DevOps) services, Data Science, Big Data and Entity Resolution Engineering services advanced data discovery... 
    Big data

    Peraton

    Washington DC
    6 hours ago
  •  ...Virginia The Mission Square Peg is seeking a Data Engineer to be responsible for designing,...  ...for our customers. The Data Engineer will develop automated pipelines for a variety of data...  ...languages (Python,SQL, Java) Prepare big data, implement data models and develop database... 
    Big data
    Full time

    Square Peg Technologies

    Washington DC
    4 days ago
  •  ...expertise in people, processes, technology, and data to help them prepare for growth, manage...  .... They will work with large data sets and develop data pipelines that move data from source...  ...in Cloudera Data Platform or similar big data technologies. Strong programming skills... 
    Big data
    Work at office
    Remote work
    Overseas

    Info Gain Consulting

    Alexandria, VA
    4 days ago
  •  ...Canyon Consulting (BCC) is searching for Data Engineer(s) to support our work for the National...  ..., C++, you name it), and environments (big data petabytes, machine learning,...  ...talented group of scientists and software developers to design, develop, test, and maintain programs... 
    Big data
    Full time
    Work at office

    Black Canyon Consulting LLC

    Bethesda, MD
    6 hours ago
  • $5,000 per month

     ...talented individual to join AIS as a Senior Data Analytics Engineer. Core Knowledge &...  ...data modeling; leads robust ETL/ELT; uses big data technologies (e.g., Spark); enforces...  ...consulting best practices. Key Responsibilities Develop and deploy software into production in... 
    Big data
    Immediate start
    Flexible hours

    Applied Information Sciences

    Washington DC
    4 days ago
  •  ...Data Engineer Employment Type: Full-Time, Mid-level Department...  ...Clearance. ~7+ years of IT experience including experience...  ...and models. ~ Experience with developing data pipelines from many...  ...SAS). ~ Strong knowledge of big data analysis and storage tools... 
    Big data
    Full time
    Flexible hours

    Contact Government Services LLC

    Arlington, VA
    2 days ago
  • $117.9k - $169.6k

     ...Data Engineer We are looking for a skilled and passionate Data Engineer to join our team...  ...scientists, analysts, and other stakeholders to develop efficient data pipelines, manage large...  ...Snowflake, Amazon Redshift, or BigQuery. Big Data Processing: Leverage frameworks like... 
    Big data
    Live in
    Local area

    Accenture Federal Services

    Suitland, MD
    4 days ago
  • $108.9k - $163.4k

     ...Data Engineer KBR’s National Security Solutions team provides high-end engineering and advanced...  ..., science, program management, mission IT and cybersecurity solutions. Collaborative...  ...capabilities of IC programs. Research emerging big data and data services technologies to... 
    Big data
    Contract work
    Temporary work
    Local area
    Relocation package
    Flexible hours

    KBR Careers

    Chevy Chase, MD
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. IT Big Data Developer. Be the first to apply!