Sr. IT Big Data Developer
Diverse Agile Solutions
TO-BH-3 Sr. IT Big Data Developer (Data Architect/Engineer)
Location: Washington, DC (100% On-site)
Client: Federal Reserve Board (Division of Research & Statistics)
Employment Type: Full-Time Contract
Period of Performance: July 27, 2026 – December 31, 2026 (Extension Possible)
Citizenship Requirement: U.S. Citizenship Required
About Diverse Agile Solutions
Diverse Agile Solutions (DAS) is a certified Minority Business Enterprise (MBE) providing innovative IT consulting, cloud, cybersecurity, software engineering, and data analytics solutions to federal, state, and commercial organizations. Our team partners with government agencies to modernize enterprise technology, improve mission outcomes, and deliver exceptional customer service.
At DAS, we invest in talented professionals who thrive on solving complex technical challenges while making a meaningful impact.
Position Overview
Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) organization within the Division of Research & Statistics.
The DATA team is responsible for transforming how economic research data is collected, managed, integrated, analyzed, and visualized across the organization.
This position is ideal for an experienced Data Architect and Data Engineer who enjoys designing scalable enterprise data platforms, building modern data pipelines, optimizing large-scale data processing systems, and supporting data-driven research initiatives.
The successful candidate will collaborate closely with economists, data scientists, researchers, and software engineers to design next-generation data architecture supporting critical economic policy research.
Key Responsibilities
- Design and implement scalable enterprise data architectures supporting research and analytics initiatives.
- Develop, optimize, and maintain enterprise data pipelines and automated ETL/ELT workflows.
- Design conceptual, logical, and physical data models.
- Build highly scalable data processing frameworks capable of supporting large datasets.
- Develop data integration solutions for structured and unstructured data sources.
- Optimize database performance across enterprise environments.
- Design enterprise data lake and data warehouse solutions.
- Implement Change Data Capture (CDC) methodologies.
- Develop workflow orchestration using tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
- Support migration of data platforms between on-premises and cloud environments.
- Perform root cause analysis of data quality and business process issues.
- Collaborate with economists and technical teams to deliver trusted, high-quality data assets.
- Develop software solutions supporting enterprise data services.
- Participate in application testing, deployment, and production support.
- Build and maintain CI/CD pipelines supporting DataOps initiatives.
- Document architecture, standards, and technical designs.
- Recommend improvements to enterprise data strategy and governance.
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
- Minimum 7 years of professional experience in Data Engineering, Data Architecture, or Big Data Development.
- Advanced experience developing complex SQL solutions.
- Extensive experience with relational databases including:
- PostgreSQL
- Microsoft SQL Server
- MySQL
- Advanced programming experience with:
- Python
- R
- Experience designing scalable enterprise data platforms.
- Experience building automated ETL/ELT pipelines.
- Experience developing scalable data processing solutions.
- Experience with GitLab and/or GitHub source control.
- Experience working in Linux environments.
- Strong software engineering background including development, testing, and deployment.
- Excellent written and verbal communication skills.
- Strong analytical and troubleshooting abilities.
Preferred Qualifications
Experience with one or more of the following technologies is highly desirable:
Data Engineering
- Apache Airflow
- Prefect
- Dagster
- AWS Step Functions
Cloud Platforms
- Amazon Web Services (AWS)
- Microsoft Azure
- Snowflake
Enterprise Data Technologies
- Enterprise Data Lakes
- Data Warehouses
- CDC (Change Data Capture)
- DataOps
- CI/CD Pipelines
Big Data
- Distributed Computing
- Large Scale Data Processing
- High-Volume Data Optimization
Additional Technologies
- NoSQL Databases
- Graph Databases
- Machine Learning
- Java
- Scala
- JavaScript
- Perl
Domain Experience
- Time Series Data
- Forecasting Analytics
- Economic Research
- Financial Data
- Research Organizations
Technical Skills
Programming Languages
- Python
- R
- SQL
- Java (Preferred)
- Scala (Preferred)
- JavaScript (Preferred)
- Perl (Preferred)
Databases
- PostgreSQL
- Microsoft SQL Server
- MySQL
- NoSQL
- Graph Databases
Cloud
- AWS
- Microsoft Azure
- Snowflake
Data Engineering
- ETL / ELT
- Apache Airflow
- Prefect
- Dagster
- AWS Step Functions
- Data Lakes
- Data Warehouses
- Change Data Capture (CDC)
- DataOps
- CI/CD
Tools
- GitLab
- GitHub
- Linux
Why Join Diverse Agile Solutions?
At DAS, you'll work alongside highly skilled professionals supporting one of the nation's most respected financial institutions. You'll contribute to enterprise-scale modernization initiatives that directly support economic research and national financial policy.
We offer:
- Challenging, mission-critical projects
- Collaborative technical teams
- Opportunities to work with modern cloud and data technologies
- Professional growth and career development
- Competitive compensation
Work Location
On-site
Federal Reserve Board
Washington, DC
Equal Opportunity Employer
Diverse Agile Solutions is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity, or any other status protected by applicable law.
BreezyHR Knockout Questions
- Are you a U.S. Citizen?
- Are you able to work 100% on-site in Washington, DC?
- Do you have at least 7 years of experience in Data Engineering or Data Architecture?
- How many years of professional Python experience do you have?
- How many years of advanced SQL development experience do you have?
- Have you designed enterprise ETL/ELT data pipelines?
- Which cloud platforms have you used professionally? (AWS, Azure, Snowflake)
- Have you worked with Apache Airflow, Prefect, Dagster, or AWS Step Functions?
- Have you designed enterprise data warehouse or data lake solutions?
- Do you have experience supporting research, economic, or financial data environments?
- Have you worked with PostgreSQL, SQL Server, and MySQL?
- What is your earliest available start date?
$103.8k - $218.1k
...Job Title: Sr. Data Engineer Job Category: Information Technology Time Type: Full time Minimum... ..., data warehousing, ETL processes, and big data technologies. The Sr. Data Engineer... ...SQL Database, or Azure Synapse Analytics. Develop and maintain data pipelines using Azure...SeniorBig dataFull timeLocal areaFlexible hours- ...Data Engineer As part of the Data Management area, the Data Engineer will provide leadership... ...Leads projects and small teams of ETL developers/engineers on complex efforts Assists... ...stream processing, and highly scalable ‘big data’ data stores. Experience supporting...SeniorBig data
- ...best‑in‑class artificial intelligence and big data analytics capabilities. Our capabilities... ...opportunity for a Senior Data Analytics Developer supporting a contract with the Navy. This... ...and working within regulated government IT environments. Strong experience with full...SeniorBig dataContract workFlexible hours
- ...Senior Data Engineer We are seeking a seasoned Senior Data Engineer to join a dynamic... ...have a strong background in designing, developing, and maintaining scalable ETL data pipelines... ...platforms, leveraging cloud services and big data technologies. Responsibilities...SeniorBig data
- ...technologies supporting the organization’s data analysis and analytics infrastructure. As... ...requirements into effective data models. Design and develop scalable data models, including relational... .... Architect and implement next-generation big data analytics frameworks. Expand and...SeniorBig data
- ...Data Engineering Lead Spear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support... ...Polygraph ~ Expertise in distributed computing frameworks and big data technologies ~ Advanced knowledge of database systems, data...SeniorBig dataFull timeRemote workHome officeRelocation packageFlexible hours
- ...Ex Parte provides our customers with the data and insight to make smart and informed decisions... ...data engineers who share our passion for big data, AI, and machine learning and are... ...Europe) Work with Azure cloud and Databricks Develop technical architectures and specific...SeniorBig data
$115k - $150k
...stronger results for our clients. As a Senior Data Engineer , you will architect, build, and... ...& ETL Development: Architect and develop end-to-end ETL/ELT pipelines for structured... ...BigQuery, Dataflow) Hands‑on experience with big data tools: Apache Spark, Kafka, Airflow,...SeniorBig dataVisa sponsorship- ...IntelliTech is seeking experienced Data Engineers to join our team. As a Data Engineer... ...you will play a crucial role in designing, developing, and maintaining our client's data... ...experience working with very large data sets/Big Data, like that of large federal agency....SeniorBig dataInterim roleRemote workFlexible hours2 days per week3 days per week
$106.9k - $176.5k
...seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data... ...for target data platform designs. Design, develop, and implement data engineering solutions... ...Databricks and experience with Spark for big data processing. Proven experience in at least...SeniorBig dataSummer holidayFlexible hours- ...transportation industries. Our software engineers and data scientists apply the latest in emerging... ...engineers, and other stakeholders to develop and implement data‑driven solutions that... ...Familiarity with distributed systems and big data technologies such as Apache Spark...SeniorBig dataWork at officeFlexible hours
$105k
...A day in the life: At Hertz, our senior data scientists are responsible developing and defining best practices for analytical methods to generate informative... ...2 years of intensive experience with cloud-based Big Data, ML and Analytics technologies, preferably...SeniorBig dataWorldwide- ...Senior IT Data Engineer (TO-BH-2) Diverse Agile Solutions (DAS) Location: Washington, D.C. (Hybrid) Position Type: Full-Time... ...visualizes data. This position is responsible for designing, developing, and optimizing enterprise data architectures, scalable data pipelines...SeniorBig dataFull timeLocal area
- ...impacting our national security in cyber as Senior Data Engineer at GDIT. Here, technologists have... ...: Amazon Web Services (AWS) Certified: Big Data Specialty Security clearance level: TS... ...your opportunity — Explore an enterprise IT career at GDIT and you’ll find endless...SeniorBig dataWork at office
$116.9k - $243.1k
...Senior Data Scientist At Accenture Federal Services, nothing matters more than helping... ...solutions. You will leverage skills in big data collection, cleaning, and exploratory... ...insights and solutions. ~ Experience developing in python. ~ Hands-on experience within...SeniorBig data- ...Corner, VA or Rockville, MD locations The Data Engineer works with moderate supervision across... ...across S3‑based data lake environments. Develop and optimize SQL for large‑scale datasets,... ...complex aggregations. Build and engineer big data systems (EMR‑on‑EC2, EMR‑on‑EKS) and...Big data
- ...An innovative firm is seeking a skilled Software Developer specializing in Bioinformatics and Big Data. This role involves developing and maintaining bioinformatics software for the National Institutes of Health. You'll collaborate with a diverse team to implement efficient...Big dataRemote work
- ...Professional services and system integration company delivering IT security, identity, access management and regulatory compliance solutions... ...in either core Java or Spark 3 years of hands‑on experience in Data Warehousing and Data Marts and Data/Dimensional Modeling and ETL...Big dataContract workImmediate start
$184.9k - $250.2k
...transformational - a greenfield, enterprise-grade data and insights platform that will redefine... ...ETL/ELT pipelines using AWS‑native and big data technologies, ensuring data... ...computer science or equivalent 5+ years of developing end‑to‑end analytics solutions, including...SeniorBig dataContract workInternshipFlexible hoursDay shift$105k - $215k
...transition from a traditional IT model to a tech... ...Engineer works with our Sr Staff Engineer and other... ...Open-Source Observability, Data platform domain. Position... ...our toughest problems Develop and execute technical software... ...Trino etc. Knowledge or Big data formats such as...SeniorBig dataHourly payWork experience placementLocal areaFlexible hours- ...are a solution-driven company delivering data insights and technology solutions to customers... ...guidance, demonstrating initiative to develop solutions independently; review architecture... ...5+ years of experience. Experience with big data systems, including Apache Spark and Databricks...Big dataContract work
- ...the ever-changing challenges that our clients face. Specialties: Big Data, Strategy and Business Architecture, Systems Engineering,... ...testing. Perform unit and system-level testing of applications. Develop reusable loosely-coupled software components to deploy on cloud...Big data
$112k - $179k
...Peraton is seeking a Data Engineer to support our classified customer in Washington, DC. Peraton has been supporting our classified customer... ...Development and Operations (DevOps) services, Data Science, Big Data and Entity Resolution Engineering services advanced data discovery...Big data- ...Virginia The Mission Square Peg is seeking a Data Engineer to be responsible for designing,... ...for our customers. The Data Engineer will develop automated pipelines for a variety of data... ...languages (Python,SQL, Java) Prepare big data, implement data models and develop database...Big dataFull time
- ...expertise in people, processes, technology, and data to help them prepare for growth, manage... .... They will work with large data sets and develop data pipelines that move data from source... ...in Cloudera Data Platform or similar big data technologies. Strong programming skills...Big dataWork at officeRemote workOverseas
- ...Canyon Consulting (BCC) is searching for Data Engineer(s) to support our work for the National... ..., C++, you name it), and environments (big data petabytes, machine learning,... ...talented group of scientists and software developers to design, develop, test, and maintain programs...Big dataFull timeWork at office
$5,000 per month
...talented individual to join AIS as a Senior Data Analytics Engineer. Core Knowledge &... ...data modeling; leads robust ETL/ELT; uses big data technologies (e.g., Spark); enforces... ...consulting best practices. Key Responsibilities Develop and deploy software into production in...Big dataImmediate startFlexible hours- ...Data Engineer Employment Type: Full-Time, Mid-level Department... ...Clearance. ~7+ years of IT experience including experience... ...and models. ~ Experience with developing data pipelines from many... ...SAS). ~ Strong knowledge of big data analysis and storage tools...Big dataFull timeFlexible hours
$117.9k - $169.6k
...Data Engineer We are looking for a skilled and passionate Data Engineer to join our team... ...scientists, analysts, and other stakeholders to develop efficient data pipelines, manage large... ...Snowflake, Amazon Redshift, or BigQuery. Big Data Processing: Leverage frameworks like...Big dataLive inLocal area$108.9k - $163.4k
...Data Engineer KBR’s National Security Solutions team provides high-end engineering and advanced... ..., science, program management, mission IT and cybersecurity solutions. Collaborative... ...capabilities of IC programs. Research emerging big data and data services technologies to...Big dataContract workTemporary workLocal areaRelocation packageFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. IT Big Data Developer. Be the first to apply!
- senior support engineer Washington DC
- lab support engineer Washington DC
- associate support engineer Washington DC
- customer support engineer Washington DC
- application support engineer Washington DC
- IT support engineer Washington DC
- line support engineer Washington DC
- IT software engineer Washington DC
- IT engineer Washington DC
- software technical support engineer Washington DC

