Sr. IT Big Data Developer
Diverse Agile Solutions
TO-BH-3 Sr. IT Big Data Developer (Data Architect/Engineer)
Location: Washington, DC (100% On-site)
Client: Federal Reserve Board (Division of Research & Statistics)
Employment Type: Full-Time Contract
Period of Performance: July 27, 2026 – December 31, 2026 (Extension Possible)
Citizenship Requirement: U.S. Citizenship Required
About Diverse Agile Solutions
Diverse Agile Solutions (DAS) is a certified Minority Business Enterprise (MBE) providing innovative IT consulting, cloud, cybersecurity, software engineering, and data analytics solutions to federal, state, and commercial organizations. Our team partners with government agencies to modernize enterprise technology, improve mission outcomes, and deliver exceptional customer service.
At DAS, we invest in talented professionals who thrive on solving complex technical challenges while making a meaningful impact.
Position Overview
Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) organization within the Division of Research & Statistics.
The DATA team is responsible for transforming how economic research data is collected, managed, integrated, analyzed, and visualized across the organization.
This position is ideal for an experienced Data Architect and Data Engineer who enjoys designing scalable enterprise data platforms, building modern data pipelines, optimizing large-scale data processing systems, and supporting data-driven research initiatives.
The successful candidate will collaborate closely with economists, data scientists, researchers, and software engineers to design next-generation data architecture supporting critical economic policy research.
Key Responsibilities
- Design and implement scalable enterprise data architectures supporting research and analytics initiatives.
- Develop, optimize, and maintain enterprise data pipelines and automated ETL/ELT workflows.
- Design conceptual, logical, and physical data models.
- Build highly scalable data processing frameworks capable of supporting large datasets.
- Develop data integration solutions for structured and unstructured data sources.
- Optimize database performance across enterprise environments.
- Design enterprise data lake and data warehouse solutions.
- Implement Change Data Capture (CDC) methodologies.
- Develop workflow orchestration using tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
- Support migration of data platforms between on-premises and cloud environments.
- Perform root cause analysis of data quality and business process issues.
- Collaborate with economists and technical teams to deliver trusted, high-quality data assets.
- Develop software solutions supporting enterprise data services.
- Participate in application testing, deployment, and production support.
- Build and maintain CI/CD pipelines supporting DataOps initiatives.
- Document architecture, standards, and technical designs.
- Recommend improvements to enterprise data strategy and governance.
Required Qualifications
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
- Minimum 7 years of professional experience in Data Engineering, Data Architecture, or Big Data Development.
- Advanced experience developing complex SQL solutions.
- Extensive experience with relational databases including:
- PostgreSQL
- Microsoft SQL Server
- MySQL
- Advanced programming experience with:
- Python
- R
- Experience designing scalable enterprise data platforms.
- Experience building automated ETL/ELT pipelines.
- Experience developing scalable data processing solutions.
- Experience with GitLab and/or GitHub source control.
- Experience working in Linux environments.
- Strong software engineering background including development, testing, and deployment.
- Excellent written and verbal communication skills.
- Strong analytical and troubleshooting abilities.
Preferred Qualifications
Experience with one or more of the following technologies is highly desirable:
Data Engineering
- Apache Airflow
- Prefect
- Dagster
- AWS Step Functions
Cloud Platforms
- Amazon Web Services (AWS)
- Microsoft Azure
- Snowflake
Enterprise Data Technologies
- Enterprise Data Lakes
- Data Warehouses
- CDC (Change Data Capture)
- DataOps
- CI/CD Pipelines
Big Data
- Distributed Computing
- Large Scale Data Processing
- High-Volume Data Optimization
Additional Technologies
- NoSQL Databases
- Graph Databases
- Machine Learning
- Java
- Scala
- JavaScript
- Perl
Domain Experience
- Time Series Data
- Forecasting Analytics
- Economic Research
- Financial Data
- Research Organizations
Technical Skills
Programming Languages
- Python
- R
- SQL
- Java (Preferred)
- Scala (Preferred)
- JavaScript (Preferred)
- Perl (Preferred)
Databases
- PostgreSQL
- Microsoft SQL Server
- MySQL
- NoSQL
- Graph Databases
Cloud
- AWS
- Microsoft Azure
- Snowflake
Data Engineering
- ETL / ELT
- Apache Airflow
- Prefect
- Dagster
- AWS Step Functions
- Data Lakes
- Data Warehouses
- Change Data Capture (CDC)
- DataOps
- CI/CD
Tools
- GitLab
- GitHub
- Linux
Why Join Diverse Agile Solutions?
At DAS, you'll work alongside highly skilled professionals supporting one of the nation's most respected financial institutions. You'll contribute to enterprise-scale modernization initiatives that directly support economic research and national financial policy.
We offer:
- Challenging, mission-critical projects
- Collaborative technical teams
- Opportunities to work with modern cloud and data technologies
- Professional growth and career development
- Competitive compensation
Work Location
On-site
Federal Reserve Board
Washington, DC
Equal Opportunity Employer
Diverse Agile Solutions is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration without regard to race, color, religion, sex, national origin, age, disability, veteran status, genetic information, sexual orientation, gender identity, or any other status protected by applicable law.
BreezyHR Knockout Questions
- Are you a U.S. Citizen?
- Are you able to work 100% on-site in Washington, DC?
- Do you have at least 7 years of experience in Data Engineering or Data Architecture?
- How many years of professional Python experience do you have?
- How many years of advanced SQL development experience do you have?
- Have you designed enterprise ETL/ELT data pipelines?
- Which cloud platforms have you used professionally? (AWS, Azure, Snowflake)
- Have you worked with Apache Airflow, Prefect, Dagster, or AWS Step Functions?
- Have you designed enterprise data warehouse or data lake solutions?
- Do you have experience supporting research, economic, or financial data environments?
- Have you worked with PostgreSQL, SQL Server, and MySQL?
- What is your earliest available start date?
- ...Business Systems Inc. is a quickly developing worldwide System Integrator,... ...and Product Development, IT Outsourcing and Technology assistance... ..., Business Intelligence, Data Management, SOA, BPM, Data Warehousing... ...or emerging trends such as Big Data, Columnar databases,...SeniorBig dataLocal areaWorldwide
$180k - $200k
...DescriptionEverforth ECS is seeking a Sr. Data and AI Engineer to work in our... ...'s degree10+ years of IT experience including experience... ...customer needs Ability to develop a roadmap that links the deployment... ..., Data Warehousing and Big Data tools, Data Analytics and...SeniorBig dataWork at office$116.2k - $229.1k
...enterprise technology platforms, modernize data environments, and unlock value through... ...Lead: Evaluate, pilot, and integrate new big data and analytics technologies, ensuring... ...remains at the cutting edge. Lead, coach, and develop teams of data engineers and architects, fostering...SeniorBig dataLocal areaVisa sponsorship$103.8k - $218.1k
Job Title: Senior Data EngineerJob Category: Information TechnologyTime Type: Full timeMinimum... ...The Opportunity:CACI is seeking a talented Sr. Data Engineer to join our dynamic team.... ...architecture, data warehousing, ETL processes and big data technologies. The Data Engineer will...SeniorBig dataContract workWork experience placementFlexible hours$130k - $160k
...best-in-class artificial intelligence and big data analytics capabilities. Our capabilities... ...opportunity for a Senior Data Analytics Developer supporting a contract with the Navy. This... ...and working within regulated government IT environments. ~ Strong experience with...SeniorBig dataContract workLocal areaFlexible hours$115k - $150k
...stronger results for our clients.As a Senior Data Engineer, you will architect, build, and... ...Pipelines & ETL Development:Architect and develop end-to-end ETL/ELT pipelines for... ...BigQuery, Dataflow)Hands-on experience with big data tools:Apache Spark, Kafka, Airflow, dbt...SeniorBig dataFull timeVisa sponsorship$140k - $220k
...fast.About the Role:We are seeking an experienced Sr Software Engineer to join our fast-paced, collaborative data team. In this role, you will have broad authority... ...opportunity to solve challenging problems and make a big impact as we invest in making technographics a...SeniorBig dataWorldwide$113k - $188.4k
...responsible for:Integrate large-scale client data and conduct statistical analyses... ...full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms... ...with Amazon Web Services (AWS) big data and analytics services, including Amazon...SeniorBig dataLocal area- Job Description Job Description Data Engineer Top Secret clearance required to apply. 7+ years of experience in database design and coding with big data. PowerBI development experience is highly desirable. Minimum Education: Bachelor's Degree.Big data
- ...Actifai is seeking experienced Senior Data Engineers. The Company Actifai is an AI company helping broadband and telecom providers... ...impact. You will work with engineers to build and operate a big data platform that processes and refines data and enables efficient...SeniorBig dataFull timeWork experience placementWork at officeRemote work
$107.9k - $195.05k
...team at the forefront of federal IT modernization, delivering real... ...maintains scalable, reliable data systems and pipelines to ingest... ...with React, JavaScript, and HTML.Develops and manages data warehouses and... ...environments.Experience with big data technologies and platforms...Big dataFull timeRemote work$106.9k - $176.5k
...Government and Public Sector - Technology Consulting - AI & Data - GenAI Developer - Senior ConsultantFrom strategy to execution, the Government... ...working world.EY delivers unparalleled service in big data, business intelligence, and digital analytics built on...SeniorBig dataFor contractorsSummer holidayWork at officeLocal areaFlexible hours$50 per hour
...Solutions (AIRES) team within Lockheed Martin’s Data & AI Enablement organization(D&Ae)... ...value for Lockheed Martin.Responsible for developing, integrating, and deploying autonomy and... ...Knowledge of the data‑science lifecycle, big‑data concepts, deep‑learning fundamentals...SeniorBig dataFull timeTemporary workWork experience placementCasual workFlexible hours$70k - $140k
...best-in-class artificial intelligence and big data analytics capabilities. Our capabilities... ...research objectives, identify data sources, and develop analysis plans. Work with teams of... ...Ability to coordinate effectively with IT and platform teams Minimum three (3)...SeniorBig dataPermanent employmentRemote workFlexible hours$113k - $188.4k
...responsible for: Integrate large-scale client data and conduct statistical analyses... ...extract, transform, and load (ETL) practices Develop automated, reproducible, and auditable... ...Experience with Amazon Web Services (AWS) big data and analytics services, including Amazon...SeniorBig dataLocal area$144.1k - $193.2k
...Job Posting Title: Sr Data Engineer Req ID: Job Description: Disney Entertainment... ...global organization of engineers product developers designers technologists data scientists... ...technologies including machine learning big data microservices and data visualization...SeniorBig dataFull time- ...Description Vivo HealthStaff is recruiting for a Data Scientist with TS/SCI Clearance in the... ...:Utilize the company's AI platform to develop and deploy production-ready solutions.Own... ...implementation.Work with customer data and big data frameworks (e.g., Databricks) to...SeniorBig dataFull timeImmediate start
$90k - $120k
...Systems comprises cyber and mission IT; electronic warfare; and C5ISR... ...of national defense - the data evolution - by accelerating a... ...range from C5ISR, AI and Big Data, cyber operations and synthetic... ...candidates are expert Python developers with strong relational...SeniorBig dataFull timeWork at officeLocal areaRemote workWork from homeWorldwideHome office- ...a successful track record helping large enterprises become more data-driven. Working with the Enterprise Account Executive (AE), the Senior... ...-makers that leads them down a path of success.Technical in big data, data science and cloud.An ability in data-driven business transformation...SeniorBig dataWorldwide
$125k - $165k
OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines.... ...Data Engineering with experience in tools such as:Big data tools: Hadoop, Spark, Kafka, etc.Relational SQL...SeniorBig data$125k - $165k
OverviewWe are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines... ...Data Engineering with experience in tools such as: Big data tools: Databricks, Apache Spark, Delta Lake,...SeniorBig data- ...About the Role We are looking for a Senior Data Scientist - Experimentation & Causal... ...scientists and platform engineers within the Big Data group, reporting to the Head of Big Data... ...methods to reduce metric variance. Develop techniques to remove noise from user historical...SeniorBig dataFull time
$153.6k - $207.8k
...across all technologies, including Compute, Storage, Database, Big Data, Application-level Services, Networking, Serverless,... ...AWS environments operationally healthy. The close relationships developed with your customers will allow you to understand their business...SeniorBig dataFlexible hours- ...Senior Software Engineer – Ad Intelligence Data Platform on a 12+ month contract. The role... ...real-time and batch processing. Develop and enhance data pipelines that integrate... ...multiple source systems. Build cloud-based big data infrastructure with a focus on scalability...SeniorBig dataHourly payContract workLocal area
- ...DescriptionUSM Business Systems Inc. is a quickly developing worldwide System Integrator, Software and Product Development, IT Outsourcing and Technology assistance supplier... ..., Product Engineering, Business Intelligence, Data Management, SOA, BPM, Data Warehousing,...Big dataWorldwide
- ...systems to provide cutting edge data exploitation, enrichment,... ...of the art in mission-focused big data analytics tools and micro-... ...resilient deployments.Design, develop, and support scalable, redundant... ...accept completed work to ensure it meets business requirements and...SeniorBig dataRemote workFlexible hours
$120k - $140k
...DescriptionEverforth ECS is seeking a Data Engineer to join our team in... ...-wide efforts to secure IT infrastructure. Strong candidates... ...with other analytics-segment developers to construct applications that... ...of Data Warehousing and Big Data. Knowledge of Data Analytics...Big data- ...Advisory practice.Responsibilities:Leverage a variety of modern big data tools / approaches to solve complex business objectivesRapidly... ...all levels (translate between business & technical stakeholders)Develop data engineering designs that positively impacts business...SeniorBig dataLocal area
- ...shape the future.Department Summary:MITRE’s Data Science and Engineering department is... ...cloud-based and self-hosted environments.Develop batch and streaming data-processing solutions... ...EngineeringDistributed Data Processing and Big Data Architectures, such as Spark, Hadoop,...SeniorBig dataInternshipLocal area3 days per week
- Analytica is seeking a Databricks Data Engineer to support a high-profile program for a... ...regulatory agency. This program entails developing, deploying, and maintaining secure, scalable... ..., Apache Spark, PySpark, or similar big data technologies.Experience with AWS cloud...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. IT Big Data Developer. Be the first to apply!
- software technical support engineer Washington DC
- line support engineer Washington DC
- junior application support engineer Washington DC
- IT engineer Washington DC
- application support engineer Washington DC
- remote support engineer Washington DC
- IT software developer Washington DC
- implementation support engineer Washington DC
- senior IT engineer Washington DC
- remote network administrator / IT support engineer Washington DC




