Senior IT Big Data Developer
Diverse Agile Solutions
Senior IT Data Engineer (TO-BH-2)
Diverse Agile Solutions (DAS)
Location: Washington, D.C. (Hybrid)
Position Type: Full-Time
Citizenship Requirement: U.S. Citizen Required
Client: Federal Reserve Board – Division of Research & Statistics (R&S)
Experience Level: Senior (7+ Years)
Security Requirement: Must be eligible to work on Federal projects
About Diverse Agile Solutions (DAS)
At Diverse Agile Solutions (DAS) ( we deliver innovative technology solutions that help government agencies and commercial organizations modernize operations, improve decision-making, and achieve mission success. We are seeking a highly skilled Senior IT Data Engineer to support the Federal Reserve Board's Data Architecture, Technology, and Analytics (DATA) Section within the Division of Research & Statistics.
This is an exciting opportunity to contribute to the modernization of enterprise data architecture and analytics capabilities that support economic research, policy analysis, and data-driven decision-making at one of the nation's most influential institutions.
Position Overview
The Senior IT Data Engineer will play a critical role in transforming how the Federal Reserve Board's Division of Research & Statistics ingests, organizes, processes, and visualizes data. This position is responsible for designing, developing, and optimizing enterprise data architectures, scalable data pipelines, and advanced analytics platforms that support economists, researchers, and technical teams.
The ideal candidate is a hands-on data engineering professional with deep expertise in data modeling, database architecture, ETL/ELT development, cloud technologies, and enterprise-scale data solutions. This individual will help drive next-generation data initiatives while ensuring efficient, secure, and reliable data delivery across multiple platforms and environments.
Key Responsibilities
- Design, develop, and maintain enterprise data architectures, databases, and data integration solutions.
- Build, optimize, and automate scalable ETL/ELT pipelines for structured and unstructured data sources.
- Develop and maintain high-performance data processing frameworks supporting large-scale analytics workloads.
- Design conceptual, logical, and physical data models aligned with business and research requirements.
- Implement and manage data lake, data warehouse, and enterprise data platform solutions.
- Collaborate with economists, researchers, and technical stakeholders to support data-driven research and policy initiatives.
- Optimize data flow, storage, and processing architectures for performance, scalability, and reliability.
- Perform root cause analysis on data and business processes to identify improvement opportunities.
- Support migration of data pipelines and workflows between on-premises and cloud environments.
- Develop and maintain DataOps practices, CI/CD pipelines, and automated deployment processes.
- Ensure adherence to data governance, security, and architectural standards.
- Evaluate emerging technologies and recommend innovative solutions to improve enterprise data capabilities.
- Document technical solutions, architecture designs, and operational procedures.
Required Qualifications
Education
- Bachelor's degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical field.
- Advanced degree (Master's or Ph.D.) preferred.
Experience
- Minimum of 7 years of professional experience in Data Engineering, Data Architecture, Database Administration, or related disciplines.
- Proven experience designing and implementing enterprise-scale data solutions.
- Experience supporting complex research, analytics, or data-intensive environments.
- Strong ability to work independently while supporting multiple stakeholders and projects.
Required Technical Skills
Data Engineering & Architecture
- Advanced SQL expertise.
- Extensive experience with:
- PostgreSQL
- Microsoft SQL Server
- MySQL
- Data modeling and enterprise information architecture design.
- Data lake and data warehouse architecture.
- Change Data Capture (CDC) implementation and maintenance.
- Data integration and pipeline automation.
Programming & Analytics
- Advanced proficiency in:
- Python
- R
- Experience with additional programming languages such as:
- Java
- Scala
- JavaScript
- Perl
Data Processing & Orchestration
- ETL/ELT workflow development and automation.
- Distributed computing and large-scale data processing.
- Workflow orchestration platforms such as:
- Apache Airflow
- Prefect
- Dagster
- AWS Step Functions
Cloud & Modern Data Platforms
- Hands-on experience with:
- AWS
- Microsoft Azure
- Snowflake
- Cloud migration of data pipelines and workflows.
- Enterprise data platform modernization initiatives.
DevOps & DataOps
- CI/CD pipeline implementation and support.
- GitLab and GitHub source control management.
- Linux-based development environments.
- Automated testing, deployment, and operational monitoring.
Preferred Qualifications
- Experience working with economic, financial, or research-oriented data environments.
- Knowledge of time-series data analysis and forecasting methodologies.
- Experience with NoSQL databases and graph database technologies.
- Experience developing, training, deploying, and maintaining machine learning models.
- Familiarity with advanced analytics, statistical modeling, and predictive analytics.
- Experience supporting Federal Government agencies or highly regulated organizations.
Desired Competencies
- Exceptional analytical and problem-solving skills.
- Strong troubleshooting and root-cause analysis capabilities.
- Excellent written and verbal communication skills.
- Ability to communicate complex technical concepts to both technical and non-technical stakeholders.
- Strong customer-service mindset and collaborative approach.
- Self-motivated, detail-oriented, and results-driven professional.
Why Join DAS?
- Work on mission-critical initiatives supporting the Federal Reserve Board.
- Collaborate with leading economists, researchers, and technology professionals.
- Contribute to innovative data modernization and analytics programs.
- Competitive compensation and benefits package.
- Opportunities for professional growth and career advancement.
- Hybrid work environment in the Washington, D.C. metropolitan area.
Equal Employment Opportunity
Diverse Agile Solutions (DAS) is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Employment decisions are made without regard to race, color, religion, sex, national origin, age, disability, veteran status, or any other protected status under applicable federal, state, or local laws.
Apply Today
If you are a highly motivated Data Engineer with a passion for building modern, scalable data solutions and supporting impactful economic research initiatives, we encourage you to apply and join the DAS team supporting the Federal Reserve Board in Washington, D.C.
- ...in‑class artificial intelligence and big data analytics capabilities. Our capabilities... ...Group has an opportunity for a Senior Data Analytics Developer supporting a contract with the Navy.... ...working within regulated government IT environments. Strong experience with...SeniorBig dataContract workFlexible hours
- ...Senior Data Engineer We are seeking a seasoned Senior Data Engineer to join a dynamic team... ...have a strong background in designing, developing, and maintaining scalable ETL data pipelines... ..., leveraging cloud services and big data technologies. Responsibilities...SeniorBig data
- ...Data Engineering Lead Spear AI is a growing defense contracting company dedicated to delivering cutting-edge solutions that support... ...Polygraph ~ Expertise in distributed computing frameworks and big data technologies ~ Advanced knowledge of database systems, data...SeniorBig dataFull timeRemote workHome officeRelocation packageFlexible hours
- ...Parte provides our customers with the data and insight to make smart and... ...looking for talented, enthusiastic senior data engineers who share our passion for big data, AI, and machine learning and... ...Work with Azure cloud and Databricks Develop technical architectures and...SeniorBig data
$115k - $150k
...deliver stronger results for our clients. As a Senior Data Engineer , you will architect, build, and... ...& ETL Development: Architect and develop end-to-end ETL/ELT pipelines for structured... ...BigQuery, Dataflow) Hands‑on experience with big data tools: Apache Spark, Kafka, Airflow,...SeniorBig dataVisa sponsorship- ...IntelliTech is seeking experienced Data Engineers to join our team. As a Data Engineer... ...you will play a crucial role in designing, developing, and maintaining our client's data... ...experience working with very large data sets/Big Data, like that of large federal agency....SeniorBig dataInterim roleRemote workFlexible hours2 days per week3 days per week
$106.9k - $176.5k
...world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering... ...target data platform designs. Design, develop, and implement data engineering... ...and experience with Spark for big data processing. Proven experience in at...SeniorBig dataSummer holidayFlexible hours- ...industries. Our software engineers and data scientists apply the latest in... ...a passionate and driven Senior Data Engineer to join our team... ..., and other stakeholders to develop and implement data‑driven... ...with distributed systems and big data technologies such as Apache...SeniorBig dataWork at officeFlexible hours
- ...impacting our national security in cyber as Senior Data Engineer at GDIT. Here, technologists... ...Certification: Amazon Web Services (AWS) Certified: Big Data Specialty Security clearance level:... ...your opportunity — Explore an enterprise IT career at GDIT and you’ll find endless...SeniorBig dataWork at office
$116.9k - $243.1k
...Senior Data Scientist At Accenture Federal Services, nothing matters more than helping the... ...solutions. You will leverage skills in big data collection, cleaning, and exploratory... ...insights and solutions. ~ Experience developing in python. ~ Hands-on experience...SeniorBig data$103.8k - $218.1k
...Job Title: Sr. Data Engineer Job Category: Information Technology Time Type: Full time Minimum... ..., data warehousing, ETL processes, and big data technologies. The Sr. Data Engineer... ...SQL Database, or Azure Synapse Analytics. Develop and maintain data pipelines using Azure Data...SeniorBig dataFull timeLocal areaFlexible hours- ...Data Engineer As part of the Data Management area, the Data Engineer will provide leadership... ...Leads projects and small teams of ETL developers/engineers on complex efforts Assists... ...stream processing, and highly scalable ‘big data’ data stores. Experience supporting...SeniorBig data
- ...questions into clearly defined hypotheses, data requirements, and modeling approaches.... ...groups, and stakeholder briefings; advise senior project personnel on technical matters.... ...relevant experience in applied research, big data analytics, statistics, applied mathematics...SeniorBig data
- ...Job Description: Job Summary We are seeking a Senior-level AI/ML Engineer to design, develop, and deploy advanced artificial intelligence and... ...AI/ML models with enterprise systems, and leveraging big data processing to drive intelligent outcomes. The ideal...SeniorBig data
$116.9k - $243.1k
...government forward! The work: As a Senior Data Scientist, you will be using Databricks... ...solutions. You will leverage skills in big data collection, cleaning, and exploratory... ...insights and solutions. ~ Experience developing in python. ~ Hands-on experience within...SeniorBig dataLive inWork at officeLocal area$102.81k - $149.32k
...Overview The Senior Data Visualization Developer is responsible for designing and developing reports and dashboards to support self-service analytics environments for clients. This role requires strong technical skills in business intelligence tools and SQL, as well as...Senior$113.2k - $237.8k
...Job Title: Senior AI-ML Engineer Job Category: Science Time Type: Full time Minimum... ...architecting high-performing AI systems, big data processing, and integrating AI/ML models... ...flexible, analytical approach to design, develop, and evaluate predictive models and...SeniorBig dataFull timeContract workWork experience placementFlexible hours$220k - $292k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ..., iterative development environments. Develop high‑performance software for real‑time systems... ...., radar, lidar, EO/IR). Familiarity with big data pipelines, NoSQL databases, and the...SeniorBig data- ...TO-BH-3 Sr. IT Big Data Developer (Data Architect/Engineer) Location: Washington, DC (100% On-site) Client: Federal Reserve Board (Division... ...Diverse Agile Solutions is seeking a highly skilled Senior IT Big Data Developer (Data Architect/Engineer) to support the...SeniorBig dataFull timeContract work
- ...Analytica is seeking a Senior Data Architect to design, implement, and optimize enterprise... ...expertise in cloud platforms (AWS, Azure, GCP), big data ecosystems, and modern data... ...ensure alignment with mission objectives. Develop data models, pipelines, APIs, and integration...SeniorBig dataFor contractorsLocal areaRemote work
- ...Department of War enterprise data and analytics program delivers... ...sector is seeking an experienced Senior Data Analyst to support the... ...patterns, and actionable insights . Develop and maintain dashboards,... ...engineering workflows . Experience with big data technologies (e.g., Spark...SeniorBig data
- ...them. Become part of Something big with Extreme! As a global networking... ...time to join the Extreme team. Senior/Staff Software Engineer (Gen AI, Big Data): Experience : 5 to 12 Years... ...reviews, and implementation · Develop high-performance, production-ready...SeniorBig dataRemote workWorldwideShift work
$146k - $234k
...Peraton is seeking Full Stack Developer with experience in Big Data, Data Analytics and designing and developing solutions within the cloud to support our classified customer in Washington, DC. Peraton has been supporting our classified customer for 20 years and has a...SeniorBig data- ...Overview Senior Data Architect — Arlington, VA Are you ready to enhance your skills and build... ...Data Architect is responsible for developing data warehousing blueprints, evaluating... ...Certified Data Architect, AWS Certified Big Data – specialty or industry equivalent...SeniorBig data
- ...Senior Databricks Platform Engineer We are seeking a highly skilled... ...organization's unified data initiative. This role's primary... ...and compliance adherence. Develop and implement scalable user provisioning... ...models Experience with big data technologies such as...SeniorBig data
- ...Senior Linux System Administrator Bethesda, MD Overview Black... ...name it) and environments (big data [petabytes], machine learning,... ...Duties & Responsibilities Develop and document standard... ...with users of varying levels of IT knowledge. Experience with...SeniorBig dataFull timeWork at officeRemote work
$79.6k - $194k
...Senior Cloud Engineer Category: Project Management... ...with application teams, data engineers, and... ...environments. Assist in developing and maintaining DR/BCP configurations... ...teams, and enterprise IT to support cloud... ...Databricks, Power BI, or big data tools....SeniorBig dataFull timeLocal area- ...supporting the organization’s data analysis and analytics infrastructure... ...This position reports to the Senior Director, Research Informatics... ...data models. Design and develop scalable data models, including... ...and implement next-generation big data analytics frameworks....SeniorBig data
- ...Senior Data Analyst / Business Intelligence Developer Adela Technologies is a fast-growing, cloud-focused managed service provider based out of the Washington DC metro area. We support clients in various industries, such as non-profit, energy, education, healthcare,...SeniorFull timeInterim roleRemote work
- ...An innovative firm is seeking a skilled Software Developer specializing in Bioinformatics and Big Data. This role involves developing and maintaining bioinformatics software for the National Institutes of Health. You'll collaborate with a diverse team to implement efficient...Big dataRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior IT Big Data Developer. Be the first to apply!
- senior support engineer Washington DC
- lab support engineer Washington DC
- associate support engineer Washington DC
- customer support engineer Washington DC
- application support engineer Washington DC
- IT support engineer Washington DC
- line support engineer Washington DC
- IT software engineer Washington DC
- IT engineer Washington DC
- software technical support engineer Washington DC

