Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Databricks Data Engineer

Full-time

N2IA Technologies

Senior Databricks Data Engineer

Our Company

N2IA Technologies is a consulting company specializing in acquisition/contracting support, cost/FinOps, and technology optimization for federal clients. We deliver tailored strategies, robust software solutions, and streamlined operations to help organizations achieve their goals. At N2IA, we are committed to developing innovative financial and compliance-based solutions that address evolving business and regulatory needs. If you are passionate about accounting, financial accuracy, and supporting government programs, N2IA is the place for you.

 

Overview

N2IA is seeking a Senior Databricks Data Engineer to build, refine, and maintain the core data pipelines on the Databricks Lakehouse Platform that enable enterprise AI, analytics, and mission systems. This role is essential for making data accessible, reliable, and usable across the agency. You will work with cloud engineers, data architects, and AI developers to ensure data is clean, connected, secure, and optimized for advanced analytics and AI/ML workflows. This role is remote supporting a Quantico, VA customer and onsite work is required at the client site full-time.

 

Key Responsibilities:

  • Design, build, and maintain scalable data pipelines and ETL/ELT workflows on Databricks using Delta Lake, Delta Live Tables (DLT), and the medallion (bronze/silver/gold) architecture across cloud and on-prem systems.
  • Develop and orchestrate workflows using Databricks Workflows/Jobs.
  • Implement data quality checks, validation, lineage tracking, and metadata management using Unity Catalog and Lakehouse Monitoring / DLT expectations.
  • Collaborate with other teams to ensure datasets meet requirements and are discoverable through Unity Catalog.
  • Automate ingestion and transformation processes using Databricks-native patterns such as Auto Loader, Structured Streaming, and the COPY INTO command.
  • Support API strategy, data modeling, and domain-driven data structures within the Lakehouse.
  • Troubleshoot pipeline issues and optimize Spark jobs and clusters for performance and cost (e.g., Photon, cluster sizing, Z-ordering, liquid clustering, and workload tuning).

 

Required Qualifications:

  • 3+ years of hands-on data engineering experience building production pipelines on Databricks.
  • 10+ years of technical professional experience.
  • Strong proficiency with Apache Spark (PySpark and Spark SQL), Delta Lake, and the Databricks Lakehouse Platform.
  • Hands-on experience with Databricks on Azure and/or AWS (e.g., Azure Databricks, Azure Data Factory, AWS Glue, or similar orchestration tooling).
  • Experience with Unity Catalog for data governance, access control, and lineage.
  • Experience integrating structured and unstructured data sources.
  • Knowledge of SQL, schema design, data modeling, and cloud-based storage patterns (e.g., Delta tables, cloud object storage).
  • Secret clearance.

 

Preferred Qualifications:

  • Databricks certification (e.g., Databricks Certified Data Engineer Associate/Professional).
  • Experience supporting AI/ML pipelines, vectorization, or embedding generation, ideally using MLflow, Databricks Mosaic AI, Model Serving, or Vector Search.
  • Experience with Delta Live Tables and streaming pipelines (Structured Streaming / Auto Loader).
  • Azure, AWS, or multi-cloud data ecosystem familiarity.
  • Experience with data governance, access controls, or sensitive data protection (Unity Catalog, row/column-level security).
  • Exposure to DevOps/CI-CD patterns for data workflows (e.g., Databricks Asset Bundles, Repos, Terraform).
  • MuleSoft implementation experience.

 

N2IA is committed to fostering a diverse and inclusive work environment. We are an Equal Employment Opportunity Employer and encourage applications from all qualified individuals, regardless of gender, race, ethnicity, sexual orientation, disability, or veteran status.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Databricks Data Engineer in Washington DC vacancy
  •  ...Senior AWS Data Engineer | Onsite, Washington DC Area | TS/SCI Required About the Role Our client, a federal services contractor, needs...  ...Airflow/MWAA or Step Functions orchestration Exposure to Databricks, Snowflake, or Informatica Streaming experience with... 
    Databricks
    Senior
    Full time
    For contractors

    Oxenham Group

    Washington DC
    6 hours ago
  •  ...Business requirements discussion with business analyst and business users Python/SQL Server/Snowflake/Databricks application development and system design Develop and maintain data models and schemas to support data integration and analysis Implement data quality and... 
    Databricks
    Senior

    Saxon Global

    Washington DC
    3 days ago
  •  ...This role is primarily focused on data engineering, transformation frameworks, orchestration, and system integrations. While the team builds...  ...with modern cloud data platforms (Snowflake and/or Databricks), transformation tooling (dbt), and orchestration frameworks... 
    Databricks
    Senior
    Full time
    Flexible hours

    Green Key Resources

    Washington DC
    3 days ago
  • Master Data Management Architect Lead the design, development, and deployment of comprehensive...  ...pipelines leveraging modern data engineering tools and practices. Develop, automate,...  ...data processing solutions using Kafka, Databricks, Snowflake, Azure Data Factory (ADF), and... 
    Databricks
    Senior
    Flexible hours

    Saxon Global

    Washington DC
    3 days ago
  •  ...Job Description Job Description . Job Title: Senior Azure Data Engineer Location: Redmond, WA 98052 Work Setup: Hybrid Duration: 1...  ...expertise in Python, SQL, Apache Spark, PySpark, and Azure Databricks . The candidate will be responsible for developing and... 
    Databricks
    Senior

    eTeam Inc.

    Washington DC
    24 days ago
  • $103.8k - $218.1k

    Job Title: Senior Data EngineerJob Category: Information TechnologyTime Type: Full timeMinimum...  ...:CACI is seeking a talented Sr. Data Engineer to join our dynamic team. The ideal...  ...services, such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL... 
    Databricks
    Senior
    Contract work
    Work experience placement
    Flexible hours

    CACI International

    Arlington, VA
    4 days ago
  • $109k - $130k

    Senior Data Engineer - Arlington, Hybrid As a Senior Data Engineer you will create and enhance scalable data pipelines using established ingestion...  ...Synapse Analytics dedicated SQL pools. Build and maintain Databricks data engineering solutions, including Delta Live Tables (... 
    Databricks
    Senior

    Team One

    Arlington, VA
    3 days ago
  • $112.2k - $196.4k

     ...possible.Job Description:Parsons is looking for a highly skilled Senior Data Engineer to join our Joint Staff Chief Digital and Artificial...  ...applications and workflow automationFamiliarity with Qlik, Databricks, War Data Platform (WDP), or AdvanaExperience supporting operational... 
    Databricks
    Senior
    Full time
    Work at office
    Flexible hours

    Parsons

    Arlington, VA
    1 day ago
  • $77.6k - $176k

    Databricks Data Engineer, SeniorThe Opportunity:As a senior Databricks Data Engineer, you will be hands-on designing, building, and maintaining robust data pipelines within Databricks and contributing independently while also providing technical leadership and mentorship... 
    Databricks
    Senior
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Bethesda, MD
    1 day ago
  • Makpar has an exciting opportunity for a Senior Data Engineer to join our growing team.his role requires expertise in Databricks, SQL, and ETL pipelines, with strong experience building scalable data frameworks to support enterprise decision-making. We are seeking a Senior... 
    Databricks
    Senior
    Contract work
    For subcontractor
    Work from home
    Flexible hours

    iQuasar

    Washington DC
    3 days ago
  • Senior Financial Data Engineer Location: Pentagon or Mark Center (approximately 2x a week) Clearance: Active Secret Clearance Required Employment...  ...DoW systems and sources. Work with WDP/Advana, Foundry, Databricks, and other enterprise data platforms to develop and... 
    Databricks
    Senior
    Full time
    Work from home
    Flexible hours

    Silverthorne Advisory Group LLC

    Arlington, VA
    3 days ago
  • $140k - $180k

    Senior Data Engineer We are looking for seasoned Senior Data Engineer to work with our team and our clients to develop enterprise grade data platforms, services, and pipelines in Databricks. We are looking for more than just a "Senior Data Engineer", but a technologist... 
    Databricks
    Senior

    Steampunk.com

    Washington DC
    3 days ago
  • $185k - $225k

    You are a data engineer who thrives in a highly collaborative environment, partnering with product, analytics, and engineering teams to...  ...effectively. You bring recent, hands-on production experience with Databricks and will play a leading role in evolving our Databricks-based... 
    Databricks
    Senior
    Full time

    Bloomberg Industry Group

    Arlington, VA
    5 days ago
  •  ...Job Description Job Description Overview Senior Data Engineer   Arlington, VA   Are you ready to enhance your skills and build...  .... Working knowledge of modern data platforms, including Databricks and Snowflake, is essential to evaluating and implementing... 
    Databricks
    Senior

    Chenega Corporation

    Arlington, VA
    3 days ago
  • $139.3k - $159.2k

     ...expertise within and across teams and contribute to our success. Senior Data Engineer Faegre Drinker has an opportunity for a Senior Data...  ...consumption delivery for the firm's enterprise data lake, built on Databricks, applying a Bronze/Silver/Gold medallion architecture... 
    Databricks
    Senior
    Work at office
    Flexible hours

    Faegre Drinker Biddle & Reath LLP

    Washington DC
    3 days ago
  • Analytica is seeking a Senior Data Engineer to support large-scale Health care data modernization and analytics initiatives. This role is responsible...  ...maintain scalable batch and streaming data pipelines using Databricks and/or cloud-native services. Build and optimize ETL/ELT... 
    Databricks
    Senior
    For contractors
    Local area

    Analytica

    Washington DC
    3 days ago
  • $150k - $160k

     ...U.S. Citizen Job Summary Castalia is seeking exceptional Senior Level Data Engineers to join our expanding team. In this role, you will be responsible...  .... Develop and maintain data solutions using Python, Databricks, SQL, relational databases, and other modern data... 
    Databricks
    Senior
    Full time
    Contract work
    Work at office
    Local area
    3 days per week

    Castalia Systems

    Arlington, VA
    3 days ago
  • $107.9k - $195.05k

     ...if an offer letter is extended to you. Leidos is seeking a Senior Data Engineer to support the Department of Veterans Affairs (VA) Summit...  ...is also valuable. Experience with production-scale Spark/Databricks or Delta Lake processing and platform-wide performance or cost... 
    Databricks
    Senior
    Permanent employment
    Contract work
    Local area
    Immediate start
    Remote work

    Leidos

    Washington DC
    3 days ago
  • $77.6k - $176k

    Senior Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's...  ...Have: Experience with Pyspark and Spark ecosystems such as Databricks and EMR Experience evaluating data analytic or science technologies... 
    Databricks
    Senior
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    College Park, MD
    3 days ago
  • $91.1k - $179.5k

    Position Summary Deloitte is seeking a Data Engineer III to support the design, development,...  ...platforms such as Snowflake, Databricks, or Amazon Redshift1+ years of experience...  ...development From entry-level employees to senior leaders, we believe there’s always room... 
    Databricks
    Senior

    Deloitte

    Rosslyn, VA
    22 hours ago
  • $131k - $218.3k

     ...Join Deloitte’s AI & Engineering team to help clients modernize...  ...to design and deliver modern data solutions that support enterprise...  ...2+ years of experience using Databricks or Palantir for data engineering...  ...From entry-level employees to senior leaders, we believe there’s... 
    Databricks
    Senior
    Work at office
    Local area
    Night shift

    Deloitte

    Rosslyn, VA
    22 hours ago
  • $77.6k - $176k

    Data Platform Engineer, SeniorThe Opportunity:Everyone is trying to “harness the cloud”, but not everyone...  ...clients’ toughest challenges. As a senior platform DevOps engineer at Booz Allen...  ...GEDNice If You Have:Experience with Databricks, Apache Spark, Delta Lake, Snowflake,... 
    Databricks
    Senior
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Alexandria, VA
    3 days ago
  • $80k - $140k

    Job Description Kearney & Company is hiring a Senior Data Engineer - Subject Matter Expert. The Senior Data Engineer SME will design, develop...  ...experience with engineering delivery platforms (such as Databricks, Palantir Foundry, etc.) Experience implementing automated... 
    Databricks
    Senior
    Local area
    Flexible hours

    Kearney & CO Pc

    Alexandria, VA
    3 days ago
  • $147k - $190k

    US-VA Arlington Full time R39896 Senior Data Engineer (SQL Server)- Arlington, VA Job Description Overview CoStar Group (NASDAQ: CSGP...  ...and Finance teams. Our technology stack includes SQL Server, Databricks, Snowflake, Kafka, NiFi, Airflow, Elasticsearch, and AWS.... 
    Databricks
    Senior
    Hourly pay
    Full time
    Work at office
    Work from home
    Monday to Thursday

    CoStar Realty Information, Inc.

    Arlington, VA
    3 days ago
  •  ..., and professionalism.V2X is seeking a Senior Data Analytics/Application Developer to provide...  ...technologies such as Qlik, Tableau, Databricks, Python, Data Definition Language (DDL)...  ...Computer Science, Data Analytics or Software Engineering.Experience:Bachelor’s Degree with 10... 
    Databricks
    Senior
    Work at office

    V2X

    Washington DC
    3 days ago
  • Senior Data Analytics/Application Developer NSI requires a Senior Data Analytics/Application...  ...and technologies (e.g., Qlik, Tableau, Databricks, Python, SQL variants, Power Apps/BI/...  ...Computer Science, Data Analytics, Software Engineering, or a related quantitative/technical... 
    Databricks
    Senior
    Temporary work
    Work at office
    Flexible hours

    ClearanceJobs

    Washington DC
    3 days ago
  • Big Data Engineer Location: Arlington, VA (3 Days onsite/week) Ability to easily move between business, data management, and technical teams...  ..., evaluating, monitoring, and presenting Cloud knowledge (Databricks or AWS ecosystem) is a plus but not required Futran Tech... 
    Databricks
    Senior
    3 days per week

    Futran Tech Solutions Pvt. Ltd.

    Arlington, VA
    3 days ago
  • $125k - $165k

    OverviewWe are looking for seasonedSenior Data Engineer to work with our team and our clients to develop enterprise...  ...grade data platforms, services, and pipelines in Databricks. We are looking for more than just a "Senior Data Engineer", but a technologist with excellent... 
    Databricks
    Senior

    Steampunk

    McLean, VA
    1 day ago
  •  ...Background** We are a remote software engineering team specializing in Data Engineering, AI/ML, and software...  ...We are looking for an experienced Senior Data Engineer to join our team for...  ...Spark, Airflow, Kafka. * Snowflake, Databricks, BigQuery. * AWS, Azure, or... 
    Databricks
    Senior
    Full time
    Remote work

    Aditi Consulting

    Washington DC
    8 days ago
  • Senior Data Engineer Cornerstone Defense is the Employer of Choice within the Intelligence, Defense, and Space communities of the U.S. Government...  ...with at least 2 of the following technologies: Cloudera, DataBricks, Snowflake, NiFi, Python, SQL, Kafka Expert experience... 
    Databricks
    Senior

    Cornerstone Defense

    Mc Lean, VA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Databricks Data Engineer. Be the first to apply!