Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineering Lead

Ignite IT

Job Description

Job Description

Position Overview

The Data Engineering Lead is responsible for designing and implementing modern, scalable data architectures to support migration of legacy, file-based analytical systems to AWS Cloud Native environments.

This role leads the transformation of legacy SAS-based data storage models—including flat files, batch outputs, and subsystem-specific data artifacts—into structured, governed, and scalable data models optimized for cloud-native processing.

The Data Engineering Lead will ensure data integrity, performance, and visibility across a system-of-systems modernization initiative, while providing technical leadership for data modeling, ingestion patterns, validation frameworks, and transparency reporting.

Expert-level proficiency in Python and strong experience designing AWS-based data architectures are required.

 

Key Responsibilities

 

Legacy Data Discovery & Data Model Transformation

  • Participate in structured system inventory efforts to document:
    • Legacy file-based storage structures
    • SAS dataset dependencies
    • Subsystem data flows
    • Manual gating and handoff processes
  • Analyze legacy storage models and design target-state data models aligned to AWS Cloud Native architecture.
  • Replace file-driven batch dependencies with:
    • API-based ingestion
    • Event-driven workflows
    • Database-backed storage (e.g., Aurora/Postgres)
  • Define canonical data schemas and transformation standards.

 

Cloud-Native Data Architecture Design

  • Architect scalable AWS data pipelines using services such as:
    • S3
    • Glue
    • Lambda
    • EventBridge
    • SNS/SQS
    • Aurora/Postgres
    • Batch
    • Athena
  • Design data ingestion, staging, transformation, and validation workflows.
  • Establish schema management, versioning, and data lineage practices.
  • Optimize data storage for performance, scalability, and cost efficiency.
  • Support serverless and containerized data processing architectures.

 

Expert Python-Based Data Engineering

  • Develop advanced Python-based data transformation and validation pipelines.
  • Implement modular, reusable data processing components.
  • Optimize large-scale data manipulation for distributed execution.
  • Develop high-performance ETL/ELT frameworks.
  • Embed automated validation checks directly into data pipelines.

Expert-level Python proficiency is required , particularly for:

  • High-volume data processing
  • Data validation logic
  • Modular data engineering frameworks

 

Data Accuracy, Validation & Visibility

  • Design and implement automated data validation frameworks to ensure:
    • Functional equivalence during migration
    • Record-level and aggregate-level consistency
    • Downstream compatibility across subsystems
  • Develop dashboards and reporting mechanisms providing:
    • Data accuracy metrics
    • Pipeline health indicators
    • Variance detection summaries
  • Enable transparency into data transformation impacts across modernization phases.
  • Support regression validation through golden datasets and automated comparisons.

 

System-of-Systems Data Coordination

  • Coordinate with Senior Developers and Requirements Engineers to align data models with application modernization.
  • Ensure upstream/downstream data contract stability.
  • Prevent data thrashing during phased migration.
  • Support orchestration of gated workflows through automated triggers rather than manual file exchanges.
  • Collaborate across workstreams to establish shared data standards.

 

DevSecOps & Governance Alignment

  • Integrate data pipelines into CI/CD frameworks.
  • Support infrastructure-as-code alignment (Terraform/CloudFormation collaboration).
  • Ensure compliance with security controls (IAM, encryption, key management).
  • Produce documentation supporting:
    • Architecture review boards
    • Interface control documents
    • Data flow diagrams
  • Support ATO-related data validation evidence.

Requirements

Required Qualifications

  • 8+ years of experience in data engineering or data architecture.
  • Expert-level proficiency in Python for data engineering.
  • Demonstrated experience transforming legacy file-based systems into cloud-native data architectures.
  • Experience developing data models for high-volume, data-intensive applications.
  • Deep experience with AWS data services (Glue, Lambda, S3, Aurora/Postgres, EventBridge, etc.).
  • Experience designing scalable ETL/ELT pipelines.
  • Experience building analytical dashboards (e.g., QuickSight or equivalent).
  • Experience implementing automated data validation and quality controls.
  • Experience working in Agile Scrum Teams.
  • U.S. Citizenship required.

 

Preferred Qualifications

  • Experience modernizing SAS-based data environments.
  • Experience supporting system-of-systems integration programs.
  • Experience implementing data lineage and metadata management.
  • Experience operating in regulated or federal environments.

 

Key Competencies

  • Systems-level thinking across data ecosystems
  • Strong schema design and normalization expertise
  • Data accuracy and integrity focus
  • Automation-first mindset
  • Cross-workstream coordination capability

Benefits

  • 401(k) with matching and 100% Vested
  • Health Insurance - 3 plans to select from
  • Dental insurance
  • Vision Insurance
  • Health savings account
  • Life insurance
  • Short Term Disability
  • Long Term Disability
  • AD&D
  • Paid time off
  • Professional development assistance
  • Training
  • Tuition reimbursement
  • Flexible schedule
  • Flexible spending account
  • Referral program
  • Paid Legal Plan
  • and more....

Ignite IT is an Equal Employment Opportunity/Affirmative Action Employer. We evaluate qualified applicants without regard to race, color, religion, sex, national origin, disability, Veteran status, sexual orientation, or other protected characteristic. In accordance with EO 13665 Final Rule, Ignite IT will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant.

Applicants selected may be required to possess and maintain a government clearance

US CITIZENSHIP REQUIRED

Vacancy posted 25 days ago
Similar jobs that could be interesting for youBased on the Data Engineering Lead in Silver Hill, MD vacancy
  •  ...Job Description Job Description Position Overview The Data Engineering Lead is responsible for designing and implementing modern, scalable data architectures to support migration of legacy, file-based analytical systems to AWS Cloud Native environments. This... 
    Suggested
    Contract work
    Temporary work
    Flexible hours

    Ignite IT

    Suitland, MD
    25 days ago
  • $120k - $150k

     ...Federal Gov Positions: Mid, senior and lead Databricks openings REMOTE MUST...  ...datasets, reconciliation routines, and reusable data products supporting a large federal human...  .... Collaborate with data architects, engineering leads, integration engineers, profiling... 
    Suggested
    Remote work

    Judge Group, Inc.

    Arlington, VA
    3 days ago
  • $140k - $180k

     ...Position Summary: The Carlyle Group seeks a hands-on engineering manager to lead AI and data engineering for Global Private Equity (GPE). The team builds and runs the platform that brings together portfolio company, deal, fund, valuation and performance data from Carlyle... 
    Suggested
    Full time
    Contract work
    For contractors

    Carlyle Group

    Washington DC
    12 days ago
  • $130k - $216k

    Job Family:Data Science ConsultingTravel Required:Up to 25%Clearance Required:Ability to...  ...You Will DoLead Databricks data engineering and DataOps delivery across ingestion, transformation...  ..., security, and operational support.Lead engineering reviews and troubleshoot Databricks... 
    Suggested
    Full time
    Flexible hours

    Guidehouse

    Arlington, VA
    2 days ago
  • We Are  The beginning of a new Data & AI decade that will reshape work and society has begun. Accenture is stepping boldly into this...  ...and Power Ecosystem.  You are A strong Data Architect / Data Engineering Lead who can provide technical leadership, architectural direction,... 
    Suggested
    Temporary work
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Arlington, VA
    1 day ago
  • $125k - $180k

     ...requirements and may be required to sign a Letter of Commitment (LOC). Responsibilities We are seeking a  Data Center / Telecommunications Lead Engineer to support a federal agency. Lead data center and telecommunications operations supporting enterprise... 
    Contract work
    Local area
    Monday to Friday
    Day shift

    TekSynap

    Suitland, MD
    2 days ago
  • $99k - $225k

     ...Job Number: R0252574 Data Engineer and Technical Lead The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer... 
    Full time
    Contract work
    Part time
    Local area
    Remote work

    Booz Allen Hamilton

    Alexandria, VA
    4 days ago
  • $125k - $180k

     ...Responsibilities & Qualifications We are seeking a Data Center / Telecommunications Lead Engineer to support a federal agency . Lead data center and telecommunications operations supporting enterprise infrastructure serving as the senior engineering authority... 
    Full time
    Contract work
    Temporary work
    Local area
    Monday to Friday
    Day shift

    TekSynap

    Suitland, MD
    7 hours ago
  •  ...preliminary interviews are being conducted to support timely hiring should authorization be granted.     The successful candidate will lead data systems architecture and integration efforts, supervise and manage data projects and the staff who support them, and ensure data-... 
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    Night shift

    Guardians of Honor Future Work

    Oxon Hill, MD
    1 day ago
  • $80k - $110k

     ...technical issues. Manage, deploy, configure, and maintain core data center hardware, including switches, routers, and high-...  ...Center (formerly Cisco DNA Center) and Cisco Identity Services Engine (ISE) for policy enforcement, device profiling, and automated access... 
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Monday to Friday
    Weekend work
    Day shift
    Afternoon shift

    TekSynap

    Andrews Air Force Base, MD
    2 days ago
  • $80k - $110k

     ...Data Center Engineer Responsibilities include designing, implementing, and maintaining information technology systems, managing data center hardware, and employing enterprise-level network systems. Required qualifications include active Secret clearance, a bachelor... 
    Work at office
    Day shift

    TekSynap

    Clinton, MD
    3 days ago
  •  ...Job Family : Data Science Consulting Travel Required : Up to 10% Clearance Required : Ability to Obtain Public Trust What You Will Do : Lead governance workstreams and small delivery teams to design and implement data/AI governance programs that... 

    Guidehouse

    Washington DC
    1 day ago
  •  ...Analytica is seeking a hands-on  Technical Lead – Data Engineering  to support the design, development, and delivery of modern data and analytics solutions in a cloud-based environment. This role is best suited for a senior engineer who has grown into a leadership... 
    Full time
    For contractors
    Local area

    Analytica

    Bethesda, MD
    a month ago
  •  ...innovative solutions leveraging common standards in architecture, data and security. Altamira believes that our people and the culture...  ...differentiate us from other companies. Position: AI/MLData Engineer Position Location: Tampa, Florida (Downtown) or Joint Base Andrews... 
    Worldwide

    Altamira Technologies

    Suitland, MD
    2 days ago
  • $70k - $110k

     ...generate progress: Harness your expertise to solve challenges and celebrate success! Job Summary JCS Solutions is seeking a Data Center Network Engineer to support mission-critical enterprise network operations for the Air Force National Capital Region (AFNCR). This... 
    Contract work
    Temporary work
    Local area
    Shift work
    Day shift

    JCS Solutions LLC

    Andrews Air Force Base, MD
    2 days ago
  •  ...Job Family : Data Science Consulting Travel Required : None Clearance Required...  ...Do : Guidehouse is seeking a Data Engineer to join our Defense and Security Segment,...  ...ingested into Databricks Organizing and leading client meetings, including scheduling... 

    Guidehouse

    Washington DC
    1 day ago
  •  ...part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and...  ...Job DescriptionAECOM is seeking a Mechanical Engineering Lead with experience on Hyperscale Data Center projects to act as Data Center Mechanical Engineer... 
    Permanent employment
    Work at office
    Local area
    Remote work
    Worldwide
    Relocation
    Visa sponsorship
    Flexible hours

    AECOM

    Arlington, VA
    3 days ago
  • $160.7k - $306.5k

     ...training and more.    Join us to drive positive, lasting change that moves missions and the government forward!   As the Data Engineer Team Lead, you will lead a team of talented engineers responsible for building and maintaining the data lifeblood.  You will provide... 
    Live in
    Work at office
    Local area

    Accenture Federal Services

    Arlington, VA
    1 day ago
  • DescriptionJob Title: ETL/Data EngineerLocation: Hybrid in Suitland, MDClearance: Public Trust; U.S. Citizenship RequiredSummaryActioNet is seeking a ETL/Data Engineer to support high-volume data processing, warehousing, and reporting initiatives for Decennial and Economic... 
    Full time

    ActioNet

    Suitland, MD
    4 days ago
  •  ...requirements. Required capabilities include assisting AAS with leveraging data, automation, and Super Intelligence (SI) to streamline service...  ...to its success. Responsibilities Serve as the Data Lead, providing strategic direction and oversight of data management... 
    Work at office
    Remote work

    Ardent Eagle Solutions

    Washington DC
    2 days ago
  •  ...Charles River Associates seeks an Associate Principal for eDiscovery in Forensic Services to lead data-driven investigations and complex litigation projects. You will leverage Relativity, Nuix, and analytics to process, organize, and produce data while interfacing with... 
    Work at office

    Charles River Associates International

    Washington DC
    3 days ago
  • $150k - $175k

     ...Data Governance Lead Full-time Compensation: USD 150,000 - USD 175,000 yearly Company Description Job Type: Direct Hire We are recruiting exclusively on behalf of a premier data and technology innovation hub and certified Benefit Corporation working at... 
    Full time
    Temporary work
    Work at office
    Immediate start

    FSR Inc

    Washington DC
    3 days ago
  • $150k - $170k

     ...The Data Migration Lead will lead the planning and execution of a large-scale migration from legacy systems to a modern Azure and Power Platform solution. This role ensures business-critical data is analyzed, mapped, transformed, validated, and migrated while maintaining... 
    Contract work

    Procentrix

    Washington DC
    1 day ago
  •  ...Description TeleSolv Consulting has an immediate opportunity to work with the Federal Government as a Mid-Sr. level Data Analytics Team Lead with prior Federal Government Agency experience for a client of ours. This person will be required to work on-site at... 
    Temporary work
    Local area
    Immediate start

    TeleSolv Consulting

    Washington DC
    a month ago
  •  ...for the roadmap, architecture, delivery and operation of data products across our current landscape and build out a...  ...focused on business domains.People and Operating Model:Lead a high-accountability engineering team. Set clear ownership, coach technical and product thinking... 
    Hourly pay
    Work experience placement
    Local area

    GEICO

    Bethesda, MD
    2 days ago
  • $170k

     ...A Day in the Life: The Director, Data Engineer owns the strategy, reliability, and evolution of the enterprise business intelligence and...  ...commensurate with relevant experience. What You'll Do: Lead the strategy, roadmap, and governance of the enterprise BI and... 
    Worldwide

    The Hertz Corporation

    Washington DC
    1 day ago
  • $83.43k - $222.48k

     ...something bigger – helping to simplify health care one person, one family and one community at a time. POSITION SUMMARY The Senior Data Engineer will design, build, and support data engineering solutions on Google Cloud Platform, with a focus on scalable data pipelines,... 
    Hourly pay
    Full time
    Temporary work
    Local area

    CVS Health

    Washington DC
    11 days ago
  • $154 per hour

     ...perspectives to spark change. BCG delivers solutions through leading-edge management consulting along with technology and design...  ...Organization is seeking a knowledgeable and talented Data Protection Engineer that will be responsible for operating and maintaining the... 
    Work at office
    Local area

    Boston Consulting Group

    Washington DC
    4 days ago
  •  ...Company – Our client is a growing global provider of data-driven analytical and technical services supporting critical national security...  ...reputation as a top workplace. Job Title – Senior Data Engineer Location – Hybrid in Alexandria, VA – typically 3 days onsite... 
    Full time
    Remote work

    Covenant HR

    Alexandria, VA
    23 days ago
  • $80k - $120k

     ...800-171 compliance solutioning as well as Enterprise Information Technology Implementation and Services. We are seeking a Data Engineer with immediate availability that will thrive in a challenging and rewarding process-oriented environment. Location: Hybrid... 
    Immediate start

    Anglicotech, LLC

    Washington DC
    a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineering Lead. Be the first to apply!