Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Pipeline Engineer (Elastic)

Serviss

Senior Data Pipeline Engineer

Location: Washington D.C. Area / Remote Employment Type: Full-Time

About SERVISS

At SERVISS, we deliver cutting-edge cybersecurity and IT solutions to government and commercial clients, with a mission to secure systems, data, and critical infrastructure through innovation and expertise. We don't just deploy tools; we engineer mission platforms that become foundational systems of record for cyber operations, compliance automation, and national cyber readiness. From CISA CDM to DoW mission enclaves, our work shapes how government sees, governs, and defends its digital terrain.

On the DHS CDM Data Services Program, our engineers build the data pipelines and Elasticsearch platforms that give agency stakeholders a unified, single-pane-of-glass view of their cyber terrain.

Position Summary

SERVISS is seeking a Senior Data Pipeline Engineer to join an established, mission-critical Pipeline team on the DHS CDM Data Services / BETSIE Program. In this senior role, you will take a leading technical role in the data ingestion and pipeline function that collects asset and cyber-intelligence data from SaaS platforms, primarily Armis and Axonius, and delivers it into Elasticsearch to power a unified single-pane-of-glass dashboard for agency stakeholders.

Our customer's requirements are dynamic and complex. The ideal candidate can engage resources and work across teams to decompose large, complex problems into workable solutions, set technical direction, and mentor junior engineers. An aptitude for strategic planning and the ability to communicate effectively at all levels of the organization are a must. The successful candidate will also serve as a liaison for the customer's data-improvement efforts, participating in regular meetings, representing the program, and supporting the requirements-gathering process.

The Work

This is a hands-on engineering role. The selected candidate will:

  • Architect, automate, and maintain scalable, fault-tolerant data processing pipelines that ingest asset, vulnerability, and configuration data from Armis, Axonius, and other SaaS/API sources into Elasticsearch
  • Handle high-volume, high-velocity data collection, processing, and indexing to support near-real-time visibility
  • Design Elasticsearch index strategies, mappings, ingest pipelines, and transforms; normalize disparate source data to a common schema (e.g., Elastic Common Schema) for consistent search, correlation, and reporting
  • Build and maintain Kibana dashboards and visualizations that deliver a true single-pane-of-glass view of the agency's technical posture
  • Own API integration patterns against evolving vendor APIs, including authentication and token management, pagination, rate limiting, incremental/delta ingestion, and resilient error handling and retry logic
  • Implement automated reconciliation and data-quality checks to ensure ingested data is complete, consistent, and accurate against source systems; document and maintain data lineage and traceability of transformed data back to source
  • Manage index lifecycle (ILM), retention, sharding, and cluster performance tuning for high-volume, low-latency operations
  • Instrument pipelines with monitoring, alerting, and logging so data-flow issues are detected and resolved before they reach stakeholders
  • Follow programming best practices, emphasizing code reusability and highly automated CI/CD pipelines for scalability
Key Responsibilities
  • Serve as a leading technical resource for the data ingestion and pipeline function on the DHS CDM Data Services / BETSIE Program
  • Set technical direction and decompose large, complex problems into workable solutions across teams
  • Establish and enforce data governance, validation, and documentation standards; review designs and mentor junior engineers on the team
  • Serve as a liaison for the customer's data-improvement efforts, participating in regular meetings, representing the program, and supporting requirements gathering
  • Communicate complex data and pipeline concepts to non-technical audiences, translating them into actionable recommendations
Required Qualifications
  • US citizenship with the ability to obtain Public Trust Suitability
  • Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (master's degree preferred)
  • A minimum of six years of experience designing, implementing, and managing the technical delivery of large-scale data engineering or data pipeline services to diverse organizations
  • 4+ years hands-on with Elasticsearch or OpenSearch: index design, mappings, ingest pipelines, query/aggregation, and cluster performance tuning
  • Strong experience integrating REST APIs from SaaS platforms, including authentication, pagination, rate limiting, incremental ingestion, and resilient error handling
  • Proficiency with a scripting/pipeline language (Python strongly preferred) and with ETL/ELT tooling such as Logstash, Elastic Agent/Beats, or equivalent
  • Experience designing, implementing, and managing data schemas that comply with cyber-relevant data standards and frameworks, e.g., SCAP, STIX, OTEL, Elastic Common Schema, and Splunk Common Information Model
  • Knowledge of data transformation processes and experience documenting and maintaining data lineage, especially traceability of transformed data to source data
  • Solid data modeling and normalization skills for heterogeneous sources, including mapping to a common schema
  • Knowledge of Federal Cybersecurity and Risk Management policies and practices, including FISMA; NIST SP 800-37, 800-53, 800-30, and 800-39; and FedRAMP
  • Solid understanding of Git, version control workflows, and CI/CD
Preferred Qualifications
  • Direct experience integrating Armis and/or Axonius, or comparable CAASM / asset-intelligence platforms (e.g., Tenable, Qualys, ServiceNow)
  • Experience utilizing data cataloging and governance tools (e.g., Alation, Collibra)
  • Containerization and orchestration (Docker, Kubernetes) and infrastructure-as-code (Terraform, Ansible)
  • CI/CD tooling (GitLab CI, Jenkins) and DevSecOps practices in cloud (AWS GovCloud / Azure Government a plus)
  • Experience with monitoring/observability tooling and data-reconciliation frameworks
  • Knowledge of cybersecurity tools and technologies
  • Active DHS Public Trust or prior EOD
  • Familiarity with Agile / SCRUM methodologies
  • Strong problem-solving and analytical skills, with a sense of urgency and the ability to prioritize and balance multiple tasks
Freedom to Thrive

Why Join SERVISS? Our goal as an employer is simple yet profound: to create an environment where you can be your best self, pursue your passions, and enjoy the freedom to thrive both personally and professionally. Your success is our success, and we're committed to supporting you every step of the way.

  • Highly competitive compensation and best in class benefits
  • 100% of medical, vision, dental, and life insurance premiums paid for by SERVISS
  • Be part of an exciting company with ground floor opportunities in the Equity Participation Program
  • Opportunities for annual performance bonuses and growth incentives
  • 401(k) retirement plan with 6% dollar for dollar match
Additional Considerations for HUBZone applicants: Preference may be given to applicants residing in a federal HUBZone in support of SERVISS LLC's HUBZone workforce objectives; all qualified candidates are encouraged to apply.

How to Determine HUBZone Residency: Candidates can verify HUBZone eligibility by entering their home address into the SBA HUBZone Map at . If your residence falls within a designated HUBZone area on the map, you are considered a HUBZone resident for hiring preference purposes.

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Pipeline Engineer (Elastic) in United States vacancy
  •  ...Senior Data Pipeline Engineer Freelancer Decentriq is the rising leader in data-clean-room technology. With Decentriq, advertisers, retailers, and publishers securely collaborate on 1st-party data for optimal audience targeting and campaign measurement. Headquartered... 
    Senior
    Freelance
    Work at office
    Immediate start
    Remote work

    Decentriq

    United States
    4 days ago
  • Accenture Federal Services is seeking a data engineering professional to design and optimize data pipelines while ensuring data quality and security. You will provide analytical enablement across federal government missions. You will design pipelines with Spark, Iceberg... 
    Senior

    Accenture Federal Services

    Mc Lean, VA
    4 days ago
  • Dormont Manufacturing Co is seeking a Senior Engineer with expertise in Cloudflare’s storage and database products to shape innovative solutions that redefine developer needs. You will own and deliver code solutions interacting with various technologies, fostering unparalleled... 
    Senior

    Dormont Manufacturing Company

    Austin, TX
    1 day ago
  • $174.72k - $295.68k

     ...Infrastructure team, you will be responsible for building the end-to-end data pipeline for autonomous driving, covering the entire chain from...  ...'s degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or related fields.3-5+ years of experience... 
    Senior
    Full time
    Overseas

    XPENG Motors

    Santa Clara, CA
    5 days ago
  • Nuance Labs based in Seattle is seeking a Member of Technical Staff — ML Infra (Data) to design and operate large-scale data pipelines. You will work on processing and curating multimodal training data, ensuring high-quality standards at scale. The ideal candidate has... 
    Senior

    Nuance Labs, Inc.

    Seattle, WA
    3 days ago
  • Jobtailor in Kentucky is seeking a Data Engineer to design, build, and maintain scalable data pipelines and ETL/ELT processes, leveraging Python, PySpark, and Java to transform large datasets. You will ingest structured and unstructured data via REST APIs, streaming platforms... 
    Senior

    Jobtailor

    Brooklyn, NY
    1 day ago
  • Redwood is building a local-global battery supply chain, delivering production-grade data pipelines for reporting and automation. The role focuses on code-based data analyses, not BI tooling, and requires translating business needs into scalable data solutions. You will... 
    Senior
    Local area

    NextGenEnergyJobs

    San Francisco, CA
    4 days ago
  • SERVISS LLC is seeking a Junior to Mid Data Pipeline Engineer to join the DHS CDM Data Services Program in the...  ...for agency stakeholders. You will work with senior engineers to grow deep expertise in data engineering, Elastic Stack, and federal cybersecurity operations,... 
    Remote job

    SERVISS LLC

    Arlington, VA
    3 days ago
  • DescriptionOur SE Region is seeking experienced Pipeline Engineers to sit in either our Atlanta, GA or Charlotte, NC offices and be responsible for oversight of pipeline engineering and consulting services for clients across the US. Main responsibilities include leading... 
    Senior
    Temporary work

    Burns & McDonnell

    Atlanta, GA
    5 days ago
  • $206.3k - $388k

    ABOUT THE ROLE We’re looking for a Principal ML Engineer to architect and scale the multimodal data processing pipelines and infrastructure behind Adobe Firefly’s...  ...quality of data that reaches training. This is a senior individual contributor role with broad technical... 
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe Systems

    Seattle, WA
    2 days ago
  • NegotiableHouston, Texas Permanent Our client is seeking a Senior Pipeline Engineer to join their team within the Oil & Gas sector, focusing on transmission and distribution projects. This permanent position offers the opportunity to lead pipeline... 
    Senior
    Permanent employment

    Matchtech

    Houston, TX
    5 days ago
  •  ...MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. In this role, you will...  ...within a Big Data environment. Develop ad-hoc ETL pipelines and build data profiling, deduping, and matching logic to analyze... 
    Senior
    Work at office

    MANTECH

    Chantilly, Loudoun County, VA
    5 hours ago
  • DescriptionDescription - ExternalThe Senior Pipeline Engineer would sit in our Minneapolis office and be responsible for oversight pipeline engineering and consulting services for clients across the US. Main responsibilities include leading others in creating pipeline... 
    Senior
    Temporary work
    Work at office

    Burns & McDonnell

    Minneapolis, MN
    5 days ago
  • $96.25k - $125k

    The Data Analytics Engineer is responsible for building the DISH Wireless Commercial data integrations...  ...will focus on building the data pipelines, insights, KPIs, and metrics using the...  ...build data and analytics solutions on the Elastic stack Analyze business and technical requirements... 
    Senior
    Flexible hours

    Dish Network Corporation

    Littleton, CO
    5 days ago
  • DescriptionThe Senior Pipeline Engineer will lead pipeline design project teams to create world designs for new projects, alterations and redevelopments...  ...: packaged equipment and construction specifications and data sheets, Requests for Qualifications (RFQs), technical bid... 
    Senior
    For contractors

    Burns & McDonnell

    Chicago, IL
    5 days ago
  • This Opportunity WSP USA Inc is currently seeking a Senior Pipeline Engineer to work out of our office in Chicago, Illinois. The following locations will also be considered: Indianapolis, IN, Cincinnati, OH, Cleveland, OH, Columbus, OH, Lansing, MI, Holland, MI, Detroit... 
    Senior
    For contractors
    Work at office
    Local area
    Flexible hours

    WSP Group

    Chicago, IL
    3 days ago
  • Job ID: 21061868Reference Number: 24-00028Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-05Company: HAN StaffingDE
    Senior

    HAN Staffing

    Iselin, NJ
    1 day ago
  •  ...EADs except H1B, OPT, CPT \ Must Have: \ \ ~4–6+ years of data science or machine learning experience \ ~ NLP classification...  ...and channel mix. \ Design maintainable Python and PySpark data pipelines. \ Define sampling strategies and annotation guidelines for labeled... 
    Senior
    Full time
    H1b
    Remote work

    Akube

    United States
    1 day ago
  • Job ID: 21057342Reference Number: 24-00019Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-04Company: HAN StaffingData Engineer
    Senior

    HAN Staffing

    Iselin, NJ
    1 day ago
  • THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham... 
    Senior
    Work at office

    Harnham

    Chicago, IL
    4 days ago
  •  ...hybridExperience with UC delta share and UC cataloguesImplemented ALMLOpsJob DutiesWrite and manage notebooks in DatabricksImplementing new data analytics requirement using ADLS Gen2 Pyspark Python Scala and SQLJob monitoring problem solving of iris service now ticketsCode... 
    Senior

    LTM

    Raritan, NJ
    2 days ago
  •  ...Data Pipeline Engineer Location: 100% remote The Role As a Data Pipeline Reliability Engineer (DPRE), you ensure stability and reliability of mission-critical workflows builds software. You gather signal by going on call — resolving problems before the customer... 
    Immediate start
    Remote work
    Weekend work

    Saxon Global

    United States
    4 days ago
  •  ...Data Pipeline Engineer Location: Remote (US / India / Global - based on project needs) Employment Type: Contract / Full-Time Industry: Healthcare, Life Sciences, Data & AI Experience: 5-10+ years (flexible based on strength) About BigRio BigRio is... 
    Full time
    Contract work
    Remote work
    Flexible hours

    Saviance

    Boston, MA
    1 day ago
  • Job ID: 21295731Reference Number: 24-00153Title: Senior Healthcare Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-07Company:...  ...Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL,... 
    Senior
    Contract work
    Remote work

    HAN Staffing

    Iselin, NJ
    1 day ago
  •  ...Data Pipeline Engineer role Remote Must have on resume - 7 years of data engineering with experience with large scale data harmonization, healthcare sector, Databricks, Python, SQL, PySpark, Azure SQL, ETL, Docker, Kubernetes Need MMDD/Last 4 of SSN... 
    Remote work

    3B Staffing LLC

    Dallas, TX
    4 days ago
  • TBDGen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability...
    Senior
    Full time

    Gen Digital

    Tempe, AZ
    5 days ago
  •  ...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Senior Data EngineerLocation - Mount Laurel, NJ (Day 1 Onsite)Job Description:Senior Data Engineer with 10 + years of experienceWorked on ETL, Azure, Databricks, Informatica, Oracle... 
    Senior
    Work at office

    SRI Tech

    Mount Laurel, NJ
    5 days ago
  •  ...DeveloperWork Location : Tampa, FloridaJob SummarySeeking an experienced Ab Initio Python Developer with strong expertise in ETL development data integration and enterprise data processing The candidate will be responsible for designing developing supporting and optimizing... 
    Senior

    LTM

    Tampa, FL
    2 days ago
  •  ...Hybrid Are you passionate about using data and technology to improve health...  ...Position Summary PCCI is seeking a Senior Data Engineer for a contract-to-hire opportunity ....  ...developing, and maintaining enterprise data pipelines, data warehouse solutions, and database... 
    Senior
    Long term contract
    Contract work

    Parkland Health and Hospital System

    Dallas, TX
    3 hours ago
  •  ...Chukka, Gulam Mohammed , Jhansi Bugatha, Vamsi SattaruCompany: SRI Tech SolutionsJob Summary (Senior ML Data Engineer) - Lead the design and maintenance of scalable data pipelines using Databricks, Spark, and Airflow. - Develop and manage Feature Stores to support machine... 
    Senior
    Hourly pay

    SRI Tech

    Atlanta, GA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Pipeline Engineer (Elastic). Be the first to apply!