Senior Data Pipeline Engineer (Elastic)
Serviss
Senior Data Pipeline Engineer
Location: Washington D.C. Area / Remote Employment Type: Full-Time
About SERVISS
At SERVISS, we deliver cutting-edge cybersecurity and IT solutions to government and commercial clients, with a mission to secure systems, data, and critical infrastructure through innovation and expertise. We don't just deploy tools; we engineer mission platforms that become foundational systems of record for cyber operations, compliance automation, and national cyber readiness. From CISA CDM to DoW mission enclaves, our work shapes how government sees, governs, and defends its digital terrain.
On the DHS CDM Data Services Program, our engineers build the data pipelines and Elasticsearch platforms that give agency stakeholders a unified, single-pane-of-glass view of their cyber terrain.
Position Summary
SERVISS is seeking a Senior Data Pipeline Engineer to join an established, mission-critical Pipeline team on the DHS CDM Data Services / BETSIE Program. In this senior role, you will take a leading technical role in the data ingestion and pipeline function that collects asset and cyber-intelligence data from SaaS platforms, primarily Armis and Axonius, and delivers it into Elasticsearch to power a unified single-pane-of-glass dashboard for agency stakeholders.
Our customer's requirements are dynamic and complex. The ideal candidate can engage resources and work across teams to decompose large, complex problems into workable solutions, set technical direction, and mentor junior engineers. An aptitude for strategic planning and the ability to communicate effectively at all levels of the organization are a must. The successful candidate will also serve as a liaison for the customer's data-improvement efforts, participating in regular meetings, representing the program, and supporting the requirements-gathering process.
The Work
This is a hands-on engineering role. The selected candidate will:
- Architect, automate, and maintain scalable, fault-tolerant data processing pipelines that ingest asset, vulnerability, and configuration data from Armis, Axonius, and other SaaS/API sources into Elasticsearch
- Handle high-volume, high-velocity data collection, processing, and indexing to support near-real-time visibility
- Design Elasticsearch index strategies, mappings, ingest pipelines, and transforms; normalize disparate source data to a common schema (e.g., Elastic Common Schema) for consistent search, correlation, and reporting
- Build and maintain Kibana dashboards and visualizations that deliver a true single-pane-of-glass view of the agency's technical posture
- Own API integration patterns against evolving vendor APIs, including authentication and token management, pagination, rate limiting, incremental/delta ingestion, and resilient error handling and retry logic
- Implement automated reconciliation and data-quality checks to ensure ingested data is complete, consistent, and accurate against source systems; document and maintain data lineage and traceability of transformed data back to source
- Manage index lifecycle (ILM), retention, sharding, and cluster performance tuning for high-volume, low-latency operations
- Instrument pipelines with monitoring, alerting, and logging so data-flow issues are detected and resolved before they reach stakeholders
- Follow programming best practices, emphasizing code reusability and highly automated CI/CD pipelines for scalability
Key Responsibilities
- Serve as a leading technical resource for the data ingestion and pipeline function on the DHS CDM Data Services / BETSIE Program
- Set technical direction and decompose large, complex problems into workable solutions across teams
- Establish and enforce data governance, validation, and documentation standards; review designs and mentor junior engineers on the team
- Serve as a liaison for the customer's data-improvement efforts, participating in regular meetings, representing the program, and supporting requirements gathering
- Communicate complex data and pipeline concepts to non-technical audiences, translating them into actionable recommendations
Required Qualifications
- US citizenship with the ability to obtain Public Trust Suitability
- Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (master's degree preferred)
- A minimum of six years of experience designing, implementing, and managing the technical delivery of large-scale data engineering or data pipeline services to diverse organizations
- 4+ years hands-on with Elasticsearch or OpenSearch: index design, mappings, ingest pipelines, query/aggregation, and cluster performance tuning
- Strong experience integrating REST APIs from SaaS platforms, including authentication, pagination, rate limiting, incremental ingestion, and resilient error handling
- Proficiency with a scripting/pipeline language (Python strongly preferred) and with ETL/ELT tooling such as Logstash, Elastic Agent/Beats, or equivalent
- Experience designing, implementing, and managing data schemas that comply with cyber-relevant data standards and frameworks, e.g., SCAP, STIX, OTEL, Elastic Common Schema, and Splunk Common Information Model
- Knowledge of data transformation processes and experience documenting and maintaining data lineage, especially traceability of transformed data to source data
- Solid data modeling and normalization skills for heterogeneous sources, including mapping to a common schema
- Knowledge of Federal Cybersecurity and Risk Management policies and practices, including FISMA; NIST SP 800-37, 800-53, 800-30, and 800-39; and FedRAMP
- Solid understanding of Git, version control workflows, and CI/CD
Preferred Qualifications
- Direct experience integrating Armis and/or Axonius, or comparable CAASM / asset-intelligence platforms (e.g., Tenable, Qualys, ServiceNow)
- Experience utilizing data cataloging and governance tools (e.g., Alation, Collibra)
- Containerization and orchestration (Docker, Kubernetes) and infrastructure-as-code (Terraform, Ansible)
- CI/CD tooling (GitLab CI, Jenkins) and DevSecOps practices in cloud (AWS GovCloud / Azure Government a plus)
- Experience with monitoring/observability tooling and data-reconciliation frameworks
- Knowledge of cybersecurity tools and technologies
- Active DHS Public Trust or prior EOD
- Familiarity with Agile / SCRUM methodologies
- Strong problem-solving and analytical skills, with a sense of urgency and the ability to prioritize and balance multiple tasks
Freedom to Thrive
Why Join SERVISS? Our goal as an employer is simple yet profound: to create an environment where you can be your best self, pursue your passions, and enjoy the freedom to thrive both personally and professionally. Your success is our success, and we're committed to supporting you every step of the way.
- Highly competitive compensation and best in class benefits
- 100% of medical, vision, dental, and life insurance premiums paid for by SERVISS
- Be part of an exciting company with ground floor opportunities in the Equity Participation Program
- Opportunities for annual performance bonuses and growth incentives
- 401(k) retirement plan with 6% dollar for dollar match
Additional Considerations for HUBZone applicants: Preference may be given to applicants residing in a federal HUBZone in support of SERVISS LLC's HUBZone workforce objectives; all qualified candidates are encouraged to apply.
How to Determine HUBZone Residency: Candidates can verify HUBZone eligibility by entering their home address into the SBA HUBZone Map at . If your residence falls within a designated HUBZone area on the map, you are considered a HUBZone resident for hiring preference purposes.
- ...Senior Data Pipeline Engineer Freelancer Decentriq is the rising leader in data-clean-room technology. With Decentriq, advertisers, retailers, and publishers securely collaborate on 1st-party data for optimal audience targeting and campaign measurement. Headquartered...SeniorFreelanceWork at officeImmediate startRemote work
- Accenture Federal Services is seeking a data engineering professional to design and optimize data pipelines while ensuring data quality and security. You will provide analytical enablement across federal government missions. You will design pipelines with Spark, Iceberg...Senior
- Dormont Manufacturing Co is seeking a Senior Engineer with expertise in Cloudflare’s storage and database products to shape innovative solutions that redefine developer needs. You will own and deliver code solutions interacting with various technologies, fostering unparalleled...Senior
$174.72k - $295.68k
...Infrastructure team, you will be responsible for building the end-to-end data pipeline for autonomous driving, covering the entire chain from... ...'s degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or related fields.3-5+ years of experience...SeniorFull timeOverseas- Nuance Labs based in Seattle is seeking a Member of Technical Staff — ML Infra (Data) to design and operate large-scale data pipelines. You will work on processing and curating multimodal training data, ensuring high-quality standards at scale. The ideal candidate has...Senior
- Jobtailor in Kentucky is seeking a Data Engineer to design, build, and maintain scalable data pipelines and ETL/ELT processes, leveraging Python, PySpark, and Java to transform large datasets. You will ingest structured and unstructured data via REST APIs, streaming platforms...Senior
- Redwood is building a local-global battery supply chain, delivering production-grade data pipelines for reporting and automation. The role focuses on code-based data analyses, not BI tooling, and requires translating business needs into scalable data solutions. You will...SeniorLocal area
- SERVISS LLC is seeking a Junior to Mid Data Pipeline Engineer to join the DHS CDM Data Services Program in the... ...for agency stakeholders. You will work with senior engineers to grow deep expertise in data engineering, Elastic Stack, and federal cybersecurity operations,...Remote job
- DescriptionOur SE Region is seeking experienced Pipeline Engineers to sit in either our Atlanta, GA or Charlotte, NC offices and be responsible for oversight of pipeline engineering and consulting services for clients across the US. Main responsibilities include leading...SeniorTemporary work
$206.3k - $388k
ABOUT THE ROLE We’re looking for a Principal ML Engineer to architect and scale the multimodal data processing pipelines and infrastructure behind Adobe Firefly’s... ...quality of data that reaches training. This is a senior individual contributor role with broad technical...Full timeTemporary workLocal areaWorldwide- NegotiableHouston, Texas Permanent Our client is seeking a Senior Pipeline Engineer to join their team within the Oil & Gas sector, focusing on transmission and distribution projects. This permanent position offers the opportunity to lead pipeline...SeniorPermanent employment
- ...MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. In this role, you will... ...within a Big Data environment. Develop ad-hoc ETL pipelines and build data profiling, deduping, and matching logic to analyze...SeniorWork at office
- DescriptionDescription - ExternalThe Senior Pipeline Engineer would sit in our Minneapolis office and be responsible for oversight pipeline engineering and consulting services for clients across the US. Main responsibilities include leading others in creating pipeline...SeniorTemporary workWork at office
$96.25k - $125k
The Data Analytics Engineer is responsible for building the DISH Wireless Commercial data integrations... ...will focus on building the data pipelines, insights, KPIs, and metrics using the... ...build data and analytics solutions on the Elastic stack Analyze business and technical requirements...SeniorFlexible hours- DescriptionThe Senior Pipeline Engineer will lead pipeline design project teams to create world designs for new projects, alterations and redevelopments... ...: packaged equipment and construction specifications and data sheets, Requests for Qualifications (RFQs), technical bid...SeniorFor contractors
- This Opportunity WSP USA Inc is currently seeking a Senior Pipeline Engineer to work out of our office in Chicago, Illinois. The following locations will also be considered: Indianapolis, IN, Cincinnati, OH, Cleveland, OH, Columbus, OH, Lansing, MI, Holland, MI, Detroit...SeniorFor contractorsWork at officeLocal areaFlexible hours
- Job ID: 21061868Reference Number: 24-00028Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-05Company: HAN StaffingDESenior
- ...EADs except H1B, OPT, CPT \ Must Have: \ \ ~4–6+ years of data science or machine learning experience \ ~ NLP classification... ...and channel mix. \ Design maintainable Python and PySpark data pipelines. \ Define sampling strategies and annotation guidelines for labeled...SeniorFull timeH1bRemote work
- Job ID: 21057342Reference Number: 24-00019Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-04Company: HAN StaffingData EngineerSenior
- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...SeniorWork at office
- ...hybridExperience with UC delta share and UC cataloguesImplemented ALMLOpsJob DutiesWrite and manage notebooks in DatabricksImplementing new data analytics requirement using ADLS Gen2 Pyspark Python Scala and SQLJob monitoring problem solving of iris service now ticketsCode...Senior
- ...Data Pipeline Engineer Location: 100% remote The Role As a Data Pipeline Reliability Engineer (DPRE), you ensure stability and reliability of mission-critical workflows builds software. You gather signal by going on call — resolving problems before the customer...Immediate startRemote workWeekend work
- ...Data Pipeline Engineer Location: Remote (US / India / Global - based on project needs) Employment Type: Contract / Full-Time Industry: Healthcare, Life Sciences, Data & AI Experience: 5-10+ years (flexible based on strength) About BigRio BigRio is...Full timeContract workRemote workFlexible hours
- Job ID: 21295731Reference Number: 24-00153Title: Senior Healthcare Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-07Company:... ...Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL,...SeniorContract workRemote work
- ...Data Pipeline Engineer role Remote Must have on resume - 7 years of data engineering with experience with large scale data harmonization, healthcare sector, Databricks, Python, SQL, PySpark, Azure SQL, ETL, Docker, Kubernetes Need MMDD/Last 4 of SSN...Remote work
- TBDGen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability...SeniorFull time
- ...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Senior Data EngineerLocation - Mount Laurel, NJ (Day 1 Onsite)Job Description:Senior Data Engineer with 10 + years of experienceWorked on ETL, Azure, Databricks, Informatica, Oracle...SeniorWork at office
- ...DeveloperWork Location : Tampa, FloridaJob SummarySeeking an experienced Ab Initio Python Developer with strong expertise in ETL development data integration and enterprise data processing The candidate will be responsible for designing developing supporting and optimizing...Senior
- ...Hybrid Are you passionate about using data and technology to improve health... ...Position Summary PCCI is seeking a Senior Data Engineer for a contract-to-hire opportunity .... ...developing, and maintaining enterprise data pipelines, data warehouse solutions, and database...SeniorLong term contractContract work
- ...Chukka, Gulam Mohammed , Jhansi Bugatha, Vamsi SattaruCompany: SRI Tech SolutionsJob Summary (Senior ML Data Engineer) - Lead the design and maintenance of scalable data pipelines using Databricks, Spark, and Airflow. - Develop and manage Feature Stores to support machine...SeniorHourly pay
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Pipeline Engineer (Elastic). Be the first to apply!
- junior data engineer remote United States
- data pipeline engineer United States
- director data engineering United States
- hadoop big data developer United States
- data engineer intern United States
- senior data quality engineer United States
- senior cloud data engineer United States
- data engineer contract United States
- data infrastructure engineer United States
- junior data developer United States




