SENIOR DATA ENGINEER

Data Pipeline EngineerWe are seeking a Data Pipeline Engineer to design, build, and maintain scalable data pipelines in support of mission-critical environments. This role focuses on working within the Palantir ecosystem to integrate, transform, and operationalize complex datasets while ensuring reliability, performance, and data integrity. This is a highly technical, hands-on position ideal for engineers with experience in distributed data processing, backend systems, and troubleshooting complex data workflows.Key Responsibilities:Design, develop, and maintain scalable data pipelines supporting structured and unstructured dataBuild and optimize ETL/ELT workflows within Palantir Foundry or similar data platformsDevelop data processing solutions using Python, PySpark, Spark, and/or PolarsDebug and troubleshoot pipeline failures, data inconsistencies, and performance bottlenecksBuild and integrate APIs and backend services to support data ingestion and transformationAnalyze and trace network traffic and data flows to support system-level troubleshootingReverse engineer backend processes and data services to resolve complex technical issuesImplement monitoring, logging, and data pipeline reliability improvementsCollaborate with cross-functional teams to enhance data workflows and platform usabilityEnsure data quality, governance, and consistency across data systemsRequired Qualifications:Active TS/SCI clearanceStrong proficiency in Python developmentHands-on experience with PySpark, Apache Spark, and/or Polars for distributed data processingExperience building and maintaining data pipelines and ETL/ELT workflowsExperience working with Palantir Foundry or similar data platformsExperience developing and debugging APIs, endpoints, and backend servicesAbility to trace and analyze network traffic and system interactionsExperience troubleshooting complex, production-level data issuesStrong understanding of data structures, data modeling, and pipeline architectureExperience with Git/version control and CI/CD practicesPreferred Qualifications:Experience working in high-reliability or production-critical environmentsKnowledge of distributed systems and large-scale data processing frameworksExperience with streaming pipelines (Kafka, Spark Streaming, etc.)Familiarity with cloud platforms (AWS or similar)Experience with data visualization or analytics toolsBackground in software engineering or backend systems developmentEducation:Bachelor's degree in Computer Science, Engineering, or related fieldEquivalent hands-on experience may be consideredWhy This Role:Work directly with cutting-edge data platforms and large-scale pipelinesSolve complex, real-world data engineering challengesHighly technical environment with strong engineering ownershipStable, long-term onsite work in the DC market