Data Pipeline Engineer

Role: Data Pipeline Engineer


Location: 100% remote


Clearance: None


IV Process: Hackerrank, followed by 2 Teams IVs

The Role

As a Data Pipeline Reliability Engineer (DPRE), you ensure stability and reliability of mission-critical workflows builds software. You gather signal by going on call - resolving problems before the customer is impacted - and use those learnings to drive product change, shape our internal tooling, and refine our operational processes such that we provide an increasing quality of service to more and more customers.

Your approach is hands-on and pragmatic: you'll rapidly address issues as they arise with quick and effective solutions and advocate for longer-term workflow or product improvements after the immediate issue is resolved. You are energized by engaging directly with problems, whether that means writing a script to automate a manual task, iterating on a workaround, or building a case for a product enhancement. You don't just fix issues- you look for opportunities to simplify, automate, and make the entire system more resilient.

A DPRE synthesizes learnings from support into best practices for others to follow. These are captured into documentation and shared with the team and broader organization. In this way, you raise the bar for reliability and efficiency across Palantir.


Core Responsibilities

1. 1. Develop a deep understanding of products and operational processes.

1. 1. Go on-call, responding quickly and effectively to mission-critical incidents.

1. 1. Diagnose, resolve, and proactively prevent issues encountered in the field.

1. 1. Collaborate with internal stakeholders to increase the scalability and reliability of Foundry workflows for our customers.

1. 1. Identify recurring pain points and inefficiencies, and take initiative to automate or streamline workflows.

1. 1. Advocate for and implement product enhancements based on insights gleamed from the field.

1. 1. Create clear, actionable documentation and share best practices to elevate team and company-wide reliability.

Note: While active work is not required on weekends or outside business hours, you must be available to respond to critical outages during assigned on-call weeks.


What We Value

1. 1. Proficiency in Python, Java, and SQL.

1. 1. Familiarity with parallel data processing and Spark job optimization.

1. 1. Strong organizational skills and attention to detail, with the ability to prioritize effectively.

1. 1. Resourcefulness and creativity in fast-paced dynamic environments.

1. 1. Ability to work independently and collaboratively to solve ambiguous technical and operational challenges.

1. 1. Experience with root cause analysis and documenting solutions for broader impact.

1. 1. Enthusiasm for hands-on problem solving, continuous improvement, and knowledge sharing.

What We Require

1. 1. Background in Computer Science, Engineering, Information Systems, or other technical field.