Senior Software Engineer of Data Platform and Services

Role Description

We are looking for a Senior Software Engineer to join our globally distributed Data Platform team in Europe. This is a high-impact individual contributor role focused on driving the migration of our core data pipelines to modern, scalable platforms. You will take technical ownership of migrating legacy Hadoop/Spark/Impala systems to a modern Databricks-centric stack. This role is ideal for a hands-on engineer who is passionate about modernizing data stacks and influencing platform architecture in a large-scale, global environment.

Key Responsibilities & Impact

• Data Pipeline Migration: Own and drive the migration of legacy data pipelines (Hadoop, Spark, Impala) to modern platforms, with a primary focus on Databricks. This includes porting complex SQL, re-architecting ETL scripts, and migrating connections and secrets.
• Accelerated Migration through "Vibe Coding": Leverage state-of-the-art AI coding assistants (such as Claude and Codex) to automate and accelerate the conversion process.
• Develop and Modernize: Design, build, and maintain scalable Airflow DAGs and Databricks Jobs for large-scale data pipelines.
• Ensure Data Integrity: Implement and execute robust validation strategies to ensure data parity and quality between legacy and modern systems throughout the migration process.
• Drive Operational Excellence: Enhance our data platform's reliability by contributing to SLOs/SLAs, observability, and incident response practices.
• Data Experience: Possess a strong understanding of contact center analytics and the data used to measure and improve customer interactions.

Qualifications

• 6–8 years of software engineering experience with a strong background in distributed systems and large-scale data platforms.
• Experience driving or heavily contributing to legacy-to-modern platform migrations (e.g., Hadoop/Impala to Databricks).
• Strong understanding of the Databricks Ecosystem, including Jobs, Delta Lake, and cluster configuration/optimization.
• Proficient in Python for ETL scripting and deep expertise with Databricks for designing, debugging, and rewriting production DAGs.
• Experience with cloud-native data storage (specifically Google Cloud Storage) and interfacing with Kubernetes (GKE) microservice architectures.
• Deep understanding of distributed data processing and real-time vs. batch trade-offs.
• Familiarity with data integration patterns (connectors, webhooks, event-driven systems).
• Experience managing and integrating with cloud-native data infrastructure (GCP preferred).
• Strong focus on platform reliability, scalability, observability, and data parity validation.
• Excellent "vibe coding" skills: comfortable guiding, prompt engineering, and utilizing AI-assisted development tools.
• Comfort working across multiple regions and collaborating with globally distributed teams (US, EU, Israel, India).

Requirements

• Experience in conversational AI, contact center platforms, or customer engagement systems (nice to have).
• Experience with Java or Scala, particularly for deciphering legacy codebases during migration (nice to have).
• Experience with CI/CD pipelines (nice to have).

Benefits

• Financial Security & Growth: Additional pension scheme (LivePerson contributes 20%), ESPP, and annual bonus depending on achievements.
• Equipment: Internet and mobile reimbursement.
• Development: Access to internal professional development resources.
• Time Away & Family Support: Flexible Paid Time Off (PTO): Personal time off 33 days, vacation (28 days), and care days (5).
• Paid public holidays.
• Volunteering days to make a difference in your community.
• Workplace Flexibility: Remote-first model with no defined working hours or boundaries.
• Join our monthly connection pizza day in the office!