Software Systems Engineer

Software Systems Engineer III

We are seeking an experienced Software Systems Engineer III to join our cloud data engineering team. This senior-level position requires a seasoned professional with over 10 years of software development experience who can architect and implement scalable data solutions using modern cloud technologies. You will lead the hands-on design and development of complex data pipelines, collaborating closely with engineers across multiple time zones and offshore teams to deliver high-quality, production-ready solutions. This role combines hands-on development with technical leadership, requiring expertise in Python, Spark, Azure Data Factory, Databricks, and cloud infrastructure. You will work in a fast-paced agile environment, contributing to sprint planning, code reviews, and continuous improvement initiatives while maintaining strong communication with distributed team members.

Responsibilities

• Design and build cloud-based data solutions, including the implementation and management of Azure infrastructure components such as Azure API Management (APIM), infrastructure as code, automated deployment pipelines, and monitoring systems, with a strong working understanding of Azure networking and security concepts
• Design, develop, and maintain enterprise-scale data processing pipelines using Apache Spark, Azure Data Factory, and Databricks platforms
• Lead technical implementation of cloud-based data solutions, ensuring scalability, reliability, and performance optimization across distributed systems
• Collaborate daily with offshore development teams across multiple time zones, facilitating knowledge transfer, code reviews, and technical discussions through effective communication channels
• Participate actively in agile ceremonies including sprint planning, daily standups, retrospectives, tech readiness, and backlog refinement to ensure continuous delivery of features
• Mentor junior and mid-level engineers, providing technical guidance, conducting code reviews, and promoting engineering excellence across the team
• Participate in production support and incident response, troubleshooting complex issues, implementing corrective actions, and driving post-incident analysis to improve platform stability and reliability
• Document technical designs, architecture decisions, and operational procedures to enable knowledge sharing across distributed teams

Required

• Minimum 8 years of professional software development experience with proven track record of delivering complex systems.
• Expert-level proficiency in Python programming for data engineering, including experience with data processing frameworks.
• Demonstrated experience with Azure Data Factory for building and orchestrating data integration workflows and ETL processes.
• Strong working knowledge of Databricks platform for collaborative data engineering and analytics workloads.
• Solid understanding of cloud engineering principles.
• Proven track record of successful collaboration with offshore and distributed team members across different time zones and cultures.
• Deep experience working in agile development environments with expertise in continuous integration, continuous delivery, and DevOps practices.
• Strong problem-solving abilities with experience troubleshooting production issues in distributed data systems.
• Excellent written and verbal communication skills for technical documentation and cross-functional collaboration.

Preferred

• Bachelor's or master's degree in computer science, software engineering, or related technical field.
• Familiarity with modern data architecture patterns including data lakes, data warehouses, and Lakehouse architectures.
• Experience with container orchestration platforms. Understanding of data governance, security, and compliance requirements in cloud environments.
• Certification in cloud platforms. Experience with infrastructure as code tools.