Senior Software Engineer - Python

Responsibilities

• Design, develop, support, and enhance high-quality software modules for the product suite.
• Design and deploy scalable data pipelines using PySpark and Kafka.
• Build automated ETL workflows using SQL, Python, Spark, and PySpark.
• Deploy containerized data using Docker to support zero-downtime releases.
• Perform data warehousing, querying, and analysis on large datasets using Apache Hive.
• Monitor and review Spark performance using Hadoop YARN.
• Design and implement new solutions and apply new technologies to existing applications.
• Conduct peer reviews and continuously enhance the product codebase and continuous integration pipeline.
• Investigate and resolve production performance and stability issues.
• Identify improvements in scalability, performance, security, and serviceability.
• Collaborate with technical teams, business owners, project management, and internal stakeholders.
• Mentor junior developers in software engineering methods and techniques.

Requirements

• Bachelor’s degree or higher, or foreign equivalent degree, in Computer Science, Information Technology, Information Systems, or a related field.
• At least 5 years of experience building automated ETL workflows using SQL, Python, Spark, and PySpark.
• At least 2 years of experience designing and deploying scalable data pipelines using PySpark and Kafka.
• At least 2 years of experience deploying containerized data using Docker.
• At least 2 years of experience using Apache Hive for data warehousing, querying, and analysis on large datasets.
• At least 2 years of experience using Hadoop YARN to monitor and review Spark performance.

Benefits

• Telecommuting is available anywhere in the U.S.
• Benefits include medical, dental, vision, disability, and life insurance coverage.
• 401(k) savings plans, paid family leave, and 9 paid holidays are provided.
• Employees receive 17–27 days of paid time off per year depending on level and length of service.