Senior Python Engineer

Skills: 'Python + Strong SQL + Airflow + Bash

JD:
• Refactor Redpen backend by consolidating uploader classes into a single, efficient class.
• Update API endpoints to be resource-based, ensuring efficient and scalable data


handling.
• Manage and optimize LabelBox integration, switching to LabelBox's new approach to


custom UIs.
• Discover, track, and communicate with LabelBox about bugs and issues, providing


detailed reports and follow-up.
• Communicate with internal Airbnb clients/stakeholders to gather feedback on LabelBox


pain points and missing features.
• Maintain Redpen service SLAs, ensuring high availability and performance.
• Monitor, update, and extend internal Datadog dashboards and alerts to account for any


new issues or changes.
• Extend existing Airflow DAG to export labeling data in various formats, ensuring


compatibility and data integrity.
• Write, and maintain unit/integration tests, maintain system stability.


Required Skills


Languages:
• Python: Advanced proficiency, with experience in writing clean, maintainable, and


efficient code.
• SQL/Presto: Strong knowledge of database querying and optimization.
• Bash: Proficient in writing scripts for automation and system management.


Tech Stack:
• Flask or equivalent: Experience in developing and maintaining web applications using


Flask.
• Airflow or equivalent: Proficiency in creating and managing workflows using Apache


Airflow.
• Datadog/Pagerduty or equivalent: Experience in setting up and managing monitoring


and alerting systems.


Soft Skills:
• Proactive Attitude: Must not wait for assignments; take initiative and drive projects


forward.
• Clear Communication: Ability to communicate complex technical concepts clearly and


effectively.
• Accountability: Take full responsibility for project outcomes with good time


management and project management skills.


Nice-to-have Skills
• Java/Javascript/Typescript/React: Solid understanding of frontend and backend


development, with experience in building and maintaining web applications.
• Labeling: Familiarity with any labeling vendor's API and tools for managing data


labeling tasks.
• Kubernetes (K8s): Experience in container orchestration and management using


Kubernetes.
• REST: Proficiency in designing and consuming RESTful APIs.
• Aurora (Database): Strong understanding of Amazon Aurora for managing relational


databases.
• Flask-Migrate: Experience in handling database migrations using Flask-Migrate and


SQL Alchemy ORM.
• Refactoring: Ability to refactor and improve existing codebases for better performance


and maintainability.
• Backend Maintenance: Experience in maintaining backward compatibility while


introducing new features.
• Unit/Integration Test Setup: Proficiency in setting up and maintaining unit and


integration tests.
• API Design: Experience in designing scalable and efficient APIs.
• Observability and Alert Management: Skills in fine-tuning observability and alerting


mechanisms for better system monitoring.
• Data Engineering: Experience in data pipeline design and management