Software Engineer

Highly Technical Engineer

We are looking for a highly technical engineer to build and support weather data acquisition, processing, and analysis products, including our weather service, using a cloud-based solutions stack. We are open to early or advanced career candidates with strong examples of client contributions and highly independent work in a fast-paced software delivery environment.

Responsibilities:

• Architect and propose new AWS/Databricks solutions & updates to existing backend systems that ingest, cache, and process terabyte and petabyte level weather data (e.g., from IBM Weather Company API)
• Work closely with the product management team and end users to understand customer experience and system requirements, build backlog, and prioritize work
• Build infrastructure as code (e.g., Terraform)
• Improve system scalability and optimize workflows to reduce cloud costs
• Create and update REST APIs and backend processes (e.g., AWS Chalice/Lambda) for current, historical, and forecast weather data
• Build/support solutions involving containerization (e.g., Docker), caching (Redis), and databases (e.g., PostgreSQL/PostGIS)
• Support Databricks/Spark pipelines for historical weather data backfill into S3 (Parquet/Delta Lake) and data analysis (SQL/PySpark)
• Migrate and maintain CI/CD pipelines (e.g., GitHub Actions)
• Enhance monitoring and alerting for weather systems (e.g., Datadog)
• Enable field testing and customer support operations by debugging and fixing data issues
• Work with data scientists to scalably fetch and manipulate large weather data sets for models and analysis

Experience:

• Excellent coding skills (Python) with production software deployment experience
• Big data experience (terabyte or petabyte level data sources)
• Core understanding of cloud computing (e.g., AWS services like IAM, Lambda, S3, RDS)

The typical base pay for this role across the U.S. is: $59.67 - $59.67/hr. Non-exempt positions are eligible for overtime at a rate of 1.5 times the base hourly rate for all hours worked in excess of 40 in a work week, or as required by state or local law. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, health savings accounts with qualified medical plan enrollment, 10 paid days off, 3 days paid bereavement leave, 401(k) plan participation with employer match, life and disability insurance, commuter benefits, dependent care flexible spending account, accident insurance, critical illness insurance, hospital indemnity insurance, accommodations and reimbursement for work travel, and discretionary performance or recognition bonus. Sick leave and mobile phone reimbursement provided based on state or local law.