Senior Data Engineer

Senior Data Engineer The Weather Company is the world's leading weather provider, helping people and businesses make more informed decisions and take action in the face of weather. Together with advanced technology and AI, The Weather Company's high-volume weather data, insights, advertising, and media solutions across the open web help people, businesses, and brands around the world prepare for and harness the power of weather in a scalable, privacy-forward way. AI is part of how we work: Human judgment, expertise, and creativity remain essential and are amplified by AI. We are looking for people who are curious, adaptable, and excited to help shape an AI-enabled culture that delivers better outcomes for our customers and our company. Job brief: We're seeking a Senior Data Engineer to design, build, and operate large-scale, data-intensive platforms in the cloud. In this role, you'll be responsible for developing reliable data pipelines, scalable data processing systems, and high-availability architectures that support analytics, machine learning, and data science use cases. You'll work with modern big data technologies and AWS services, contribute hands-on code, lead smaller data initiatives, and mentor junior engineers. This is an ideal role for someone who thrives in complex data environments, values strong engineering fundamentals, and enjoys turning raw data into dependable, production-ready systems. The impact you'll make: Designs and implements sophisticated software systems using either object-oriented or functional programming techniques implemented in Python, Scala or Java languages. Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash Maintain an advanced level of proficiency with Computer Science/Software Engineering knowledge. Work well independently and as part of a team, mentoring junior engineers in routine, less-complex tasks, and leading small projects Other duties as assigned. What you've accomplished: Bachelor's or Master's in a related field, or commensurate experience 5+ years in Computer Science, with a proven track record of successful projects. 5+ years of experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis, and MSK. 5+ years of experience with one or more of the following programming languages: Python, Scala, or Java 5+ years of experience with SQL. 5+ years of experience with big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc. Advanced proficiency in building data integrations using both API and file-based protocols. Advanced proficiency with test-driven development and unit testing. Experience with Git Version Control or similar Experience with CI/CD pipeline patterns and best practices Proficiency with alerting and monitoring tools like Grafana Demonstrated ability to learn new technologies and languages. Able to put together process documentation concisely and clearly. Excellent written and verbal communication skills. Able to work closely and effectively with peer developers and work on several active projects simultaneously, including leading small projects. Solid experience implementing high-availability, scalable cloud solutions Strong understanding of data structures and algorithms Solid knowledge of functional programming languages and techniques, and object-oriented programming languages and techniques Solid knowledge of concurrency and concurrent programming techniquess and distributed computing techniques Knowledge and understanding of operating with data in large scale, including Machine Learning and Data Science concepts TWCo Benefits/Perks: Flexible Time Off program Hybrid work model Variety of medical insurance options, including a $0 cost premium employee coverage Benefits effective day 1 of employment include a competitive 401K match with no vesting requirement, national health, dental, and vision plans Progressive family plan benefits An opportunity to work for a global and industry-leading technology company Impactful work in a collaborative environment The Weather Company