Data Engineer

Data EngineerBoston, Massachusetts, United StatesSalary Range: $115,000 - $145,000Atlantic Talent is proud to be partnered with a leading online retailer that serves millions of monthly users. Located in Boston, MA, you will be playing a crucial role in shaping the data infrastructure to drive business insights and enhance the customer experience. As a Data Engineer, you will be responsible for developing and optimizing data pipelines to support the collection, processing, and analysis of large-scale datasets. This role offers an exciting opportunity to work on cutting-edge technologies and drive innovation in data engineering within the e-commerce industry.Role Responsibilities:This is a hybrid role, requiring a minimum of 5 days in the Boston office each month. The 5 days can be consecutive or spread out at your choice.Design, build, and maintain scalable data pipelines and ETL processes to ingest, transform, and load data into the data warehouse and other storage systems.Monitor and troubleshoot data pipeline issues, perform root cause analysis, and implement solutions to prevent recurrence.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and project objectives.Upcoming projects include SQL migration, infrastructure management, and solely Python focused projects.Essential Skills and Qualifications:A minimum of 4 years experience as a Data Engineer.Bachelor's in Computer Science, Engineering, or a related field. Advanced degree preferred but not essential.Proficiency in programming languages including Python, Java, Scala, and experience with data processing frameworks including Apache Spark, and Apache Flink.Experience working with major cloud platforms.Strong SQL skills and experience with relational databases and NoSQL databases.Familiarity with data warehousing concepts and technologies including Snowflake and Redshift is a bonus but not essential.Excellent problem-solving skills and attention to detail, with the ability to work independently and collaboratively in a fast-paced environment.Benefits:Competitive salary with performance-based incentives.Comprehensive health, dental, and vision insurance.401(k) retirement plan with company match.Generous paid time off and holidays.Professional development and training opportunities.Flexible working hours and a hybrid working environment.The necessary technology, including a laptop and additional equipment, to create an optimal home working environment.Regular team breakfasts, plus monthly team outings.An energetic and supportive work environment.