Senior Data Engineer

About Flywheel Flywheel's suite of digital commerce solutions accelerate growth across all major digital marketplaces for the world's leading brands. We give clients access to near real-time performance measurement and improve sales, share, and profit. With teams across the Americas, Europe and APAC, we offer a career with real impact, endless growth opportunities and the support you need to be the best you can be. Opportunity Omni Platform Group (OPG) is currently seeking a senior data engineer to join our technology team. In this role you will build Omni products which sit atop cloud-based data infrastructure. We are looking for people who have a shared passion for technology, design & development, data, and fusing these disciplines together to build cool things. In this role, you will work on one or more software and data products in the Omni Engineering Team. You will participate in technical architecture, design and development of software products as well as research and evaluation of new technical solutions. This position is based out of our Jersey City Office. What you'll do: Steward data and compute environments to facilitate usage of data assets. Design, build, test and deploy scalable and reusable systems that handle large amounts of data. Lead and mentor a small team of developers. Perform code reviews and provide leadership and guidance to junior developers. Learn and teach new technologies to the team. Who you are: Experience designing and managing data flows. Experience designing systems and APIs to integrate data into applications. 8+ years of Linux, Bash, Python, and SQL experience. 4+ years using Spark and other Hadoop ecosystem software. 4+ years using AWS cloud services, esp. EMR, Glue, Athena, and Redshift. Passion for Technology: Excitement for new technology, bleeding edge applications, and a positive attitude towards solving real world challenges. Additional Skills: BS, MS or PhD in Computer Science, Engineering, or equivalent real-world experience (You've learned something to be able to claim you are an engineer). Significant experience with Python, C++, or other popular language. Experience with big data and/or infrastructure. Bonus for having experience in setting up Petabytes of data so they can be easily accessed. Understanding of data organization, i.e., partitioning, clustering, file sizes, file formats. Data cataloging with Hive/Hive metastore or Glue or something similar. Experience working with relational databases. Experience with Hadoop, Hive, Spark, or other data processing tools. Experience in any of the modern data stack technologies like dbt, airbyte is desired. Experience building scalable data pipelines (Airflow experience a plus). Significant experience working with AWS and/or GCP. Proven ability to independently execute projects from concept to implementation to launch and to maintain a live product. Flywheel Commerce Network is committed to fair and equitable compensation practices. Actual compensation packages are based on several factors that are unique to each candidate, including but not limited to skill set, depth of experience, certifications, and specific work location. Salary Range: $120,000 USD - $140,000 USD Working at Flywheel We are proud to offer all Flywheelers a competitive rewards package and unparalleled career growth opportunities and a supportive, fun and engaging culture. We have office hubs across the globe where team members can go to feel productive, inspired, and connected to others - team members go into Hub Offices 3x a week Competitive paid time off, including annual leave plus paid public holidays Great learning and development opportunities Benefits that help you live your best life Parental leave and benefits Volunteering opportunities If you’re looking to connect with teammates on a topic of inclusion and identity, chances are there’s an ERG for that. So you know: The hired candidate will be required to complete a background check Learn more about us here: Life at Flywheel The Interview Process: Every role starts the same, an introductory call with someone from our Talent Acquisition team. We will be looking for company and values-fit as well as your professional experience; there may be some technical role-specific questions during this call. Every role is different after the initial call, but you can expect to meet several people from the team 1:1 and there might be further skill assessments in the form of a Take Home Assignment/Case Study Presentation or Pair Programming/Live Coding exercise depending on the role. In your initial call, we will walk you through exactly what to expect the process to be. Inclusive Workforce Flywheel Commerce Network’s goal is to create a culture where all individuals of all backgrounds feel comfortable in bringing their authentic selves to work. We want all people to feel included and empowered to contribute fully to our vision and goals. Flywheel Commerce Network is an Equal Opportunity Employer and participates in E-Verify. All applicants will receive fair consideration for employment. We do not discriminate based upon race, color, religion, sex, sexual orientation, age, marital status, gender identity, national origin, disability, or any other applicable legally protected characteristics in the location in which the candidate is applying. If you have any accessibility requirements that would make you more comfortable during the application and interview process, please let us know at View email address on click.appcast.io so that we can support you. For more information about what data we collect and how we use it, please refer to our Privacy Policy. We leverage AI technology to streamline our hiring workflow, though all candidate decisions are made by our Talent Acquisition Team. This position is for an existing vacancy. #J-18808-Ljbffr