Data Engineer

Data Engineer

The New York Mets are seeking a Data Engineer for its Data Engineering Technology team. This role is a unique opportunity to work with data and systems in support of operations in both baseball and the business of baseball. It requires hands-on experience in ingesting, processing, storing, optimizing and distributing structured and unstructured sources of data in areas as diverse as ticketing operations, business strategy, baseball analytics, performance technology and other key areas. You will join a global team (NY and Poland) of data engineering professionals who provide and support best in class end-to-end data and engineering services to Baseball and Business Operations, including but not limited to, Analytics and Systems teams. Prior experience in or knowledge of baseball is a plus but is not required.

Essential Duties & Responsibilities:

• Ensure all production data sources are optimally ingested, processed, and distributed to applications, dashboards and users at set frequencies including real time in-game data
• Onboard new datasets and technologies for use by analysts, data scientists, players and other stakeholders throughout the organization
• Troubleshoot, communicate, mitigate and solve any data ingestion and/or quality issues to all stakeholders
• Design, code, test and roll out new datasets, as well as enhance and bug fix existing datasets
• Support quantitative analysts in Baseball and Business Analytics with production deployments and maintenance of machine learning and other predictive models
• Build and manage Data Model, Data Domains and Data Catalog to keep data well-organized, accurate and curated for efficient data discovery
• Deploy and manage data quality solutions (e.g. scalable framework, monitoring dashboard) to ensure accuracy, integrity, and proactive monitoring of information
• Help maintain a data catalog for efficient data discovery
• Actively collaborate with global team of Data Engineering/Support professionals on data engineering and support requests/issues
• Able to work flexible schedule during the baseball season to ensure in-game support for users
• Coordinate with IT and Infrastructure team to ensure a robust cloud development and production environment

Qualifications:

• BS degree in Computer Science or a related field
• 2+ years' experience in data engineering and data operations/support roles
• Comfort level with both on-premise and cloud (GCP or Azure experience required) environments
• Technical skills (Python, dbt, SQL, T-SQL, Linux) in working with ingesting, processing, and distributing large scale (both structured and unstructured) data sets
• Experience extracting data from FTP and API data sources
• Experience building data structures and data pipelines in the cloud, preferably Azure, Google Cloud Platform and on-prem
• Experience in using modern Software Development Life Cycle (SDLC) and DevOps tools from development to production e.g. Terraform, Cloud Build, BitBucket
• Ability to provide prompt support and resolution of data issues
• Experience in implementing scalable data quality solutions
• Knowledge of big data frameworks, database, orchestration and other data tools, such as Google Cloud Composer (Airflow), Google BigQuery, Microsoft SQL Server, Postgres, Google Dataflow, Google Pub/Sub, etc.
• Ability to deliver superior customer experience through continuous process improvement
• Strong analytical skills and ability to work well in a collaborative and fast paced environment

The above information is intended to describe the general nature, type, and level of work to be performed. The information is not intended to be an exhaustive or complete list of all responsibilities, duties, and skills required for this position. Nothing in this job description restricts management's right to assign or reassign duties and responsibilities to this job at any time. The individual selected may perform other related duties as assigned or requested.

The New York Mets value the unique qualities individuals with various backgrounds and experiences can offer the organization. Our continued success depends heavily on the quality of our workforce. The Organization is committed to providing employees with the opportunity to develop to their fullest potential.

Salary Range: $75,000 - $90,000

For technical reasons, we strongly advise to not use an.edu email address when applying. Thank you very much.