Senior Data Engineer

At Grape Up, we transform businesses by unlocking the potential of AI and data through innovative software solutions. We partner with industry leaders, from the automotive and finance industry, to build sophisticated Data & Analytics platforms that transform how organizations manage and leverage their data assets. As an AWS Partner, we work closely with AWS teams to deliver solutions built on the AWS ecosystem. Our solutions provide comprehensive capabilities spanning data storage, management, advanced analytics, machine learning, and AI, enabling enterprises to accelerate innovation and make data-driven decisions. Responsibilities Implement a scalable architecture capable of handling the high volume of simulation data Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform Optimize and enhance system setup and improve data structures following industry best practices Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs Collaborate with business stakeholders and technical teams to understand data requirements, translate business needs into technical solutions Requirements Master’s degree in computer science, Data Engineering, AI, or a related field 6+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines Proven experience with AWS platform and AWS Data Engineering stack (S3, Glue, Athena and other) Strong experience with Apache Spark (PySpark), including performance optimization, and large-scale data processing Proficiency in Python and SQL for data transformations and analytics workloads Experience with data pipeline orchestration (Airflow, Dagster, Prefect or similar) Strong problem-solving skills and ability to work independently Fluency in English, both written and spoken Nice to have Databricks experience (Unity Catalog, Delta Lake and Lakehouse architecture) Experience with Infrastructure as Code (Terraform, CloudFormation) Data Engineer certificate (AWS or Databricks) Experience with streaming tools like Kafka, Kinesis or similar #J-18808-Ljbffr