Senior Big Data Engineer

Senior Big Data EngineerJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team is responsible for developing robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets. About the RoleWe're looking for a Senior Big Data Engineer who can work independently and proactively to design, implement, and maintain scalable data processing pipelines. You will contribute to a high-performing team that owns infrastructure critical to analytics, modeling, and media performance reporting.Essential functionsDesign and develop large-scale data pipelines and infrastructure to process high-volume datasetsBuild and maintain scalable, production-grade ETL/ELT workflows using Apache Spark, Scala, and SQLWork with distributed file systems (HDFS) and optimize data processing performanceWrite and test reusable and reliable code using functional programming libraries like Cats and fs2Develop and test solutions in containerized environments (e.g., Docker, Kubernetes)Collaborate with analysts, platform teams, and product stakeholders to deliver data-driven solutionsTake ownership of services with minimal supervision, demonstrating initiative and autonomyQualificationsStrong programming experience with Scala and distributed data frameworks like Apache SparkProficiency in SQL and experience handling large datasets in HDFS environmentsWorking knowledge of Python for scripting and data manipulation tasksHands-on experience developing and testing in Docker and/or Kubernetes environmentsFamiliarity with Cats, fs2, or other advanced Scala functional programming librariesAbility to work autonomously in a dynamic, fast-paced environment and take full ownership of projectsWe offerOpportunity to work on bleeding-edge projectsWork with a highly motivated and dedicated teamCompetitive salaryFlexible scheduleProfessional development opportunitiesAbout usGrid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.