Senior Data Engineer

Senior Data Engineer at Parser. About the role As a Senior Data Engineer at Parser, you will play a pivotal role in shaping our data architecture and driving the development of data pipelines that support our analytics and machine learning initiatives. You will collaborate with cross-functional teams to ensure that our data infrastructure is robust, scalable, and optimized for performance. This position is ideal for someone who is passionate about data engineering and is eager to tackle complex challenges in a fast-paced environment. Your expertise will directly contribute to the success of our data-driven decision-making processes. Key facts Location: Madrid, Madrid Engagement: Full-time Salary: Competitive, commensurate with experience Visa: Sponsorship available for qualified candidates What you'll do Design and implement scalable data pipelines that can handle large volumes of data efficiently, ensuring data quality and integrity throughout the process. Collaborate with data scientists and analysts to understand their data needs and translate them into technical specifications for data solutions. Optimize existing data workflows and processes to improve performance and reduce latency, ensuring timely access to data for stakeholders. Develop and maintain ETL (Extract, Transform, Load) processes to integrate data from various sources into our data warehouse. Monitor and troubleshoot data pipeline issues, implementing solutions to prevent future occurrences and ensure smooth operations. Work with cloud-based data storage solutions, such as AWS or Google Cloud, to manage and scale our data infrastructure effectively. Participate in code reviews and contribute to best practices in data engineering, fostering a culture of continuous improvement within the team. Document data architecture, processes, and workflows to ensure knowledge sharing and maintainability of the data systems. Stay updated on industry trends and emerging technologies in data engineering, applying relevant innovations to enhance our data capabilities. Mentor junior data engineers, providing guidance and support to help them grow in their roles and develop their technical skills. Collaborate with IT and security teams to ensure data governance and compliance with relevant regulations and standards. Engage in agile development practices, participating in sprint planning, daily stand-ups, and retrospectives to contribute to team success. Requirements Bachelor's degree in Computer Science, Engineering, or a related field; a master's degree is a plus. At least 5 years of experience in data engineering or a similar role, with a strong focus on building data pipelines and data architecture. Proficiency in programming languages such as Python and Scala, with a solid understanding of data structures and algorithms. Experience with SQL and NoSQL databases, including but not limited to PostgreSQL, MongoDB, or similar technologies. Familiarity with cloud platforms like AWS, Google Cloud, or Azure, particularly in relation to data storage and processing services. Strong understanding of ETL processes and data warehousing concepts, with hands‑on experience in implementing these solutions. Knowledge of data modeling techniques and best practices for data governance and security. Excellent problem‑solving skills and the ability to work independently as well as collaboratively in a team environment. Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders. Nice to have Experience with big data technologies such as Apache Spark, Kafka, or Hadoop. Familiarity with data visualization tools like Tableau or Power BI. Understanding of machine learning concepts and experience working with data scientists on related projects. Previous experience in a startup or fast-paced environment, demonstrating adaptability and innovation. Skills & tools Programming Languages: Python, Scala Databases: SQL (PostgreSQL, MySQL), NoSQL (MongoDB, Cassandra) Cloud Platforms: AWS, Google Cloud, Azure Data Processing: ETL tools, Apache Spark, Kafka Data Visualization: Tableau, Power BI Version Control: Git Practical notes This position is based in Madrid, and candidates should be prepared to work on-site or in a hybrid model as required. The company offers a competitive salary package along with benefits that promote work-life balance and professional development. Candidates should be eligible to work in Spain; visa sponsorship is available for qualified applicants. META Company: Parser Title: Senior Data Engineer Listed location: Madrid, Madrid Job type: Full-time #J-18808-Ljbffr Parser