Senior Data Engineer

Company Overview At Innovecture, we are a people‑first company. Our success is built on hiring the best talent across the world and nurturing an environment of collaboration, commitment, honesty, and curiosity. We offer a challenging and rewarding journey, while providing our employees with all they need to be successful and happy. Though we may operate in several countries, we are one team, one family, one INTeam. Come join us and see what it’s like to grow with a diverse team. Innovation Labs Research, create new concepts, prototypes, patents, and help accelerate the growth of Innovecture’s digital future. Impactful Projects & Products Be part of an exciting and talented team while working on interesting software/engineering projects and products for leading global customers. Learning & Development Innovecture is always looking for growth mindsets in talented people. We have continuous learning baked into our DNA. Growth Culture We hire for attitude and train for skill. We promote a strong culture of team collaboration, transparency, open communication and career growth. Perks & Benefits We’ve got you covered! All employees have access to excellent healthcare insurance & other benefits. Social Commitment We believe in serving others through our corporate social responsibility initiatives and giving our best efforts to build communities wherever we are around the world. Diversity & Inclusion Our core strength lies in global teams of talent that champions our diversity, inclusion and knowledge potential. Join Our Global Talent Community This is where we advertise the latest career opportunities at our offices around the world. Please browse below to find an opportunity that might be perfect for you. If you’re interested in a career with us, but don’t see the right vacancy, please send an email to View email address on click.appcast.io Location: Pune, India Job Id: 1413 # of Openings: 1 We at Innovecture are hiring for a Senior Data Engineer to expand our team. This is a Remote position in India. You will work across various Innovecture and client teams and apply your technical expertise to some of the most complex and challenging technology problems. About Innovecture Founded in 2007 under the leadership of CEO Shreyas Kamat, Innovecture LLC began as a U.S.-based Information Technology and Management Consulting Company focusing on technology consulting and services. With international development centers located in Salt Lake City, USA, and Pune, India, Innovecture leverages its Global Agile Delivery Model to effectively deliver client projects within budget scope and project deadline. The primary focus of Innovecture is to provide a unique wealth of expertise and experience to the IT and Management Consulting realm by utilizing various technologies across multiple industry domains. Innovecture uses best‑in‑class design processes and top‑quality talent to ensure the highest quality deliverables. With innovation embedded in its consulting and services approach, Innovecture will continue to deliver outstanding results for its Fortune 500 clients and employees. Role and Responsibilities We are looking for a highly skilled Senior Data Engineer with deep expertise in Databricks and modern data engineering practices to join our Data COE. Your Experience As a Senior Data Engineer, you will be responsible for developing Data solutions to address business problems. This role will be responsible for designing, building, and optimizing scalable data pipelines and data platforms that support advanced analytics and business intelligence initiatives. The ideal candidate is a problem‑solver with hands‑on expertise in Databricks, Spark, Delta Lake, cloud platforms (AWS), and data pipeline orchestration, with a strong focus on performance, reliability, and scalability. This is a hands‑on role that requires the candidate to work collaboratively in a squad following a Scaled Agile development methodology. You must be a self‑starter, delivery‑focused, and possess a broad set of technology skills. Things you will do Ensure that solution requirements are gathered accurately, understood, and that all stakeholders have transparency on impacts. Design, develop, and maintain scalable ETL/ELT pipelines using Databricks (PySpark/Scala/SparkSQL). Build and optimize batch and streaming pipelines for large‑scale data processing. Implement data ingestion frameworks for structured and unstructured data. Develop solutions leveraging Databricks Lakehouse architecture (DeltaLake). Implement data models, schema design, partitioning, and performance tuning. Ensure ACID compliance, data versioning, and time travel capabilities in Delta. Work with cloud platforms (preferably AWS – S3, Glue). Integrate data pipelines with data warehouses, APIs, and downstream applications. Implement CI/CD pipelines for data workflows. Enforce data quality, validation, and monitoring frameworks. Build reports using PowerBI. Implement data lineage, cataloguing (UnityCatalog preferred), and governance standards. Ensure compliance with security, privacy, and regulatory requirements. Optimize Spark jobs for cost and performance. Monitor cluster utilization and improve efficiency in Databricks. Implement caching, partition pruning, and query optimization techniques. Collaborate with data scientists, analysts, and business stakeholders. Mentor junior engineers and promote best practices within the team. Contribute to the data engineering roadmap, standards, and reusable frameworks. Monitor performance and advise any necessary infrastructure changes. Select and integrate any Big Data tools and frameworks required to provide requested capabilities. Champion good agile practices that are foundational to product delivery. Build strong relationships with product owners, solutions architects, analysts, and pod leadership. Work with state‑of‑the‑art technologies to solve genuine, real‑world problems. Troubleshoot and resolve development issues. Provide technical support to clients regarding existing problems. Recommend and execute code improvements based on current solutions. What will you bring For the Senior Data Engineer role, we are looking for a candidate with at least 8+ years of extensive experience in Data Engineering. Proven record of successfully delivering software with a broad mix of languages, technologies, and platforms. Proven experience in Big Data Engineering. Experience working with Agile at Scale, Lean and Continuous Delivery approaches such as Continuous Integration, Test‑Driven Development and Infrastructure as Code. Strong hands‑on experience with Databricks (must‑have). Expertise in Apache Spark (PySpark/Scala). Strong proficiency in SQL and data modelling. Strong hands‑on experience in PowerBI. Experience with Delta Lake and Lakehouse architecture. Hands‑on experience with cloud platforms (AWS preferred). Experience with orchestration tools. Knowledge of streaming frameworks (Kafka). Technical Skills Required Databricks – core experience. ApacheSpark (PySpark/Scala). SQL and data modelling. PowerBI. DeltaLake and Lakehouse architecture. AWS – S3, Glue, and related services. Orchestration tools (e.g., Airflow, dbt, Prefect). Kafka or similar streaming platforms. CI/CD & DevOps practices. Data governance and security best practices. Innovecture is a vibrant and exciting place to start a career and develop professionally. Since 2007, many graduates have begun their professional journey at Innovecture. They moved up the career ladder to lead the global product / project teams, travelled to onsite locations and held several key positions. Please send an email to View email address on click.appcast.io. #J-18808-Ljbffr