Software Engineer - Data Infrastructure

Data Infrastructure Engineer In ResearchAs a Data Infrastructure Engineer in Research at Luma, you will play a critical role in building and scaling the data infrastructure that supports our cutting-edge multimodal AI systems. Your work will focus on developing high-throughput, large-scale data processing pipelines tailored for machine learning research and internal ML platform needs. You will collaborate closely with ML researchers and product teams to create reliable, efficient, and easy-to-use data infrastructure that empowers innovation and accelerates development. This role requires a strong foundation in distributed systems and data engineering, with an emphasis on supporting complex machine learning workflows rather than traditional product data infrastructure.ResponsibilitiesBuild and maintain scalable data infrastructure for high-throughput machine learning workflowsCollaborate with ML researchers and product teams to ensure data systems meet evolving needsDevelop and optimize large-scale data pipelines and batch processing jobsContribute to the architecture and implementation of reliable, high-performance data platformsIntegrate open-source tools and continuously improve data infrastructure through monitoring and tuningParticipate in cross-functional projects to improve data reliability, scalability, and operational excellenceSupport the evaluation and adoption of new programming languages and frameworks relevant to data infrastructureEngage in continuous improvement of data infrastructure through monitoring, troubleshooting, and performance tuningCollaborate with research & engineering teams to help define and refine best practices for data infrastructure developmentQualificationsProficiency in Python (or similar languages with willingness to learn Python) and experience with large-scale, high-throughput data infrastructureFamiliarity with distributed computing frameworks (e.g., Ray, Spark, Beam)Ability to design and optimize data pipelines for ML research and internal teamsStrong problem-solving skills and understanding of data engineering at scaleCollaborative, product-focused mindset; comfortable in fast-paced environmentsExperience sourcing, integrating, and optimizing data from diverse and large datasetsComfortable working in a fast-paced, product-focused environment with a strong execution mindsetOpen to candidates across seniority levels, from mid-level individual contributors to senior engineers and managers.Nice to HavePrior experience working with complex data infrastructure or AI/ML platforms highly desirableExperience with open source data infrastructure projects is a plusExperience working in the robotics industry preferred