Senior Data Engineer

Senior Data EngineerMotor Information Systems (Hearst) is the industry leader in automotive data and insights. We power the aftermarket ecosystem with some of the most comprehensive datasets in the world—and we're investing heavily in modernizing our data platform to support the next generation of products and AI-driven capabilities.The Opportunity: We're looking for a hands-on Senior Data Engineer to take a leading role in architecting, designing, building, and evolving our AWS-based data platform. This is not a maintenance role—you'll have meaningful technical ownership and influence over how data is architected, processed, and delivered across our systems and product suite.You'll tackle large-scale, complex data challenges while driving architectural decisions, establishing engineering best practices, and designing solutions for scalability, reliability, performance, and cost efficiency. As a senior member of the team, you'll collaborate across engineering and product, provide technical guidance and mentorship, and help shape the evolution of our platform toward a more modern, scalable, and intelligent data architecture.Required Experience (Must Have):Expert Python & SQL DeveloperStrong AWS Experience (Lambda, Glue, State Machines, Fargate, Cloud Formation, RedShift)Strong Experience with Semi-Structured Data (XML, CSV, JSON, Parquet)Strong Automation ExperienceExperience with Databricks (Delta Lake, Notebooks, SQL Analytics)Experience with Kubernetes (Cluster Orchestration, Container Networking, Pod Management)Experience with DevOps, CI/CD, Deployment Orchestration (Octopus Deploy)Experience with Agentic AI (LangGraph, MCP Servers, Agent Frameworks)Experience with Data Handling (Pandas / NumPy, Apache Spark, Ray)Helpful Experience (Nice to Have):Experience with LLMs, Machine Learning & Deep Learning Libraries, AI Application Frameworks, Vector DatabasesExperience with Automotive Data / IndustryExperience with Agile / ScrumPrimary Responsibilities:Analyze large, and complex, data setsDesign, develop and coordinate the generation of Data PipelinesWork collaboratively with team to plan and solve complex problemsDesign for, or optimize existing pipelines, for performance and costWhy Join MOTOR:Work on high-impact data products used across the automotive industryReal ownership and influence over platform directionBacked by Hearst—stable, but with room to innovateCollaborative team solving meaningful, complex problemsAdditional Details:Hybrid schedule: 3 days onsite in Troy, MINo visa sponsorship available at this time