Senior Data Engineer

Scion Staffing has been engaged to conduct a search for a Senior Data Engineer / AI Data Platform Engineer for an innovative and rapidly growing transportation and logistics organization focused on modernizing enterprise data and analytics capabilities across multiple business units. This is a hybrid opportunity based in Pleasanton, California. Open to candidate relocation (assistance available) and H1B transfers for the right candidate! High visibility role supporting enterprise modernization and AI initiatives. This role will focus on building scalable data pipelines, integrating enterprise systems, developing Databricks-based data architecture, and supporting AI/ML and agentic AI initiatives across the organization. POSITION OVERVIEW The Senior Data Engineer / AI Data Platform Engineer will play a critical role in supporting enterprise-wide cloud data initiatives, operational analytics, and modern reporting solutions within a fast-paced logistics environment. This individual will partner with internal stakeholders and external technical teams to build scalable data pipelines, optimize cloud-based analytics workflows, and support ongoing Databricks initiatives . The ideal candidate brings strong expertise in Databricks, SQL, Python, PySpark, and cloud-based ETL/ELT environments, along with a passion for solving complex operational data challenges. PERKS Competitive compensation package with performance-driven growth opportunities Collaborative and inclusive team environment focused on innovation and continuous improvement Opportunity to work on enterprise-scale cloud, analytics, AI, and automation initiatives Hybrid work environment with exposure to modern technologies including Databricks, AWS, Azure, and enterprise analytics platforms RESPONSIBILITIES Develop, maintain, and optimize scalable cloud-based data solutions within Databricks Build and support ETL/ELT workflows utilizing SQL, Python, PySpark, APIs, and modern data engineering practices Support enterprise analytics initiatives, operational reporting, and scalable data architecture across multiple business units Develop and optimize Spark workloads, transformations, and cloud-based data processing pipelines for performance and scalability Support integrations with APIs, operational systems, telematics platforms, and external data providers using structured and semi-structured datasets Create automation workflows, validation processes, and operational analytics solutions using Python and Databricks notebooks QUALIFICATIONS Minimum 7+ years of experience in Data Engineering, Analytics Engineering, or related technical roles Strong hands-on experience with SQL, Python, Databricks, PySpark, and Spark-based processing Experience supporting cloud-based environments within AWS and Microsoft Azure Experience developing and maintaining modern ETL/ELT workflows and enterprise data pipelines Understanding of APIs, JSON data structures, and operational analytics environments Experience working with logistics, transportation, telematics, or operational datasets preferred Experience supporting hybrid cloud architectures, enterprise analytics environments, and large-scale integrations preferred Experience creating automation workflows, data validation processes, and scalable reporting solutions preferred COMPENSATION AND BENEFITS This opportunity offers a competitive compensation salary up to $215k/yr along with a 10% annual bonus and comprehensive benefits , including medical, dental, and vision coverage, paid time off, and opportunities for professional growth and advancement. The organization fosters a collaborative and inclusive culture that values innovation, continuous learning, and long-term career development while providing exposure to enterprise-scale cloud, analytics, and automation initiatives. Scion Staffing, Inc. is an equal opportunity employer and service provider and does not discriminate based on race, religion, gender, gender identity, national origin, citizenship status, sexual orientation, disability, political affiliation or belief, or any other protected class. We are committed to the principles of Equal Opportunity Employment and are dedicated to making employment decisions based on merit and value, for ourselves, our client companies, and the candidates we represent. For opportunities located in a region that has enacted fair chance, arrest or conviction-based employment ordinances, Scion Staffing proactively follows the enacted guidance and considers for employment all qualified applications with arrest and conviction records. We engage in socially conscious business practices and believe that diverse, inclusive, and non-biased talent and recruitment processes are foundational to the success of Scion as well as every client organization with whom we partner. #J-18808-Ljbffr