Senior Data Engineer

Position Summary As a Senior Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions using modern data architecture, Azure data services, including Data Lake, Synapse Analytics, Azure Functions, and Databricks. This role also includes close collaboration with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions. The ideal candidate brings strong technical depth (proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory and/or Databricks Workflows), a continuous improvement mindset, and the ability to mentor while contributing to engineering standards, reusable patterns, and solution design reviews. Key Responsibilities Conduct the design, innovation and optimization of data extraction, ingestion and transformation processes. Facilitate the development and design of complex data architecture to process and store high-volume data sets. Enable the development of complex data pipelines; advocate for and implement data security and privacy measures. Conduct complex data quality and processing tasks using open source and cloud services. Provide technical expertise during critical incidents. Facilitate the adoption of best practices for data security and privacy and collaborate with other departments to ensure seamless data integration. Facilitate the implementation of continuous improvements in data processing methods and drive consistency and best practices across data engineering projects. Solve complex problems; take a new perspective on existing solutions; participate in strategic planning sessions for data infrastructure. Oversee quality assurance and testing for data solutions. Mentor less experienced data engineers. Education and Experience Bachelor’s Degree in Information Technology, related field or equivalent experience. 5+ years of relevant data engineering experience. Skills Big Data Technologies: Familiarity with Hadoop, Spark, and distributed computing for processing and analyzing large volumes of data. Cloud Platform: Knowledge of AWS, Azure, or GCP and their associated services for data storage, processing, and analytics. Data Governance: Ability to establish procedures, policies, and standards ensuring data quality, compliance, and secure handling. Data Integration: Proficiency in integrating data from various sources using ETL processes, data pipelines, and ingestion frameworks. Data Lifecycle: Understanding of stages from creation to disposal governed by policies. Data Modeling: Design and implement data models aligning with business requirements, ensuring integrity, performance, and scalability. Data Operations: Managing, manipulating, and analyzing data throughout its lifecycle for meaningful insights. Data Pipelines: Enable reliable flow of data from sources to destinations with ETL. Data Privacy: Implement practices ensuring protection of personal and sensitive information. Data Quality Management: Knowledge of quality dimensions, methodologies, and best practices. Data Security: Awareness of cybersecurity best practices and protection of sensitive information. Data Warehousing: Monitoring and observability of data pipeline performance and system health. DevOps: Integration of software development and IT operations for continuous delivery with security focus. General Programming: Use of a programming language to automate tasks. Metadata Management: Proficiency in solutions for data discovery, lineage tracing, and asset management. NoSQL Databases: Use of NoSQL for flexible, scalable storage of unstructured data. Real-Time Processing: Handling data immediately with minimal latency. Minimum Qualifications Bachelor’s Degree in Information Technology, related field or equivalent experience. 5+ years of relevant experience. Location San Antonio, Texas (Additional locations: Findlay, Ohio). Benefits Marathon Petroleum offers a total rewards program which includes, but is not limited to, access to health, vision, and dental insurance, paid time off, 401k matching program, paid parental leave, and educational reimbursement. Detailed benefit information is available at The hired candidate will also be eligible for a discretionary company-sponsored annual bonus program. EEO Statement Marathon Petroleum Company LP is an Equal Opportunity Employer and gives consideration for employment to qualified applicants without discrimination on the basis of race, color, religion, creed, sex, gender (including pregnancy, childbirth, breastfeeding or related medical conditions), sexual orientation, gender identity, gender expression, reproductive health decision‑making, age, mental or physical disability, medical condition or AIDS/HIV status, ancestry, national origin, genetic information, military, veteran status, marital status, citizenship or any other status protected by applicable federal, state, or local laws. #J-18808-Ljbffr 4500 Marathon Petroleum Company LP