Senior Data Engineer
Jobleads-US
- Position SummaryAs a Senior Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions using modern data architecture, Azure data services, including Data Lake, Synapse Analytics, Azure Functions, and Databricks.This role also includes close collaboration with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions. The ideal candidate brings strong technical depth (strong proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory and/or Databricks Workflows), a continuous improvement mindset, and the ability to mentor while contributing to engineering standards, reusable patterns, and solution design reviews.This position belongs to a family of jobs with increasing responsibility, competency, and skill level. Actual position title and pay grade will be based on the selected candidate’s experience and qualifications.# Key Responsibilities* Conducts the design, innovation and optimization of data extraction, ingestion and transformation processes.* Facilitates the development and design of complex data architecture to process and store high-volume data sets.* Enables the development of complex data pipelines; advocates for and implements data security and privacy measures.* Conducts complex data quality and processing tasks using open source and cloud services.* Provide technical expertise during critical incidents.* Facilitates the adoption of best practices for data security and privacy and collaborates with other departments to ensure seamless data integration.* Facilitates the implementation of continuous improvements in data processing methods and drives consistency and best practices across data engineering projects.* Solves complex problems; takes a new perspective on existing solutions; participates in strategic planning sessions for data infrastructure.* Oversee quality assurance and testing for data solutions.* Mentors less experienced data engineers.# Education and Experience* Bachelor’s Degree in Information Technology, related field or equivalent experience* 5+ years of relevant data engineering experience# Skills* **Big Data Technologies** - Familiarity with big data technologies and frameworks, such as Hadoop, Spark, and distributed computing, for processing and analyzing large volumes of data.* **Cloud Platform** - Knowledge of cloud-based data platforms, such as AWS, Azure, or GCP, and their associated services for data storage, processing, and analytics.* **Data Governance** - Ability to establish and oversee a set of procedures, policies, and standards that ensure the effective and efficient management of an organization's data assets. This includes ensuring data quality, compliance with relevant laws and regulations, and secure data handling practices. It also involves the coordination between different departments to ensure that data is accurate, accessible, and used responsibly and ethically.* **Data Integration** - Proficiency in integrating data from various sources, including structured and unstructured data, using technologies such as ETL (Extract, Transform, Load) processes, data pipelines, and data ingestion frameworks.* **Data Lifecycle** - The data lifecycle refers to the sequential stages that data goes through from its creation or acquisition to its eventual disposal. These stages typically include data creation, storage, processing, analysis archival, and eventual deletion or destruction, with each phase governed by specific policies and practices.* **Data Modeling** - Skill in designing and implementing data models that align with business requirements, ensuring data integrity, performance, and scalability.* **Data Operations** - Data operations refer to the various actions and processes involved in managing, manipulating, and analyzing data throughout its lifecycle. These operations encompass tasks such as collection, storage, retrieval, transformation, and visualization of data to derive meaningful insights and support decision-making.* **Data Pipelines** - Data pipelines are a set of processes that enable the flow of data from one or multiple sources to a destination, often involving tasks such as extraction, transformation, and loading (ETL). These pipelines are designed to efficiently and reliably move and process data, ensuring its quality and accessibility for various analytical and operational purposes.* **Data Privacy** - Ability to understand and implement practices that ensure the protection and confidential handling of personal and sensitive information. This includes knowledge of relevant laws and regulations (such as GDPR or HIPAA), the ability to design and enforce policies that safeguard data, and the skills to manage data access rights and consent protocols.* **Data Quality Management** – Strong understanding of data quality dimensions, methodologies, and best practices to establish and maintain data quality standards and processes.* **Data Security** - Knowledge of data privacy regulations, cybersecurity best practices, and techniques for protecting sensitive information and ensuring compliance.* **Data Warehousing (DW)** - Knowledge of monitoring and observability tools and practices for tracking data pipeline performance, data quality, and system health.* **DevOps**- A set of practices that combines software development and information-technology operations which aims to shorten the systems development life cycle and provide continuous delivery with high software quality and a security first approach.* **General Programming** – Applies a computer language to communicate with computers using a set of instructions and to automate the execution of tasks.* **Metadata Management** – Proficiency in metadata management solutions to enable efficient data discovery, data lineage tracing, and data asset management.* **NoSQL Databases** – NoSQL databases are a type of database management system that provides a flexible and scalable approach to storing and retrieving data, often diverging from the traditional relational database model. Unlike relational databases, NoSQL databases are designed to handle large volumes of unstructured or semi-structured data, offering high performance and horizontal scalability for modern applications.* **Real Time Processing** – Real-time processing refers to the method of handling data or performing computations immediately as they occur, without any noticeable delay. In real-time processing systems, data is processed, and responses are generated within a timeframe that meets the requirements of the application or task, typically within milliseconds or microseconds.MINIMUM QUALIFICATIONS: Bachelor’s Degree in Information Technology, related field or equivalent experience. 5+ years of relevant experienceAs an energy industry leader, our career opportunities fuel personal and professional growth.Location:San Antonio, TexasAdditional locations:Findlay, OhioJob Requisition ID:00024300Location Address:19100 Ridgewood PkwyEducation:Bachelors: Information TechnologyEmployee Group:Full timeEmployee Subgroup:RegularMarathon Petroleum Company LP is an Equal Opportunity Employer and gives consideration for employment to qualified applicants without discrimination on the basis of race, color, religion, creed, sex, gender (including pregnancy, childbirth, breastfeeding or related medical conditions), sexual orientation, gender identity, gender expression, reproductive health decision-making, age, mental or physical disability, medical condition or AIDS/HIV status, ancestry, national origin, genetic information, military, veteran status, marital status, citizenship or any other status protected by applicable federal, state, or local laws. If you would like more information about your EEO rights as an applicant, click here. If you need a reasonable accommodation for any part of the application process at Marathon Petroleum LP, please contact our Human Resources Department at View email address on click.appcast.io. Please specify the reasonable accommodation you are requesting, along with the job posting number in which you may be interested. A Human Resources representative will review your request and contact you to discuss a reasonable accommodation. Marathon Petroleum offers a total rewards program which includes, but is not limited to, access to health, vision, and dental insurance, paid time off, 401k matching program, paid parental leave, and educational reimbursement. Detailed benefit information is available at hired candidate will also be eligible for a discretionary company-sponsored annual bonus program. Equal Opportunity Employer: Veteran / DisabilityWe will consider all qualified Applicants for employment, including those with arrest or conviction records, in a manner consistent with the requirements of applicable state and local laws. In reviewing criminal history in connection with a conditional offer of employment, Marathon will consider the key responsibilities of the role.
- J-18808-Ljbffr Jobleads-US
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in San Antonio, TX vacancy
- ...ideas, encourages diverse perspectives, develops our people, and fosters a collaborative team environment.Position SummaryAs a Senior Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions using modern data...SeniorFull timeLocal areaImmediate startFlexible hours
Marathon Petroleum Corporation
San Antonio, TX7 hours ago - Job Summary:We are seeking a highly motivated and talented Senior Data Engineer to join our team. We value ambition, intelligence, and the ability to learn quickly over specific experience in our stack. If you have a strong background in software data engineering, a passion...Senior
- Title:Senior Software and Data EngineerBelong. Connect. Grow. with KBR!KBR’s National Security Solutions team provides high-end engineering and advanced technology solutions to our customers in the intelligence and national security communities. In this position, your work...SeniorFull timeFor contractorsLocal area
KBR
San Antonio, TX2 days ago - Guidehouse is seeking a Sr. Data Analytics Developer to design, build, and optimize enterprise data lakes, data warehouses, and dimensional models in a multi-location US footprint, including San Antonio, TX. You will implement secure data ingestion pipelines and support...Senior
- Senior Data Engineer The Data Services team is responsible for technical design and end-to-end delivery of complex data-driven solutions and data products for the enterprise. The Senior Data Engineer will report to the Sr Manager, Data Solutions / Manager. This role is...SeniorFull timePart timeWork at officeLocal areaWork from homeHome office2 days per week
$102.5k - $213.4k
...working world. We are seeking a talented Adobe CJA Developer Senior Consultant to join our dynamic Marketing Transformation team.... ...strategies. The ideal candidate will have a strong background in data analytics, experience with Adobe CJA, and a passion for delivering...SeniorFull timeSummer holidayFlexible hours- ...Marathon Petroleum Corporation seeks a Senior Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions using Azure data services such as Data Lake, Synapse Analytics, Azure Functions, and Databricks. You will collaborate...Senior
$124k - $280k
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions... ...that meet current and future business needs. As a Senior Manager you lead large projects, innovate processes, and maintain...SeniorH1b$114.08k - $218.03k
...for active-duty military spouses consistent with applicable policy and business needs.The OpportunityAs a dedicated Senior Infrastructure Engineer - Data Protection, you will be responsible for designing, implementing, maintaining, and troubleshooting our data backup, recovery...SeniorFull timeH1bWork at officeRemote workHome officeRelocation packageFlexible hoursUSAA - United Services Automobile Association
San Antonio, TX7 hours ago- ...Job Description Job Description Senior Data Engineer — Microsoft Fabric Remote | Active Secret Clearance Build and Modernize a Mission-Focused Data Platform Help shape the data engineering foundation behind a major federal data modernization effort. As...SeniorWeekly payWork at officeRemote workHome office
$127k - $150k
Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology professionals help clients identify and solve... ...member, provider, eligibility, medical, and pharmacy domains. Senior Data Engineer responsible for designing, developing, and...SeniorLocal areaVisa sponsorshipDeloitte
San Antonio, TX1 day ago$170k - $200k
GovCIO is seeking a Senior Data Engineer / Enterprise Telemetry & Data Pipeline SME to design, optimize, automate, and sustain large-scale data collection and streaming pipelines supporting Air Force Intelligence Community missions.The environment includes a global Elastic...Govcio
San Antonio, TX2 days ago- ...Datacenter Engineer The engineer in this position should have a wealth of experience engineering/installing datacenter equipment. The... ...cohesive package. This would include the complete engineering of data centers including, but not limited to, infrastructure, overhead...For contractorsWork at officeLocal area
ADEX
San Antonio, TX5 days ago - ...Educational Qualification(Mandatory) Bachelor's or Master's degree in a quantitative discipline such as Statistics, Mathematics, Economics, Data Science, Operations Research, Applied Mathematics, Computer Science, or a related field. Notes :- All qualified applicants will...Permanent employmentLocal area
Danta Technologies
San Antonio, TX2 days ago $71.3k - $140.6k
Position Summary Our Deloitte AI & Engineering team works to transform technology... ...innovation. Work you'll do As a PROJECT - Data Engineer II on the AI & Data team, you will... ...development From entry-level employees to senior leaders, we believe there’s always room to...Local areaDeloitte
San Antonio, TX4 days ago- ...Data Analytics Professional Employment Eligibility Statement: Due to specific project... ...Statistics, Economics, Computer Science, Engineering, or related field. ~6+ years of... ...presentations and communicating insights to senior leadership. ~ Understanding of Agile methodologies...Permanent employmentLocal area
Danta Technologies
San Antonio, TX5 days ago $102.3k - $209.5k
...Description Tracks and monitors ongoing Data Center critical infrastructure... ...suitability for data center builds. Acts as the engineering representative on a wide range of moderately... ..., and Governance Collaborates with senior team members and supports a project or other...Contract workTemporary workFor contractorsFlexible hoursShift workOracle
San Antonio, TX5 days ago- ...work will be OS/JUNOS software upgrades and card installs (Routing Engines, line cards, etc.) during the maintenance window (00:00 am - 06:... ...as Switches and Terminal Servers that support Voice, Video, and Data in the AT&T Mobility Network. This role focuses on Hardware...Local areaAll shiftsFlexible hoursShift workNight shift
TriOptus LLC
San Antonio, TX5 days ago $106.3k - $206.2k
...Join us to drive positive, lasting change that moves missions and the government forward! Accenture Federal Services is seeking a Data Engineer to join our team and support our client in the San Antonio, TX area. This role sits at the intersection of development and...For contractorsLive inWork at officeLocal area- ...Snowflake and SQL will be responsible for developing, and maintaining data solutions using Snowflake cloud data platform and SQL databases... ...industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services...
- Data Engineer / Developer Design and develop high-quality, scalable, and efficient data solutions. Support end-to-end data engineering initiatives and data transformation efforts. Develop and optimize complex SQL queries and data transformations. Build and maintain ETL/...
- ...San Antonio, TX Duration 6 months Duties Develop and support data applications, APIs, web services, and microservices. Design,... ...Analytics, NLP, and big data technologies Experience Hands-on Data Engineering/Application Development experience. Strong Python development...Local area
- CTG is seeking to fill a Data Engineer position for our client. Location: San Antonio, TX Duration: 6 months Duties: Develop and support data applications, APIs, web services, and microservices. Design, develop, test, debug, and maintain complex Python applications....Local area
- Junior Data Engineer Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: Yes San Antonio, TX Jr. Data Engineer position who can write good SQL, experience in using Gitlab for code migration...
- Senior Data Engineer We are seeking a highly experienced Senior Data Engineer to lead the design and development of model-ready data solutions for Data Analytics & Monitoring Tools for our Pricing Team. This role will be responsible for building scalable data pipelines...Work experience placement
- We’re Hiring: Data Engineer / Technical Lead - Snowflake & dbt Work Authorization: TN Visa, U.S. Citizens (USC), and Green Card (GC) holders We are looking for an experienced Data Engineer / Technical Lead with strong hands‑on expertise in Snowflake and dbt (Core or Cloud...Work visa
- Data Engineer San Antonio, Texas, United States About the Job We are seeking a skilled and motivated Data Engineer to join our client's dynamic team. As a Data Engineer, you will play a critical role in designing, building, and maintaining data pipelines and architectures...
- Job Summary: The Senior Technical Lead will be responsible for leading technical teams and projects related to Snowflake, DBT, SQL, and... ...overseeing the design, development, and implementation of data solutions leveraging these technologies to meet business requirements...Immediate start
$62k - $83k
HCLTech is hiring a Developer specializing in Snowflake and SQL to design and maintain data solutions in the Snowflake cloud data platform, with a focus on reliable pipelines, data quality, and support for analytics initiatives. Key Responsibilities Develop and implement...- ...DBT SQL Python Datastage or Informatica Unix Detailed Job Description Knowledge of SQL language and cloud-based technologies Data warehousing concepts, data modeling, metadata management Data lakes, multi-dimensional models, data dictionaries Migration to AWS...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- senior data center engineer San Antonio, TX
- senior cloud data engineer San Antonio, TX
- senior data integration developer San Antonio, TX
- data developer San Antonio, TX
- data engineer San Antonio, TX
- big data cloud engineer San Antonio, TX
- data engineering intern summer San Antonio, TX
- data engineer analytics San Antonio, TX
- big data devops engineer San Antonio, TX
- junior big data engineer San Antonio, TX