Senior Data Engineer
InterSources
Sr Data Engineer
Role: Sr Data Engineer MoI: 2 Video Notes from Manager: Candidates must be located in San Antonio, TX, VA, DC, NY- will work onsite first week and then remotely, contract through end of year, ideally 5+ years of experience with Pyspark who has experience building a code framework using Pyspark and debugged using spark logs for performance tuning. The expected output is a highly performant code that will used as a backbone for the enterprise, able to handle complex business transformations and move data from Delta format (Databricks) to a data warehouse in Synapse Pyspark, Spark Architecture, Azure Databricks (Unity Catalog), Azure Synapse, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS)
Responsibilities
- Takes a leading role in the design, development and implementation of processes to extract, transform and load data from disparate sources into a form that is consumable by analytics processes within a given project, reviewing deliverables to ensure high quality
- Evaluates and resolves issues regarding data quality reviews, cleansing, data integration and migration, leveraging advanced technical knowledge and showing technical leadership in aspects of data engineering while driving continuous improvement efforts
- Ensures that the appropriate expectations, principles, structures, tools and responsibilities are in place to deliver the project
- Analyzes the latest industry trends such as cloud computing and distributed processing and infers potential impact on businesses (short and long-term)
- Provides advanced technical expertise to maximize efficiency, reliability and value from current data engineering processes and researches and monitors existing client base and industry developments to identify potential new product opportunities from emerging technologies
- Develops strong working relationships with peers across engineering, collaborating to develop leading data engineering solutions
- Drives adherence to the relevant data engineering and data modelling processes, procedures, standards, and may input into the definition, maintenance and implementation of technology standards
Qualifications
- Uses most of the related skills and technologies, and maintains an in-depth knowledge of the area
- Experience designing and conducting research and experiments with recently developed technologies
- Has successfully demonstrated domain of most skills and technologies during a large number of relevant projects
- Strong experience in the use of complex technologies Computer Science
- Typical Education: Engineering, IT, Mathematics
- ...We are seeking a highly experienced Senior Data Engineer to lead the design and development of model-ready data solutions for Data Analytics & Monitoring Tools for our Pricing Team. This role will be responsible for building scalable data pipelines, enabling standardized...SeniorWork experience placement
- ...Data Analyst Responsible for partnering with Quality Management, Information Technology (IT), and third-parties, serving as a data expert, to maintain, develop and improve solutions that source, structure, and curate data to enable business operations, service enhancements...Senior
$100k - $120k
...Senior Data Governance Engineer Skill: Senior Data Governance Engineer Must Have Technical/Functional Skills: 8+ years of experience in Data Governance, Metadata Management, or Data Management. Strong hands on experience with Collibra (or similar enterprise data governance...Senior- ...Data Scientist Join a forward-thinking analytics team driving mission-critical solutions for U.S. Government partners. We're seeking... ...Required: ~ Bachelor's degree in Data Engineering, Data Science, Computer Science, Mathematics, Statistics, or a...SeniorFor contractorsWork at office
- ## Senior Data EngineerApplylocations: San Antonio, Texas: Findlay, Ohiotime type: Full timeposted on: Posted Todayjob requisition id: 0... ...collaborative team environment.# Position SummaryAs a Senior Data Engineer, you will design, develop, and optimize scalable data...SeniorLocal areaImmediate startFlexible hours
$106.9k - $176.5k
...take your career wherever you want it to go. Join EY and help to build a better working world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering,...SeniorSummer holidayFlexible hours- ...Data Engineer Altamira Technologies has a long and successful history of providing innovative solutions throughout the U.S. National Security community. Headquartered in McLean, Virginia, Altamira serves the defense, intelligence, and homeland security communities worldwide...SeniorWorldwide
- A data solutions firm in San Antonio, Texas seeks a skilled Palantir Foundry Data Engineer to lead the development of data pipelines, enhance operational dashboards, and translate critical data into actionable insights. The ideal candidate holds a Master’s degree and has...SeniorFull time
- TechHuman is hiring a Data Engineer to enhance our data pipeline environment in San Antonio, Texas. You will be pivotal in building and optimizing the data pipeline, working closely with senior data professionals. Responsibilities will include creating new pipelines and...Senior
$133k - $238k
...Data Engineer (TS/SCI) – Senior / Technical Lead IAMUS Consulting ____________________________________________________________________________________________________________________Make an Impact Where It Matters! IAMUS Consulting is seeking a Senior Data Engineer / Technical...SeniorContract work- An innovative company is seeking a skilled Data Engineer to design, build, and maintain data pipelines. This role involves optimizing data models in Snowflake and utilizing dbt for effective data transformations. The ideal candidate will have strong SQL skills and experience...Senior
- Inherent Technologies is looking for a Senior Data Engineer in San Antonio, TX to design scalable data solutions for data analytics. This role is key for building robust data pipelines and supporting advanced analytics for the Pricing Team. The ideal candidate will have...Senior
- A specialized recruiting firm is seeking an experienced SME-level Data Engineer to support mission-critical data ingestion in a hybrid environment based in San Antonio, TX. The ideal candidate has 14+ years in data engineering, expertise with Java, Apache NiFi, and is familiar...Senior
$99k - $164.8k
...to provide an experience to our stakeholders that delivers on our promises. Position Summary We are seeking a highly skilled Senior Data Engineer to guide the design, development, and delivery of our enterprise data platforms. This role requires deep technical expertise...SeniorCasual workWork at officeLocal areaRemote work- A data consulting firm is seeking a Data Profiler in San Antonio, TX. The role involves supporting data research and performing analytics using SIEM platforms like Splunk and Elastic. Candidates should have a technical BS along with 9 years of relevant experience and must...Senior
$77k - $202k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...thorough data architecture strategies. As a Senior Associate you analyze complex problems,...SeniorFull timeH1b$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time... ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies... ...current and future business needs. As a Senior Manager you lead large projects, innovate...SeniorFull timeH1b- A leading data center provider seeks a Senior Project Engineer to manage construction projects in San Antonio, Texas. Responsibilities include overseeing project coordination, managing contractor billing, and ensuring compliance with safety and quality controls. The ideal...SeniorFull timeFor contractors
- A specialized recruiting firm is seeking a SME-level Data Engineer in San Antonio, TX. The role involves supporting mission-critical data ingestion, requiring expertise in ETL processes, programming languages like Java, Python, and SQL, and familiarity with big data tools...SeniorRemote work
- An established industry player is seeking a seasoned Data Warehousing professional with a minimum of 8 years of IT experience. This role emphasizes leadership and hands-on development skills, particularly in Data Stage, PL-SQL, and Unix Shell Scripting. The ideal candidate...Senior
$65.5k - $134k
...EY and help to build a better working world. Senior Analyst - Financial Services Organization - AI and Data - Service Delivery Center EY is the only professional... ..., compliance, or banking) Knowledge of prompt engineering and in-context learning optimization...SeniorSummer holidayFlexible hours- ViziRecruiter,LLC. is hiring a Data Center Infrastructure Engineer in San Antonio, Texas. You will be responsible for the deployment, maintenance, and support of physical data center infrastructure, enhancing operational efficiency through process improvement. The ideal...Senior
- An established industry player is seeking a skilled Data Engineer to join their innovative team. In this role, you will leverage your expertise in Snowflake and cloud technologies to create and implement enterprise-level applications. You'll be responsible for designing...Senior
- LVI Associates in San Antonio seeks a Senior Electrical Engineer to lead electrical design for mission-critical data center projects. This role involves owning technical delivery from concept to completion, along with collaborating with major equipment vendors and providing...SeniorRemote jobFlexible hours
- A leading company is seeking a Senior Cloud/Data Infrastructure Engineer to oversee the design and implementation of scalable data infrastructure and automation in the cloud. The role demands a seasoned professional with significant experience in ETL tools, cloud platforms...Senior
$132.9k - $182.7k
...we give our best and know that we’re making a difference. As a Senior Structural Engineer professional based within our Advanced Manufacturing team, you’ll work on a variety of projects related to Data Centers, including new builds, retrofits, colocations, etc. You will...SeniorFull timeRemote work- Driveformpc is seeking a Senior Data Engineer in San Antonio, Texas. In this role, you will design and optimize scalable data pipelines, collaborate with various teams, and ensure data security and quality. The ideal candidate will have a Bachelor's Degree in Information...SeniorFull time
- Marathon Petroleum Company LP is looking for a Senior Data Engineer located in San Antonio, Texas. You will design, develop, and optimize scalable data pipelines and cloud-based data solutions using Azure data services. The ideal candidate will work closely with various...Senior
$102.5k - $187.9k
...Studio+ - Adobe Customer Journey Analytics (CJA) Developer -Senior At EY, we’re committed to building a better working world.... ...strategies. The ideal candidate will have a strong background in data analytics, experience with Adobe CJA, and a passion for delivering...SeniorFull timeSummer holidayFlexible hours- EY is seeking a Senior Consultant Data Engineer to join their team in San Antonio, Texas. The position involves designing and building analytics solutions, focusing on cloud data engineering, particularly using Databricks. Ideal candidates should have a strong background...SeniorFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
- remote data engineer San Antonio, TX
- entry level big data engineer San Antonio, TX
- big data devops engineer San Antonio, TX
- data engineer San Antonio, TX
- data engineer contract San Antonio, TX
- software data engineer San Antonio, TX
- big data cloud engineer San Antonio, TX
- junior big data engineer San Antonio, TX
- sr information security engineer San Antonio, TX
- director data engineering San Antonio, TX

