Lead Data Engineer (Spark/Scala/Python)
Omni Inclusive
Senior Technical LeadThe Senior Technical Lead will be responsible for leading technical teams and projects related to Apache Spark, Scala, and Python. The role involves overseeing the design, development, and implementation of scalable and efficient solutions using these technologies.Key Responsibilities:Lead technical teams in the design and implementation of solutions using Apache Spark, Scala, and PythonProvide technical expertise and guidance to team members in resolving complex technical issuesCollaborate with stakeholders to gather requirements and define project scopeEnsure adherence to best practices in coding, testing, and deployment processesConduct code reviews and performance optimization activitiesTroubleshoot and debug technical issues to ensure seamless project deliveryStay updated with the latest trends and advancements in Apache Spark, Scala, and Python technologiesMentor team members and facilitate knowledge sharing within the teamSkill Requirements:Strong proficiency in Apache Spark, Scala, and PythonExperience in leading technical teams and projectsExcellent problem-solving skills and ability to think criticallySolid understanding of software development life cycleGood communication and interpersonal skillsAbility to work effectively in a collaborative team environmentStrong organizational and leadership abilitiesExperience in performance tuning and optimization techniquesKnowledge of big data concepts and tools is a plusCertifications: Relevant certifications in Apache Spark, Scala, or Python are a plus
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (Spark/Scala/Python) in Houston, TX vacancy
$134.5k - $265.1k
Position Summary Deloitte is seeking a Lead Data Engineer- Databricks to support the design, build, and delivery of... ...• 3+ years of experience with Databricks and Apache Spark• 3+ years of experience with Python and Structured Query Language (SQL)• 2+ years of experience...PythonLocal areaVisa sponsorshipDeloitte
Houston, TX5 days ago- ...Lead Software EngineerIf you are looking for a game... ...place.As a Lead Software Engineer at JPMorgan Chase... ...integral part of an agile data engineering team. To enhance... ..., particularly Python and/or JavaAdvanced knowledge... ...-on experience with Spark/PySpark and other big data...Python
hackajob
Houston, TX4 days ago $100k - $125k
...consulting company that leads with outcomes to... ...create custom software, data, AI, and cloud... ...Data Architecture & Engineering team sees data as the... ...languages such as SQL, Python, Java and or Scala.* Experience with several... ...technologies, which may include Spark, Kafka, Airflow, dbt,...PythonTemporary workWork at officeLocal areaSlalom
Houston, TX8 days ago- ...opportunities for success.We are currently seeking an experienced Data Engineer to join the Big Dat and Advanced Analytics department. The... ...architectures.5+ years of in-depth programming experience in Python and SQL.5+ years in software development lifecycle experience...Python
Enterprise Products
Houston, TX8 days ago - ...Title: Lead Data Engineer (AI/ML) Location: Houston, TX 77002 (ONSITE) Duration: Direct Hire Work Requirements: U.S. Citizen, GC Holders... ...in a technical lead role. ~ Expert level experience in Python with solid software engineering fundamentals including testing...PythonFlexible hours
INSPYR Solutions
Houston, TX5 days ago - ...We are currently looking for a Lead Analyst Data Engineer for our Houston, TX office. POSITION DESCRIPTION The Lead Data Engineer is responsible... ...Alation data governance tool. Strong skills in SQL (T‑SQL), Python (PySpark/Pandas), DAX, Power Query (M), PL/SQL. Experience...PythonWork at office
Bwpipelines
Houston, TX3 days ago - ...We are seeking a Principal Data Engineer to lead the architecture, design, and delivery of modern... ...modern programming language, preferably Python, Scala, Java, or C#. ~ Strong experience... ...processing technologies such as Apache Spark, Kafka, Flink, Hadoop ecosystems, or comparable...Python
CG Infinity
Houston, TX3 days ago - ...Principal Data EngineerJoin the ECI Group's Professional Technical... ...a contract Principal Data Engineer. This is a Houston TX based... ...Principal Data Engineer to lead the delivery of innovative... ...programming languages such as Python, Scala, or Spark-SQL.Experience in designing...PythonPermanent employmentContract work
Engineers and Constructors International
Houston, TX2 days ago - NAVA Software solutions is looking for a Lead Data Engineer Details: Lead Data Engineer /Integrations Location: Houston TX - 3 days onsite... ...consultative and/or IT capacity. 5+ years of demonstrated use of Python, Java, C#, or high-level programming language. 5+ years of...PythonFull timeShift work
- Senior Data Engineer - (100% Remote) Fully Remote: Work from anywhere with flexible hours... ...Develop and optimize workflows with Apache Spark and Scala for batch and streaming data... ...workflows. Preferred Skills: Knowledge of Python for data engineering tasks. Experience...PythonRemote workFlexible hours
- Senior Data Engineer We are seeking a Senior Data Engineer to... ...observability. Key Responsibilities Lead the design, development,... ...processing frameworks (Spark, Databricks, Flink, Beam... ...solutions in Python/SQL and one additional language (Scala/Java); familiarity with...Python
- ...Services) is an AI, Data & Digital innovation... ...outperform competition and lead the change in their... ...and motivated Data Engineer to design, build, and... ...architectures. Proficiency in Python, PySpark, or Scala for data processing.... ...technologies such as Spark, Databricks, Hadoop,...Python
- ...publicly traded partnerships and a leading North American provider of... ...time-series and operational data alongside unstructured document... ...Development Life Cycle Mentor junior engineers in design and code reviews and... ...Expert level experience in Python with solid software...PythonShift work
- Senior Data Engineer - Remote 100% Contract-Long Term--CTH Visa Independent Only Senior Data... ...via code-oriented systems like Spark, Airflow, Luigi, or similar, and with... ...in data engineering languages such as Python, Java, Scala, SQL Familiarity with visualizing data...PythonContract workRemote work
$146.1k - $210k
...PermanentPosted: 2026-10-11Deadline: 0001-01-01Our client is seeking a Lead Data Engineer to join their team. As a Lead Data Engineer, you will be part... ...diverse data at scale, utilizing technologies such as Apache Spark, Hadoop, and Kafka.Work within cloud environments like AWS or...RelocationFlexible hoursExperis
Houston, TX6 days ago- ...Bwpipelines in Houston, TX, seeks a Lead Analyst Data Engineer to architect and deliver high-performance data pipelines across cloud environments... ...will have extensive AWS experience, strong skills in SQL and Python, and a Bachelor's degree in a relevant field. Boardwalk...Python
Bwpipelines
Houston, TX2 days ago - We are looking for an experienced Senior Data Engineer to help design and enhance scalable data platforms that support critical business... ...from multiple sources.• Develop robust ETL workflows using Python and Spark to support reporting, analytics, and operational data needs...Python
Robert Half
Houston, TX3 days ago - In this role, you will lead the development of a robust data ecosystem that transforms drilling... ...will work closely with engineers, data scientists, and... ...hands-on experience with Python, PySpark, SQL and modern data... ...technologies such as Databricks, Spark, SQL Server, Data Lakes,...Python
National Oilwell Varco
Houston, TX4 days ago - ...digitalization, building AI, and data solutions that solve the... ...the Global Value Delivery team leads software implementation,... ...improve decisions in industrial engineering, but you experience that the... ...technologies and languages i.e Python, Spark, Rest APIsCustomize existing...PythonWork at officeLocal area
Cognite
Houston, TX7 days ago $100.79k - $160.26k
...what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds,... ...initiatives.Desired SkillsProficiency in SQL and Python.Data pipeline tooling and cloud data... ...programming languages such as Java, Scala, or Go; experience integrating data from...PythonFull timeWork at officeRemote workVisa sponsorshipDLA Piper
Houston, TX7 days ago$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co... ...into products, engineering systems that support learning... ...Platforms (Dataproc, Apache Spark)* GoogleBigQuery,BigLake, Cloud SQL* Python, Java, SQL* Firestore,... ...consulting company that leads with outcomes to bring more...PythonTemporary workWork at officeLocal areaFlexible hoursSlalom
Houston, TX5 days ago- Lead Software Engineer We have an opportunity to impact your career and provide... ...Infrastructure Platforms - Data and Specialty Services team... ..., build and optimize Spark-based batch/real-time workflows... ...Heavy experience with Spark (Scala/Python/Java), distributed data...Python
$128k - $249k
...search for important and impactful work lead to the same place.We are seeking a Senior Data Engineer to join the firm. The Senior Data... ....• Demonstrate expertise in SQL and Python for data transformation and automation, utilizing Spark and CI/CD pipelines through Azure...PythonFull timeTemporary workLocal areaRemote workFlexible hoursAfternoon shiftK&L Gates
Houston, TX5 days ago- ...US|Data Engineer IIIJob Location: Houston, TXJob Duration: 9 months contractResponsibilities:Design and build the integration jobs... ...patterns, tools and languages (Azure Data Factory, Data Brick, Spark SQL, Python, PySpark).Design, build, & maintain the environments (SIT/...Python
Samprasoft
Houston, TX4 days ago - ...Job Title: Sr. Data Engineer Worksite: Houston, TX (Hybrid) Position Summary: We are... ...design, version control, CI/CD). Build Python modules (Pandas, NumPy) for data processing... ...Functions, or dbt Cloud. Exposure to Spark, streaming platforms, NoSQL, and API-...PythonLong term contractContract work
- We are looking for an experienced Lead Data Engineer to oversee the design, implementation, and management... ...datasets using tools such as Apache Spark, Hadoop, and Kafka.• Utilize cloud... ..., using programming languages like Python or R.• Implement and enforce data governance...Python
Robert Half
Houston, TX7 days ago - ...Staff Data Engineer - Data Platform - (Remote) Location : This position is open... ...platforms using Databricks, AWS, SQL, and Python . You will lead technical decisions, ensure data... ...AWS SQL, Python, and optionally Scala ETL/ELT pipelines and Delta Live...PythonPermanent employmentFull timeWork at officeRemote work
System Soft Technologies
Houston, TX5 hours ago $146.1k - $210k
Our client is seeking a Lead Data Engineer to join their team. As a Lead Data Engineer, you will be part of supporting data infrastructure and... ...diverse data at scale, utilizing technologies such as Apache Spark, Hadoop, and Kafka. Work within cloud environments like AWS...Weekly payTemporary workRelocationRelocation packageFlexible hours- ...to grow as the world’s leading energy company!Role SummaryWe... ...Machine Learning Engineer who combines deep machine... ...team alongside data scientists, software engineers... ...languages (e.g. Python, Go, Java, C++).Advanced... ...technologies (e.g. Hadoop, Hive, Spark).Experience with...PythonFull timeWork at officeLocal areaRemote workFlexible hours
BP
Houston, TX5 days ago - ...Bechtel is seeking an analytics engineer todesign, build, andmaintainscalable data pipelines and data integration solutions... ...reports to the PIIM Analytics Lead underthe PIIM team. The PIIM... ...Strong programming experience (Python, Scala, or equivalent) with a focus on data...PythonFull timeWork experience placementWork at officeLocal areaRemote workRelocation
Bechtel Global Corporation
Houston, TX5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer (Spark/Scala/Python). Be the first to apply!
Related searches
- python engineer Houston, TX
- python developer Houston, TX
- full stack / python developer (remote) Houston, TX
- python developer data analytics Houston, TX
- python programmer Houston, TX
- sap data migration Houston, TX
- data tech Houston, TX
- data visualization Houston, TX
- data loss prevention engineer Houston, TX
- data loss prevention analyst Houston, TX