Lead Data Engineer
Argyle Infotech
Senior Lead Data Engineer
Location: San Jose, CA 95125 Hybrid(Locals)
Key Responsibilities:
- Architect, construct, test and maintain ELT pipelines using Hadoop and Spark SQL
- Manage and optimize the infrastructure ensuring reliability and performance
- Design and implement data models and schemas for enterprise data warehouse and data marts
- Write and maintain scripts in Python for various applications
- Develop, optimize, troubleshoot complex SQL queries and database structures for relational and non-relational databases
- Work closely with analysts and product managers to understand data requirements and deliver high-quality data
- Provide technical guidance and mentorship to other team members fostering best practices in data engineering
- Monitor system performance, identify bottlenecks, implement solutions to ensure high data availability
Required Skills:
- High proficiency in the Hadoop ecosystem (HDFS, MapReduce, Yarn) and Apache Spark, Scala for large scale data processing
- Good knowledge in Python for data manipulation and scripting
- Mastery of advanced SQL and deep experience working with relational databases and data warehouses
- Hands-on experience with workflow management tools like Apache Airflow
- Familiarity with Unix shell scripting for automation and system management
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in San Jose, CA vacancy
- ...Hello Everyone, No GC, Role: Senior Lead Data Engineer Location: San Jose, CA 95125 Hybrid(Locals) Key: Hadoop, Spark SQL strong • Key Responsibilities: • Architect, construct , test and maintain ELT pipelines using Hadoop and Spark SQL •...SuggestedLocal area
Argyll Infotech, Inc.
San Jose, CA4 days ago $139k - $257.55k
...yours! The Opportunity The Marketing Operations and Engineering team in Growth Marketing and Insights (GMI) handles data architecture, transformation, and engineering for... ..., and lifetime value. We want an Engineering Lead to manage the data enabling the team’s work. You...SuggestedTemporary workLocal areaAdobe
San Jose, CA5 days ago- Role Lead Data Engineer Required Skills Matillion ELT Snowflake DataStage Azure Data Services such as ADLS, SQL Server Dbt tool Experience in Data platform migration projects Experience in design documentation Responsibilities The core requirement for developers...Suggested
- ...generation computing experiences—from AI and data centers, to PCs, gaming and embedded... ...career. THE ROLEWe are seeking a Senior Data Engineer to design, build, and optimize our next-... ...-tech semiconductor operations. You will lead the implementation of a modern data lake,...Suggested
$147k - $237.5k
A cybersecurity company in Santa Clara is seeking a Principal Engineer to design and develop groundbreaking SASE technologies. The ideal... ...with system software in networking devices, a strong background in data plane architecture, and proficiency in programming languages...SuggestedFull time- ...Lead Data EngineerData team builds and operates the data marts and pipelines that power HR/Workforce reporting and analytics across Intuit. We're looking for a hands-on Data Engineer who can operate independently. High-visibility, high-ownership — direct exposure to AI...
United IT
Mountain View, CA1 day ago - Job Description RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and robust...
- UST is seeking a Senior Lead I Data Engineer to design, develop, and maintain real-time and batch data pipelines using Spark and Kafka, with cloud services (GCP) and data warehousing in BigQuery. You will optimize performance and ensure data quality across scalable architectures...Full time
$174.72k - $295.68k
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies... ..., and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset...Full time- Stepping Up Solutions in Sunnyvale is looking for a Lead Data Engineer to design and implement scalable data infrastructure. This role involves leading a team, delivering quality projects, and collaborating with data professionals. The ideal candidate will have expertise...
- ...for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ..., calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data...
$63 - $68 per hour
...| USD 63-68 / Hourly (C2C)Employment Type: Full TimeClient: TechMContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (Hybrid) / Austin, TX / Seattle, WAAbout the Role:We build data systems that power innovation...Hourly payFull time$152k - $190k
...constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform.... ...future of cybersecurity.RoleWe are looking for a Staff Software Engineer to join our team. This is a hybrid, based in San Jose, CA 3 days...Full timeWork at officeLocal areaWorldwide3 days per week- ...roleGridmatic’s business is complex, and we need to build a robust data layer to be able to answer core questions around profit and loss... ...our renewable supply.We’re looking for a startup-minded data engineer who can wear a lot of hats, work with multiple teams, and build...Work at officeHome officeFlexible hours3 days per week
$148.75k - $361k
...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their...Work at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$184k - $287.5k
NVIDIA is currently seeking a highly motivated Senior DevTech Compute Engineer for Compression and Data Processing! Would you enjoy prototyping and developing ground breaking methods and data formats to accelerate complex distributed workflows? Do you love investigating...Full timeRemote work- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...Remote work
$167.7k - $245.2k
...expected to close on: 08/30/2026Meet the TeamAt Data Center Business Unit in Cisco, we are... ...will participate in a project team of engineers involved in the development of software for... ...productive working relationships.• May lead projects with limited complexity to execute...Full timeTemporary workLocal areaFlexible hours$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...fast-growing teams.Responsibilities: Create and maintain optimal data processing pipeline architectureBuild the infrastructure...Full time$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus...Full time$76.73k - $127.88k
...wants to work in a collaborative environment? As an experienced Data Engineer, you will have the ability to share new ideas and collaborate... ...from engagement managementIndependently and collaboratively lead client engagement workstreams focused on improvement, optimization...Local areaVisa sponsorship$75 - $85 per hour
Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description:This will be a data... ...CS/ChemE/MechE is preferred. About PTR Global: PTR Global is a leading provider of information technology and workforce solutions....Full timeContract work$140.25k - $210.38k
Introduction to the jobThe senior lead SQA engineer is responsible for leading validation activities for shared Data & Compute platform capabilities across multiple products. The role focuses on validating new functionality and platform enhancements in areas such as Data...Full time$184k - $287.5k
...do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all... ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our data...Full time$133.1k - $236.4k
...introduce the finance of the future! We seek a data scientist to join the Creativity &... ...problems to create processes to reverse engineer existing data flows and source-to-target... ...personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio,...Full timeTemporary workWork experience placementWork at officeLocal areaWorldwide- ...4-06-04Company Name:HITACHI ENERGY USA INCProfession (Job Category):Engineering & ScienceJob Schedule: Full timeRemote:NoJob Description:General information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities...Full time
$207.4k - $259.2k
...RoleArcher is building the future of urban air mobility, and our data platform is what makes intelligent decisions possible — from... ...operations to flight analytics. We're looking for a Senior Staff Data Engineer who brings deep expertise in data modeling and warehouse design:...Local area$184k - $287.5k
...Relational Foundation Model team is helping lead that transformation. We are building a... ...a new frontier for enterprise AI. As an engineer on this team, you will go beyond adapting... ...architectures that generalize across diverse data schemas. Your work will power meaningful...Full time$174.72k - $295.68k
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies... ...learning, and smart connectivity.We are looking for a Data Infrastructure Engineer with engineering background and development skills. As a...Full time$108.22k - $162.1k
...are the essential building blocks of the data infrastructure that connects our world. Across... ...Marvell is a place to thrive, learn, and lead. Your Team, Your ImpactThe existing and... ...to enable AE/FAE and validation engineers to quickly interpret test results and debug...Permanent employmentFull timeInternshipWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches