Lead Data Engineer
Argyle Infotech
Senior Lead Data Engineer
Location: San Jose, CA 95125 Hybrid(Locals)
Key Responsibilities:
- Architect, construct, test and maintain ELT pipelines using Hadoop and Spark SQL
- Manage and optimize the infrastructure ensuring reliability and performance
- Design and implement data models and schemas for enterprise data warehouse and data marts
- Write and maintain scripts in Python for various applications
- Develop, optimize, troubleshoot complex SQL queries and database structures for relational and non-relational databases
- Work closely with analysts and product managers to understand data requirements and deliver high-quality data
- Provide technical guidance and mentorship to other team members fostering best practices in data engineering
- Monitor system performance, identify bottlenecks, implement solutions to ensure high data availability
Required Skills:
- High proficiency in the Hadoop ecosystem (HDFS, MapReduce, Yarn) and Apache Spark, Scala for large scale data processing
- Good knowledge in Python for data manipulation and scripting
- Mastery of advanced SQL and deep experience working with relational databases and data warehouses
- Hands-on experience with workflow management tools like Apache Airflow
- Familiarity with Unix shell scripting for automation and system management
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in San Jose, CA vacancy
- ...NewRocket is looking for an AI Data Intelligence Lead who will design AI-powered capabilities for modernizing enterprise data. This role entails... ...machine learning, generative AI, and advanced data engineering to enrich and optimize enterprise data. Ideal candidates will...SuggestedRemote work
NewRocket Inc
Santa Clara, CA2 days ago - ...Qcells North America is seeking a Lead Data Engineer to architect and lead scalable, cloud‑based data platforms that support enterprise analytics and reporting. You will drive ETL/ELT frameworks, data governance, and Lakehouse patterns across Azure services. The ideal...Suggested
Qcells North America
Santa Clara, CA2 days ago $139k - $257.55k
...yours! The Opportunity The Marketing Operations and Engineering team in Growth Marketing and Insights (GMI) handles data architecture, transformation, and engineering for... ..., and lifetime value. We want an Engineering Lead to manage the data enabling the team’s work. You...SuggestedTemporary workLocal area- Role Lead Data Engineer Required Skills Matillion ELT Snowflake DataStage Azure Data Services such as ADLS, SQL Server Dbt tool Experience in Data platform migration projects Experience in design documentation Responsibilities The core requirement for developers...Suggested
- Lead Data Engineer We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud‑based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides technical leadership in...Suggested
$251k - $310k
...simulation across 15+ U.S. states. This role follows a hybrid work schedule and reports to Sr. Staff TLM. You will: Lead, mentor, and grow a team of data engineers responsible for the Waymo Commercialization Data Lake and associated data pipelines. Define and drive the...Full timeRemote workWaymo
Mountain View, CA2 days ago- ...Lead Data Engineer RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and...
Stepping Up Solutions
Sunnyvale, CA1 day ago - Key Responsibilities • Lead the architecture, design, and implementation of large-scale distributed data platforms. • Build and optimize high-performance data pipelines... ...observability. • Mentor a team of data engineers and provide technical leadership across...
Veridic Solutions
Sunnyvale, CA4 days ago - ...Lead Data Engineer Data team builds and operates the data marts and pipelines that power HR/Workforce reporting and analytics across Intuit. We're looking for a hands-on Data Engineer who can operate independently. High-visibility, high-ownership — direct exposure...
United IT
Mountain View, CA1 day ago - Coupang is seeking a skilled Database Engineer in Mountain View, California, to join the Customer Success team. You will be responsible for ensuring the reliability and performance of databases in a high-traffic e-commerce environment. The role requires strong expertise...
Coupang
Mountain View, CA4 days ago $174.72k - $295.68k
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies... ..., and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset...Full time$152k - $190k
...constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform.... ...future of cybersecurity.RoleWe are looking for a Staff Software Engineer to join our team. This is a hybrid, based in San Jose, CA 3 days...Full timeWork at officeLocal areaWorldwide3 days per week$148.75k - $361k
...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their...Work at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$148k - $224.25k
...record in technology and the skills for GPU product definition for Data Center. We are a small, dynamic, and motivated team that... ...experience in technology with previous product management, AI related engineering, design or development experience highly valuedBS or MS or...Full time$75 - $85 per hour
Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description:This will be a data... ...CS/ChemE/MechE is preferred. About PTR Global: PTR Global is a leading provider of information technology and workforce solutions....Full timeContract work- DescriptionGeneral information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities:Analyze and understand customer engineering, business, and software requirements, propose technically feasible solutions,...
- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...Remote work
$63 - $68 per hour
...| USD 63-68 / Hourly (C2C)Employment Type: Full TimeClient: TechMContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (Hybrid) / Austin, TX / Seattle, WAAbout the Role:We build data systems that power innovation...Hourly payFull time$184k - $287.5k
...do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all... ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our data...Full time- ...for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ..., calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data...
$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...fast-growing teams.Responsibilities: Create and maintain optimal data processing pipeline architectureBuild the infrastructure...Full time$140.25k - $210.38k
Introduction to the jobThe senior lead SQA engineer is responsible for leading validation activities for shared Data & Compute platform capabilities across multiple products. The role focuses on validating new functionality and platform enhancements in areas such as Data...Full time$165k - $241.4k
...architecture to capture and utilize structured and unstructured data from diverse sources. We build the essential structures that... ...store, process, and visualize large datasets. Improve feature engineering and build innovative models to solve a variety of complex business...Full timeTemporary workLocal areaFlexible hours$110k - $187k
...average on innovation and we invest 15% of sales back into R&D. Our expert teams of physicists, engineers, data scientists and problem-solvers work together with the world’s leading technology providers to accelerate the delivery of tomorrow’s electronic devices. Life here...Minimum wageFull timeFlexible hours$119.5k - $164.5k
...Materials is a global leader in materials engineering solutions used to produce virtually... ...while learning every day in a supportive leading global company. Visit our Careers website... ...analysis and deliver recommendations in a data-driven manner Lead thoughtful and...Full timeWork experience placementRelocation$108.22k - $162.1k
...are the essential building blocks of the data infrastructure that connects our world. Across... ...Marvell is a place to thrive, learn, and lead. Your Team, Your ImpactThe existing and... ...to enable AE/FAE and validation engineers to quickly interpret test results and debug...Permanent employmentFull timeInternshipWork from home$184.7k - $324.8k
...Machine Learning Data Engineer Apple is where individual imaginations gather together, committing to the values that lead to great work. Every new product we build, service we create, or Apple Store experience we deliver is the result of us making each other's ideas...Immediate startRelocationApple
Cupertino, CA4 days ago$80k - $100k
...Machine Learning Data Engineer – Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and...Full timeH1bLocal areaImmediate startRemote workVisa sponsorshipBright Vision Technologies
Santa Clara, CA1 day ago$174.72k - $295.68k
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies... ...learning, and smart connectivity.We are looking for a Data Infrastructure Engineer with engineering background and development skills. As a...Full time- DDN is seeking a highly experienced Senior Staff Engineer specializing in AI Data Path & Storage to lead hands-on development and integration of advanced storage systems with next-generation AI inference pipelines. This role involves coding, prototyping, and rapidly iterating...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches