Lead Data Engineer
Argyle Infotech
Senior Lead Data EngineerLocation: San Jose, CA 95125 Hybrid(Locals)Key Responsibilities:Architect, construct, test and maintain ELT pipelines using Hadoop and Spark SQLManage and optimize the infrastructure ensuring reliability and performanceDesign and implement data models and schemas for enterprise data warehouse and data martsWrite and maintain scripts in Python for various applicationsDevelop, optimize, troubleshoot complex SQL queries and database structures for relational and non-relational databasesWork closely with analysts and product managers to understand data requirements and deliver high-quality dataProvide technical guidance and mentorship to other team members fostering best practices in data engineeringMonitor system performance, identify bottlenecks, implement solutions to ensure high data availabilityRequired Skills:High proficiency in the Hadoop ecosystem (HDFS, MapReduce, Yarn) and Apache Spark, Scala for large scale data processingGood knowledge in Python for data manipulation and scriptingMastery of advanced SQL and deep experience working with relational databases and data warehousesHands-on experience with workflow management tools like Apache AirflowFamiliarity with Unix shell scripting for automation and system management
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer in San Jose, CA vacancy
$160k - $220k
...Lead Data Engineer Location: Santa Clara, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD Annually We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise...SuggestedQ-Cells
Santa Clara, CA5 days ago$139k - $257.55k
...yours! The Opportunity The Marketing Operations and Engineering team in Growth Marketing and Insights (GMI) handles data architecture, transformation, and engineering for... ..., and lifetime value. We want an Engineering Lead to manage the data enabling the team’s work. You...SuggestedTemporary workLocal areaAdobe
San Jose, CA3 days ago- Role Lead Data Engineer Required Skills Matillion ELT Snowflake DataStage Azure Data Services such as ADLS, SQL Server Dbt tool Experience in Data platform migration projects Experience in design documentation Responsibilities The core requirement for developers...Suggested
- NVIDIA is seeking a high-caliber, hands-on data engineer specializing in supply chain to act as the ultimate data custodian. This role will build the foundation for our fully coordinated forecasting and supply-chain ecosystem, reporting to executive leadership. Your mission...Suggested
$147k - $237.5k
A cybersecurity company in Santa Clara is seeking a Principal Engineer to design and develop groundbreaking SASE technologies. The ideal... ...with system software in networking devices, a strong background in data plane architecture, and proficiency in programming languages...SuggestedFull time- ...Lead Data EngineerData team builds and operates the data marts and pipelines that power HR/Workforce reporting and analytics across Intuit. We're looking for a hands-on Data Engineer who can operate independently. High-visibility, high-ownership — direct exposure to AI...
United IT
Mountain View, CA1 day ago - ...Lead Data Engineer RadiumOne is seeking a Lead Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and...
Stepping Up Solutions
Sunnyvale, CA4 days ago - ...Data Engineering LeadLead the architecture, design, and implementation of large-scale distributed data platforms.Build and optimize high-performance... ...technical roadmaps and platform modernization strategies.Lead architecture reviews and governance forums.Identify...
Veridic Solutions
Sunnyvale, CA1 day ago - ...Location: Sunnyvale, CA (3x/ week onsite) Duration: 6 months Data Engineer ***Only share profile, who is interested to appear for face to face interview in Cupertino, CA*** • 8+ years of experience in Data Engineering with advanced SQL skills...
Q1 Technologies
Sunnyvale, CA1 day ago $174.72k - $295.68k
XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies... ..., and smart connectivity.We are seeking a Machine Learning Data Curation Engineer to spearhead the data pipeline development and dataset...Full time- ...for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ..., calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data...
$148k - $224.25k
...record in technology and the skills for GPU product definition for Data Center. We are a small, dynamic, and motivated team that... ...experience in technology with previous product management, AI related engineering, design or development experience highly valuedBS or MS or...Full time$130k - $200k
Santa Clara, CAData Engineering - Data Infrastructure /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus...Full time$133.1k - $236.4k
...introduce the finance of the future! We seek a data scientist to join the Creativity &... ...problems to create processes to reverse engineer existing data flows and source-to-target... ...personalized customer experiences. Adobe’s industry-leading offerings including Adobe Acrobat Studio,...Full timeTemporary workWork experience placementWork at officeLocal areaWorldwide$184k - $287.5k
...do their best work.NVIDIA has a rapidly expanding ecosystem of data center platform designs. From single node HGX/DGX systems all... ...and HPC software stack. We are searching for a highly motivated engineer to lead performance benchmarking and optimization efforts for our data...Full time- ...4-06-04Company Name:HITACHI ENERGY USA INCProfession (Job Category):Engineering & ScienceJob Schedule: Full timeRemote:NoJob Description:General information:Hitachi Energy is seeking for a Senior Data Management Engineer for it's San Jose, CA location.Your Responsibilities...Full time
$152k - $190k
...constantly pushing the envelope, leveraging the world’s largest security data lake to power our cloud-native Zero Trust Exchange platform.... ...future of cybersecurity.RoleWe are looking for a Staff Software Engineer to join our team. This is a hybrid, based in San Jose, CA 3 days...Full timeWork at officeLocal areaWorldwide3 days per week- Company: Tredence Inc. Position Title: Senior Data Engineer Location: 1900 Camden Ave., Suite 66, San Jose, CA 95124 Position Responsibilities: Manage end to end delivery by Investigating problem areas, working cross-functionally with product manager & other stakeholders...Remote work
$184k - $287.5k
NVIDIA is currently seeking a highly motivated Senior DevTech Compute Engineer for Compression and Data Processing! Would you enjoy prototyping and developing ground breaking methods and data formats to accelerate complex distributed workflows? Do you love investigating...Full timeRemote work- ...roleGridmatic’s business is complex, and we need to build a robust data layer to be able to answer core questions around profit and loss... ...our renewable supply.We’re looking for a startup-minded data engineer who can wear a lot of hats, work with multiple teams, and build...Work at officeHome officeFlexible hours3 days per week
$135k - $180k
Santa Clara, CAData Engineering - Backend Engineering /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver... ...fast-growing teams.Responsibilities: Create and maintain optimal data processing pipeline architectureBuild the infrastructure...Full time$148.75k - $361k
...streamers around the world while gaining meaningful experience across a variety of disciplines.About the teamThe mission of Roku's Data Engineering team is to develop a world-class big data platform that enables internal and external customers to leverage data to grow their...Work at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours$137.5k - $174.3k
...TeamWe are looking for an early in career Data Science Analyst to help turn product,... ...Analyst, you will partner with Product, Engineering, Quality, Finance, and Operations teams to... ...machine learning, combined with the ability to lead large, sophisticated datasets and ensure...Full timeTemporary workWork experience placementInternshipLocal areaFlexible hours$152k - $253k
...development team. We have the best platform and have maintained a leading position in the field of artificial intelligence. Next, we... ...growth to our customers.We're looking for a Senior Data Analysis Engineer, AD critical metrics with strong technical ability to deeply...Full time- Company descriptionOverviewWe are looking for a Senior Data Engineer with strong hands-on experience designing, building, and maintaining... ...ingestion frameworks using Snowflake and Google Cloud Platform.Lead and support data migration initiatives between enterprise data...
$75 - $85 per hour
Position: Battery Data Engineer III Location: Cupertino, California Duration: Contract Job ID: 171364 Job Description:This will be a data... ...CS/ChemE/MechE is preferred. About PTR Global: PTR Global is a leading provider of information technology and workforce solutions....Full timeContract work$140.25k - $210.38k
Introduction to the jobThe senior lead SQA engineer is responsible for leading validation activities for shared Data & Compute platform capabilities across multiple products. The role focuses on validating new functionality and platform enhancements in areas such as Data...Full time$63 - $68 per hour
...| USD 63-68 / Hourly (C2C)Employment Type: Full TimeClient: TechMContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Data Engineering & AnalyticsLocation: Cupertino, CA (Hybrid) / Austin, TX / Seattle, WAAbout the Role:We build data systems that power innovation...Hourly payFull time- Stepping Up Solutions in Sunnyvale is looking for a Lead Data Engineer to design and implement scalable data infrastructure. This role involves leading a team, delivering quality projects, and collaborating with data professionals. The ideal candidate will have expertise...
- ...Machine Learning Data Engineer – RemoteBright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-...Full timeH1bLocal areaImmediate startRemote workVisa sponsorship
Bright Vision Technologies
Santa Clara, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
Related searches
- data network cabling San Jose, CA
- data processor San Jose, CA
- data capturer San Jose, CA
- clinical data coordinator remote San Jose, CA
- data tech San Jose, CA
- data technician San Jose, CA
- provider data management San Jose, CA
- data recovery San Jose, CA
- data visualization San Jose, CA
- data governance San Jose, CA