Tech Lead- Python + Spark (PySpark)
Zortech Solutions
Tech Lead- Python + Spark (PySpark)
Location: Palo Alto, CA (Onsite from day 1) Duration: Contract/Fulltime
Job Description:
- 10+ years of total experience with application development using Python + Spark (PySpark)
- Proficient in AWS Cloud (especially services around AWS BigData/Analytics)
- Good understanding on AWS networking (VPC) for connectivity between jobs running in AWS VPC and other Cloud services (e.g. Cloud Data Stores)
- Proficiency with bulk operations (data load and unload) on databases and warehouses, expertise on big data projects
- Expertise with ETL/Big Data concepts understanding
- Good in Apache Spark platform
- Good articulation / communication skills to brainstorm ideas with offshore team and also discuss/pass thoughts with AWS team.
- Good database understanding (RDBMS and also Bigdata)
- Good requirements understanding
- Data warehousing, analytics domain understanding
- Skills to ramp up on new databases (as per the connectors)
- Source code versioning using GIT
- CI/CD using Jenkins/Gitlab/AWS services
Please share your updated resume to View email address on click.appcast.io.
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Tech Lead- Python + Spark (PySpark) in Palo Alto, CA vacancy
$164k - $210k
...big data processing frameworks like Apache Spark and Apache Airflow with just a few clicks,... ...a strong technical background in Spark to lead the Cloudera Data Engineering Spark... ...following languages: Java, Scala, Rust, C++, or Python. ~ Excellent collaboration and communication...PythonRemote workWork from homeWorldwideRelocationFlexible hoursCloudera
Palo Alto, CA2 days ago- ...support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBase3. Hands on experience with UNIX, Teradata... ...experience. Required Qualifications Have experience with Python, PySpark (Highly Used), Scala, Spark, GCP, Airflow DAG, Hive, Data...PythonRemote work
Samprasoft
Sunnyvale, CA2 days ago - ...Role: Python/Pyspark Lead Location: Palo Alto, CA (Onsite) Duration: C2C/Full Time (H1 Transfers is fine) Job Description... ...or REST APIs Experience in Big data (Hadoop, Spark, Kafka, etc.) Bulk operations (Data load and unload) on databases...PythonFull time
Zortech Solutions
Palo Alto, CA18 hours ago $251k - $310k
...reports to Sr. Staff TLM. You will: Lead, mentor, and grow a team of data engineers... ...at least one programming language such as Python, Java, or C++. We prefer:... ...technologies and distributed systems (e.g., Spark, Flume, Kafka, BigQuery, etc.). Knowledge...PythonFull timeRemote workWaymo
Mountain View, CA1 day ago$205k - $215k
...Principal Software Engineer/Tech Lead - Platform Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington... ...Develop, test, debug, and maintain high-quality applications using Python, React, and Next.js Leverage modern large language models (...PythonRedbeard Solutions
Palo Alto, CA1 day ago- ...- Palo Alto, CA (Hybrid) No Remote Option Key Skills: ~6-10 years backend/infrastructure engineering ~ Strong coding in Python / Go ~ Deep Kubernetes (clusters, networking, operators) ~ Distributed systems cloud-native design ~ AWS / GCP (compute, storage...PythonRemote work
Yantran LLC
Palo Alto, CA4 days ago $180k - $260k
...more, visit About the Role We are seeking an experienced Tech Lead to lead the architecture, development, and scaling of a high-... ...technical field. Strong hands-on programming experience in C++, Go, Python, Rust, or similar systems programming languages. Proven...PythonClockwork Inc
Palo Alto, CA4 days ago$168k - $280k
Lanteris Space Systems is seeking a V&V Tech Lead in Palo Alto, CA to lead verification and validation efforts for flight software, including... ...5 years of software V&V experience, and expertise in C/C++ and Python for automation. The salary range for California is $168,000 to...Python$276k - $293.25k
Intrinsic in Mountain View, CA is seeking a Technical Lead Manager to empower software developers in utilizing the Intrinsic platform... ...leadership. The ideal candidate has a strong background in C++, Python, or Go, and experience within open-source ecosystems. The salary...Python$218k - $234k
...'ll Do Typeface is looking for a Staff Software Engineer, Tech Lead who will play a critical role in establishing the direction and... ...on technical background ~ Experience with React, Java, and Python ~ Excellent cross-team collaboration and communication skills...PythonWork experience placementWork at officeFlexible hours3 days per weekTypeface
Palo Alto, CA1 day ago$180k - $260k
Clockwork.io in Palo Alto is seeking a Tech Lead to architect and develop a high-performance network monitoring platform. This role demands strong programming skills in languages such as C++, Go, or Python and significant experience with distributed systems and networking...Python$200k - $287.5k
...Collaborate with infrastructure teams to productionize improvements. Lead a team of engineers towards building great products... ...production. ~ Proficiency in programming languages such as Python, Go ~ Strong communication skills and ability to collaborate...PythonFlexible hoursSnowflake Computing
Menlo Park, CA3 days ago- ...4 firms, and an impressive portfolio of leading customers. Tier 1 Backing: We are funded... ...Role Overview: As an Engineering Tech Lead at Zania, you will play a key player... ...proficiency in our tech stack (e.g., Python, TypeScript, React, cloud infrastructure)...PythonWork at officeRelocationRelocation packageFlexible hours
Zania, Inc
Palo Alto, CA3 days ago $250k - $300k
...Watch (2026), Forbes AI 50, and Gartner's Tech Innovators in Agentic AI, Glean continues... ...company. About the Role: The Tech Lead Manager of the Agentic Runtime team builds... ...Strong coding skills in at least one of: Python, Go, Java, or C++, with a focus on reliability...PythonHome officeFlexible hoursGlean.info
Mountain View, CA18 hours ago$250k - $300k
Glean is seeking a Tech Lead Manager for their Agentic Runtime team in Mountain View, California. The role involves building a reliable... ...engineering management, with strong skills in programming languages like Python, Go, Java, or C++. The position offers a hybrid work model with...Python$251k - $310k
.... Staff TLM You will: Lead, mentor, and grow a team of software... ...in engineering management or tech leadership, including people... ...proficiency in C++, Java, or Python. ~ Deep understanding of... ...processing frameworks (e.g., Flume, Spark, Beam), storage systems (e.g.,...PythonFull timeRemote workWaymo
Mountain View, CA1 day ago- ...hands on programming experience in Python and Big Data technologies. Good understanding... ...such as HDFS, HIVE, Impala, Pig, Spark, Hadoop etc. Good Experience on Pyspark and open source techn 3. Experience... ...& Responsibilities : Technical Lead Bachelors in science , engineering...PythonSecond jobShift work
FIRST SOFTSOLUTIONS INC
Sunnyvale, CA1 day ago $270k - $320k
...big data processing frameworks like Apache Spark, Apache Airflow, Iceberg with just a few... ...background in the data infrastructure space to lead the Cloudera Data Engineering experience... ...following languages: Java, Scala, C++, Python, GoLang. And interested to learn the languages...PythonWork from homeWorldwideRelocationFlexible hoursCloudera
Alviso, CA2 days ago$168k - $280k
Lanteris Space Systems is currently seeking a V&V Tech Lead to join our team in Palo Alto, CA, San Jose, CA or Houston, TX offices. In this... ...management. Preferred Skills & Experience C/C++ skills, Python for automation scripts. Experience working in a continuous build...PythonPermanent employment- ...actively looking for Data Engineers (Java/spark) for Sunnyvale, CA or Bentonville, AR... ...You have expert-level coding skills in Python, JAVA, Spring, API design, Kafka, databases... ...Frameworks What you'll do : Leading the discovery phase of medium to large projects...PythonContract workImmediate start
Redolent
Sunnyvale, CA4 days ago - ...Job Title Skills: Hands-on experience in Spark is must and experience in Kafka. Work experience in handling huge volume of data. Very good knowledge in Yarn, Pig, Python, MR, Hadoop, Hive, Flume, Oozie. Nifty with design, development and enhancement of Data Lakes,...PythonWork experience placement
ClifyX
Sunnyvale, CA1 day ago $296.3k - $423.9k
...on a global scale.? We are looking for a Principal Technical Lead Manager (TLM) to lead the Trajectory Generation team within the... ...machine learning systems Strong software engineering skills (Python, C++, or similar). Experience deploying ML models into real-world...PythonLocal areaRemote workWork from homeRelocationRelocation packageFlexible hoursGeneral Motors
Mountain View, CA1 day ago$276k - $293.25k
...economic potential of industrial robotics. Role As a Technical Lead Manager on the Extensibility Squad, your mission is to empower software... ...team, and work hands‑on with an SDK that involves a lot of C++, Python, and Protobuf, alongside a growing TypeScript codebase. How...PythonLocal area$207k - $300k
...cross‑business projects. 3 years of experience in a technical leadership role leading project teams and setting technical direction. Coding proficiency in one or more of the following: SQL, Python, or Java. Familiarity with ads systems. About the Job The team provides...PythonFull time- ...Tech Lead, Data & Inference Engineer Sunnyvale, California, United States About the Job... ...(query optimization on large datasets) and Python skills. ~ Hands-on experience with distributed data technologies (Spark, Flink, Kafka) and modern orchestration tools...PythonFull time
Catalyst Labs, LLC
Sunnyvale, CA5 days ago - ...Hadoop Lead Developer Location: SANTA CLARA, CA Must Have:... ...must) ~ Hands on experience in Python with good coding standards ~... ...Hands on experience in Apache Spark ~ Experience in developing ETL scripts using Python, PySpark and shell scripts ~ Job scheduling...Python
ClifyX
Santa Clara, CA1 day ago $176k - $264k
...their own destiny. Job Title: Lead AI Engineer - Marketing &... ...without being the overall area tech lead. You'll be based in our... ...workloads. Fluent in Python and data tooling. Proficient... ...using big data tools such as Spark/Hadoop and ORMs like SQLAlchemy...PythonWork at officeLocal areaKlaviyo
Palo Alto, CA18 hours ago$180k - $260k
...About the Role We are looking for a passionate and experienced Tech Lead - Frontend / Full Stack to join our growing engineering team.... ...development experience with technologies such as TypeScript, HTML, Go, Python, or similar languages. ~ Proven experience leading frontend...PythonClockwork.io
Palo Alto, CA10 days ago$189k - $290.7k
...lines, developer environments, cloud services, and more. As a Tech Lead Manager in the AV Launch team, you'll develop embedded... ...Linux-based environments ~ Strong background in modern C++ and Python development ~ Experience working with and building tooling for...PythonPermanent employmentWork experience placementLocal areaRemote workWork from homeRelocationRelocation packageFlexible hoursGeneral Motors
Mountain View, CA2 days ago- ...engineering to design and maintain data pipelines and back-end systems. The successful candidate will work with technologies like Spark, Python, and AWS. Responsibilities include writing SQL for ETL processes, implementing data solutions and collaborating with engineers....Python
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tech Lead- Python + Spark (PySpark). Be the first to apply!
Related searches
- technical leader Palo Alto, CA
- technical lead Palo Alto, CA
- entry level python Palo Alto, CA
- python data scientist Palo Alto, CA
- data analyst - r python sql Palo Alto, CA
- weekend python Palo Alto, CA
- junior python remote Palo Alto, CA
- python Palo Alto, CA
- python data scientist (contract) Palo Alto, CA
- cardiac tech Palo Alto, CA