Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Tech Lead - Software Engineer

Yantran LLC

Job Description

Job Description

We are seeking an experienced
Senior Databricks Engineer
with strong expertise in
Databricks, Python, PySpark, and SQL
to design, develop, and optimize large scale data processing solutions. The ideal candidate will have hands on experience building data pipelines, implementing ETL/ELT processes, and working with cloud based data platforms to support analytics and business intelligence initiatives.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using
Databricks, PySpark, Python, and SQL .
Build and optimize ETL/ELT frameworks for processing large volumes of structured and unstructured data.
Develop data ingestion solutions from multiple source systems into cloud data lakes and warehouses.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Collaborate with data architects, analysts, and business stakeholders to understand data requirements.
Implement data quality, validation, and monitoring frameworks.
Perform data modeling and transformation for reporting and analytics use cases.
Troubleshoot production issues and provide timely resolutions.
Follow best practices for coding, testing, version control, and deployment.
Required Skills
8+ years of experience in Data Engineering.
Strong hands on experience with
Databricks .
Expertise in
PySpark, Python, and SQL .
Experience with Spark optimization techniques and performance tuning.
Strong understanding of data warehousing concepts and dimensional modeling.
Experience building ETL/ELT pipelines.
Knowledge of Delta Lake, Spark SQL, and Databricks workflows.
Experience with Git, CI/CD, and Agile methodologies.
Strong analytical and problem solving skills.
Preferred Skills
Experience with cloud platforms such as
Azure, AWS, or GCP .
Knowledge of
Azure Data Factory (ADF) , Airflow, or other orchestration tools.
Experience with streaming technologies such as Kafka or Structured Streaming.
Exposure to Power BI, Tableau, or other analytics tools.
Databricks or cloud certifications are a plus.
Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Excellent communication and stakeholder management skills

Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Tech Lead - Software Engineer in Santa Clara, CA vacancy
  •  ...data quality checks, validation processes, and monitoring mechanisms. Collaborate with business stakeholders, data analysts, and engineers to gather requirements and deliver data solutions. Manage CI/CD deployments and support data platform automation. Ensure... 
    Suggested

    Yantran LLC

    San Jose, CA
    5 days ago
  •  ...Job Description Job Description Job Title: Network Deployment / Implementation Engineer Data Job Summary The Network Deployment/Implementation Engineer is responsible for planning, configuring, deploying, testing, and supporting enterprise and service provider... 
    Suggested

    Yantran LLC

    San Jose, CA
    5 days ago
  •  ...Job Description Job Description Job Title: Senior Full stack Engineer Location: San Jose, CA (Remote Work) Years of Experience:...  ...Science, Business, or a related field. Proven experience in leading Agile transformations and coaching teams. Strong analytical... 
    Suggested
    Remote work

    Yantran LLC

    San Jose, CA
    5 days ago
  • $193.93k - $291.15k

     ...Fidelity, T. Rowe Price, and other leading investors.About the RoleAs...  ...of fault-tolerant software across both cellular and Wi-Fi...  ...cohesive system designs, mentor engineers, and shape the long-term architectural...  ...track record of acting as a Tech Lead on complex software... 
    Suggested
    Immediate start
    Remote work
    Flexible hours

    Nuro

    Mountain View, CA
    1 day ago
  •  ...with a strong background in Java 11 and Angular to join our dynamic team. The ideal candidate will have 7 10 years of experience in software development, demonstrating a deep understanding of both front end and back end technologies. You will be responsible for designing... 
    Suggested

    Yantran LLC

    San Jose, CA
    26 days ago
  •  ...DESCRIPTION: As a GenAI Forward Deployed Engineer (FDE) at Google Cloud, you are an...  ...experience. 5 years of experience with software development using Python or similar coding...  ...to launch for customers. Experience leading technical discovery sessions with customers... 
    Remote work

    Yantran LLC

    San Jose, CA
    26 days ago
  • $135k - $170k

     ...semiconductor-based technologies with the company’s COSMOS software suite to unify diverse components into cohesive, flexible...  ...infrastructure requirements. Discover more at . The role : Tech Lead, Software Engineer We're looking for a hands-on Tech Lead, Software... 
    Flexible hours

    Astera Labs

    San Jose, CA
    3 hours ago
  •  ...Description As a GenAI Forward Deployed Engineer (FDE) at Google Cloud, you are an...  ...experience. 5 years of experience with software development using Python or similar coding...  ...to launch for customers. Experience leading technical discovery sessions with customers... 

    Yantran LLC

    San Jose, CA
    26 days ago
  • $125k - $130k

     ...criteria, and solution recommendations . Lead functional solutioning and feasibility...  ...owners, product teams, architects, engineering, delivery, testing, security, and support...  ...annum including any bonuses or variable pay. Tech Mahindra also offers benefits like... 

    Black Rock Groups

    Santa Clara, CA
    6 days ago
  •  ...Virtual Agent AI / GenAI Large Language Models (LLMs) Agentic AI RAG Vector Databases Semantic Search Prompt Engineering AI Orchestration Frameworks MCP Protocol A2A Agent Communication Cloud Data Azure OpenAI Azure AI Foundry... 

    Yantran LLC

    San Jose, CA
    26 days ago
  • Job Description Job Description a { text decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background color: #f5f5f5; } Job Summary We are seeking a skilled Snowflake Tableau Developer with expertise...

    Yantran LLC

    San Jose, CA
    26 days ago
  •  ...JOB DESCRIPTION: As a Forward Deployed Engineer (FDE) in Applied AI, you are the "Agent...  ...-travel, high-impact role focused on leading technical delivery for Conversational AI...  ...This role requires a deep understanding of software engineering, Machine Learning Operations... 
    Hourly pay
    Remote work

    Yantran LLC

    San Jose, CA
    26 days ago
  •  ...background in Hibernate and JPA to join our dynamic team in San Jose, CA. The ideal candidate will have 7 10 years of experience in software development, focusing on building robust and scalable platform solutions. You will play a crucial role in designing, developing,... 

    Yantran LLC

    San Jose, CA
    26 days ago
  •  ...programming principles, clean code practices, and enterprise software development standards. 2. Develop high performance RESTful APIs...  ...quality checks, and deployment automation. Collaborate with engineering teams to troubleshoot production issues, optimize performance,... 

    Yantran LLC

    San Jose, CA
    26 days ago
  • $140k - $200k

     ...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge...  ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life... 

    Arista Networks

    Santa Clara, CA
    5 days ago
  • $160.11k - $240.16k

     ...company, we have offices in nine countries and can insert advertisements around the world.Job SummaryFreeWheel is seeking a Lead Software Engineer (ENG 5) to serve as a principal-level individual contributor driving the technical direction of our Buyer Cloud Ad Serving... 
    Full time
    Night shift
    Weekend work

    Comcast

    Sunnyvale, CA
    2 days ago
  • Key ResponsibilitiesFramework Development: Architect, expand, and maintain robust test automation frameworks for Android (Mobly, Java, Python).RCS & SMS Testing: Automate functional, integration, and performance test scenarios for RCS features (read receipts, typing indicators...

    Virtusa

    San Jose, CA
    20 hours ago
  • $140k - $210k

     ...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge...  ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life... 

    Arista Networks

    Santa Clara, CA
    4 days ago
  • $135k - $165k

     ...platform services and shared infrastructure that power the technology ecosystem across the organization.About the RoleThe Lead Software Engineer will be responsible for leading the design, development, and delivery of enterprise-grade, scalable platform services and APIs... 
    H1b
    Work at office
    Local area
    Home office
    Relocation package
    Monday to Thursday

    Williams-Sonoma

    San Jose, CA
    5 days ago
  • $140k - $210k

     ...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge...  ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life... 

    Arista Networks

    Santa Clara, CA
    2 days ago
  • $140k - $170k

     ...people, process, technology, and innovation while making a meaningful impact across the organization.About the RoleWe are seeking a Lead Engineer for Oracle HCM Cloud Applications to lead the design, implementation, enhancement, and support of key HCM modules across the... 
    For contractors
    Work experience placement
    H1b
    Work at office
    Local area
    Relocation package
    Monday to Thursday

    Williams-Sonoma

    San Jose, CA
    1 day ago
  • $183.9k - $294.3k

     ...business results.Opportunity OverviewMemorty Test is looking for software engineers to join an exciting, dynamic, hardworking, engaging, and...  ...history of consistent on time software delivery.Experience as a Tech LeadMastery implementing software that directly interacts... 
    Local area
    Relocation
    Flexible hours

    Universal Robots

    San Jose, CA
    1 day ago
  • $8.21k

     ...Full Time)Employment Type: Full TimeIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsSoftware Engineer & Technical Lead ( two requirements with same JDSunnyvale, CAEx A*** will be preferredSubmit with skill matrix pleaseSoftware... 
    Full time

    SRI Tech

    Sunnyvale, CA
    5 days ago
  • $190.9k - $334.1k

     ...applications, data, cloud environments, and AI agents. For engineers joining Veza today, this means the scale and resources of an...  ...Job DescriptionWe are looking for a passionate Senior Staff (Tech Lead) Software Engineer who will play a key role in designing, developing,... 
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Santa Clara, CA
    2 days ago
  • $140k - $210k

     ...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge...  ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life... 

    Arista Networks

    Santa Clara, CA
    2 days ago
  • $45 - $60 per hour

     ...Responsibilities TikTok Lead Ads team is responsible for building lead generation solutions...  ...as CRM ecosystem. We are looking for software engineers who are excited to grow their business...  ...Extensive knowledge of modern software tech stack, including front-end applications,... 
    Hourly pay
    Internship
    Summer internship
    Local area

    TikTok

    San Jose, CA
    1 day ago
  • $213.48k - $319.72k

     ..., NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the RoleThe Routing Team crafts vital services...  ...destinations safely and efficiently. We continuously refine our routing engine to calculate more efficient routes, deliver highly accurate... 
    Immediate start
    Flexible hours

    Nuro

    Mountain View, CA
    5 days ago
  • $129.88k - $175.38k

     ...Software Development Engineer Primary Duties & Responsibilities Software development – 80% Design and develop software features based on high level customer and product line management requirements Develop new features for existing and future products... 
    Full time
    Work at office

    Coherent

    Santa Clara, CA
    5 days ago
  • $170k - $220k

     ...DataVisor DataVisor is the world’s leading AI-powered Fraud and Risk...  ..., powerful decision engine, and investigation tools work...  ...the globe. Our award-winning software platform is powered by a team...  ...technical leadership experience as a tech lead, staff engineer, engineering... 
    Full time

    DataVisor

    Mountain View, CA
    4 days ago
  •  ...Job Description Job Description Job Title: MDM Mobility Engineer Location: Mountain View, California(Onsite) Onsite/Remote/...  ...triage and understand the customer Pixel/Android enterprise related tech queries and work within Google for a quick resolution.... 
    Remote work

    Yantran LLC

    Mountain View, CA
    26 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Tech Lead - Software Engineer. Be the first to apply!