Tech Lead - Software Engineer
Yantran LLC
Job Description
Job Description
We are seeking an experienced
Senior Databricks Engineer
with strong expertise in
Databricks, Python, PySpark, and SQL
to design, develop, and optimize large scale data processing solutions. The ideal candidate will have hands on experience building data pipelines, implementing ETL/ELT processes, and working with cloud based data platforms to support analytics and business intelligence initiatives.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using
Databricks, PySpark, Python, and SQL .
Build and optimize ETL/ELT frameworks for processing large volumes of structured and unstructured data.
Develop data ingestion solutions from multiple source systems into cloud data lakes and warehouses.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Collaborate with data architects, analysts, and business stakeholders to understand data requirements.
Implement data quality, validation, and monitoring frameworks.
Perform data modeling and transformation for reporting and analytics use cases.
Troubleshoot production issues and provide timely resolutions.
Follow best practices for coding, testing, version control, and deployment.
Required Skills
8+ years of experience in Data Engineering.
Strong hands on experience with
Databricks .
Expertise in
PySpark, Python, and SQL .
Experience with Spark optimization techniques and performance tuning.
Strong understanding of data warehousing concepts and dimensional modeling.
Experience building ETL/ELT pipelines.
Knowledge of Delta Lake, Spark SQL, and Databricks workflows.
Experience with Git, CI/CD, and Agile methodologies.
Strong analytical and problem solving skills.
Preferred Skills
Experience with cloud platforms such as
Azure, AWS, or GCP .
Knowledge of
Azure Data Factory (ADF) , Airflow, or other orchestration tools.
Experience with streaming technologies such as Kafka or Structured Streaming.
Exposure to Power BI, Tableau, or other analytics tools.
Databricks or cloud certifications are a plus.
Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Excellent communication and stakeholder management skills
- ...data quality checks, validation processes, and monitoring mechanisms. Collaborate with business stakeholders, data analysts, and engineers to gather requirements and deliver data solutions. Manage CI/CD deployments and support data platform automation. Ensure...Suggested
- ...Job Description Job Description Job Title: Network Deployment / Implementation Engineer Data Job Summary The Network Deployment/Implementation Engineer is responsible for planning, configuring, deploying, testing, and supporting enterprise and service provider...Suggested
- ...Job Description Job Description Job Title: Senior Full stack Engineer Location: San Jose, CA (Remote Work) Years of Experience:... ...Science, Business, or a related field. Proven experience in leading Agile transformations and coaching teams. Strong analytical...SuggestedRemote work
$193.93k - $291.15k
...Fidelity, T. Rowe Price, and other leading investors.About the RoleAs... ...of fault-tolerant software across both cellular and Wi-Fi... ...cohesive system designs, mentor engineers, and shape the long-term architectural... ...track record of acting as a Tech Lead on complex software...SuggestedImmediate startRemote workFlexible hours- ...with a strong background in Java 11 and Angular to join our dynamic team. The ideal candidate will have 7 10 years of experience in software development, demonstrating a deep understanding of both front end and back end technologies. You will be responsible for designing...Suggested
- ...DESCRIPTION: As a GenAI Forward Deployed Engineer (FDE) at Google Cloud, you are an... ...experience. 5 years of experience with software development using Python or similar coding... ...to launch for customers. Experience leading technical discovery sessions with customers...Remote work
$135k - $170k
...semiconductor-based technologies with the company’s COSMOS software suite to unify diverse components into cohesive, flexible... ...infrastructure requirements. Discover more at . The role : Tech Lead, Software Engineer We're looking for a hands-on Tech Lead, Software...Flexible hours- ...Description As a GenAI Forward Deployed Engineer (FDE) at Google Cloud, you are an... ...experience. 5 years of experience with software development using Python or similar coding... ...to launch for customers. Experience leading technical discovery sessions with customers...
$125k - $130k
...criteria, and solution recommendations . Lead functional solutioning and feasibility... ...owners, product teams, architects, engineering, delivery, testing, security, and support... ...annum including any bonuses or variable pay. Tech Mahindra also offers benefits like...- ...Virtual Agent AI / GenAI Large Language Models (LLMs) Agentic AI RAG Vector Databases Semantic Search Prompt Engineering AI Orchestration Frameworks MCP Protocol A2A Agent Communication Cloud Data Azure OpenAI Azure AI Foundry...
- Job Description Job Description a { text decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background color: #f5f5f5; } Job Summary We are seeking a skilled Snowflake Tableau Developer with expertise...
- ...JOB DESCRIPTION: As a Forward Deployed Engineer (FDE) in Applied AI, you are the "Agent... ...-travel, high-impact role focused on leading technical delivery for Conversational AI... ...This role requires a deep understanding of software engineering, Machine Learning Operations...Hourly payRemote work
- ...background in Hibernate and JPA to join our dynamic team in San Jose, CA. The ideal candidate will have 7 10 years of experience in software development, focusing on building robust and scalable platform solutions. You will play a crucial role in designing, developing,...
- ...programming principles, clean code practices, and enterprise software development standards. 2. Develop high performance RESTful APIs... ...quality checks, and deployment automation. Collaborate with engineering teams to troubleshoot production issues, optimize performance,...
$140k - $200k
...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge... ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life...$160.11k - $240.16k
...company, we have offices in nine countries and can insert advertisements around the world.Job SummaryFreeWheel is seeking a Lead Software Engineer (ENG 5) to serve as a principal-level individual contributor driving the technical direction of our Buyer Cloud Ad Serving...Full timeNight shiftWeekend work- Key ResponsibilitiesFramework Development: Architect, expand, and maintain robust test automation frameworks for Android (Mobly, Java, Python).RCS & SMS Testing: Automate functional, integration, and performance test scenarios for RCS features (read receipts, typing indicators...
$140k - $210k
...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge... ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life...$135k - $165k
...platform services and shared infrastructure that power the technology ecosystem across the organization.About the RoleThe Lead Software Engineer will be responsible for leading the design, development, and delivery of enterprise-grade, scalable platform services and APIs...H1bWork at officeLocal areaHome officeRelocation packageMonday to Thursday$140k - $210k
...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge... ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life...$140k - $170k
...people, process, technology, and innovation while making a meaningful impact across the organization.About the RoleWe are seeking a Lead Engineer for Oracle HCM Cloud Applications to lead the design, implementation, enhancement, and support of key HCM modules across the...For contractorsWork experience placementH1bWork at officeLocal areaRelocation packageMonday to Thursday$183.9k - $294.3k
...business results.Opportunity OverviewMemorty Test is looking for software engineers to join an exciting, dynamic, hardworking, engaging, and... ...history of consistent on time software delivery.Experience as a Tech LeadMastery implementing software that directly interacts...Local areaRelocationFlexible hours$8.21k
...Full Time)Employment Type: Full TimeIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsSoftware Engineer & Technical Lead ( two requirements with same JDSunnyvale, CAEx A*** will be preferredSubmit with skill matrix pleaseSoftware...Full time$190.9k - $334.1k
...applications, data, cloud environments, and AI agents. For engineers joining Veza today, this means the scale and resources of an... ...Job DescriptionWe are looking for a passionate Senior Staff (Tech Lead) Software Engineer who will play a key role in designing, developing,...Work at officeRemote workFlexible hours$140k - $210k
...advancements in cloud computing, artificial intelligence, and software-defined networking to provide our clients with a competitive edge... ...has earned us several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation, and Work-Life...$45 - $60 per hour
...Responsibilities TikTok Lead Ads team is responsible for building lead generation solutions... ...as CRM ecosystem. We are looking for software engineers who are excited to grow their business... ...Extensive knowledge of modern software tech stack, including front-end applications,...Hourly payInternshipSummer internshipLocal area$213.48k - $319.72k
..., NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the RoleThe Routing Team crafts vital services... ...destinations safely and efficiently. We continuously refine our routing engine to calculate more efficient routes, deliver highly accurate...Immediate startFlexible hours$129.88k - $175.38k
...Software Development Engineer Primary Duties & Responsibilities Software development – 80% Design and develop software features based on high level customer and product line management requirements Develop new features for existing and future products...Full timeWork at office$170k - $220k
...DataVisor DataVisor is the world’s leading AI-powered Fraud and Risk... ..., powerful decision engine, and investigation tools work... ...the globe. Our award-winning software platform is powered by a team... ...technical leadership experience as a tech lead, staff engineer, engineering...Full time- ...Job Description Job Description Job Title: MDM Mobility Engineer Location: Mountain View, California(Onsite) Onsite/Remote/... ...triage and understand the customer Pixel/Android enterprise related tech queries and work within Google for a quick resolution....Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tech Lead - Software Engineer. Be the first to apply!
- technical lead Santa Clara, CA
- technical leader Santa Clara, CA
- lead engineer Santa Clara, CA
- lead operating engineer Santa Clara, CA
- software intern Santa Clara, CA
- bank software Santa Clara, CA
- software sales executive Santa Clara, CA
- software technology Santa Clara, CA
- ultimate software Santa Clara, CA
- id software Santa Clara, CA




