Pyspark developer jobs in San Francisco, CA

Front is the leading AI-powered customer service platform built for collaboration. Front brings core support channels into a modern, intuitive workspace where teams can collaborate on requests, automate manual processes, and delight customers across their entire lifecycle...

 ..., libraries, and distributed systems with a focus on reliability, observability, and performance. Demonstrated proficiency in developing high-quality software, delivering production-ready code, managing infrastructure, and crafting RESTful APIs to industry standards... 

Full-time Description Lead Frontend Engineer (React) Description EMPIRE is a premier and dynamic music company that prides itself on the development and support of independent artists. We are a rapidly growing firm that has been making waves in the...

 ...highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS. • Improve the data platform...  ...engines like Trino/Presto. • Familiarity with ingestion frameworks, developer-experience tooling, and best practices for data versioning,... 

 ...complex global challenges daily. Whether analyzing blockchain data, developing cutting-edge tools, or collaborating with global organizations...  ...ago San Francisco, CA $75,000.00-$150,000.00 1 month ago Lead Pyspark / SQL Engineer - Threat Detection & DataBricks San Francisco,... 

 ...Excel/Sheets, and internal databases. + Operational analytics: Develop analytical models to support forecasting, expense tracking, and...  ...Proficiency in SQL, Python, and data integration/ETL pipelines (PySpark a plus). Strong problem-solving and analytical abilities.... 

 ...architectures. Build and maintain scalable data pipelines using technologies such as GCP (or AWS), BigQuery, Python, and Spark. Develop and manage service-oriented and event-driven architectures, utilizing tools like Pub/Sub and Kafka. Collaborate with machine... 

 ...are looking for an engineering leader to lead major product features, design systems, and mentor other engineers. As this product develops, I expect every engineer to be part of the core technical or people leadership team. This is a unique opportunity and timing to join... 

 ...Nice To Haves Familiarity with ML workflows, experiment tracking, or model management tools Background in building developer tools or internal platforms at scale Experience in cloud environments like AWS or GCP Notice to Applicants for Jobs Located... 

 ...dependable and fast at scale–from building retrieval systems to more effectively ground LLM responses in Whatnot’s business context to developing scalable LLM evaluation frameworks and human-in-the-loop feedback mechanisms. What you'll do: Own the infrastructure... 

 ...interact with other services. The successful candidate will be proficient in Python and have demonstrable experience designing, developing, and deploying scalable & highly available services. We expect you to have a deep understanding of performance, multi-threading,... 

 ..., window functions, analytical optimizations. ThoughtSpot / Power BI - data modeling, embedding, semantic layer design. Python / PySpark - data transformations and automation. Airflow, Informatica IICS, or equivalent for orchestration. Strong understanding of data modeling... 

 ...research with fast-paced, results-driven execution. We’re reimagining the very foundations of intelligence while simultaneously developing product-focused machine learning models in a tight feedback loop, where research fuels application. Founded in 2022, we’ve raised... 

 ...ensure best practices around IAM, network design, and data lake access — while focusing on platform reliability, scalability, and developer experience. This is a high-ownership, hands-on engineering role. You’ll manage everything from Terraform modules and CI/CD pipelines... 

 ...see your code shape an entire industry, this might be your jam. the bigger picture: we're not just talking to traditional developers. we're reaching the next 500 million people who will be "coding" with plain english - lawyers, designers, product managers, founders... 

About Us: ~ Indent is building the platform that every software engineer begins and ends their day in. Our customers are large engineering teams who use Indent for everything from incident response to code review to data analysis. Indent is built to handle these tasks...

We're building the future of B2B SaaS with AI agents. We're an enterprise company that cares a lot about user experience. You'll own the interfaces and tools that our customers use to make sense of and tune millions of agent actions and decisions operating over 100% of ...

Salient is one of the fastest-growing AI startups in consumer finance. In less than two years, we’ve achieved product-market fit, scaled to 8-figure ARR, and emerged as one of the undisputed leaders in financial voice AI. A few fast facts: ~ Backed by YC and raised...

About Delve Delve is building an AI-native platform that transforms compliance from tedious, manual work into effortless, automated workflows. We’re the fastest growing compliance company on the market. Delve helps hundreds of companies save hundreds of hours (...

 ...designers and backend engineers to create elegant, high-impact user-facing features from within a modern React and TypeScript codebase. Develop intuitive and engaging user interfaces that deliver significant value to users, ensuring smooth functionality and a beautiful... 

 ...lineage, and streaming Own the Airbyte frontend Work with a talented team to build a great internal development experience for developers and a great user experience for our users Define and promote conventions and best practices for the frontend Write high-... 

 ...patterns, and streamlining cross-module user flows. Up-level our frontend tooling and best practices to drive a world class frontend developer experience. Update and maintain our component library to enforce a more standard UI throughout our application. Contribute... 

The Role Be a part in one of the fastest growing AI companies in Silicon Valley serving millions of users. Contribute to the frontend of a top 100 projects on GitHub. What you’ll do Lead the design and development of core frontend architecture of new products from...

 ...you'll do Participate in example meetings Lead example initiatives Recruit new team members to example team Mentor and develop existing team members Requirements ~ Experience writing good example job descriptions ~ Other exemplary skills ~3-5 years... 

What you'll do Ship a lot of features for the front-end of our core operations platform (Doss ARP) Contribute to technical roadmap and prioritizing features customer facing experience Iterate quickly with Design and other engineers to deliver super-fast, extremely...

 ...and generate content, and is trusted by hundreds of the world's largest and most innovative organizations. The company empowers developers with a portfolio of best-in-class, pre-trained AI models, serving billions of customer API requests every month. Hive also offers... 

 ...our first full-time Frontend Engineer to own and evolve the user interfaces that bring our AI systems to life. From dashboards and developer tools to intelligent workflows and context-aware interactions, you’ll work across the product to create thoughtful, responsive,... 

 ...problems. You care about craft, and you like helping people build things that matter. You want to make generative AI easier for developers and creators to use. You want to work on some of the most interesting problems in AI — and help ship a product that gives... 

About Hedra: Hedra is a pioneering video foundation model company founded by former Stanford PhDs and backed by top investors at Index, A16Z, and Abstract Ventures. We're building a full-stack creation studio capable of control, emotion, and creative intelligence. ...

 ...Engineer to join our team and help us build the next generation of anime and video game tools. You'll be responsible for designing and developing complex front-end applications, usually in react and typescript, with a focus on making responsive and delightful user interfaces...