Pyspark developer jobs in San Francisco, CA

Front is the leading AI-powered customer service platform built for collaboration. Front brings core support channels into a modern, intuitive workspace where teams can collaborate on requests, automate manual processes, and delight customers across their entire lifecycle...

 ..., libraries, and distributed systems with a focus on reliability, observability, and performance. Demonstrated proficiency in developing high-quality software, delivering production-ready code, managing infrastructure, and crafting RESTful APIs to industry standards... 

Full-time Description Lead Frontend Engineer (React) Description EMPIRE is a premier and dynamic music company that prides itself on the development and support of independent artists. We are a rapidly growing firm that has been making waves in the...

 ...Collaborate with application engineers to ensure clean data flow between backend systems and end-user features Develop and optimize data pipelines using PySpark and Databricks Work closely with the lead data engineer on system architecture and data infrastructure design... 

 ...complex global challenges daily. Whether analyzing blockchain data, developing cutting-edge tools, or collaborating with global organizations...  ...ago San Francisco, CA $75,000.00-$150,000.00 1 month ago Lead Pyspark / SQL Engineer - Threat Detection & DataBricks San Francisco,... 

 ...ensuring that our data infrastructure is reliable, scalable, and developer-friendly as we continue to power financial services for small...  ...highly scalable data pipelines and lakehouse infrastructure with PySpark, Databricks, and Airflow on AWS. Improve the data platform... 

 ...Excel/Sheets, and internal databases. + Operational analytics: Develop analytical models to support forecasting, expense tracking, and...  ...Proficiency in SQL, Python, and data integration/ETL pipelines (PySpark a plus). Strong problem-solving and analytical abilities.... 

 ...architectures. Build and maintain scalable data pipelines using technologies such as GCP (or AWS), BigQuery, Python, and Spark. Develop and manage service-oriented and event-driven architectures, utilizing tools like Pub/Sub and Kafka. Collaborate with machine... 

 ...are looking for an engineering leader to lead major product features, design systems, and mentor other engineers. As this product develops, I expect every engineer to be part of the core technical or people leadership team. This is a unique opportunity and timing to join... 

 ...second latency, high reliability, and model training fidelity. Optimize system performance by managing resource utilization and developing intelligent feature caching strategies. Empower scientists to iterate faster by building abstractions, APIs, and developer... 

 ...Nice To Haves Familiarity with ML workflows, experiment tracking, or model management tools Background in building developer tools or internal platforms at scale Experience in cloud environments like AWS or GCP Notice to Applicants for Jobs Located... 

 ...you'll do Participate in example meetings Lead example initiatives Recruit new team members to example team Mentor and develop existing team members Requirements ~ Experience writing good example job descriptions ~ Other exemplary skills ~3-5 years... 

 ...research with fast-paced, results-driven execution. We’re reimagining the very foundations of intelligence while simultaneously developing product-focused machine learning models in a tight feedback loop, where research fuels application. Founded in 2022, we’ve raised... 

About Hedra: Hedra is a pioneering video foundation model company founded by former Stanford PhDs and backed by top investors at Index, A16Z, and Abstract Ventures. We're building a full-stack creation studio capable of control, emotion, and creative intelligence. ...

 ...Engineer to join our team and help us build the next generation of anime and video game tools. You'll be responsible for designing and developing complex front-end applications, usually in react and typescript, with a focus on making responsive and delightful user interfaces... 

We’re building the post-training platform that makes AI deployments safe, transparent, and continuously improving by productising frontier LLM and interpretability research. At Parsed, we supercharge large language models with reinforcement learning, enabling them to ...

Rattle is building the first AI-powered Revenue Intelligence Platform, solving the most critical problem in B2B sales: 75% of companies miss their revenue forecasts because the entire revenue tech stack depends on manual seller input and CRM guesswork. The Problem We...

 ...our first full-time Frontend Engineer to own and evolve the user interfaces that bring our AI systems to life. From dashboards and developer tools to intelligent workflows and context-aware interactions, you’ll work across the product to create thoughtful, responsive,... 

 ...problems. You care about craft, and you like helping people build things that matter. You want to make generative AI easier for developers and creators to use. You want to work on some of the most interesting problems in AI — and help ship a product that gives... 

The Role Be a part in one of the fastest growing AI companies in Silicon Valley serving millions of users. Contribute to the frontend of a top 100 projects on GitHub. What you’ll do Lead the design and development of core frontend architecture of new products from...

 ..., window functions, analytical optimizations. ThoughtSpot / Power BI - data modeling, embedding, semantic layer design. Python / PySpark - data transformations and automation. Airflow, Informatica IICS, or equivalent for orchestration. Strong understanding of data modeling... 

Salient is one of the fastest-growing AI startups in consumer finance. In less than two years, we’ve achieved product-market fit, scaled to 8-figure ARR, and emerged as one of the undisputed leaders in financial voice AI. A few fast facts: ~ Backed by YC and raised...

About Delve Delve is building an AI-native platform that transforms compliance from tedious, manual work into effortless, automated workflows. We’re the fastest growing compliance company on the market. Delve helps hundreds of companies save hundreds of hours (...

 ...designers and backend engineers to create elegant, high-impact user-facing features from within a modern React and TypeScript codebase. Develop intuitive and engaging user interfaces that deliver significant value to users, ensuring smooth functionality and a beautiful... 

We're building the future of B2B SaaS with AI agents. We're an enterprise company that cares a lot about user experience. You'll own the interfaces and tools that our customers use to make sense of and tune millions of agent actions and decisions operating over 100% of ...

About Us: ~ Indent is building the platform that every software engineer begins and ends their day in. Our customers are large engineering teams who use Indent for everything from incident response to code review to data analysis. Indent is built to handle these tasks...

 ...lineage, and streaming Own the Airbyte frontend Work with a talented team to build a great internal development experience for developers and a great user experience for our users Define and promote conventions and best practices for the frontend Write high-... 

 ...patterns, and streamlining cross-module user flows. Up-level our frontend tooling and best practices to drive a world class frontend developer experience. Update and maintain our component library to enforce a more standard UI throughout our application. Contribute... 

 ...see your code shape an entire industry, this might be your jam. the bigger picture: we're not just talking to traditional developers. we're reaching the next 500 million people who will be "coding" with plain english - lawyers, designers, product managers, founders... 

What you'll do Ship a lot of features for the front-end of our core operations platform (Doss ARP) Contribute to technical roadmap and prioritizing features customer facing experience Iterate quickly with Design and other engineers to deliver super-fast, extremely...