Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology)

Capital One

Lead Data Engineer (Python, AWS, SQL, GenAI)Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you'll have the opportunity to be on the forefront of driving a major transformation within Capital One.Enterprise Platforms Technology (EPTech) comprises many of Capital One's most important enterprise platforms. We play an essential role in establishing practices for building technology solutions across the company, while also delivering capabilities that exemplify those practices.The Marketing and Messaging team is responsible for delivering hyper-personalized messages and experiences that will delight the customer, attract prospects and drive increasing business value. The team builds scalable platforms that deliver omnichannel messages in owned and paid Adtech channels.What You'll Do:Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologiesWork with a team of developers with deep experience in machine learning, distributed microservices, and full stack systemsUtilize programming languages like Java, Scala, Python and Open Source RDBMS and NoSQL databases and Cloud based data warehousing services such as Redshift and SnowflakeShare your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering communityCollaborate with digital product managers, and deliver robust cloud-based solutions that drive powerful experiences to help millions of Americans achieve financial empowermentPerform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performanceBasic Qualifications:Bachelor's DegreeAt least 4 years of experience in application development (Internship experience does not apply)At least 2 years of experience in big data technologiesAt least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud)Preferred Qualifications:Master's Degree1+ years of experience leveraging AI-assisted coding tools (Claude Code, GitHub Copilot) to accelerate the software delivery7+ years of experience in application development including Python, SQL, Scala, or Java4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud)4+ years of experience with Distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL)4+ years of experience working on real-time data and streaming applications4+ years of experience with NoSQL implementation (Mongo, Cassandra)4+ years of data warehousing experience (Redshift or Snowflake)4+ years of experience with UNIX/Linux including basic commands and shell scripting4+ years of experience with data modeling for data warehousing2+ years of experience with Agile engineering practices

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) in San Francisco, CA vacancy
  • $197.3k - $225.1k

     ...Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    San Francisco, CA
    2 days ago
  • $179.4k - $245.6k

    Machine Learning Engineer 4 (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology) Do you love building and pioneering in the AI...  ..., such as Ops, Modeling, and Data Engineering. In this role, you'...  ...years of experience as a technical lead developing ML solutions using... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Part time
    H1b
    Local area

    Capital One

    San Francisco, CA
    2 days ago
  • $124k - $280k

     ..., our people in data and analytics engineering focus on leveraging advanced technologies and techniques to...  ...you need to lead and deliver value...  ...Certification in Cloud Platforms [e.g., AWS Certified...  ...- Proficient in Python and structured/unstructured...  ...- Proficient in SQL and relational... 
    Platform
    Amazon Web Service
    SQL
    Full time
    H1b

    PwC

    San Francisco, CA
    4 days ago
  • $179.4k - $245.6k

    Full Stack Engineer 4- People Tech- GenAI & Agentic...  ...pioneering in the technology space? Do...  ..., Data, and Enablement...  ...scalable platforms and data...  ...and the enterprise. What You...  .... Lead a portfolio...  ...Java, Scala, Python, Go, Node....  ...variety of AWS tools and...  ...TypeScript, SQL, or Go ~... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    San Francisco, CA
    2 days ago
  • $216.2k - $270.25k

     ...that makes enterprise AI seamless...  ...Infrastructure Engineer to act as a...  ...technical lead,...  ...ensuring our platform remains the...  ...GCP, Azure, AWS) for customers...  ...Use our own data and AI platform...  ...in Python or JavaScript...  ...TypeScript, and SQL.Bonus...  ...emerging AI technologies.Compensation... 
    Platform
    Amazon Web Service
    SQL
    Full time

    Scale AI

    San Francisco, CA
    15 hours ago
  • $225k - $255k

     ...manufacturing, data center...  ...for a Principal Enterprise Technology Architect to own...  ...mature, capable platforms running Finance...  ...data models, engineering a scalable and...  ...the Identity Lead retains ownership...  ....Advanced SQL proficiency and...  ...architecture exposure (AWS, Azure, or GCP... 
    Platform
    Amazon Web Service
    SQL
    Temporary work

    Crusoe

    San Francisco, CA
    15 hours ago
  • $252k - $315k

     ...Generative AI Platform) is an enterprise-grade Generative...  ...for a strong engineer to join our...  ...and learn new technologies quicklyIdeally...  ...technologiesProficient in Python or Javascript/...  ...providers (AWS, Azure, GCP)...  ...high-quality data and full-stack...  ...the world's leading models, and... 
    Platform
    Amazon Web Service
    Full time

    Scale AI

    San Francisco, CA
    15 hours ago
  • Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Join to...  ...Canonical is a leading provider of open...  ...to the global enterprise and technology markets. Our platform, Ubuntu, is very...  ...public clouds (AWS, Azure, Google...  ...Software Engineer, SQL - AI Training (... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Freelance
    Internship
    Local area
    Remote work
    Work from home
    Worldwide

    Canonical

    San Francisco, CA
    1 day ago
  • $164.5k - $219k

     ...Senior Manager, Data Sciences,...  ...Areas Technology & Engineering Employment...  ...Science, to lead data science...  ...sources, and GenAI-driven classification...  ...production, enterprise scale data...  ...in Python and SQL requiredExperience...  ...and cloud platforms such as AWS, Azure or... 
    Platform
    Amazon Web Service
    SQL
    Permanent employment
    Full time
    Apprenticeship
    Local area
    Home office
    3 days per week

    Bain & Company

    San Francisco, CA
    4 days ago
  • $176.6k - $239k

     ...Web Services (AWS). In this role,...  ...trends, emerging technologies, and innovative...  ...for leading the implementation...  ...APN) to execute enterprise cloud computing...  ...scalable, and secure GenAI and ML applications...  ...adopted cloud platform. We...  ...database (eg. SQL, NoSQL, Hadoop,... 
    Platform
    Amazon Web Service
    SQL
    Local area
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    13 hours ago
  • $176.6k - $239k

     ...Services (AWS). In this...  ...emerging technologies, and...  ...responsible for leading the...  ...execute enterprise cloud computing...  ...secure GenAI and ML applications...  ...cloud platform. We...  ...(eg. SQL, NoSQL, Hadoop...  ....g., for data pre-...  ...languages (e.g. Python)Preferred...  ..., DevOps Engineer... 
    Platform
    Amazon Web Service
    SQL
    Local area
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    12 hours ago
  • $142.8k - $193.2k

     ...4, 2026As a Data & AI Sales Specialist...  ...of cloud technology, you'll drive...  ...that align AWS solutions...  ...prerequisite for GenAI and Agentic...  ...outputs in trusted enterprise data.AWS...  ...and analytics engines unified,...  ...— serverless SQL and Apache Spark...  ...managed big data platform for Spark,... 
    Platform
    Amazon Web Service
    SQL
    Local area
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    15 hours ago
  • Software Engineer A technology company building modern backend infrastructure...  ...language such as Python, Go, or Rust Solid understanding of data structures, algorithms,...  ...with REST APIs, SQL and NoSQL databases, and cloud platforms such as AWS or GCP A bias toward ownership... 
    Platform
    Amazon Web Service
    SQL
    Immediate start

    Career Movement

    San Francisco, CA
    1 day ago
  • $111.2k - $126.9k

    At Capital One, data is at the center...  ...database, cutting edge technology in 1988! Fast-...  ...sources and platforms Build well-...  ...Science, Technology, Engineering, Mathematics...  ...experience in (Python, R, Spark, and SQL) Strong desire and...  ...developing within AWS services At least... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Part time
    Local area

    Capital One

    San Francisco, CA
    3 days ago
  •  ...business and technology consulting company...  ...over 400 leading technology...  ...Database Migration Engineer to support...  ...platform that automates...  ..., and ensure data integrity throughout...  ...PostgreSQL.* Support AWS Database...  ..., functions, SQL dialect differences...  ...within enterprise modernization... 
    Platform
    Amazon Web Service
    SQL
    Local area
    Remote work
    Flexible hours

    Slalom

    San Francisco, CA
    2 days ago
  • $269k - $314k

     ...future through technology. We are stage agnostic...  ..., crypto, enterprise, fintech, games...  ...As a software engineer optimizing...  ...internal developer platform as well as the...  ...experienceProficiency in Python 3, Rust or...  ...platform (GCP, AWS, or Azure)...  ...with production SQL databases (e.g.... 
    Platform
    Amazon Web Service
    SQL
    Work at office
    2 days per week
    3 days per week

    a16z

    San Francisco, CA
    2 days ago
  • $165k - $225k

     ...the proven enterprise database foundation...  ...SQL architecture...  ...work on fresh data, act safely...  ...to own and lead TiDB's...  ...leading AI platforms, infrastructure...  ...providers, and technology companies...  ...Product, Engineering, Marketing,...  ...agentic AI and GenAI...  ...platforms (AWS, GCP, Azure... 
    Platform
    Amazon Web Service
    SQL
    Local area
    Flexible hours

    TiDB

    San Francisco, CA
    20 days ago
  • $229.9k - $262.4k

     ...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do...  ...pioneering in the technology space? Do you...  ...marrying data with emerging...  ...this by building platforms that enable the...  ..., TypeScript, SQL, Python, and Go...  ...a variety of AWS tools and services... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Part time
    Internship
    Local area

    Capital One National Association

    San Francisco, CA
    21 hours ago
  • $172.5k - $260.1k

     ...the company leading workforce transformation...  ...Slack, data isn't just...  ...— it's the engine behind every great enterprise decision. Our...  ...collaboration platforms.What You'll Be...  ..., tuning SQL, and scaling...  ...proficiency in Python and SQLFamiliarity...  ...Spark SQL, AWS (S3, EMR),... 
    Platform
    Amazon Web Service
    SQL
    Permanent employment
    Full time

    Salesforce

    San Francisco, CA
    15 hours ago
  •  ...Infotech is a technology and talent...  ...cybersecurity, data analytics, artificial...  ...Deployed Engineer (FDE)...  ...automation using Python. Build and...  ...Work with SQL and databases...  ...solutions using AWS, Azure, or...  ...major cloud platform: AWS, Azure,...  .... AI: LLM/GenAI, RAG, AI Agents... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Local area

    Cogent Infotech Corp

    San Francisco, CA
    1 hour ago
  • $231k - $318k

     ...FaireFaire is a technology wholesale platform built on...  ...of tech, data, and machine...  ...role:Our Engineering organization...  ...experimentation and leading adoption...  ....Strong SQL skills and...  ...and teach:AWS, Snowflake,...  ..., Spark, Python, Kotlin.Salary...  ...the latest enterprise AI tools,... 
    Platform
    Amazon Web Service
    SQL
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    1 day ago
  • $176.6k - $239k

     ...practical application of GenAI, AI, and ML? Are...  ...are the large enterprises of the future....  ...that’s capital, engineering resource, or experience...  ...leverage AWS technology to develop, train...  ...roadmap of the AWS platform and services, connecting...  ..., networking, data & analytics)... 
    Platform
    Amazon Web Service
    Local area
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    4 days ago
  • $201k - $272k

     ...adoption of the AWS cloud worldwide...  ..., unmatched technology, and unwavering...  ...new markets for GenAI, Machine Learning...  ...start-ups to leading web companies to...  ...insights from their data.The NAMER...  ...adopted cloud platform. We pioneered cloud...  ...of technical, enterprise customer facing... 
    Platform
    Amazon Web Service
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    15 hours ago
  • $106.7k - $121.7k

     ...Associate, Support Engineer – Capital...  ...that technology and data can enable even...  ...first large enterprises to go all‑in...  ...and executing SQL scripts to...  ...managers and platform engineers to...  ...languages (Python, Bash). ~3...  ...monitoring tools (AWS CloudWatch,...  ...121,700 for Lead Support... 
    Platform
    Amazon Web Service
    SQL
    Full time
    Part time
    Local area
    Remote work

    CloudDevs

    San Francisco, CA
    2 days ago
  • $176.6k - $239k

    AWS Global Sales drives adoption...  ..., unmatched technology, and...  ...convenience, enterprises operating tens...  ...and brightest engineers, architects,...  ...innovation• Lead Well-...  ...Supply chain platforms providing end...  ...presenting a GenAI-powered restaurant...  ...networking, data & analytics)... 
    Platform
    Amazon Web Service
    Local area
    Worldwide
    Flexible hours

    AmazonWebServices

    San Francisco, CA
    1 day ago
  • $176k - $242k

     ...FaireFaire is a technology wholesale platform built on the belief...  ...power of tech, data, and machine...  ...waits on a partner engineering pod carrying its...  ...CockroachDB, on AWS.SQL and enough...  ...including the latest enterprise AI tools, to help...  ...and engineering leads from Square. We’... 
    Platform
    Amazon Web Service
    SQL
    Contract work
    Temporary work
    Work experience placement
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours
    3 days per week

    Faire

    San Francisco, CA
    3 days ago
  • $180k - $225k

     ...Generative AI Platform) is an enterprise-grade...  ...Full-Stack Engineer to help us build...  ...frontends to Python-based backends...  ...systems, data pipelines, and...  ...learning new technologies, frameworks,...  ...with SQL and modern API...  ...cloud provider (AWS, GCP, or Azure...  ...the world's leading models, and... 
    Platform
    Amazon Web Service
    SQL
    Full time

    Scale AI

    San Francisco, CA
    15 hours ago
  •  ...Our AI-powered platform was purpose-built...  .... Our enterprise-grade technology transforms patient...  ...technologists, and engineers working...  ...highly motivated Data Engineer to join...  ...language (e.g., Python, Java, Scala) and SQL (any variant)...  ...provider (GCP, AWS, Azure) and accompanying... 
    Platform
    Amazon Web Service
    SQL
    Hourly pay
    Full time
    Flexible hours

    Abridge

    San Francisco, CA
    4 days ago
  • $155.4k - $208.4k

    Technology is at the heart of Disney...  ...of engineers, product developers...  ..., data scientists,...  ...products and platforms that will power...  ...s industry‑leading ad technology...  ...truth for enterprise‑wide...  ...level. Strong Python, Scala/Spark and SQL skills processing...  ...with AWS S3 Preferred... 
    Platform
    Amazon Web Service
    SQL
    Work experience placement

    Disney Cruise Line - The Walt Disney Company

    San Francisco, CA
    3 days ago
  •  ...experience with SQL, Databricks,...  ...raw data, kafka ingestions...  ...advanced SQL and Python • Strong...  ...BI tools and technologies based on the...  ...tools, reporting platforms, and...  ...information. Lead, design and...  ...product and engineering team to understand...  ...with Azure, AWS or equivalent... 
    Platform
    Amazon Web Service
    SQL

    BayOne Solutions

    San Francisco, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer (Python, AWS, SQL, GenAI) (Enterprise Platforms Technology). Be the first to apply!