Lead Data Engineer
$215.2k - $245.6kSwiftCruit
Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast‑paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers, doers and disruptors, who solve real problems and meet real customer needs. We are seeking Data Engineers who are passionate about marrying data with emerging technologies. As a Capital One Lead Data Engineer, you’ll have the opportunity to be on the forefront of driving a major transformation within Capital One. About the Team: The Transaction Core team, a key part of the PINT (Payments Intelligence) organization, is dedicated to building and maintaining the foundational data platforms that empower Capital One to understand and act on customer spend. Our mission is to provide an actionable understanding of purchase transactions to enrich our customer's financial lives through real‑time, intelligent, and resilient platform‑based services. What You’ll Do: Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full‑stack development tools and technologies. Work with a team of developers with deep experience in machine learning, distributed microservices, and full stack systems. Utilize programming languages like Java, Scala, Python and open source RDBMS and NoSQL databases and cloud‑based data warehousing services such as Redshift and Snowflake. Share your passion for staying on top of tech trends, experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the engineering community. Collaborate with digital product managers, and deliver robust cloud‑based solutions that drive powerful experiences to help millions of Americans achieve financial empowerment. Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance. Basic Qualifications: Bachelor’s Degree. At least 4 years of experience in application development (internship experience does not apply). At least 2 years of experience in big data technologies. At least 1 year experience with cloud computing (AWS, Microsoft Azure, Google Cloud). Preferred Qualifications: 7+ years of experience in application development including Python, SQL, Scala, or Java. 4+ years of experience with a public cloud (AWS, Microsoft Azure, Google Cloud). 4+ years experience with distributed data/computing tools (MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL). 4+ years experience working on real‑time data and streaming applications. 4+ years of experience with NoSQL implementation (Mongo, Cassandra). 4+ years of data warehousing experience (Redshift or Snowflake). 4+ years of experience with UNIX/Linux including basic commands and shell scripting. 2+ years of experience with Agile engineering practices. Experience leveraging interactive AI tooling to accelerate productivity, utilizing capabilities beyond basic code completion. Salary: New York, NY: $215,200 - $245,600. San Francisco, CA: $215,200 - $245,600. This role is eligible to earn performance‑based incentive compensation, which may include cash bonus(es) and/or long‑term incentives (LTI). Capital One offers a comprehensive, competitive, and inclusive set of health, financial and other benefits that support your total well‑being. Eligibility varies based on full or part‑time status, exempt or non‑exempt status, and management level. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non‑discrimination in compliance with applicable federal, state, and local laws. Capital One promotes a drug‑free workplace. Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with the requirements of applicable laws regarding criminal background inquiries. #J-18808-Ljbffr
- ...Job Title Mandatory Skills: (Oracle or PostgreSQL) and ETL Pipelines and Big Data and AWS Responsibilities • Uses structured tools for analysis and presentation of concepts and models to enhance the BRD • Develop, maintain and deliver training materials to the...SuggestedWork experience placement
- ...Lead Data Engineer RADIUMONE IS A GLOBAL PROGRAMMATIC AD BUYING PLATFORM RadiumOne is the 6th largest web property in the U.S. according to comScore We build intelligent software that automates media buying, making big data actionable for marketers and connects...Suggested
$215.2k - $245.6k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...SuggestedFull timePart timeInternshipH1bLocal area- ...Lead Data Engineer With Martech Location: SFO, CA (Hybrid 2 days a week) Key Responsibilities Lead end-to-end Martech engineering initiatives across orchestration, data processing, and activation pipelines. Architect scalable, event-driven systems that...Suggested2 days per week
- ...problem you want to work on, we'd like to talk. Your Team The data team at Nuna is an interdisciplinary group spanning data... ...data analytics, actuarial science, and research. Within it, data engineering is the technical backbone which creates the architecture, platform...Suggested
$160k - $220k
...Lead Data Engineer Location: San Francisco, CA, United States Location Type: On-site Salary Range: 160000 - 220000 USD Annually Position Description We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data...- ...based on user interactions. Visualize data for business teams. Develop and... ...Spark streaming. Leadership Duties: Lead the measurement processes from requirements... ...product managers. Balance between hands-on engineering (50%) and team leadership (50%)....Local area
- ...tools • Write SQL for processing raw data, kafka ingestions, adf pipelines, data validation... ...protect sensitive information. Lead, design and implement innovative... ...technologies Work with product and engineering team to understand requirements, evaluate...
- ...Lead Data Engineer The Office of Information Technology (IT) is responsible for enabling State Bar's internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support of State Bar's mission and goals. The...Work at office
- ...Job Description Title: Lead Data Engineer Location: Hybrid in SF (Tuesdays onsite) Openings: 1 Work Schedule: (available until 12 am PT time to overlap with onshore team) Follow-Up Meeting: After each interview is scheduled. Contract Type: 12 months contract extensions...Contract work
- Salesforce is looking for talented engineers at the Senior and Lead Member of Technical Staff levels to join our Master Data Management (MDM) Engineering team. These roles involve designing and developing critical capabilities while leveraging modern AI technologies. Candidates...
$200k
...company in San Francisco seeks a Developer Experience Lead to enhance internal tools for their pre-training data team. This role involves leading tooling efforts... .... Candidates should have strong software engineering fundamentals and experience with CI systems. Annual...- A leading technology company is seeking a Controls Commissioning Engineer in San Francisco to lead the commissioning and startup of SCADA/BMS/EPMS systems for industrial applications. This role requires over 5 years of experience in controls commissioning, strong expertise...For contractors
$215.2k - $245.6k
Capital One National Association is seeking a Lead Data Engineer in San Francisco, CA. The role involves driving technological transformations and collaborating with agile teams to build technical solutions using programming languages like Python, SQL, and Scala. Ideal...- Epoch Biodesign in San Francisco is seeking a Senior Data Engineer to architect and build foundational data platform infrastructure for AI operations. This full-time position requires proficiency in Python and systems-level languages, experience with data platforms, and...Full time
- United States Digital Space LLC in San Francisco is looking for a Technical Lead Manager to drive the Trust & Safety Data Engineering team. In this role, you will set the strategy and technical direction for the team while ensuring the integrity and safety of data systems...
- ...Job Description: Job brief Join our San Francisco office as an ML Engineer focused on Data Engineering. Visa sponsorship available for global talent ~3 days ago A machine learning engineer with an emphasis on data engineering is needed by this organization...Full timeH1bWork at officeImmediate startVisa sponsorship
- ...Job Details Title: ML Engineer - Fraud Risk/AI Data Science Job Type: Contract Contract Length: 4-5 months Pay Range: 80-85/hr Target Start Date: 3/11 Location: Remote About the Opportunity Our client, a leader in FinTech, is looking for a skilled ML Engineer - Fraud Risk...Contract workFor contractorsWork at officeRemote work
$180k - $260k
...by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion... ...business and bring people together through commerce. Role Data is crucial to Whatnot's mission to bring people together through...Full timeWork at officeLocal areaRemote workWork from homeHome office$138.9k - $186.2k
...Senior Data Engineer Disney Entertainment and ESPN Product & Technology Technology is at the heart of Disney's past, present, and future... .... Ad Platforms is responsible for Disney's industry-leading ad technology and products – driving advertising performance,...- ...Job Description At Vori, Forward Deployed Data Engineers bridge the gap between customer systems and our modern grocery platform. You’ll work closely with onboarding managers to configure Vori for each retailer’s unique needs—reducing out-of-stocks, cutting shrink, and...Local area
- ...Big Data Engineer CA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco... ...Advanced Technology & Architecture (AT&A) practice, you will lead technology innovation for our clients through robust delivery...Work experience placement
$150k - $210k
...the lives of patients living with severe, complex diseases. Our data platform is used by drug developers and patient advocacy groups... ...stage equity. About the role We’re looking for our Founding Data Engineer who’s excited to help shape the future of how we use data to make...Work experience placementWork at officeRelocationFlexible hours3 days per week- ...We are partnering with a large consumer marketplace platform to find a Senior Data Engineer to join their growing data engineering team in San Francisco. In this role you will own the data pipeline infrastructure for a key business domain, working directly with stakeholders...3 days per week
- ...development of technology solutions. - Develop and maintain data integration solutions (including ETL/ELT design and architecture... ...model design. - Analyze requirements and apply architectural and engineering concepts to develop solutions that meet business needs while...Minimum wageContract workTemporary workWork experience placement
$138.9k - $186.2k
...Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all working to build and advance... ...Ad Platforms is responsible for Disney’s industry‑leading ad technology and products – driving advertising...- ...About Neon Redwood Neon Redwood is a data services consulting company, working on cutting-edge AI and data-driven solutions. We are a team of passionate engineers and data experts, and we are currently looking for a Senior Data Engineer to join our team and help us develop...Full timeWork experience placement
$156k - $196k
...the company | Senior Data Engineer | Hybrid (in San Francisco) | Full-time | $156k-$196k DataSF is looking for a Senior Data Engineer to help us build out the city's central Snowflake platform, which will ultimately power the majority of SF's analytics, open data, and...Full time$170k - $220k
...Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core... ...taking a large project from ideation to production Experience leading greenfield projects Working knowledge of cloud-native data engineering...$230k - $385k
About the Team OpenAI's Financial Engineering (FinEng) team powers how revenue flows through... ...efficient worldwide. About the Role As a Data Scientist on FinEng, you'll own the... ...dashboards that drive proactive action. Lead subscription, retention, and monetization...Work at officeLocal areaWorldwideRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer. Be the first to apply!
- data San Francisco, CA
- data collection researcher San Francisco, CA
- data reviewer San Francisco, CA
- data technician San Francisco, CA
- provider data management San Francisco, CA
- data cabling San Francisco, CA
- data intern San Francisco, CA
- clinical data San Francisco, CA
- voice and data technician San Francisco, CA
- clinical data coordinator remote San Francisco, CA

