Data Engineer
Full Scope
Job Title: Data Engineer Location: San Francisco, CA Required Clearance: Secret Salary: Competitive Key Responsibilities Design, build, and maintain scalable data pipelines and ETL processes to support AI and machine learning workflows. Collaborate with data scientists and machine learning engineers to understand data requirements and translate them into technical solutions. Implement data processing, transformation, and integration solutions to ensure high-quality, clean, and usable data for model training and evaluation. Optimize data storage and retrieval processes for performance and efficiency. Develop and maintain data infrastructure on cloud platforms (e.g., AWS, Google Cloud, Azure) to support AI model deployment and scaling. Implement monitoring and alerting mechanisms to ensure data pipeline reliability and availability. Ensure compliance with data governance and security standards throughout the data lifecycle. Stay current with industry trends and advancements in data engineering, AI, and machine learning. Participate in code reviews, team meetings, and contribute to a collaborative development environment. Document data architecture, processes, and workflows comprehensively. Qualifications Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. Proven experience as a Data Engineer with a focus on AI and machine learning projects. Strong proficiency in programming languages such as Python, Scala, Java, or SQL. Experience with big data technologies and frameworks such as Hadoop, Spark, Kafka, etc. Solid understanding of data modeling, database design, and data warehousing concepts. Experience with cloud-based data services (e.g., AWS S3, Redshift, EMR, Glue, Google BigQuery, Azure Data Lake). Familiarity with AI and machine learning frameworks and libraries such as TensorFlow, PyTorch, scikit-learn, etc. Strong problem-solving skills and attention to detail. Excellent communication and teamwork skills. Preferred Qualifications Experience with containerization technologies such as Docker and orchestration tools like Kubernetes. Knowledge of DevOps practices and CI/CD pipelines. #J-18808-Ljbffr Full Scope
$208k - $260k
...is committed to simple principles: a rigorous understanding of data, modern technology, and most importantly, compassion and care for... ...learning, data analytics, actuarial science, and research. The Data Engineer team is a core part of the broader Data organization, which is...SuggestedShift workNuna Inc
San Francisco, CA4 days ago$215.2k - $245.6k
...Lead Data Engineer Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive, and iterative delivery environment? At Capital One, you'll be part of a big group of makers, breakers...SuggestedFull timePart timeInternshipH1bLocal areaCapital One Financial Corp
San Francisco, CA1 day ago- ...Lead Data Engineer The Office of Information Technology (IT) is responsible for enabling State Bar's internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support State Bar's mission and goals. The office...SuggestedWork at office
GovernmentJobs.com
San Francisco, CA3 days ago - ...Lead Data Engineer With MarTech Location: SFO, CA (Hybrid 2 days a week) Key Responsibilities Lead end-to-end MarTech engineering initiatives across orchestration, data processing, and activation pipelines. Architect scalable, event-driven systems that power...Suggested2 days per week
Georgia IT Inc
San Francisco, CA4 days ago - ...Collect metrics based on user interactions. Visualize data for business teams. Develop and redesign data pipelines using... ...business partners, and product managers. Balance between hands-on engineering (50%) and team leadership (50%). Collaboration Structure:...SuggestedLocal area
My3Tech Inc
San Francisco, CA5 days ago - ...Description POSITON DESCRIPTION We are seeking a Lead Data Engineer to architect, build, and lead the development of scalable, cloud-based data platforms that support enterprise analytics, operational reporting, and advanced data use cases. This role provides...
Q-Cells
San Francisco, CA1 day ago - ...Thoughtspot and other BI tools • Write SQL for processing raw data, kafka ingestions, adf pipelines, data validation and QA •... ...other Big Data related technologies Work with product and engineering team to understand requirements, evaluate new features and architecture...
BayOne Solutions
San Francisco, CA1 day ago - ...Hello, I am Mohammed Dastagir with Saxon Global Inc wanted to let you know about the job opportunity for Lead Data Engineer position if interested please share your updated resume along with expecting rate. Title: Lead Data Engineer Location:8068...
Saxon Global
San Francisco, CA1 day ago - ...Job Title Mandatory Skills: (Oracle or PostgreSQL) and ETL Pipelines and Big Data and AWS Responsibilities · Uses structured tools for analysis and presentation of concepts and models to enhance the BRD · Develop, maintain and deliver training materials to the...Work experience placement
Omega Solutions Inc
San Francisco, CA4 days ago - ...Lead Data Engineer RADIUMONE IS A GLOBAL PROGRAMMATIC AD BUYING PLATFORM RadiumOne is the 6th largest web property in the U.S. according to comScore We build intelligent software that automates media buying, making big data actionable for marketers and connects...
Stepping Up Solutions
San Francisco, CA1 day ago - ...Lead Data Engineer The Office of Information Technology (IT) is responsible for enabling State Bar's internal and external stakeholders by the management, implementation, and maintenance of an organization's technology to support of State Bar's mission and goals. The...Work at office
State Bar CA
San Francisco, CA1 day ago - ...Title : Data Engineer Location : Remote in SFO, CA Duration : 6 Months contract ( Possibility of extension ) W2 Contract Only About the Company This is a hands-on role focused on data ownership, modeling, quality, and performance — enabling scalable automation...Contract workRemote work
Tech Observer
San Francisco, CA1 day ago - ...Lead Data Engineer With MarTech We are seeking an experienced Lead Data Engineer with strong MarTech expertise to lead the design and development of scalable marketing data platforms and real-time customer engagement systems. The ideal candidate will have deep experience...Contract work2 days per week
Staffing the Universe
San Francisco, CA3 days ago $191.52k - $212.8k
...LE POSTE VOTRE PROFIL Lead Data Engineer Enterprise Reporting & Analytics Publiée le 05.05.2026 Sephora Tech Référence : 288055 Ajouter aux favoris Ouvrir Partager Localisation : San Francisco, United States Type de contrat : Permanent...Permanent employmentFull timeLVMH
San Francisco, CA4 days ago$166.5k - $266.2k
...development. AI4D's mission is connecting scientists to petabyte-scale data through natural language interfaces, automated analysis... ...practices that scale across therapeutic areas. As a Scientific Data Engineer, you will close that gap. You will build the semantic layer,...Full timeFlexible hoursEli Lilly
San Francisco, CA4 days ago$158.81k - $198.49k
...Lead Scientific Data Engineer Berkeley Lab's (LBNL) Joint Genome Institute (JGI) has an opening for a Lead Scientific Data Engineer to join the Advanced Analysis Team! JGI has a long history of generating world-class genomic data to address pressing national energy...Full timeWork at officeRemote workRelocation packageBerkely Lab
San Francisco, CA3 days ago- ...speed of thought. Mithrl is building the world's first commercially available AI Co-Scientist. It is a discovery engine that transforms messy biological data into insights in minutes. Scientists ask questions in natural language, and Mithrl responds with analysis, novel...Work at office
Mithrl
San Francisco, CA4 days ago $180k - $270k
...Staff Data Engineer (Founding Team) Location: San Francisco (In-office) Compensation: $180,000 - $270,000 + meaningful equity Start Date: Immediate About the Company We have partnered with an elite team in SF building an AI-native platform that acts...Work at officeImmediate startXpertalent
San Francisco, CA5 days ago- ...cloud-based technologies • Profound knowledge and hands-on experience in SnowflakePlatform Architecture. • Proficient in SQL for data validation and querying, withexperience in Snow SQL scripts. • Excellent understanding of Snowflake Internals, Stages,...
Purple Drive
San Francisco, CA4 days ago - ...Dollar Startups 2024," and Y Combinator's #1 GovTech startup. About the Role At Promise we rely on data for every decision we make - from product and engineering to operations, finance, and everything in between. As our newest Data Engineer, you'll build and...Permanent employmentWork at officeLocal areaFlexible hours
Promise Co.
San Francisco, CA4 days ago $160k - $175k
...company is backed by climate-tech and Silicon Valley investors. For more information, please visit Role Overview As a Data Engineer at Gridware, you'll help build and maintain the pipelines and data systems powering our Active Grid Response platform. You'll work...Gridware
San Francisco, CA5 days ago- ...Analog Mixed-Signal (AMS) Cad Engineer Location: San Francisco, CA The Integrated Circuit (IC) CAD Engineer - Analog Mixed-Signal Flow Automation role involves supporting IC design teams in various capacities, including PDK administration, layout design support,...Remote work
Redolent
San Francisco, CA3 days ago $99k - $149k
...Day to Day This role's primary responsibility is to integrate data from a variety of sources into common data domain models,... ...learning new technologies Demonstrated experience in software engineering fundamentals and coding Salary Range Transparency Tier 1...Work experience placementLocal areaIndeed
San Francisco, CA5 days ago$170k - $220k
...Windfall is seeking a Sr. Data Engineer to join our data team. As a Sr. Data Engineer on our data team, you will be building out the core data asset that everything else at Windfall is built on top of. Communication and collaboration are at the heart of Windfall, and you...Windfall
San Francisco, CA4 days ago- ...across the globe. Join us on this journey to redefine resource management-and change lives along the way. The Role As a Data Engineer at Air Apps, you will be responsible for designing, building, and optimizing data pipelines, data warehouses, and data lakes...Temporary workWorldwide
Air Apps
San Francisco, CA3 days ago £75k - £95k per year
...Join to apply for the Data Engineer role at Surecall Tech Join to apply for the Data Engineer role at Surecall Tech Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Surecall Tech Entrepreneur & Recruitment...Full timeFreelanceRemote workFlexible hoursSurecall Tech
San Francisco, CA6 days ago$152k - $205.6k
...solving on our Blog. Be sure to explore our Interviewing Guide to learn how to ace our interview process. About the Role As a data engineer in the Data Platform organization, you will be transforming Twitch's largest data sets into offerings that are usable by the...Flexible hoursTwitch
San Francisco, CA3 days ago$120.8k - $151k
...make this a reality by empowering you with the tools, resources, and support you need to grow your career. Data at Brex Our Scientists and Engineers work together to make data - and insights derived from data - a core asset across Brex. But it's more than just...Work at officeRemote workWork from homeBrex
San Francisco, CA3 days ago$195k - $230k
...by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion... ...bring people together through commerce. Role At Whatnot data engineers build foundational data systems that power product development...Full timeWork at officeLocal areaRemote workWork from homeHome officeWhatnot
San Francisco, CA1 day ago- ...Data Engineer Factory is bringing autonomy to software engineering, and we're hiring a Data Engineer to own the systems that power how we understand and operate the business. You'll architect and evolve the full data stack, designing the pipelines, models, and integrations...Work at office
Factory
San Francisco, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
- staff data engineer San Francisco, CA
- data visualization developer San Francisco, CA
- data science developer San Francisco, CA
- senior data center engineer San Francisco, CA
- sr information security engineer San Francisco, CA
- junior big data engineer San Francisco, CA
- entry level big data engineer San Francisco, CA
- data engineer contract San Francisco, CA
- aws data engineer San Francisco, CA
- data engineer manager San Francisco, CA