Data Engineer
Software Technology Inc
Big Data Engineer
Client: Walmart
Role: Big Data Engineer
# of roles: 2 x3, 2 x4 level data engineers
Duration: 6 month CTH
Target Start Date: 8/7/22
Interview Process: One and done back to back: 2 hour interview
Project Details – Size, Scale, Scope?
- Working within the Ad-Tech Division - they support the data processing and transformation before it goes to reporting division
- Coordinated team/data foundations team (store the data for ad-tech and “source of truth” for their data metrics)
- They work to audit and do multiple code reviews on items before implementation so that is a big portion of their role on this team
- Work with big data and large distributed systems – want someone with that exposure
Day to Day Responsibilities/typical day look like:
- Senior:
- 40% data analysis/Data quality
- 50% designing and coding
- 20% meetings with other teams on data/data sources
- Staff:
- Flexible on tasking a bit based on what they have most exposure but will be more cross-functional work and mix of leadership and local tasks
- 25% meetings & 25% planning/meeting review (50% meeting related work)
- 25% mentorship
- 10-15% coding
- 10% or more other
Selling Points for Candidates:
Technical Stack:
- Apache (Spark, Hive, Airflow)
- Need exposure to Spark and other apache stack
- Google Cloud (BigQuery in particular)
- Any cloud experience can suffice instead if needed
- Scala
- Work with Python, JAVA, or other would be okay instead
- Atlassian (JIRA, Jenkins, Github)
- Basic exposure here or similar tooling okay
Team Size & Structure: Team of 8-10 people
Education or Certification Requirements: N/A
Level of experience target (junior/mid/senior and/or years of experience): More concerned with level versus years. Talked about 2-3+ and that sounded like a good benchmark.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in San Bruno, CA vacancy
- ...Data EngineerLooking for:Heavy spark and scala everything else is a nice to haveSpark / Scala/ SQL Python and Java are fine as long as they understand spark/scalaGood to have: Data science experience, data pipelines, data structuresThey have extensive pipelines in spark...Suggested
Software Technology Inc
San Bruno, CA1 day ago $130k - $200k
...speeds.About You and The Role Zipline designs, manufactures, and operates autonomous delivery systems that rely on accurate engineering product data. Every prototype, production build, supplier order, repair, and field configuration depends on trusted component records,...SuggestedLocal area- ...Hello, One of our direct client is urgently looking for Sr. Data Engineer @ San Bruno, CA TITLE: Sr. Data Engineer Duration: 6 to 12+ months LOCATION: San Bruno,CA Rate: DOE Description: Looking for a backend data engineer with Adobe Analytics or Google Analytics knowledge...Suggested
Redolent Infotech Pvt. Ltd.
San Bruno, CA1 day ago $160k - $210k
...real impact. About the Role Our fleet produces a continuous stream of data, and we're looking for a senior IC to own how that data becomes insight: for customers, partners, operations, engineering, and leadership. You'll be the bridge between the raw telemetry coming...SuggestedFull timeTemporary workFlexible hoursAgtonomy
South San Francisco, CA3 days ago$185k - $210k
...about building easy-to-use, beautifully designed technologies that keep food in the food system and out of landfills. The Role As a Data Engineer at Mill, you'll touch systems end-to-end — from raw ingestion to the recommendation a customer sees in the app to managing the...SuggestedContract workWork at office3 days per week$155k - $210k
...'s mission is to supercharge every function at Zipline with the data they need to optimize every day. We design and build Zipline's central... ...dispatch, to customer delivery, and more. As a Senior Analytics Engineer, you are the owner of analytics infrastructure and datasets that...Local areaFlexible hours3 days per weekEarly shift$160k - $200k
...Zipline builds, manufactures, and operates autonomous delivery systems that move essential goods where they are needed. As a Senior Data Engineer on the Data Platform team, you will build cloud data foundations that turn application and operational telemetry into trusted...Full timeLocal area$185k - $210k
...about building easy-to-use, beautifully designed technologies that keep food in the food system and out of landfills.The RoleAs a Data Engineer at Mill, you'll build and maintain the core data infrastructure that powers analytics and product data across the company —...Contract work$185k - $210k
...passionate about building easy-to-use, beautifully designed technologies that keep food in the food system and out of landfills.As a Data Engineer at Mill, you'll touch systems end-to-end — from raw ingestion to the recommendation a customer sees in the app to managing the...Contract work$133k - $150k
...This is a hybrid role based in Fremont, CA. About the role you're considering We are seeking a highly experienced Senior Data Engineering Lead with minimum 8+ years' experience in modern data engineering, data warehousing and data lake technologies on Azure cloud...Full timeLocal area- ...SW South San Francisco, California, USA Battery Modeling Engineer South San Francisco, California, USA Billing Operations Analyst... ...Test Technician) South San Francisco, California, USA Business Data Analyst South San Francisco, California, USA...
ZipLine
South San Francisco, CA20 hours ago - Redolent Infotech Pvt. Ltd. seeks a Sr. Data Engineer in San Bruno, CA to design and optimize backend data pipelines, leveraging Hadoop, Spark, Hive, and SQL. The role demands strong programming skills in Python/Java/Scala and hands-on analytics experience. You will collaborate...
- Mill is seeking a Data Engineer in California to own end-to-end data systems from ingestion to customer-facing recommendations. You will architect data warehouse models, tune recommendation logic, and collaborate with product, engineering, analytics, and marketing teams...
- The Mill is seeking a Data Engineer to design and operate scalable data pipelines across our product and operational systems. You will contribute to a customer-facing recommendation engine and manage data transformations from multiple sources, enabling actionable insights...Work at office
- We are seeking a hands-on Lead Data Engineer to join the Data & AI Supply Chain organization and drive the design, development, and delivery of enterprise-scale data products on Google Cloud Platform (GCP). This role will support Supply Chain initiatives across Sourcing...Hourly payFreelance
- ...we invest in our employees and our community. Join us in using data, bold thinking, and a commitment to innovation to help clear the... ...accounting, investor reporting, and collections. As a Lead Data Engineer, you'll lead the Financial Data Operations team, owning the pipelines...Full timeWork at officeLocal areaRemote workRelocationFlexible hours
$140k - $175k
...Peak Energy Job Title: Senior Cell Modeling & Analytics Engineer Location: Broomfield, CO or Burlingame, CA Department: Cell... ...& Analytics Engineer to develop the predictive models and data analytics that drive cell design, performance optimization, and...Full timeFlexible hoursPeak Energy
Burlingame, CA3 days ago$170k - $200k
About the RoleWe're looking for a Data Engineer who wants to operate like a founder. Not someone who wants to spend their time maintaining dashboards, moving tickets across a board, or optimizing pipelines in a mature environment. Someone who sees infrastructure as a product...Work at officeRemote workFlexible hoursShift work$140k - $348k
...anywhere in the world. If you're excited to shape the future of design and collaboration, join us!We are looking for an experienced Data Engineer to partner with our Data Science and Data Infrastructure teams to own and scale our data pipelines. You’ll also work closely...Minimum wageFull timeLocal areaRemote workFlexible hours$120.8k - $151k
...dream. We make this a reality by empowering you with the tools, resources, and support you need to grow your career.Data at BrexOur Scientists and Engineers work together to make data — and insights derived from data — a core asset across Brex. But it's more than just...Work at officeRemote workWork from home- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...Work at office
$140k - $180k
Data Engineer, Data Platform About the RoleWe are building out our Data Platform team at Sigma, with a relentless focus on developing data models that fuel trusted insights across the company. As a Data Platform Engineer, you will be responsible for the underlying data...Full timeWork at office$153k - $207k
...years. But that only happens when clean, structured scientific data and AI are built into how science gets done. Benchling is the... ...software to modern science. Benchling is building AI & Data Engineering (AIDE), a small, autonomous team within our Security & IT...Full timeWork at officeLocal areaFlexible hours3 days per week$150k - $250k
...automation layer used across IT, HR, Finance, Security, Legal, and Engineering. Our mission is to eliminate repetitive, manual work across... ...General Catalyst, Elad Gil, and others. Role Overview As a Data Engineer at Serval, you'll be our first dedicated data hire,...Full time- We are looking for a Contract Data Engineer to support financial systems and data operations in San Francisco, California. This is a remote on-going contract. This role will work across Finance, Systems, and Engineering to improve data reliability, strengthen integrations...Contract workRemote work
$100.79k - $160.26k
...DLA Piper is a place you can engage in meaningful work and grow your career. Let’s see what we can achieve. Together.SummaryThe Data Engineer, Solutions & Data role designs, builds, and operates data pipelines and data integration processes that translate raw data into...Full timeWork at officeRemote workRelocationVisa sponsorshipRelocation package$140k - $175k
Zipline in South San Francisco is seeking a Senior Analytics Engineer to develop and maintain data pipelines and provide actionable insights. You will work with cross-functional teams to bridge business problems with data requirements, contributing to data-driven decisions...$140k - $175k
...finance, supply chain, inventory, manufacturing, maintenance, and engineering. We also build the software applications that enable the... ...team, you’ll play a key role in unlocking the full potential of data from these systems. You will enable data pipelines, transform raw...Local area$76.73k - $127.88k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Data Engineer, you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel...Local areaVisa sponsorship$132.7k - $206.8k
...intelligent agreement management, Docusign unleashes business-critical data that is trapped inside of documents. Until now, these were... ...'ll doDocusign is seeking a talented and results oriented Data Engineer to focus on delivering trusted data to the business. As a member...Contract workWork at officeLocal areaRemote work2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data center engineer San Bruno, CA
- data engineer analytics San Bruno, CA
- data engineer machine learning San Bruno, CA
- finance data engineer San Bruno, CA
- data engineer San Bruno, CA
- data developer San Bruno, CA
- senior data center engineer San Bruno, CA
- data science developer San Bruno, CA
- data loss prevention analyst San Bruno, CA
- data collection San Bruno, CA