Data Engineer

Big Data Engineer

Client: Walmart

Role: Big Data Engineer

# of roles: 2 x3, 2 x4 level data engineers

Duration: 6 month CTH

Target Start Date: 8/7/22

Interview Process: One and done back to back: 2 hour interview

Project Details – Size, Scale, Scope?

• Working within the Ad-Tech Division - they support the data processing and transformation before it goes to reporting division
• Coordinated team/data foundations team (store the data for ad-tech and “source of truth” for their data metrics)
• They work to audit and do multiple code reviews on items before implementation so that is a big portion of their role on this team
• Work with big data and large distributed systems – want someone with that exposure

Day to Day Responsibilities/typical day look like:

• Senior:
  • 40% data analysis/Data quality
  • 50% designing and coding
  • 20% meetings with other teams on data/data sources
• Staff:
  • Flexible on tasking a bit based on what they have most exposure but will be more cross-functional work and mix of leadership and local tasks
  • 25% meetings & 25% planning/meeting review (50% meeting related work)
  • 25% mentorship
  • 10-15% coding
  • 10% or more other

Selling Points for Candidates:

Technical Stack:

1. Apache (Spark, Hive, Airflow)
   1. Need exposure to Spark and other apache stack
2. Google Cloud (BigQuery in particular)
   1. Any cloud experience can suffice instead if needed
3. Scala
   1. Work with Python, JAVA, or other would be okay instead
4. Atlassian (JIRA, Jenkins, Github)
   1. Basic exposure here or similar tooling okay

Team Size & Structure: Team of 8-10 people

Education or Certification Requirements: N/A

Level of experience target (junior/mid/senior and/or years of experience): More concerned with level versus years. Talked about 2-3+ and that sounded like a good benchmark.