Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem

TikTok

Our team plays a crucial role in the data ecosystem of the TikTok Recommendation System, focusing on creating offline and real-time data storage solutions for large-scale recommendation, search, and advertising businesses, serving over 1 billion users. The core goals of the team are to ensure high system reliability, uninterrupted service, and smooth data processing. We are committed to building a storage and computing infrastructure that can adapt to various data sources and meet diverse storage requirements, ultimately providing efficient, cost-effective, and user-friendly data storage and management tools for the business.Responsibilities1. Architecture Design and Implementation: Design and implement offline and real-time data architectures for large-scale recommendation, search, and advertising systems based on Paimon and Flink. Ensure efficient data processing and storage to meet the strict requirements of the business for data timeliness and accuracy.2. System Construction and Optimization: Design and implement flexible, scalable, stable, and high-performance storage systems and computing models. Use Paimon as the storage foundation and combine it with the powerful computing capabilities of Flink. Continuously optimize system performance to cope with the challenges brought by business growth.3. Troubleshooting and Stability Assurance: Be responsible for troubleshooting production systems. For problems that occur in the Paimon-Flink architecture during operation, design and implement necessary mechanisms and tools, such as data consistency assurance and exception recovery, to ensure the overall stability of the production system.4. Distributed System Construction: Build industry-leading distributed systems, including offline and online storage based on Paimon and batch and stream processing frameworks based on Flink, providing solid and reliable infrastructure support for massive data and large-scale business systems.Minimum Qualifications:- A bachelor's degree or above in computer science, software engineering, or related fields, with experience in building scalable systems.- Thorough understanding of Paimon and Flink, and be able to understand and use them at the source-code level.- In-depth understanding of at least one data lake technology (such as Paimon), with practical implementation and customization experience, which should be highlighted in the resume.- Proficiency in programming languages such as Java, C++, and Scala, with strong coding and problem-solving abilities.- Experience in data warehouse modeling and be able to design efficient data models that meet complex business scenarios.Preferred Qualifications:- Experience in using other big-data systems/frameworks (such as Hive, HBase, Kudu, etc.) and handling large-scale data (PB - level and above) is preferred.- Have the courage to take on complex problems and be willing to explore problems without clear solutions.- Passions in learning new technologies and be able to quickly master and apply them to practical work.- Familiar with the principles of HDFS, and knowledge of columnar storage formats such as Parquet and ORC is preferred.Req ID: A187812

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem in Seattle, WA vacancy
  • A leading social media platform is seeking a Senior/Staff Big Data Storage and Computing Engineer to join their Recommendation Data Ecosystem team in Seattle. This role is pivotal in enhancing the data ecosystem and contributing to innovative data-driven improvements.... 
    Senior
    Big data

    Tik Tok

    Seattle, WA
    1 day ago
  • $241.68k

     ...optimize the advanced recommendation systems that...  ...global e-commerce ecosystem.Balance user...  ...real-world user data modeling in statistical...  ...from a ML engineering viewpoint.Mentor...  ...equivalent degree in Computer Science, Engineering...  ...learning; andUtilizing Big data framework... 
    Senior
    Big data
    Full time
    Work experience placement

    TikTok

    Seattle, WA
    1 day ago
  •  ...Summary The Apple Services Engineering team combines art and technology...  ...s degree in Machine Learning, Computer Science, Computer Engineering,...  ...computer science fundamentals like data structures, algorithms, and...  ...JAX). Distributed Systems & Big Data: Proven experience with... 
    Senior
    Big data

    Apple

    Seattle, WA
    2 days ago
  • $61.31 - $104.39 per hour

     ...management to analyze clinical data, and to identify and...  ...leverage cloud computing, big data, data science, and...  ...less experiences Data Engineers and participate in...  ...years of experience as a Senior Data Engineer Preferred...  ...NoSQL (Spark, Hadoop ecosystem, Kafka, Flink, NoSQL... 
    Senior
    Big data
    Minimum wage
    Full time
    Local area
    Remote work
    Shift work

    Providence Health & Services

    Renton, WA
    5 days ago
  • $218.8k - $295.9k

     ...The AWS Analytics Engineering (AAE) is at the forefront...  ...from their data. We are a cross functional...  ...-oriented Senior Applied Science Manager...  ...system, develop big data engineering...  ..., and strategic recommendations to technical and non...  ...in statistics, computer science, engineering... 
    Senior
    Big data
    Flexible hours

    Amazon Science

    Seattle, WA
    4 days ago
  • $210.3k - $273.4k

     ...WA, USA Full time JOBREQ-2616462 Senior Machine Learning Engineer, Data Infrastructure Unity Vector builds...  ...that supports both batch and stream big data processing using technologies such...  ...utilization across distributed compute systems used for data processing Partner... 
    Senior
    Big data
    Full time
    Work at office
    Worldwide

    Unity Technologies

    Bellevue, WA
    2 days ago
  • $155k - $190k

    Senior Software Engineer - Big Data/ML OpsTruveta is the world’s first health provider led data platform with...  ...job and are motivated by solving computing problems that can have a direct...  ...concepts across the Truveta and partner ecosystems.Bring your curiosity,... 
    Senior
    Big data
    For contractors
    Visa sponsorship
    Work visa
    Flexible hours

    Truveta

    Seattle, WA
    2 days ago
  • $185k - $235k

    Senior Machine Learning Engineer, User Signal & Ads Bellevue, Washington...  ...by advanced AI, recommendation systems, and...  ...to dream big, innovate fast,...  ...events, contextual data, engagement history...  ...'s degree in Computer Science, Machine...  ...of the big-data ecosystem (Hadoop, Spark,... 
    Senior
    Big data
    Full time
    Local area
    Work from home

    NewsBreak

    Bellevue, WA
    2 days ago
  • $175k - $215k

     ...We are seeking a Senior Machine Learning Engineer to play a key role to join...  ...deploying state-of-the-art computer vision and recommendation models that power our...  ...technical expertise in data and machine learning, innovative...  ...engineers, building an ecosystem of technologies at the... 
    Senior
    Temporary work
    Work experience placement
    Work at office
    Local area

    Metropolis Corp

    Seattle, WA
    4 days ago
  •  ...Responsibilities: Advanced Data Modeling: Build and...  ...opportunities for improvement, and recommend enhancements to optimize...  ...: Bachelor’s degree in Computer Science, Engineering, Information Systems, or a...  ...services for data solutions. Big Data Expertise: Extensive... 
    Senior
    Big data
    For contractors

    Software Technology Inc

    Seattle, WA
    4 days ago
  • $207.48k - $368.22k

     ...create hyper-scale data-center networking...  ...passionate development engineer who combines deep...  ...intelligent ecosystem with predictive and...  ...autonomously generate, recommend, or even execute...  ...Fundamentals in Computer Science and Networking...  ...desirable: - Big Data Processing: Familiarity... 
    Big data
    Temporary work
    Local area

    ByteDance

    Seattle, WA
    3 days ago
  • $136k - $184.1k

     ...Now deliveries to big-screen TV’s, increasingly...  ...costs from the ecosystem. Our mission is to...  ...technology and engineering muscle as our...  ...technologies in big data, machine learning,...  ...communicating insights and recommendations to audiences of...  ...in influencing senior leadership through... 
    Senior
    Big data
    Worldwide
    Flexible hours

    Socket.dev

    Bellevue, WA
    1 day ago
  •  ...project, we are working with bleeding-edge big data technologies to develop a high-...  ...enthusiastic and technology-proficient Senior Data Engineer, who is eager to participate in design...  ...environment BS/BA or equivalent degree in computer science or similar (preferred) What we... 
    Senior
    Big data
    Flexible hours

    Grid Dynamics Holdings, Inc.

    Seattle, WA
    5 days ago
  • $152.4k - $268.2k

    Manage data collection and streamlining processes, creating frameworks...  ...planning for partner Data Engineering team, including gathering...  ...to back up assumptions, make recommendations and drive actions. Career examples...  ...data formats and tools for big data systems (e.g. Parquet,... 
    Senior
    Big data
    Relocation

    Apple Inc.

    Seattle, WA
    5 days ago
  • $142k - $220.5k

    Job DescriptionNordstrom Data Platform is a real-time, event-...  ...-time.We are looking for an engineer to help our team design and...  ...processing pipelines in the Big Data ecosystem in the Cloud, apply data definitions...  ...’s or Master's degree in Computer Science, Engineering, or... 
    Senior
    Big data
    Full time
    Work at office

    Nordstrom

    Seattle, WA
    1 day ago
  •  ...Beyond is seeking a hands-on AI / Data Engineer & Analyst to serve as our AI...  ...'s, Master's, or Ph.D. in Computer Science, Engineering, or a...  ...(Type 1/2). Experience with big data processing frameworks (Apache...  ...Spark, Flink) and cloud data ecosystems (AWS, Azure, GCP). Hands-on... 
    Big data

    Concepts Beyond

    Seattle, WA
    5 days ago
  • $170k - $240k

     ...work on applications and data at scale, serving...  ...and employers and need senior data engineers to build fast, scalable...  ...a focus on Python and big data technologies ~...  ...technologies ~ Comprehensive computer science fundamentals...  ...Familiarity with data storage technologies such as... 
    Senior
    Big data
    Full time
    Remote work
    Flexible hours

    ZipRecruiter

    Seattle, WA
    29 days ago
  •  ...Southern California’s robotics ecosystem, we build risk-aware,...  .... We go beyond typical data-driven approaches or...  ...architectures, combining rigorous engineering with learning systems...  ...distributed or parallel computing. Experience with object storage, Parquet or similar... 
    Senior
    Local area

    FieldAI

    Seattle, WA
    2 days ago
  •  ...Title: Senior Data Engineer Location: Bellevue, WA JOB DESCRIPTION: Roles & Responsibilities Digital Marketing...  ...; MSBI; Database Administration (DBMS); Cosmos; Digital : Big Data Platforms Key Responsibilities Own end... 
    Senior
    Big data

    SWITS DIGITAL Private Limited

    Bellevue, WA
    1 day ago
  • The Apple Services Engineering team is one of the most exciting...  ...opportunities here. Data and analytics...  ...Skillset: Familiarity with big data technologies and...  ...Systems, Data Science, Computer Science, Business, or...  ...customer lifecycle data ecosystems Leadership and... 
    Big data
    Shift work

    Socket.dev

    Seattle, WA
    6 days ago
  • $157.7k - $213.8k

     ...passionate about enabling data teams to solve the...  ...their business. Founded by engineers — and customer obsessed...  ...distributed data storage and processing systems...  ...standard framework for big data.Data Plane Storage...  ...for:BS (or higher) in Computer Science, related technical... 
    Senior
    Big data
    Local area
    Worldwide

    DataBricks

    Bellevue, WA
    14 hours ago
  • Providence Health & Services in Renton, WA is seeking a Senior Data Engineer to apply health care domain knowledge to analyze clinical data and...  ...processes. You will design data pipelines, leverage cloud and big data tools, mentor junior engineers, and collaborate with... 
    Senior
    Big data

    Providence Health & Services

    Renton, WA
    5 days ago
  • $108k - $216k

     ...massive scale. As a Data Scientist, you’ll turn...  ...closely with product, engineering, and business teams...  ...and communicate clear recommendations that drive measurable...  ...learning algorithms and computational algorithms based on...  ...goals Utilize big data analytics and advanced... 
    Senior
    Big data
    Full time
    Temporary work
    Part time
    Work at office
    Flexible hours

    Walmart

    Bellevue, WA
    3 days ago
  • Jobtailor in Seattle seeks a senior data engineer to lead multi-engineer projects and mentor teammates. You will design scalable data pipelines...  ...robust data models, and optimize performance in a cloud-based Big Data environment. Collaborate with product managers, data... 
    Senior
    Big data

    Jobtailor

    Seattle, WA
    4 days ago
  •  ...Our client has an opportunity for a Senior Software Engineer – Ad Intelligence Data Platform on a 12+ month contract....  ...systems. Build cloud-based big data infrastructure with a focus on...  ...emerging technologies across data and AI ecosystems. Experience Requirements: ~4... 
    Senior
    Big data
    Hourly pay
    Contract work
    Local area

    Eliassen Group

    Seattle, WA
    25 days ago
  • Senior Data Engineer Employment Type :- W2 Duration :- Long Term Visa Type :- All Visa applicable which are ready for W2 Location- Bellevue,...  ...documentation skills. Preferred Qualifications Experience with Big Data tools and platforms, including Apache Spark, Hadoop, or... 
    Senior
    Big data

    Highbrow LLC

    Bellevue, WA
    5 days ago
  • $138.9k - $186.2k

     ...global organization of engineers, product...  ...designers, technologists, data scientists, and...  ...machine learning, big data, microservices...  ...We are hiring a Senior Data Engineer to design...  ...optimize scalable storage and retrieval...  ...Bachelor or above in computer science or a... 
    Senior
    Big data

    The Walt Disney Company

    Seattle, WA
    3 days ago
  • $155.4k - $208.4k

     ...Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more – all...  ...: ~ Bachelor's degree in Computer science, Information Systems, Software...  ....  ~5+ years of related big data engineering experience modeling... 
    Senior
    Big data
    Work experience placement

    Disney Entertainment and ESPN Product & Technology Careers

    Seattle, WA
    14 hours ago
  • Data Engineer At Slack, data isn't just infrastructure — it's the engine behind every great enterprise decision. Our Data Engineering...  ...with Spark SQL, AWS (S3, EMR), Apache Pinot, or Hadoop/Big Data ecosystems Experience with Flink or other real-time stream processing... 
    Senior
    Big data
    Permanent employment

    Slack

    Seattle, WA
    3 days ago
  • $218.8k - $295.9k

     ...solutions, working with product, engineering teams to deliver the optimal...  ...scope includes personalized recommendations, search, marketing, and the...  ...Master's degree in Computer Science (Machine Learning, AI...  ...+ years of hands‑on work in big data, machine learning and predictive... 
    Senior
    Big data
    Temporary work
    Flexible hours

    Socket.dev

    Seattle, WA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem. Be the first to apply!