Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - Data Infrastructure - Kafka

Canonical Group Ltd

Software Engineer - Data Infrastructure - Kafka
Home based - EMEA

Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a managed solutions for a full range of data stores and data technologies, spanning from big data, through NoSQL, cache-layer capabilities, and analytics; all the way to structured SQL engines (similar to Amazon RDS approach).

We are facing the interesting problem of fault‑tolerant mission‑critical distributed systems and intend to deliver the worlds best automation solution for delivering managed data platforms.

We are looking for candidates from junior to senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event‑stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open‑source community dynamics and equally aware of the needs of large, innovative organisations.

Location: This role can be filled in European, Middle East and African time zones.

What your day will look like
The data platform team is responsible for the automation of data platform operations, with the mission of managing and integrating Big Data platforms at scale. This includes ensuring fault‑tolerant replication, TLS, installation, backups and much more; but also provides domain‑specific expertise on the actual data system to other teams within Canonical. This role is focused on the creation and automation of infrastructure features of data platforms, not analysing and/or processing the data in them.

Collaborate proactively with a distributed team

Write high‑quality, idiomatic Python code to create new features

Debug issues and interact with upstream communities publicly

Work with helpful and talented engineers including experts in many fields

Discuss ideas and collaborate on finding good solutions

Work from home with global travel for 2 to 4 weeks per year for internal and external events

What we are looking for in you

Proven hands‑on experience in software development using Python

Proven hands‑on experience in distributed systems, such as Kafka and Spark

Have a Bachelor’s or equivalent in Computer Science, STEM, or a similar degree

Willingness to travel up to 4 times a year for internal events

Additional skills that you might also bring

Experience operating and managing other data platform technologies, SQL (MySQL, PostgreSQL, Oracle, etc) and/or NoSQL (MongoDB, Redis, ElasticSearch, etc), similar to DBA level expertise

Experience with Linux systems administration, package management, and infrastructure operations

Experience with the public cloud or a private cloud solution like OpenStack

Experience with operating Kubernetes clusters and a belief that it can be used for serious persistent data services

What we offer you
Your base pay will depend on various factors including your geographical location, level of experience, knowledge and skills. In addition to the benefits above, certain roles are also eligible for additional benefits and rewards including annual bonuses and sales incentives based on revenue or utilisation. Our compensation philosophy is to ensure equity right across our global workforce.

In addition to a competitive base pay, we provide all team members with additional benefits, which reflect our values and ideals. Please note that additional benefits may apply depending on the work location and, for more information on these, please ask your Talent Partner.

Fully remote working environment - we’ve been working remotely since 2004!

Personal learning and development budget of 2,000USD per annum

Annual compensation review

Recognition rewards

Annual holiday leave

Employee Assistance Programme

Opportunity to travel to new locations to meet colleagues twice a year

Priority Pass for travel and travel upgrades for long haul company events

About Canonical
Canonical is a pioneering tech firm that is at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world on a daily basis. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do.

Canonical has been a remote-first company since its inception in 2004. Work at Canonical is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game. Canonical provides a unique window into the world of 21st‑century digital business.

Canonical is an equal‑opportunity employer

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - Data Infrastructure - Kafka in Richmond, VA vacancy
  • $200k - $220k

     ...Senior Software Engineer, Data Infrastructure (RDBMS) TRM Labs provides blockchain analytics and AI solutions to help law enforcement and national security agencies, financial institutions, and cryptocurrency businesses detect, investigate, and disrupt crypto-related... 
    Suggested
    Remote work
    Worldwide
    Shift work

    Crypto Pro Network

    Richmond, VA
    2 days ago
  •  ...you are: We’re looking for a Senior Software Engineer, Data Platform to help evolve and operate...  ...time streaming platform consisting of Kafka topics and Flink jobs (FlinkSQL) to process...  ...experience with GCP (AWS/Azure) infrastructure (core services, IAM, security... 
    Suggested
    Remote work
    Flexible hours

    Apella

    Richmond, VA
    8 hours ago
  • $190k - $220k

     ...world. By leveraging blockchain data, threat intelligence, and...  ...law enforcement, data science, engineering, and financial intelligence, tackling...  ...workflows including Spark, Kafka, and Flink. Competence in deploying and monitoring infrastructure within public cloud platforms,... 
    Suggested
    Remote work
    Shift work

    TRM

    Richmond, VA
    3 days ago
  • $170k - $280k

     ...future of payments. Our infrastructure powers card programs for 100...  ...Were hiring a Senior Software Engineer to join our Infrastructure...  ...and APIs that make Lithics data accessible across the organization...  ...Gateway, ECS/Fargate) Kafka or event streaming experience... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Omaze

    Richmond, VA
    20 hours ago
  • $186.07k - $218.9k

     ...expected and fully supported. The Data Platform team builds and...  ...end-user experiences. As an engineer on the team you will contribute...  ...Spark, SQL), streaming services (Kafka), query federation and caching...  ...5+ years of experience in software engineering. You have Strong... 
    Suggested
    Local area

    Coinbase

    Richmond, VA
    4 days ago
  • $160.9k - $257.1k

     ...About The Team At Zillow, data is one of our most valuable assets...  ...to customers. As a Senior Software Engineer, Big Data on the Streaming...  ...design and evolve the streaming infrastructure that hundreds of internal...  ..., and operate large‑scale Kafka and Flink infrastructure supporting... 
    Live in
    Local area
    Remote work

    Zillow Inc

    Richmond, VA
    3 days ago
  • $180k - $250k

     ...Senior Software Engineer, Data Engineering About Atria Atria is a membership‑based preventive health...  ...engineering efforts across our data infrastructure, pipelines, and analytics platforms....  ...PostgreSQL, MySQL Streaming: Pub/Sub, Kafka CI/CD: GitHub Actions Monitoring &... 
    Remote work
    Flexible hours

    Atria Health and Research Institute

    Richmond, VA
    3 days ago
  • $190k - $220k

     ...secure world for all. The Data Product team collaborates with...  ...experienced group of data scientists, engineers, and product managers to build...  ...including Dataflow, Spark, Kafka, and Flink. Competence in deploying and monitoring infrastructure within public cloud platforms,... 
    Worldwide

    TRM

    Richmond, VA
    20 hours ago
  • $141k - $165k

     ...Senior Software Engineer I - Data Collection Remote, United States The proliferation of machine log...  ...unprecedented real-time visibility into their infrastructure and operations. With this opportunity...  ...and greatest technologies such as Kafka, Kubernetes, and Docker. Requirements... 
    Remote work

    Sumo Logic

    Richmond, VA
    3 days ago
  • $155k - $195k

     ...Senior Software Engineer - Infrastructure United States What We Do At GoGuardian, we’re helping build...  ...the core cloud infrastructure, shared data services, and developer tooling that...  ...streaming platforms like Kinesis or Kafka is a plus. Familiarity with Infrastructure... 
    Remote work
    Flexible hours

    GoGuardian

    Richmond, VA
    2 days ago
  • $176k - $237.6k

     ...experience, building world‑class open‑source software and communities, and want to be a part of...  ...love to hear from you! Summary Cloud Data Store (CDS) owns the storage, retrieval,...  ..., click here] As a Senior Software Engineer , you will get the chance to design,... 
    Full time
    Temporary work
    Part time
    Remote work
    Work from home
    Home office

    Temporal Technologies

    Richmond, VA
    2 days ago
  •  ...service tools that help our data consumers to extract and analyze...  ...improvements in data engineering. Skills you should HODL 5...  ...Data Engineer, DWH Engineer, Software Engineer, etc) Experience with...  ...for data sourcing. Bonus - Kafka and other streaming technologies... 
    Full time
    Work experience placement
    Local area
    Remote work

    Crypto Pro Network

    Richmond, VA
    2 days ago
  • $180k - $220k

     ...A leading data platform company in the United States seeks a Senior Software Engineer to lead initiatives in scalability and reliability. The role involves architectural design, mentoring engineers, and ensuring high system quality. Candidates should bring 6+ years of... 

    Datavant

    Richmond, VA
    3 days ago
  • $150k - $180k

     ...A leading education technology company is seeking a Senior Software Engineer to develop scalable systems supporting education benefits for employer partners. This role involves using TypeScript, Python, AWS tools, and collaborating across teams to deliver impactful features... 

    Guild

    Richmond, VA
    3 days ago
  • $143k - $196.9k

     ...development of features and components for the data platform, focusing on high-throughput...  .... You will report to the Director, Engineering. Architect and implement robust, distributed...  ...will bring with you: 5+ years in a software engineer role, with experience in a... 
    Full time
    Remote work

    Sysdig

    Richmond, VA
    2 days ago
  •  ...healthcare technology company in the United States seeks a Senior Software Engineer to build and maintain core components of its application...  ...operational efficiency, providing constructive feedback, and ensuring data pipeline architecture is robust and scalable. The position... 
    Flexible hours

    Stellar Health

    Richmond, VA
    3 days ago
  • $253.9k - $298.7k

     ...products, but a world-class data foundation beneath...  ...Platform team is the engine that makes Coinbase's...  ...hands-on Senior Staff Software Engineer to help define...  ...that matters at the infrastructure level of one of the most...  ...data capture (CDC), Kafka Connect, or real-time... 
    Local area

    Coinbase

    Richmond, VA
    5 days ago
  •  ...U-Haul International, Inc. is hiring a Software Developer to work on the Core Services team in the United States. You will design, develop...  ...solving skills, and proficiency with tools like SQL Server and Kafka. Health insurance, 401(k) plans, and professional development... 

    U-Haul International, Inc

    Richmond, VA
    3 days ago
  •  ...of real-world zero-days across the software billions rely on, and achieved the...  ...love to talk. Your Role: Software Engineer - Platform / Core Infrastructure We’re looking for a Software...  ...async workflows (for example, using Kafka). A track record of performance... 
    Full time
    Contract work
    Immediate start
    Remote work

    XBOW

    Richmond, VA
    20 hours ago
  • $160k

     ...Python and Kubernetes Software Engineer - Data, AI/ML & Analytics Join to apply for the Python and Kubernetes Software Engineer - Data...  ...open source solutions for public cloud and private infrastructure. As a software engineer on the team, youll collaborate... 
    Full time
    Local area
    Work from home
    Worldwide

    Canonical

    Richmond, VA
    20 hours ago
  •  ...| Automotive| Genzeon has an exciting opening for Python Software Engineer, Data (Healthcare with Apache Airflow) to join our dynamic team...  ...the availability, reliability, and efficiency of our data infrastructure. Key Responsibilities: Design and Develop Data Pipelines:... 
    Permanent employment
    Contract work
    Remote work
    Work from home

    Genzeon

    Richmond, VA
    2 days ago
  •  ...Sunvery, a leading U.S.-based financial technology company, is seeking a Software Engineer to resolve complex technical issues. The role combines data engineering and development, requiring proficiency in Python and Scala. The position will contribute to product improvements... 

    Sunvery

    Richmond, VA
    3 days ago
  •  ...Clarity Innovations is seeking a motivated Software Engineer II to join their team in the United States. This mid-level position focuses on data pipeline development and systems integration, requiring active TS security clearance and proficiency in programming languages... 

    Clarity Innovations

    Richmond, VA
    3 days ago
  •  ...Indeed, Inc., c/o CT Corporation is looking for a Software Engineer II for the Meta Profile team to design and build scalable natural-language...  ...from technical design to implementation and evaluation in a data-heavy environment. As an ideal candidate, you will have a... 

    Indeed, Inc., c/o CT Corporation (Indeed.com)

    Richmond, VA
    9 hours ago
  • $120k - $160k

     ...Senior Software Engineer - Data Acquisition Job Title: Senior Software Engineer - Data Acquisition Position Type: Full time Location: Remote—Must reside within 30 miles of Portland, ME; Boston, MA; Chicago, IL; or San Francisco Bay Area, CA, Seattle, WA Salary Range:... 
    Full time
    Work experience placement
    Remote work
    Flexible hours

    Ipro Networks Pte. Ltd.

    Richmond, VA
    3 days ago
  • $500 per month

     ...Job Summary As a senior software engineer, you will help build and scale the systems and services that form the foundation of Alpaca and empower...  ...Influence the overall architecture of Alpaca’s market data systems Design highly scalable, mission‑critical systems Obsess... 
    Local area
    Home office

    Framework Ventures

    Richmond, VA
    3 days ago
  • $85k - $178k

     ...Indeed, Inc., c/o CT Corporation (Indeed.com) is seeking a Software Engineer for the Meta Profile team. This role involves building and operating pipelines that generate accurate profiles for job seekers using marketplace signals. The ideal candidate should have a Bachelors... 

    Indeed, Inc., c/o CT Corporation (Indeed.com)

    Richmond, VA
    20 hours ago
  •  ...Indeed, Inc. is looking for a Software Engineer II to design and implement scalable natural-language generation pipelines. You will lead features, collaborate across teams, and mentor junior engineers. Ideal candidates have a Bachelor’s in a relevant field and at least... 

    Indeed, Inc., c/o CT Corporation (Indeed.com)

    Richmond, VA
    1 day ago
  •  ...innovative, and collaborative team members. Engineering is at the heart of the action, building...  ...growth. This role is part of the Data Team and is responsible for supporting our...  ...Collaborate with project leads and other software engineers across multiple teams. Work on... 
    Remote work
    Visa sponsorship
    Work visa

    Framework Ventures

    Richmond, VA
    20 hours ago
  •  ...Senior Software Development Engineer, Big Data Join to apply for the Senior Software Development Engineer, Big Data role at Zillow About The Team...  ...manual processes, optimizing data delivery, re‐designing infrastructure for greater scalability and performance, etc.... 
    Local area
    Remote work

    Zillow Inc

    Richmond, VA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - Data Infrastructure - Kafka. Be the first to apply!