Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Engineer, Real Time Data Enrichment Platform (Hybrid)

$195k - $290k

Crowdstrike

As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here to stop breaches, and we’ve redefined modern security with the world’s most advanced AI-native platform. We work on large scale distributed systems, processing almost 3 trillion events per day and this traffic is growing daily. Our customers span all industries, and they count on CrowdStrike to keep their businesses running, their communities safe and their lives moving forward. We're proud to work for a mission-driven company leveraging AI to transform the way we work. CrowdStrikers drive their careers through flexibility and autonomy while also being expected to contribute to a culture of responsible AI adoption, experimentation, and innovation. We use an AI-first mindset as a force multiplier to proactively and continuously accelerate execution, build expertise, uncover insights, and solve complex problems. We’re always looking to add talented CrowdStrikers to the team who have limitless passion, a relentless focus on innovation and a fanatical commitment to our customers, our community and each other. Ready to join a mission that matters? The future of cybersecurity starts with you.About the Role:Our Data Platform group at Crowdstrike is unique among its kind for being uncommonly customer-focused. We build and operate systems to centralize all of the data from Falcon Sensors and 3rd Party sources derived from trillions of events/day, and we also drive industry-leading innovation on a hyper scale security data lake that helps find bad actors and stop breaches.Setting ourselves apart, we make it easy for all customers to utilize the platform for batch and streaming analytics, machine learning and threat hunting through the production and delivery of self-service platforms (Query Platform, Analytics Platform, Enrichment platform...) using Spark and Flink respectively as the runtimes. These self-service platforms allow customers to apply their own custom schema, syntax, data models (etc.) to our historical cyberattack data, modeling threats in a way that empowers them to predictively build (among other things) behavioral automations that defend against such threats 'before' they appear in their own environments.In this role, you will be a Principal Engineer within Data Platform, owning - in entirely hands-on capacity the design, build and delivery of a new self-service data enrichment platform which will take our customers' proactive defense measures to the next level.As a leader in data platform, you will contribute to the full spectrum of our systems, including query processing, scalable pipeline builds with largely Apache-based ingestion, materialized view, transformation and data storage frameworks, and tools/applications that make data available to thousands of users and hundreds of internal systems.What You’ll Do:Shape the vision of our Analytics Data Platform for its next phase of growth: building a Unified Data Catalog as well as Query Analysis for structured data stored in different forms (columnar vs graph), and building and optimizing query performance using different techniques of indexing and data partitioning.Design, develop, and maintain a data platform that processes petabytes of data.Participate in technical reviews of our products and help us develop new features and enhance stability.Continually help us improve the efficiency of our services so that we can delight our customers.Help us research, evolve and implement new ways for both internal stakeholders as well as customers to query their data efficiently and extract results in the format they desire.What You’ll Need:(One among:) 17+ years exp with B.S. in a related field, 15+ years with M.S. in a related field, or 12+ years with PhD in a related field.Experience building and supporting very high scale data platform and data storage systems (MINIMUM: 100s of TB/day in either a current or past role)Significant experience performance-tuning or developing internals (source code) within Spark, Flink, Iceberg or Pinot or an equivalent structured streaming, Time Series, OLAP or Open Table real time system.Production experience building either Spark- or Flink-based self-service data platforms, or equivalent (i.e. with Ray, or building spark- or Flink-like frameworks themselves in Scala, Akk, etc.)Strong familiarity with (and ample hands-on experience tuning & optimizing) at least one applicable technology in the Apache Hadoop ecosystem: Spark, Kafka, Hive/Iceberg/Delta Lake, Presto/Trino, Pinot, Druid, etc.3+ years coding in Java, Scala, Kotlin or another JVM language (bonus points for experience tuning the language, i.e. garbage collection, memory management…)Production experience with relational SQL and NoSQL databases, including Postgres/MySQL, Cassandra/DynamoDB, etc.Proven expertise with multiple big data frameworks in general, especially handling data volume at (ideally) multi-petabyte scale.Proven expertise with algorithms, distributed systems design and the software development lifecycle.Great test driven development discipline.Reasonable proficiency with Linux administration tools.Proven experience utilizing AI technologies to enhance decision-making, streamline workflows and processes, improve efficiency and drive business outcomes.Proven ability to work effectively with remote teams.Bonus Points:Familiarity with Go.Familiarity with Kubernetes/Mesos or equivalent.Production experience with Flink, especially as runtime for a self-service platform.#LI-MP2#LI-SF1Benefits of Working at CrowdStrike:Market leader in compensation and equity awardsComprehensive physical and mental wellness programs Competitive vacation and holidays for recharge Paid parental and adoption leavesProfessional development opportunities for all employees regardless of level or roleEmployee Networks, geographic neighborhood groups, and volunteer opportunities to build connectionsVibrant office culture with world class amenitiesGreat Place to Work Certified across the globeCrowdStrike is proud to be an equal opportunity employer. We are committed to fostering a culture of belonging where everyone is valued for who they are and empowered to succeed. We support veterans and individuals with disabilities through our affirmative action program.CrowdStrike is committed to providing equal employment opportunity for all employees and applicants for employment. The Company does not discriminate in employment opportunities or practices on the basis of race, color, creed, ethnicity, religion, sex (including pregnancy or pregnancy-related medical conditions), sexual orientation, gender identity, marital or family status, veteran status, age, national origin, ancestry, physical disability (including HIV and AIDS), mental disability, medical condition, genetic information, membership or activity in a local human rights commission, status with regard to public assistance, or any other characteristic protected by law. We base all employment decisions--including recruitment, selection, training, compensation, benefits, discipline, promotions, transfers, lay-offs, return from lay-off, terminations and social/recreational programs--on valid job requirements.If you need assistance accessing or reviewing the information on this website or need help submitting an application for employment or requesting an accommodation, please contact us at View email address on click.appcast.io for further assistance.Find out more about your rights as an applicant.CrowdStrike participates in the E-Verify program.Notice of E-Verify ParticipationRight to WorkCrowdStrike, Inc. is committed to fair and equitable compensation practices. Placement within the pay range is dependent on a variety of factors including, but not limited to, relevant work experience, skills, certifications, job level, supervisory status, and location. The base salary range for this position for all U.S. candidates is $195,000 - $290,000 per year, with eligibility for bonuses, equity grants and a comprehensive benefits package that includes health insurance, 401k and paid time off.For detailed information about the U.S. benefits package, please click here. SummaryLocation: USA - New York, NY; USA - Austin, TX; USA - Sunnyvale, CA; USA - Redmond, WAType: Full time

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Principal Software Engineer, Real Time Data Enrichment Platform (Hybrid) in New York, NY vacancy
  • Senior Software Engineer - Multi-Asset Order Management System...  ...based in New York, NY. Hybrid work arrangement with...  ...and build a scalable, real-time OMS, owning the full trade...  ...systems, streaming data pipelines, and key...  ...leadership to shape the platform's #J-18808-Ljbffr Certus... 
    Platform
    Data

    Certus Sales Recruitment

    New York, NY
    3 days ago
  • $200k - $250k

     ...Principal Software Engineer, Full-Stack AI Standard Template...  ...across our platform - from data ingestion and model...  ...interfaces, and real-world...  ...agents, and real-time inference. Define...  ...including automated enrichment, anomaly explanation...  ...) pipelines and hybrid search systems... 
    Platform
    Data
    Local area

    Standard Template Labs

    New York, NY
    1 day ago
  •  ...firm is seeking a highly motivated Market Data Engineer - C++ to design and build a high-performance market data distribution platform. The ideal candidate will have expertise...  ...C++ and Python, along with experience in real-time data systems and distributed architectures... 
    Platform
    Data

    Balyasny Asset Management

    New York, NY
    2 days ago
  • $50 per hour

    Principal Software EngineerThe global capital markets...  ...Software Engineer, Full Stack at...  ...spend most of your time on server-side architecture, data processing, and...  ...of our platform and decide our...  ...in it For You?Hybrid Work Model: We’...  ...challenges and deliver real-world solutions... 
    Platform
    Data
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    New York, NY
    4 days ago
  • Citi is seeking a hands-on Senior Market Data Platform Engineer to join the Market Data Engineering team in Jersey City. You will design and deliver real-time market data distribution platforms supporting global Equities with plans for multi-asset coverage, focusing on... 
    Platform
    Data
    Worldwide

    Citi

    New York, NY
    3 days ago
  •  ...impact, solving real-world problems...  ...to impact. Our hybrid teams collaborate...  ...observability platform built for...  ...to focus on the data and insights that...  ...industrial-scale Software-as-a-Service observability...  ...experienced engineers who can craft...  ...States of AmericaType: Full time
    Platform
    Data
    Full time
    Remote work
    Flexible hours

    Palo Alto Networks

    New York, NY
    1 day ago
  • Jefferies’ Equities Data & Analytics team seeks an experienced Kdb+/Q Engineer to design, build, and enhance real-time analytics platforms supporting electronic trading and market data workflows. You will develop low-latency data infrastructure, ingest ticker data, and... 
    Platform
    Data

    Jefferies

    New York, NY
    1 day ago
  •  ...own and deliver high-performance trading platforms. You will work closely with front-office...  ...on the back end, with emphasis on real-time data visualization and automation. You will lead efforts in UI performance engineering, real-time messaging (WebSocket, Kafka,... 
    Platform
    Data

    Barclays

    New York, NY
    5 days ago
  •  ...Services (TNS) in New Jersey is seeking a Network Engineer to support real-time trading and market data connectivity across global networks. The role involves...  ...of experience with Cisco, Juniper, and Arista platforms, along with strong communication skills. TNS offers... 
    Platform
    Data

    Transaction Network Services (TNS)

    New York, NY
    4 days ago
  •  ...company redefining cancer care through a data-driven platform that supports patients, providers, and payers. We seek a Data Engineer who can build scalable data pipelines and...  ...dbt, AWS), implement governance, and drive real-time analytics. #J-18808-Ljbffr Daymark Health
    Platform
    Data
    Remote job

    Daymark Health

    New York, NY
    5 days ago
  •  ...financial services firm in New York is seeking an experienced Data Engineer to join their Global Data Engineering group. This role...  ...trading strategies by designing and maintaining data solutions for real-time and research environments. Ideal candidates will have 3+ years... 
    Platform
    Data
    Worldwide

    Selby Jennings

    New York, NY
    5 days ago
  •  ...hiring a Staff Product Manager for our Rewards Platform to own the vision and build the real-time earn and burn engine that powers rewards across BILL's card products....  ...virtual card teams, partnering with Engineering, Data, Finance, Risk, Compliance and external partners... 
    Platform
    Data

    United States Digital Space LLC

    New York, NY
    4 days ago
  •  ...Product Manager to own data generation infrastructure...  ...frameworks behind our real-world data products....  ...to drive the delivery platform used across oncology data...  ...years of PM experience in software/SaaS/healthcare, strong...  ...data quality. This hybrid role is based in New York... 
    Platform
    Data
    Flexible hours

    Flatiron Health

    New York, NY
    1 day ago
  • $230k - $245k

     ...Summary We are hiring a founding engineer for the firm's proprietary investment platform — in effect, the operating...  ...are genuinely interesting ones. Real-time market data under back-pressure. Sub-...  ...continuing education opportunities ~ Hybrid work flexibility ~ Life and... 
    Platform
    Data
    Full time
    Worldwide

    Global X ETFs

    New York, NY
    3 days ago
  • $200k - $300k

     ...Job Description Job Description Real-Time Voice AI Agent Systems Engineer Company: HireNow Staffing (Direct...  ...Analyze production interaction data and translate findings into measurable...  ...Required Qualifications ~3+ years of platform, infrastructure, backend, or... 
    Platform
    Data
    Permanent employment
    Full time
    Relocation
    Visa sponsorship

    HireNow Staffing

    New York, NY
    7 days ago
  • Tabs, the leading AI-native revenue platform, seeks a Senior Software Engineer for the Data Ingest team in our Integrations org. You will own parts of the usage-to-billing pipeline, ingest real-time data from CRM systems, and help scale data flows to support AI-era billing... 
    Platform
    Data

    TABS inc.

    New York, NY
    3 days ago
  • $183.1k - $340k

     ...shaping the world. Our platforms drive legal, tax,...  .... As a Principal Software Engineer for Cloud Audit Suite...  ...feature. Work at real production scale:...  ...and unstructured data, audit compliance...  ...accountants doing time‑sensitive work....  ...’s in it For You?Hybrid Work Model: We’ve... 
    Platform
    Data
    Full time
    Work at office
    Local area
    Flexible hours
    Shift work

    Thomson Reuters

    New York, NY
    3 days ago
  •  ...own the product vision and multi-year roadmap for a real-time fraud intelligence platform that protects millions of customers across digital...  ...fraud rings and multi-step schemes, partnering with Fraud Ops, Data Science, Engineering, and Risk #J-18808-Ljbffr Jobleads-US
    Platform
    Data

    Jobleads-US

    New York, NY
    2 days ago
  • $180k - $350k

    Product Management Lead, AI - Real-Time News Location New York...  ...workflows, and unstructured data, and how users consume and act...  .... You will work closely with engineering, data, UX, and product teams...  ...transformation or large-scale platform evolutionStrong track record... 
    Platform
    Data
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    4 days ago
  • BDIPlus, a data and AI consulting firm, seeks a Senior Data Engineer to support a Fortune 100 financial services client’s real-time intelligence initiatives. In a virtualization-first architecture using Denodo, you’ll build governed virtual data models, ensure high quality... 
    Platform
    Data

    VALID8 Financial

    New York, NY
    3 days ago
  •  ...highly skilled Associate Director, Real Assets Quantitative Analyst to...  ...down dynamic asset allocation platform supporting real assets...  ...while owning daily production, data ingestion, and backend Python...  ...like Angular and Power BI in a hybrid NYC setting. #J-18808-Ljbffr... 
    Platform
    Data

    Cohen & Steers

    New York, NY
    4 days ago
  •  ...team in New York City, NY. The role offers a hybrid work arrangement with two remote days, and involves monitoring real-time transactions and analyzing high-risk activity....  ...a business/finance-related degree, and strong data-entry accuracy. You’ll join a fast-growing company... 
    Data
    Remote work

    Windcave

    New York, NY
    2 days ago
  •  ...Recruitment Group is seeking a Senior Software Engineer to design and build a scalable,...  ...components, delivering high-performance, real-time capabilities in a hybrid work setting. You should bring 8+...  ...systems, messaging, and market data pipelines. #J-18808-Ljbffr Certus... 
    Data

    Certus Recruitment Group

    New York, NY
    2 days ago
  •  ...pioneering the future of real-time 3D experiences by fusing cutting...  ...visualization, software, interactive simulations,...  ...systems that connect web platforms, real-time 3D engines, and cloud infrastructure...  ...Python to support real-time data exchange and Unreal integrations... 
    Platform
    Data
    Local area

    NOVΛVERSE

    New York, NY
    1 day ago
  • $188k - $242k

     ...HR issues. We’re data-driven and never stop...  ...?As a Senior Software Engineer, you will be leveraging...  ...Engineer for Time Lifecycle, you'll...  ...fragmented legacy platforms. At the core of this...  ...modeling complex real-world problems with...  ...year.#LI-AD1 #LI-Hybrid #LI-JS1Actual compensation... 
    Platform
    Data
    Full time
    Casual work
    Work at office
    Local area
    Shift work

    Justworks

    New York, NY
    2 days ago
  • New York Life is seeking a data engineer to join our Technology data team, focusing on building robust dbt data pipelines and real-time processing with PySpark and AWS Glue. You'll collaborate...  ...and standards across the enterprise. Hybrid work arrangement (3 days per week) and... 
    Data
    3 days per week

    New York Life

    New York, NY
    3 days ago
  • $135.2k - $306.4k

     ...Description Senior / Principal Software Engineer or Architect...  ...a database platform used by...  ...is about the data layer: document processing, hybrid lexical/vector...  ...understand how real workloads behave...  ...transformed, searched, enriched, and reasoned...  ...# Paid time off: Flexible... 
    Platform
    Data
    Full time
    Temporary work
    Flexible hours

    Oracle

    New York, NY
    1 day ago
  •  ...better tech. We’re rewriting how data moves and what the world can do...  ...Confluent, data doesn’t sit still. Our platform puts information in motion, streaming in near real-time so companies can react faster,...  ...the core streaming analytics engine underlying Confluent's real-time... 
    Platform
    Data

    Confluent

    New York, NY
    1 day ago
  • $140k - $295k

    Technical Product Manager - Real-Time Data Technology Location New...  ...how they build market data platforms, moving more workloads to the...  ...with deeply specialized engineers, product managers, client-facing...  ...solutions architecture, or software engineering — with a meaningful... 
    Platform
    Data
    Temporary work
    For contractors
    Work experience placement
    Shift work

    Bloomberg

    New York, NY
    3 days ago
  • $163k - $204k

     ...people we serve.All full-time employees receive...  ...seasoned full-stack software engineers to join the teams...  ...technical craft with real-world impact — helping...  ...Product Management, Data, Design, and Platform Engineering teams to...  ...non-office days for hybrid employees.Our... 
    Platform
    Data
    Full time
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week

    Gusto

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer, Real Time Data Enrichment Platform (Hybrid). Be the first to apply!