Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Developer/Data Engineer (PySpark & Distributed Systems)

Veganetworks

We have been doing cutting edge engineering work for Silicon Valley of the U.S. We developsoftware solutions, algorithms, and innovations to enable reliably fast broadband and Wi-Fiinternet connectivity to consumers everywhere. Software engineers considered for this positionwill be developing backend applications on the server side and have an opportunity to make asignificant impact at a fast-growing company. We are looking for a Java software developer to play an influential role in the development of ourCloud product suite, which is used by network operators like Telefonica to manage 100 million ofInternet lines and home Wi-Fi around the world. The right candidate will be an enthusiastic,hands-on engineer, and will also be experienced with the entire software engineering life cycle -from requirement analysis, architecture, design, development, code review, quality assurance todeployment. You will be working in a dynamic and continuous learning environment, with highlycooperative colleagues, and you will feel a part of a highly skilled technical community. Job Responsibilities: You will help plan, design, and develop and test software systems used in productionsystems managing several millions of subscribers' homes You will be working with a strong development team concentrated mainly in Spain andTurkey but also with US You will be participating in weekly scrums and team meetings Qualifications: B.Sc. or M.Sc. degree in CS / EE or any related field Technical skills: Good command of English Over 5 years of Server-side programming experience focusing on large-scale distributed cloud-based systems Hands-on experience with Python and PySpark is preferred. Solid technical foundation (algorithms, data structures, database, unit testing) and problem-solving skills Expert knowledge of Spark SQL (PySpark) and DataFrames, avoiding anti-patterns like row-level iteration Deep understanding of DAG execution, shuffling, data skew, and partitioning to build scalable distributed systems Ability to develop logic within object-oriented frameworks using abstract base classes and centralized configurations Foundational knowledge of Java for JVM-level troubleshooting and performance tuning within the Spark engine Strong experience with Java is a plus Soft Skills: Work with multiple teams across time zones on cross-functional areas with complex requirements and dependencies Highly motivated and passionate in delivering results Strong communication skills and ability to grasp complex product requirements, technical concepts and standards Write highly reliable and maintainable code Ability to troubleshoot through complex issues involving multiple internal and external modules/teams Able to scope effort with accurate estimates Able to work independently- starting from architecting, designing, implementing, maintain a feature from start to end We offer competitive salaries based on USD Full remote working depends on the project and will be discussed at interviews Please send your CV to View email address on click.appcast.io if interested #J-18808-Ljbffr Veganetworks

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Developer/Data Engineer (PySpark & Distributed Systems) in New York, NY vacancy
  • $160k - $240k

     ...Bloomberg L.P. is looking for a Senior Software Engineer for their VAULT platform in New York. The...  ...involves building high-performance data pipelines and leading technical direction...  ..., and a strong understanding of distributed systems. This position offers a competitive... 
    Senior

    Bloomberg

    New York, NY
    4 days ago
  • TextQL is an NYC-based startup building the agentic data lakehouse. This Senior Software Engineer, Distributed Data Systems role focuses on building a scalable data platform that turns messy enterprise data into trustworthy answers for customers like Amazon, Ring, Scale... 
    Senior

    Getclera

    New York, NY
    4 days ago
  • $160k - $240k

     ...Bloomberg L.P. is seeking a Senior Software Engineer for its Distributed Data and Retrieval Platform in New York. The role involves building OLTP store services...  ...under varying workloads across financial data systems. Candidates should have 4+ years of experience, strong... 
    Senior

    Bloomberg

    New York, NY
    3 days ago
  • $170k - $230k

    Materialize, Inc. is looking for an engineer to improve their Database technology based in...  .... You will design, debug, and enhance system reliability while owning projects from initial...  ...in software development, preferably in distributed systems and are excited about learning... 
    Senior

    Materialize, Inc.

    New York, NY
    2 days ago
  • $148.7k - $199.4k

     ...The Walt Disney Company (France) is hiring a Senior Software Engineer in New York, NY. You will design, develop, and deploy scalable software solutions using...  ...Kubernetes for cloud deployment, emphasizing distributed systems and observability. Ideal candidates should have... 
    Senior

    The Walt Disney Company

    New York, NY
    3 days ago
  • $160k - $200k

     ...in New York City is seeking a Senior Software Engineer with extensive experience in Python...  .... This full-time role entails developing informatics tools that serve...  ...include maintaining high-quality distributed systems and operationalizing data frameworks. The annual... 
    Senior
    Full time

    Simons Foundation

    New York, NY
    3 days ago
  • A technology company in New York seeks a Senior/Staff Software Engineer to design and build features for their leading vector database, enhancing...  ...in Rust, Go, or C++, and a strong interest in distributed systems. The role emphasizes collaboration, problem-solving, and... 
    Senior
    Flexible hours

    Pinecone

    New York, NY
    4 days ago
  • $225k - $255k

     ...The Voleon Group in New York is hiring a Software Engineer to design and evolve distributed systems that support research and trading. With over 5 years of experience in software engineering and expertise in languages like Python, Go, or Java, candidates will lead complex... 
    Senior

    The Voleon Group

    New York, NY
    3 days ago
  •  ...Bloomberg runs on financial data. Every price, corporate action...  ...scale. Our team builds the distributed OLTP storage layer behind...  ...most critical financial data systems. We provide deterministic, purpose...  ...APIs that let Bloomberg engineers read and write financial data... 
    Senior

    Bloomberg

    New York, NY
    3 days ago
  • $179.98k - $267.9k

     ...Spotify USA, Inc. in New York, NY is seeking a Senior Software Engineer to join an agile team focused on product innovation. The ideal candidate...  ...6 years in Agile environments and 5 years with distributed systems. The role allows telecommuting with a salary ranging from... 
    Senior
    Remote work

    New York Times

    New York, NY
    4 days ago
  • $164.64k - $246.96k

     ...We are hiring a Senior Lead Data Engineer to build and scale the...  ...generation personalization systems across Home, Search/...  ...who thrives in distributed systems, large-scale...  ...in-Time Correctness: Develop feature sets that...  ...experience with Spark (PySpark/Scala), Databricks,... 
    Senior

    Paramount

    New York, NY
    1 day ago
  • PulseRise Technologies is seeking a Senior Software Engineer with strong modern C++ expertise to innovate on our distributed blockchain ledger. You will work on critical aspects...  ..., and network performance, optimizing our system to secure decentralized transactions. The... 
    Senior
    Full time
    Relocation

    PulseRise Technologies

    New York, NY
    2 days ago
  •  ...Group in the United States is seeking a Senior Software Engineer for its Software Platform team. The...  ...involves designing and implementing distributed systems critical for research and trading...  ...Java, and familiarity with advanced data storage technologies. This position... 
    Senior

    The Voleon Group

    New York, NY
    2 days ago
  • A top staffing company is seeking a Senior Platform Engineer for a remote position. Candidates should possess at least 8 years of software engineering experience, specializing in distributed systems and backend platforms. Key responsibilities include designing scalable... 
    Senior
    Remote job

    V-Soft Consulting Group, Inc.

    New York, NY
    2 days ago
  • $145k - $165k

    A leading tech company is seeking a distributed systems engineer to enhance their shared services team. The role involves improving system efficiency...  ...issues. Applicants should have a strong background in data-intensive systems and cloud platforms. This position is fully... 
    Senior
    Remote job

    Airship

    New York, NY
    2 days ago
  • Feedinkoo is seeking a Software Engineer to manage clusters and write Golang while using Terraform to provision infrastructure. The...  ...experience, particularly with Golang, containers, and distributed systems. You'll benefit from flexible time off and an inclusive health... 
    Senior
    Remote job
    Work at office
    Flexible hours

    Feedinkoo

    New York, NY
    4 days ago
  • $152k - $200k

     ...The Opportunity As a Sr Software Engineer on our Distributed Systems team, you'll be at the core of what...  ...guarantees. Build and tune low-latency data layers across Postgres, Redis, and...  ...documentation. Mentor and actively develop junior and mid-level engineers, raising... 
    Senior
    Full time
    Seasonal work
    Remote work

    Fanatics

    New York, NY
    3 days ago
  • $194.4k - $279k

     ...A technology company is seeking a Senior Software Engineer to lead the development of scalable backend systems and distributed architectures for Federal customers. This role involves managing full lifecycle feature development, leading customer engagements, and ensuring... 
    Senior

    SCALE

    New York, NY
    3 days ago
  • We are looking for a Senior Software Engineer with strong modern C++ expertise to help design and evolve the distributed engine powering a global blockchain ledger. This role sits...  ...layer, working on high-impact distributed systems that secure consensus, transaction... 
    Senior
    Full time
    Immediate start
    Relocation

    PulseRise Technologies

    New York, NY
    2 days ago
  • $170k - $220k

     ...clear, reliable, and scalable data and AI solutions, while strengthening HealthVerity’s engineering framework through real-world application...  ..., and production-ready systems. You will help turn fragmented...  ...building data-intensive, distributed systems, including APIs, data... 
    Senior
    Permanent employment
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours
    3 days per week

    Dormont Manufacturing Co

    New York, NY
    2 days ago
  •  ...technology company in the United States is seeking a Software Engineer II to join their innovative team. This fully remote position requires hands-on experience with large-scale distributed database systems and proficiency in languages like C++, Java, or C#. You will work... 
    Remote job

    Buoyant

    New York, NY
    4 days ago
  • $142.5k - $220.5k

     ...to its mission is the Recursion Operating System (OS), a platform built across diverse...  ..., biology, chemistry and patient‑centric data to advance the future of medicine. In this...  ...supporting Recursion’s drug discovery. Engineer Data Integrity and Traceability . You will... 
    Senior
    Work at office
    Local area

    I did my part and supported the Regular Toilet

    New York, NY
    2 days ago
  • $110k - $150k

     ...Senior Data Engineer Neuberger's Private Markets Technology group is seeking...  ...Responsibilities: Develop and optimize data models in...  ...such as capital calls, distributions, and co-investment closings...  ...downstream investment and reporting systems Leverage AI to drive... 
    Senior
    Work at office
    Shift work
    2 days per week

    Neuberger Berman

    New York, NY
    3 days ago
  • $121.4k - $161.8k

     ...Senior Software Engineer, Data Engineering Manhattan, New York, United States Become part...  ...candidate will be skilled in developing complex ingestion and transformation...  ...building production software systems, preferably in a distributed or data‑intensive environment.... 
    Senior
    Full time
    Work at office

    Rockstar Games

    New York, NY
    3 days ago
  • $200k - $325k

    Moment Technology is seeking a Distributed Systems Engineer to help build software for leading financial institutions. The role involves architecting and shipping systems that manage large data volumes while ensuring precision and speed. Candidate must have a strong foundation... 

    Moment Technology

    New York, NY
    2 days ago
  •  ...Green Key Resources is looking for a Python Software Engineer in New York City to support and enhance its internal...  ...trading technology stack. The role focuses on building system integrations, ensuring high-quality data flows, and collaborating with various teams to... 
    Senior

    Green Key Resources

    New York, NY
    3 days ago
  •  ...Mission Staffing in New York is seeking a skilled Software Engineer to design and deliver high-quality data systems that impact customer decisions. The ideal candidate will have over 5 years of experience in software engineering with a strong focus on Python, and be capable... 
    Senior

    Mission Staffing

    New York, NY
    3 days ago
  • Confiz Limited is seeking a Software Engineer III - Java (Supply Chain) in Mexico. The ideal candidate will have at least 7+...  ...software for complex environments. Responsibilities include developing software systems that support Supply Chain services, engaging in system... 
    Senior

    Confiz Limited

    New York, NY
    2 days ago
  •  ...leading staffing agency is seeking a Senior Search Consultant specializing in Data Engineering to join their team. This mid-...  ...involves designing data systems, building software libraries, and...  ...qualifications include familiarity with distributed computing frameworks and cloud... 
    Senior
    Full time

    CW Talent Solutions

    New York, NY
    4 days ago
  •  ...company in the United States is looking for an exceptional Back-End Engineer to join their team. The ideal candidate will have over 5 years...  ...generating recyclable code libraries, implementing security systems, and ensuring server stability. This role offers an excellent... 
    Senior

    VirtueTech inc

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Developer/Data Engineer (PySpark & Distributed Systems). Be the first to apply!