Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Developer/Data Engineer (PySpark & Distributed Systems)

Veganetworks

We have been doing cutting edge engineering work for Silicon Valley of the U.S. We developsoftware solutions, algorithms, and innovations to enable reliably fast broadband and Wi-Fiinternet connectivity to consumers everywhere. Software engineers considered for this positionwill be developing backend applications on the server side and have an opportunity to make asignificant impact at a fast-growing company. We are looking for a Java software developer to play an influential role in the development of ourCloud product suite, which is used by network operators like Telefonica to manage 100 million ofInternet lines and home Wi-Fi around the world. The right candidate will be an enthusiastic,hands-on engineer, and will also be experienced with the entire software engineering life cycle -from requirement analysis, architecture, design, development, code review, quality assurance todeployment. You will be working in a dynamic and continuous learning environment, with highlycooperative colleagues, and you will feel a part of a highly skilled technical community. Job Responsibilities: You will help plan, design, and develop and test software systems used in productionsystems managing several millions of subscribers' homes You will be working with a strong development team concentrated mainly in Spain andTurkey but also with US You will be participating in weekly scrums and team meetings Qualifications: B.Sc. or M.Sc. degree in CS / EE or any related field Technical skills: Good command of English Over 5 years of Server-side programming experience focusing on large-scale distributed cloud-based systems Hands-on experience with Python and PySpark is preferred. Solid technical foundation (algorithms, data structures, database, unit testing) and problem-solving skills Expert knowledge of Spark SQL (PySpark) and DataFrames, avoiding anti-patterns like row-level iteration Deep understanding of DAG execution, shuffling, data skew, and partitioning to build scalable distributed systems Ability to develop logic within object-oriented frameworks using abstract base classes and centralized configurations Foundational knowledge of Java for JVM-level troubleshooting and performance tuning within the Spark engine Strong experience with Java is a plus Soft Skills: Work with multiple teams across time zones on cross-functional areas with complex requirements and dependencies Highly motivated and passionate in delivering results Strong communication skills and ability to grasp complex product requirements, technical concepts and standards Write highly reliable and maintainable code Ability to troubleshoot through complex issues involving multiple internal and external modules/teams Able to scope effort with accurate estimates Able to work independently- starting from architecting, designing, implementing, maintain a feature from start to end We offer competitive salaries based on USD Full remote working depends on the project and will be discussed at interviews Please send your CV to View email address on click.appcast.io if interested #J-18808-Ljbffr Veganetworks

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Developer/Data Engineer (PySpark & Distributed Systems) in New York, NY vacancy
  • $160k - $240k

    Bloomberg L.P. is looking for a Senior Software Engineer for their VAULT platform in New York. The...  ...involves building high-performance data pipelines and leading technical direction...  ..., and a strong understanding of distributed systems. This position offers a competitive... 
    Senior

    Bloomberg

    New York, NY
    1 day ago
  • $160k - $240k

    Bloomberg L.P. is seeking a Senior Software Engineer for its Distributed Data and Retrieval Platform in New York. The role involves building OLTP store services...  ...under varying workloads across financial data systems. Candidates should have 4+ years of experience, strong... 
    Senior

    Bloomberg L.P.

    New York, NY
    5 days ago
  • $229.9k - $262.4k

     ...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do you love building and pioneering...  ...are passionate about marrying data with emerging technologies. As a...  ...technology projects and a team of developers with deep experience in... 
    Senior
    Full time
    Part time
    Internship
    Local area

    Capital One Financial Corp

    New York, NY
    6 days ago
  • A technology company in New York seeks a Senior/Staff Software Engineer to design and build features for their leading vector database, enhancing...  ...in Rust, Go, or C++, and a strong interest in distributed systems. The role emphasizes collaboration, problem-solving, and... 
    Senior
    Flexible hours

    Pinecone

    New York, NY
    10 days ago
  • LiveKit is seeking a Senior/Staff Engineer to enhance our platform's core services and observability. This role demands expertise in distributed systems and a strong grasp of programming fundamentals. You will design resilient architectures, improve system reliability,... 
    Senior

    LiveKit

    New York, NY
    3 days ago
  • $160k - $240k

    Bloomberg L.P. in New York seeks a Senior Software Engineer to work on the Bloomberg Product Identifier Repository...  ...involves modernizing ticker management systems, designing high-performance systems, and working on distributed data infrastructure. Applicants should have 4+... 
    Senior

    Bloomberg

    New York, NY
    3 days ago
  • $148.7k - $199.4k

    The Walt Disney Company (France) is hiring a Senior Software Engineer in New York, NY. You will design, develop, and deploy scalable software solutions using...  ...Kubernetes for cloud deployment, emphasizing distributed systems and observability. Ideal candidates should have... 
    Senior

    The Walt Disney Company

    New York, NY
    2 days ago
  • Blueface Ltd is seeking a C++ Engineer to design and support their innovative video advertising platform. This role involves substantial experience with C/C++, distributed systems, and problem-solving, along with leading development efforts and mentoring team members. The... 
    Senior

    Blueface

    New York, NY
    1 day ago
  • The Voleon Group in New York is hiring a Senior Software Engineer to design and evolve distributed systems that power research and trading workflows. This critical role involves collaboration with Infrastructure, Security, and ML researchers, focusing on creating reliable... 
    Senior

    The-Voleon-Group

    New York, NY
    6 days ago
  • PulseRise Technologies is seeking a Senior Software Engineer with strong modern C++ expertise to innovate on our distributed blockchain ledger. You will work on critical aspects...  ..., and network performance, optimizing our system to secure decentralized transactions. The... 
    Senior
    Full time
    Relocation

    PulseRise Technologies

    New York, NY
    3 days ago
  • The Trade Desk, Inc. is seeking a Senior Engineer in New York City to design, build, and deliver digital advertising solutions. This...  ...where you will solve complex challenges involving large-scale distributed systems, and contribute to meaningful projects that shape the... 
    Senior

    The Trade Desk, Inc.

    New York, NY
    1 day ago
  •  ...Group in the United States is seeking a Senior Software Engineer for its Software Platform team. The...  ...involves designing and implementing distributed systems critical for research and trading...  ...Java, and familiarity with advanced data storage technologies. This position... 
    Senior

    The Voleon Group

    New York, NY
    3 days ago
  • A top staffing company is seeking a Senior Platform Engineer for a remote position. Candidates should possess at least 8 years of software engineering experience, specializing in distributed systems and backend platforms. Key responsibilities include designing scalable... 
    Senior
    Remote job

    V-Soft Consulting Group, Inc.

    New York, NY
    3 days ago
  • Framework Ventures is looking for a Senior Software Development Engineer to join their team in the United States. Responsibilities include designing and troubleshooting large-scale distributed systems and contributing to system monitoring and vulnerability scanning. Ideal... 
    Senior

    Framework Ventures

    New York, NY
    3 days ago
  • $156.8k - $235.2k

     ...Overview We are hiring a Senior Lead Data Engineer to build and scale...  ...personalization systems across Home, Search/...  ...engineer who thrives in distributed systems, large-scale...  ...-Time Correctness: Develop feature sets that...  ...experience with Spark (PySpark/Scala), Databricks,... 
    Senior

    Paramount Pictures

    New York, NY
    1 day ago
  •  ...interface lets teams connect their data to AI models and ship production...  ...AI that work runs on a single engine. Some agents finish in a second....  ...without losing a step. We're hiring a Senior Software Engineer, Engine & Distributed Systems to own that engine: the durable... 
    Senior

    Stack AI, Inc.

    New York, NY
    1 day ago
  • Cloudspirit in New York is seeking a self-driven Senior Market Data Engineer to take end-to-end ownership of core components of our market data...  ...speed. Responsibilities include designing high-performance systems and driving protocol upgrades to enhance trading capacity.... 
    Senior

    Cloudspirit

    New York, NY
    3 days ago
  • $110k - $150k

    Talan Group is seeking a self-driven Senior Market Data Engineer to take ownership of core components of our market data stack. This high-impact...  ...Responsibilities include designing high-performance market data systems and driving exchange protocol upgrades. Ideal candidates... 
    Senior

    Talan Group

    New York, NY
    1 day ago
  • $124k - $280k

     ...Specialty/Competency: Data, Analytics & AI Industry...  ...in data and analytics engineering focus on leveraging...  ...techniques to design and develop robust data solutions...  ...algorithms, models, and systems to enable intelligent decision...  ...and health plans. As a Senior Manager, you will drive... 
    Senior
    Full time
    H1b

    PwC

    New York, NY
    3 days ago
  • Laotop recherche un Senior Azure Data Engineer / Devops Engineer basé à New York. Le candidat idéal aura une solide expérience avec Azure Databricks, Pyspark, ADF et Synapse, ainsi qu'une connaissance avancée de Python, SQL et Power BI. Les missions incluront l'utilisation... 
    Senior

    Laotop

    New York, NY
    5 days ago
  •  ...infrastructure, enterprise engineering systems, and mission‑critical...  ...Vertex is seeking a Senior Software Engineer -...  ...Architect and scale distributed cloud services that...  ...decisions across APIs, data stores, messaging...  ...performance optimization, and developer experience... 
    Senior
    Temporary work
    Remote work
    Work visa
    Flexible hours

    Vertex Software, Inc.

    New York, NY
    3 days ago
  • $121.4k - $161.8k

     ...Senior Software Engineer, Data Engineering At Rockstar Games, we create world-class entertainment...  ...candidate will be skilled in developing complex ingestion and...  ...experience building production software systems, preferably in a distributed or data-intensive environment.... 
    Senior
    Full time
    Work at office

    Rockstar Games

    New York, NY
    2 days ago
  • $165k - $180k

     ...We are seeking a highly skilled and motivated Sr. AI Data Engineer with a proven track record in building scalable data...  ...Utilize and integrate open-source tools such as Python, PySpark, and Apache Airflow for distributed data processing and workflow orchestration. GenAI-... 
    Senior
    Work experience placement
    H1b
    Work at office
    Local area

    Karsun Solutions

    Brooklyn, NY
    4 days ago
  •  ...This isn't a traditional data engineering role focused solely on...  ...moving data from one system to another. This is a...  ...Operations. As a Senior Data Engineer, you'll...  ...integrations using Databricks, PySpark, Spark SQL, and Azure...  ...data solutions Developing and maintaining Delta... 
    Senior

    Floor & Decor

    New York, NY
    3 days ago
  • $126k - $210k

     ...the global financial system, we influence nearly 2...  ...robust batch/streaming data pipelines and transformations...  ...platforms. Develop scalable transformation...  ...dependencies using modern data engineering tools. Partner with...  ...best practices in distributed processing, testing,... 
    Senior
    Temporary work
    Worldwide
    Flexible hours

    BNY Mellon

    Jersey City, NJ
    2 days ago
  • $190k - $220k

     ...our trajectory. The Data Platform team...  ...data scientists, engineers, and product managers...  ...and services. As a Senior Data Engineer on the...  ...mission-critical systems and data services...  ...dozens of blockchains. Develop complex ETL...  ...experience in architecting distributed system... 
    Senior
    Remote work
    Shift work

    Crypto Pro Network

    New York, NY
    3 days ago
  • 6AM City, LLC is seeking a Java Big Data Engineer for a hybrid role in Columbus, OH. The position requires strong experience...  ...a proven track record in mentoring junior engineers, developing large-scale distributed systems, and working with container technology. A BS/BA... 
    Senior

    6AM City, LLC

    Brooklyn, NY
    1 day ago
  •  ...leading staffing agency is seeking a Senior Search Consultant specializing in Data Engineering to join their team. This mid-...  ...involves designing data systems, building software libraries, and...  ...qualifications include familiarity with distributed computing frameworks and cloud... 
    Senior
    Full time

    CW Talent Solutions

    New York, NY
    5 days ago
  •  ...company in the United States is looking for an exceptional Back-End Engineer to join their team. The ideal candidate will have over 5 years...  ...generating recyclable code libraries, implementing security systems, and ensuring server stability. This role offers an excellent... 
    Senior

    VirtueTech inc

    New York, NY
    3 days ago
  • $150k - $240k

    Pendulum offers unmatched social data coverage, ensuring...  ...We are currently seeking a Senior Backend Data Engineer who can help drive the efforts...  ...microservices and databases. Distributed compute & big data: You've...  ...Build backend services and systems with languages like Python,... 
    Senior
    Remote work

    Pendulum

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Developer/Data Engineer (PySpark & Distributed Systems). Be the first to apply!