Senior Developer/Data Engineer (PySpark & Distributed Systems)
Veganetworks
We have been doing cutting edge engineering work for Silicon Valley of the U.S. We developsoftware solutions, algorithms, and innovations to enable reliably fast broadband and Wi-Fiinternet connectivity to consumers everywhere. Software engineers considered for this positionwill be developing backend applications on the server side and have an opportunity to make asignificant impact at a fast-growing company. We are looking for a Java software developer to play an influential role in the development of ourCloud product suite, which is used by network operators like Telefonica to manage 100 million ofInternet lines and home Wi-Fi around the world. The right candidate will be an enthusiastic,hands-on engineer, and will also be experienced with the entire software engineering life cycle -from requirement analysis, architecture, design, development, code review, quality assurance todeployment. You will be working in a dynamic and continuous learning environment, with highlycooperative colleagues, and you will feel a part of a highly skilled technical community. Job Responsibilities: You will help plan, design, and develop and test software systems used in productionsystems managing several millions of subscribers' homes You will be working with a strong development team concentrated mainly in Spain andTurkey but also with US You will be participating in weekly scrums and team meetings Qualifications: B.Sc. or M.Sc. degree in CS / EE or any related field Technical skills: Good command of English Over 5 years of Server-side programming experience focusing on large-scale distributed cloud-based systems Hands-on experience with Python and PySpark is preferred. Solid technical foundation (algorithms, data structures, database, unit testing) and problem-solving skills Expert knowledge of Spark SQL (PySpark) and DataFrames, avoiding anti-patterns like row-level iteration Deep understanding of DAG execution, shuffling, data skew, and partitioning to build scalable distributed systems Ability to develop logic within object-oriented frameworks using abstract base classes and centralized configurations Foundational knowledge of Java for JVM-level troubleshooting and performance tuning within the Spark engine Strong experience with Java is a plus Soft Skills: Work with multiple teams across time zones on cross-functional areas with complex requirements and dependencies Highly motivated and passionate in delivering results Strong communication skills and ability to grasp complex product requirements, technical concepts and standards Write highly reliable and maintainable code Ability to troubleshoot through complex issues involving multiple internal and external modules/teams Able to scope effort with accurate estimates Able to work independently- starting from architecting, designing, implementing, maintain a feature from start to end We offer competitive salaries based on USD Full remote working depends on the project and will be discussed at interviews Please send your CV to View email address on click.appcast.io if interested #J-18808-Ljbffr Veganetworks
$160k - $240k
Bloomberg L.P. is looking for a Senior Software Engineer for their VAULT platform in New York. The... ...involves building high-performance data pipelines and leading technical direction... ..., and a strong understanding of distributed systems. This position offers a competitive...Senior$160k - $240k
Bloomberg L.P. is seeking a Senior Software Engineer for its Distributed Data and Retrieval Platform in New York. The role involves building OLTP store services... ...under varying workloads across financial data systems. Candidates should have 4+ years of experience, strong...Senior$229.9k - $262.4k
...Senior Lead Software Engineer, Distributed Systems (Golang + Python on Kubernetes) Do you love building and pioneering... ...are passionate about marrying data with emerging technologies. As a... ...technology projects and a team of developers with deep experience in...SeniorFull timePart timeInternshipLocal area- A technology company in New York seeks a Senior/Staff Software Engineer to design and build features for their leading vector database, enhancing... ...in Rust, Go, or C++, and a strong interest in distributed systems. The role emphasizes collaboration, problem-solving, and...SeniorFlexible hours
- LiveKit is seeking a Senior/Staff Engineer to enhance our platform's core services and observability. This role demands expertise in distributed systems and a strong grasp of programming fundamentals. You will design resilient architectures, improve system reliability,...Senior
$160k - $240k
Bloomberg L.P. in New York seeks a Senior Software Engineer to work on the Bloomberg Product Identifier Repository... ...involves modernizing ticker management systems, designing high-performance systems, and working on distributed data infrastructure. Applicants should have 4+...Senior$148.7k - $199.4k
The Walt Disney Company (France) is hiring a Senior Software Engineer in New York, NY. You will design, develop, and deploy scalable software solutions using... ...Kubernetes for cloud deployment, emphasizing distributed systems and observability. Ideal candidates should have...Senior- Blueface Ltd is seeking a C++ Engineer to design and support their innovative video advertising platform. This role involves substantial experience with C/C++, distributed systems, and problem-solving, along with leading development efforts and mentoring team members. The...Senior
- The Voleon Group in New York is hiring a Senior Software Engineer to design and evolve distributed systems that power research and trading workflows. This critical role involves collaboration with Infrastructure, Security, and ML researchers, focusing on creating reliable...Senior
- PulseRise Technologies is seeking a Senior Software Engineer with strong modern C++ expertise to innovate on our distributed blockchain ledger. You will work on critical aspects... ..., and network performance, optimizing our system to secure decentralized transactions. The...SeniorFull timeRelocation
- The Trade Desk, Inc. is seeking a Senior Engineer in New York City to design, build, and deliver digital advertising solutions. This... ...where you will solve complex challenges involving large-scale distributed systems, and contribute to meaningful projects that shape the...Senior
- ...Group in the United States is seeking a Senior Software Engineer for its Software Platform team. The... ...involves designing and implementing distributed systems critical for research and trading... ...Java, and familiarity with advanced data storage technologies. This position...Senior
- A top staffing company is seeking a Senior Platform Engineer for a remote position. Candidates should possess at least 8 years of software engineering experience, specializing in distributed systems and backend platforms. Key responsibilities include designing scalable...SeniorRemote job
- Framework Ventures is looking for a Senior Software Development Engineer to join their team in the United States. Responsibilities include designing and troubleshooting large-scale distributed systems and contributing to system monitoring and vulnerability scanning. Ideal...Senior
$156.8k - $235.2k
...Overview We are hiring a Senior Lead Data Engineer to build and scale... ...personalization systems across Home, Search/... ...engineer who thrives in distributed systems, large-scale... ...-Time Correctness: Develop feature sets that... ...experience with Spark (PySpark/Scala), Databricks,...Senior- ...interface lets teams connect their data to AI models and ship production... ...AI that work runs on a single engine. Some agents finish in a second.... ...without losing a step. We're hiring a Senior Software Engineer, Engine & Distributed Systems to own that engine: the durable...Senior
- Cloudspirit in New York is seeking a self-driven Senior Market Data Engineer to take end-to-end ownership of core components of our market data... ...speed. Responsibilities include designing high-performance systems and driving protocol upgrades to enhance trading capacity....Senior
$110k - $150k
Talan Group is seeking a self-driven Senior Market Data Engineer to take ownership of core components of our market data stack. This high-impact... ...Responsibilities include designing high-performance market data systems and driving exchange protocol upgrades. Ideal candidates...Senior$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry... ...in data and analytics engineering focus on leveraging... ...techniques to design and develop robust data solutions... ...algorithms, models, and systems to enable intelligent decision... ...and health plans. As a Senior Manager, you will drive...SeniorFull timeH1b- Laotop recherche un Senior Azure Data Engineer / Devops Engineer basé à New York. Le candidat idéal aura une solide expérience avec Azure Databricks, Pyspark, ADF et Synapse, ainsi qu'une connaissance avancée de Python, SQL et Power BI. Les missions incluront l'utilisation...Senior
- ...infrastructure, enterprise engineering systems, and mission‑critical... ...Vertex is seeking a Senior Software Engineer -... ...Architect and scale distributed cloud services that... ...decisions across APIs, data stores, messaging... ...performance optimization, and developer experience...SeniorTemporary workRemote workWork visaFlexible hours
$121.4k - $161.8k
...Senior Software Engineer, Data Engineering At Rockstar Games, we create world-class entertainment... ...candidate will be skilled in developing complex ingestion and... ...experience building production software systems, preferably in a distributed or data-intensive environment....SeniorFull timeWork at office$165k - $180k
...We are seeking a highly skilled and motivated Sr. AI Data Engineer with a proven track record in building scalable data... ...Utilize and integrate open-source tools such as Python, PySpark, and Apache Airflow for distributed data processing and workflow orchestration. GenAI-...SeniorWork experience placementH1bWork at officeLocal area- ...This isn't a traditional data engineering role focused solely on... ...moving data from one system to another. This is a... ...Operations. As a Senior Data Engineer, you'll... ...integrations using Databricks, PySpark, Spark SQL, and Azure... ...data solutions Developing and maintaining Delta...Senior
$126k - $210k
...the global financial system, we influence nearly 2... ...robust batch/streaming data pipelines and transformations... ...platforms. Develop scalable transformation... ...dependencies using modern data engineering tools. Partner with... ...best practices in distributed processing, testing,...SeniorTemporary workWorldwideFlexible hours$190k - $220k
...our trajectory. The Data Platform team... ...data scientists, engineers, and product managers... ...and services. As a Senior Data Engineer on the... ...mission-critical systems and data services... ...dozens of blockchains. Develop complex ETL... ...experience in architecting distributed system...SeniorRemote workShift work- 6AM City, LLC is seeking a Java Big Data Engineer for a hybrid role in Columbus, OH. The position requires strong experience... ...a proven track record in mentoring junior engineers, developing large-scale distributed systems, and working with container technology. A BS/BA...Senior
- ...leading staffing agency is seeking a Senior Search Consultant specializing in Data Engineering to join their team. This mid-... ...involves designing data systems, building software libraries, and... ...qualifications include familiarity with distributed computing frameworks and cloud...SeniorFull time
- ...company in the United States is looking for an exceptional Back-End Engineer to join their team. The ideal candidate will have over 5 years... ...generating recyclable code libraries, implementing security systems, and ensuring server stability. This role offers an excellent...Senior
$150k - $240k
Pendulum offers unmatched social data coverage, ensuring... ...We are currently seeking a Senior Backend Data Engineer who can help drive the efforts... ...microservices and databases. Distributed compute & big data: You've... ...Build backend services and systems with languages like Python,...SeniorRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Developer/Data Engineer (PySpark & Distributed Systems). Be the first to apply!
- mdm developer New York, NY
- apigee developer New York, NY
- weekend developer New York, NY
- work from home junior developer New York, NY
- mongodb developer New York, NY
- interactive developer New York, NY
- junior developer no experience New York, NY
- hadoop developer New York, NY
- remote entry level developer New York, NY
- senior sas developer New York, NY

