Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer Java + Data (PySpark)

Full-time

Lineate

About Lineate

Lineate is a US-based international software development company with over two decades of experience.

From Intelligent Document Processing(IDP) and Agentic RAG systems to scalable cloud architectures, we turn complex ideas into real, measurable results.

We deliver AI-driven custom solutions for FinTech, HealthTech, AdTech, and beyond, empowering businesses to grow smarter, faster, and more efficiently.

Our expertise falls into three main categories:


  • Building Custom AI Solutions: Deploying high-impact, AI-enabled technology utilizing IDP, Agentic RAG.

  • Cloud and Data Infrastructure: Optimizing business operations with our data management and cloud computing solutions.

  • Team Augmentation: Providing specialized experts in FinTech, AdTech, and HealthTech to integrate seamlessly and accelerate project timelines.

  • Our goal is not just to build technology, but to build the future operating model for our clients.

 

Responsibilities


  • Design, develop, and maintain scalable backend services using  Java and  Python

  • Build and optimize data processing pipelines and APIs for high-performance applications

  • Collaborate with cross-functional teams to deliver reliable and efficient solutions

  • Improve system performance, scalability, and reliability

  • Work with large datasets to support search, recommendation, or ML-driven features

  • Contribute to architecture decisions and technical design

  • Write clean, maintainable, and well-documented code

 

Requirements (Must-have)


  • 6+ years of commercial software development experience

  • Strong hands-on experience with  both Java and Python (primarily  PySpark code)

  • Experience in designing, developing, and optimizing scalable data processing pipelines and backend APIs for  high-performance applications

  • Solid understanding of backend development principles and system design

  • Experience working with APIs,  microservices , and distributed systems

Nice-to-have


  • Databricks OR AWS EMR OR Hadoop

  • Search technologies experience , such as:

Lexical search (e.g., Solr, Elasticsearch)

Semantic search, vector search, or RAG-based systems

Search relevance tuning and optimization


  • Machine Learning experience , especially in:

Recommendation systems

User behavior prediction (e.g., click-through rate prediction, relevance estimation)

Practical ML application in production systems

We offer:


  • B2B contract with our US office

  • NY working hours (at least 6 hours overlap)

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer Java + Data (PySpark) in New York, NY vacancy
  •  ...is currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.Responsibilities...  ...management using analytics and software development processes for natural...  ...MLOps, with hands-on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while... 
    Suggested
    H1b
    Local area

    KPMG

    New York, NY
    3 days ago
  • A leading data solutions company in New York is seeking a Mid-Senior level Data Engineer. The role involves designing and optimizing high-performance Spark-based data pipelines using Python/PySpark. Candidates should have strong experience with AWS services and data warehousing... 
    Suggested
    Full time

    Quadrant IQ Solutions LLC

    New York, NY
    3 days ago
  • $175k - $200k

     ...We are looking for a seasoned engineer to build and maintain the system...  ...produces essential reference data that is critical for most...  ...databases and API Architect custom software solutions for business...  ...distributed systems experience in Java ~ Strong understanding of... 
    Suggested
    Full time
    Worldwide

    Our Company Virtu

    New York, NY
    1 day ago
  • An established industry player is seeking a skilled data engineer to design and maintain scalable data pipelines using Azure technologies. This role involves integrating data from various sources into the Azure Databricks platform, implementing ETL processes, and ensuring... 
    Suggested

    TechDigital Group

    New York, NY
    1 day ago
  • $158.1k - $213.8k

    The AppStar Data Analytics & Engineering (DNA) team within Amazon's Application Security...  ...ideal candidate has strong software engineering fundamentals,...  ..., leveraging Spark/PySpark and AWS infrastructure- Monitor...  ...and services using: C#, C++, Java, or Perl experience- 1+... 
    Suggested
    Internship
    Flexible hours

    Amazon

    New York, NY
    6 hours ago
  • Laotop recherche un Senior Azure Data Engineer / Devops Engineer basé à New York. Le candidat idéal aura une solide expérience avec Azure Databricks, Pyspark, ADF et Synapse, ainsi qu'une connaissance avancée de Python, SQL et Power BI. Les missions incluront l'utilisation... 

    Laotop

    New York, NY
    5 days ago
  • $97.17k - $126.32k

     ...our benefits and perks support that mindset.About the Role:The Data Engineer designs, develops, and maintains NYSTEC’s enterprise data...  ...maintain data engineering solutions that leverage SQL, Python, and PySpark to support enterprise data processing and automation.•... 
    Full time
    Local area
    Visa sponsorship

    New York State Technology Enterprise Corporation (NYSTEC)

    New York, NY
    4 days ago
  • $110k - $130k

     ...Role:At The New York Times, data powers decisions across the entire...  ...and we're looking for a Data Engineer to help us build them. You'll...  ...relational data modeling and PySpark for complex data processing...  ..., hands-on experience with Software Engineering in a data context... 
    Full time
    Local area
    Flexible hours

    The New York Times

    New York, NY
    1 day ago
  • $141.9k - $190.3k

    Job Posting Title:Sr Data EngineerReq ID:10147075Job Description:Technology is at the heart...  ...& Technology is a global organization of engineers, product developers, designers,...  ...acquisition reporting using Databricks, PySpark, SQL, and Unity Catalog.Lead the modernization... 
    Full time

    Hulu

    New York, NY
    1 day ago
  • $111k - $220k

    Join Mizuho as a Market Data Sr. Java Developer!This is an exciting opportunity where you would...  ...modern technologies and data & software architectures.Key Responsibilities:Hands...  ...MarketsEducation:Bachelor degree in Mathematics, Engineering or Computer Science.The expected base... 
    Full time
    Work at office
    Local area
    Remote work
    Worldwide

    Mizuho Financial Group

    New York, NY
    4 days ago
  •  ...limits of what's possible.As a Sr Lead Software Engineer at JPMorganChase within Credit Technology...  ...and operational stability using Python, Java.Hands-on experience with AI components,...  ...use in engineering workflows, including data sensitivity considerations, secure handling... 

    JP Morgan Chase

    New York, NY
    1 day ago
  •  ...York Life will join a team of analytics engineers focused on delivering clean, well-structured, and reliable data to power various business and AI...  ...time data ingestion and processing using PySpark and AWS Glue.• Apply software engineering best practices—including version... 
    Local area
    3 days per week

    New York Life Insurance Company

    New York, NY
    3 days ago
  • $168k - $252k

     ...recognized heritage in large-scale IT and engineering, we combine market-leading capabilities...  ..., our experience spanning technology, data sciences, consulting and customer...  ...engineering using SQL, DBT, Python, Spark, PySpark, Java, JavaScript, Scala, or similar tools. Strong... 
    Flexible hours

    Publicis Media

    New York, NY
    4 days ago
  • About the Role We are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud‑native data platforms and...  ...Required Qualifications Strong proficiency in Python and/or Java with Spark/PySpark. Experience with Data Pipelines, Data Modelling, Data... 

    The Judge Group, LLC

    New York, NY
    1 day ago
  • $140k - $175k

     ...the lookout for a skilled Senior Analytics Engineer with strong software development skills who is passionate about games and big data. This is a full-time, in-office position...  ...engineering or data engineering Python and PySpark. 5+ years of hands-on experience in using... 
    Full time
    Work at office

    Rockstar Games

    New York, NY
    2 days ago
  •  ...communities.This is a Principal Software Engineering position at Associate level...  ..., and implement robust PySpark‑based ETL frameworks with error...  ...environments. Perform data enquiry, data analysis and data...  ...in Linux Shell Experience in Java Development Experience and Understanding... 
    Temporary work

    Morgan Stanley

    New York, NY
    6 hours ago
  •  .../manage ETL pipelines for the data lake and Snowflake; automate data...  ...movement. Must-Have Skills: PySpark (Strong hands-on experience)...  ...ETL AWS EMR Snowflake Python Java Data Structures & Algorithms Preferred...  ...Candidate: Senior Big Data Engineer with strong PySpark, AWS Glue/... 
    Live in

    BCforward

    New York, NY
    1 day ago
  •  ...the place to do it. What we're looking for As a Backend Engineer, you’ll design, develop, and maintain scalable, secure, and high...  ...crypto liquidity) Our technology stack is based predominantly on Java 25 on the backend with Postgres database We rely on Spring... 
    Full time
    Work at office
    3 days per week

    Arq

    New York, NY
    1 day ago
  • $186.4k - $233k

     ...seeking a highly skilled and motivated Software Engineer to join our dynamic Public Sector...  ...architect and build the foundational data infrastructure that will serve as the...  ...Go, C++, or highly optimized Python/Java, Spark, PySpark) and a fundamental understanding of memory... 
    Full time

    Scale AI

    New York, NY
    6 hours ago
  •  ...performance Exchange Connectivity applications using distributed Java platforms for low-latency, high-throughput message processing....  ...Required Qualifications • Advanced degree in IT, Engineering, or Mathematics • Expert-level Java and/or C++ development... 
    Full time
    Work at office
    2 days per week

    Cadogan Solutions

    New York, NY
    1 day ago
  • $175k - $200k

     ...securities, at over 235 venues, in 36 countries worldwide ATLAS SOFTWARE ENGINEER Our Atlas Development team is a highly talented group of...  ...and scalable software in general purpose languages such as Java, Go, C++ ~ Driven, self-starting personality. Our employees... 
    Full time
    Worldwide

    Virtu Financial Inc.

    New York, NY
    1 day ago
  •  ...predictive analytics, supported by AI-ready data assets and AI-assisted development...  ...including leading and developing a team of data engineers. You will work closely with business and...  ...practices Apache Spark proficiency (PySpark preferred) and experience with distributed... 
    Full time
    Temporary work
    Remote work
    Work from home

    Arch Capital Group

    New York, NY
    6 hours ago
  • $131k - $218.3k

    Position Summary Our Deloitte AI & Engineering team works to transform technology...  ...innovation. Work you'll do As an AI and Data Science Engineer III on the team, you will...  ...years of experience programming in Python, Pyspark, Pytorch, Tensorflow3+ years of... 
    Local area

    Deloitte

    New York, NY
    1 day ago
  • $120k - $140k

     ...database management systems, data integration solutions,...  ..., and related software functions supporting the...  ...candidate will serve as a Data Engineer, performing complex...  ...experience with pySpark preferred. Experience with...  ...framework. Experience with Java development and related... 

    City of New York

    New York, NY
    2 days ago
  •  ...elaboration, designs and develops software applications, and tests and...  ...member of an agile engineering team that designs and develops...  ...engineering experienceExperience with Java development in an Enterprise...  ...and nonSQL databases, Big Data platforms etcDemonstrated experience... 
    Work experience placement

    Comtech

    New York, NY
    3 days ago
  • Goldman Sachs in New York is seeking a Senior Software Engineer for Global Banking & Markets, AI/ML Technology. You will design, develop, and...  ...services, integrating AI tooling into production-grade Java microservices across multi-region cloud environments. The role... 

    Goldman Sachs Group, Inc.

    New York, NY
    5 days ago
  • $180k - $220k

    Our Client seeks an experienced software engineer to help them modernize their existing data systems using current and emerging industry best practices.The base salary...  ...7 years of comprehensive IT experience5+ years of Java development expertise utilizing J2EE and Spring... 

    Solomon Page

    New York, NY
    3 days ago
  • $350k

     ...intersection of quantitative modeling, software engineering, and portfolio analytics,...  ...researchers and data scientists to deploy and scale...  ...software engineering experience in Java or another object-oriented...  .... Experience with Python, PySpark, Scala, or distributed... 
    Work visa

    Selby Jennings

    New York, NY
    2 days ago
  •  ...your career — and we have the perfect software engineering opportunity for you.As a Software Engineer...  ...draws conclusions from large, diverse data sets to identify problems and...  ...querying languagesHands on experience with Java, Spring Boot, and KafkaDemonstrable ability... 

    JP Morgan Chase

    New York, NY
    4 days ago
  •  ...have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at...  ...and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications... 

    JP Morgan Chase

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer Java + Data (PySpark). Be the first to apply!