Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer Java + Data (PySpark)

Full-time

Lineate

About Lineate

Lineate is a US-based international software development company with over two decades of experience.

From Intelligent Document Processing(IDP) and Agentic RAG systems to scalable cloud architectures, we turn complex ideas into real, measurable results.

We deliver AI-driven custom solutions for FinTech, HealthTech, AdTech, and beyond, empowering businesses to grow smarter, faster, and more efficiently.

Our expertise falls into three main categories:


  • Building Custom AI Solutions: Deploying high-impact, AI-enabled technology utilizing IDP, Agentic RAG.

  • Cloud and Data Infrastructure: Optimizing business operations with our data management and cloud computing solutions.

  • Team Augmentation: Providing specialized experts in FinTech, AdTech, and HealthTech to integrate seamlessly and accelerate project timelines.

  • Our goal is not just to build technology, but to build the future operating model for our clients.

 

Responsibilities


  • Design, develop, and maintain scalable backend services using  Java and  Python

  • Build and optimize data processing pipelines and APIs for high-performance applications

  • Collaborate with cross-functional teams to deliver reliable and efficient solutions

  • Improve system performance, scalability, and reliability

  • Work with large datasets to support search, recommendation, or ML-driven features

  • Contribute to architecture decisions and technical design

  • Write clean, maintainable, and well-documented code

 

Requirements (Must-have)


  • 6+ years of commercial software development experience

  • Strong hands-on experience with  both Java and Python (primarily  PySpark code)

  • Experience in designing, developing, and optimizing scalable data processing pipelines and backend APIs for  high-performance applications

  • Solid understanding of backend development principles and system design

  • Experience working with APIs,  microservices , and distributed systems

Nice-to-have


  • Databricks OR AWS EMR OR Hadoop

  • Search technologies experience , such as:

Lexical search (e.g., Solr, Elasticsearch)

Semantic search, vector search, or RAG-based systems

Search relevance tuning and optimization


  • Machine Learning experience , especially in:

Recommendation systems

User behavior prediction (e.g., click-through rate prediction, relevance estimation)

Practical ML application in production systems

We offer:


  • B2B contract with our US office

  • NY working hours (at least 6 hours overlap)

Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Software Engineer Java + Data (PySpark) in New York, NY vacancy
  • $175k - $200k

     ...We are looking for a seasoned engineer to build and maintain the system...  ...produces essential reference data that is critical for most...  ...databases and API Architect custom software solutions for business...  ...distributed systems experience in Java ~ Strong understanding of... 
    Suggested
    Full time
    Worldwide

    Our Company Virtu

    New York, NY
    13 hours ago
  • $60 - $72 per hour

     ...Data Engineer 4 Corner Resources is hiring Data Engineers for a leading healthcare organization...  ...maintaining data pipelines Strong Java or Python skills Working knowledge of...  ...Working knowledge of AWS Hands-on PySpark experience High School Diploma or GED... 
    Suggested
    Contract work
    Remote work

    4 Corner Resources

    New York, NY
    2 days ago
  •  ...Data Engineer The New York City Department of Sanitation (DSNY) keeps...  ...custom applications, and related software functions supporting the...  .... Additional experience with pySpark preferred. Experience with...  ...framework. Experience with Java development and related technologies... 
    Suggested

    New York City | Jobs

    New York, NY
    2 days ago
  • About the Role We are seeking a Lead Software Engineer - Data Engineering to design and build scalable, cloud‑native data platforms and...  ...Required Qualifications Strong proficiency in Python and/or Java with Spark/PySpark. Experience with Data Pipelines, Data Modelling, Data... 
    Suggested

    The Judge Group, LLC

    New York, NY
    2 days ago
  • $140k - $175k

     ...Documentation platform that reviews all patient data in the EHR to recommend diagnoses and...  ...Stack Data: S3, Apache Iceberg, EMR, PySpark, Dagster, Kubernetes, Clickhouse,...  ...data to downstream consumers Partner with engineering teams to identify and resolve data quality... 
    Suggested
    Work at office
    Local area
    Home office
    Visa sponsorship
    Relocation package

    REGARD

    New York, NY
    2 days ago
  • $90k - $150k

     ...Description Your role at GEI. The Data Engineer is responsible for designing, building, and maintaining the data...  ...pipelines. Proficiency in Python and SQL; experience with PySpark or Spark is strongly preferred. Experience with Azure data... 
    Work at office
    Flexible hours

    GEI Consultants

    New York, NY
    1 day ago
  •  ...Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field. Experience in Data Engineering or related roles. Strong SQL and Python...  ...and data warehousing concepts. Experience with PySpark and Apache Spark. Knowledge of data modeling and... 

    Capgemini

    New York, NY
    18 hours ago
  •  ...are looking for a passionate certified Data Engineer. The successful candidate will turn data...  ...Skillset Primary skillset: Python/Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing...  ...and adopt an Agile (SCRUM like) software development mindset Follow established... 
    Work experience placement

    Chris Baily

    New York, NY
    2 days ago
  •  ...One of our Client is seeking Lead Data Engineers in NJ and Ohio Respectively. Due to the requirement, only visa independent candidates -...  ...Delivery Design and implement end-to-end data pipelines using PySpark, Snowflake, and AWS cloud services Architect scalable ELT/ETL... 
    Remote work

    VBeyond

    New York, NY
    3 days ago
  •  ...dots - across properties, people, businesses, documents, market data - into a unified system that powers our financial and technology...  ...and data quality tests ~2+ years of experience with Databricks pyspark a strong plus, familiarity with data products using AI/ML also a... 
    Live in
    Work at office
    Local area
    Work from home

    Withco, Inc

    New York, NY
    2 days ago
  •  ...Mandatory Skills Azure Data Bricks Azure Data Lake Python Pyspark Desired Skill: Bloomberg data acquisition and transformation Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Lake. Integrate data from various sources into the... 

    TechDigital Group

    New York, NY
    1 day ago
  •  ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial...  ...Python and associated libraries for data engineering (pandas, PySpark, etc.). Hands-on experience with Databricks and Spark for... 
    Full time
    Work at office
    Remote work

    Urban SDK

    New York, NY
    4 days ago
  •  ...resumes for the following position: Senior Data Engineer Job Overview Design, build and...  ...University in computer science, computer/software engineering or other relevant programs...  ...methodologies. Fluency with SQL, Python, and Spark/PySpark is required. Experience with Airflow... 

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    1 day ago
  •  ...About The Role The data engineer role is changing. The traditional pattern - build a pipeline...  ..., production‑grade code. Think like a software engineer building a product, not a script...  ...Strong Python and SQL; experience with PySpark and distributed data processing. Python... 
    Immediate start

    Perform

    New York, NY
    1 day ago
  • $160k - $220k

     ...solvers to help us create it. Who you are As a Senior Data Engineer at Metropolis, you will play a key role in shaping data products...  ...required, these are a plus: Experience with Spark and PySpark Master's degree in Computer Science, Computer Engineering,... 
    Temporary work
    Work at office
    Local area
    Afternoon shift

    Metropolis Corp

    New York, NY
    3 days ago
  •  ...Senior Data Engineer – AWS Glue & Snowflake Location: Midtown Manhattan, NY Duration: 6+ Months Contract Apply here – Required Skills 5+...  ...years of hands-on AWS Glue development Strong experience with PySpark, Python, SQL, Snowflake, and Amazon S3 Experience building scalable... 
    Contract work

    Sandeep Kanchi

    New York, NY
    18 hours ago
  • $130k - $160k

     ...bringing passion and customer focus to the business. Senior Data Ops Engineer (Azure Databricks) Fractal is a strategic AI partner to Fortune...  ...and manage end-to-end data pipelines using Azure Databricks (PySpark, SQL) Implement workflow orchestration (Airflow / ADF /... 
    Hourly pay
    Full time
    Local area

    Fractal, Inc.

    New York, NY
    1 day ago
  • $150k - $170k

     ...track record in handling complex data pipelines for high transaction...  ...systems. The Senior Data Engineer provides support to the Application...  ...deployment, using Databricks, PySpark, and Airflow, out-of-the-box...  .... 1+ year of experience in Java and Linux scripting is essential... 
    Work experience placement
    H1b
    Work at office
    Local area

    Karsun Solutions

    New York, NY
    8 days ago
  •  ...Databricks Data Engineer New York, New York, United States About The Job Our client provides data-driven, action-oriented solutions...  ...~ Technologies Databricks, Delta Lake storage, Spark (PySpark, Spark SQL). Good to have - Airflow, Splunk, Kubernetes, Power... 

    Inizio Partners

    New York, NY
    18 hours ago
  • $145k - $165k

     ...global investing! About The Team We are looking for a Data Engineer who thrives on solving data problems, and enjoys working cross...  ...~ Proficiency in Python and SQL ~ Familiarity with Spark (PySpark and SparkSQL) and distributed data processing ~ Familiarity... 
    Full time
    Work at office
    Remote work
    Worldwide
    2 days per week
    3 days per week

    DriveWealth

    New York, NY
    1 day ago
  • $160.5k - $200k

    Role Description The Senior Big Data Engineer is responsible for designing,...  ...ETL Spark applications in PySpark and Scala, Flume. ~Spark architecture...  ...~Data Bricks. ~Managing software systems using Hadoop,...  ...techniques. ~Core Java, Linux, SQL, scripting languages... 
    Remote work

    Remotive

    New York, NY
    4 days ago
  •  ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI...  ...achieve their full potential with AI. Senior Data Engineer Are you an experienced Data...  ...complex queries, performance tuning), and PySpark/Apache Spark. Data Modeling: Expert knowledge... 
    H1b
    Local area

    North Eastern Services

    New York, NY
    18 hours ago
  •  ...Opportunity Strategio is seeking an experienced Senior Snowflake Data Engineer to join a high-impact enterprise data team supporting large-...  ...backend data services while leveraging Snowflake, Python, and PySpark to power modern data analytics platforms. You will play a... 

    Strategio Inc.

    New York, NY
    18 hours ago
  •  ...We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The...  ...data pipelines, migrating data from Hadoop to Snowflake using PySpark, and developing enterprise ETL solutions. Roles and Responsibilities... 

    Veriipro

    New York, NY
    1 day ago
  •  ...in New York City, Take‑Two Interactive Software, Inc. is a leading developer, publisher...  ...a motivated and quality focused Senior Data Engineer to join our Data Engineering team to design...  ...The ideal candidate is a strong Python/PySpark developer equally comfortable with... 
    Work at office
    Flexible hours

    Take-Two

    New York, NY
    4 days ago
  •  ...over 100 million households. They are currently expanding their Data Engineering team based in New York City, NY. This role is hybrid, on‑site...  ...efficient, maintainable code in Python, Scala, or Spark / PySpark. Develop and optimize ETL processes using AWS services and SQL... 

    The Cypress Group

    New York, NY
    4 days ago
  •  ...SG Analytics a Straive company is a leading data, analytics, and AI services firm delivering end-to-end consulting...  ...Role We are looking for an experienced Senior Data Engineer with deep expertise in Databricks, PySpark, and AWS. The ideal candidate will have a strong... 
    Work experience placement

    Straive

    New York, NY
    2 days ago
  •  ...with an Agile team to build data pipelines and models Drive data...  ...new tools for analytics data engineering Develop and deliver plans on...  ...equivalent experience 4+ years of software development and design...  ..., Delta Lake, Synapse, ADLS, PySpark, SQL Server, Databricks Notebooks... 

    Jobtailor

    New York, NY
    18 hours ago
  • $112.29k - $161.28k

     ...Director, Data Engineering PHM is the leading health media agency in the US, built for the modern healthcare experience. Here, industry...  ...Snowflake, Databricks Languages: SQL, Python, Spark (PySpark), Java ETL / Integration: SSIS, APIs BI & Analytics:... 
    Temporary work
    Freelance
    Flexible hours

    Prodigious Worldwide

    New York, NY
    3 days ago
  • $160k - $180k

    Role Description As a Senior Analytics Engineer at Kard, you will be the go-to expert for turning data into impactful business intelligence tools and visualizations...  ...~Proficiency in Python, with a preference for PySpark experience. ~Exceptional communication skills... 
    Remote work
    Work from home
    Flexible hours

    Remotive

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer Java + Data (PySpark). Be the first to apply!