Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer

$90k - $120k

Public Partnerships

It's fun to work in a company where people truly BELIEVE in what they're doing!

We're committed to bringing passion and customer focus to the business.

Public Partnerships LLC supports individuals with disabilities or chronic illnesses and aging adults, to remain in their homes and communities and "self" direct their own long-term home care. Our role as the nation's largest and most experienced Financial Management Service provider is to assist those eligible Medicaid recipients to choose and pay for their own support workers and services within their state-approved personalized budget. We are appointed by states and managed healthcare organizations to better serve more of their residents and members requiring long-term care and ensure the efficient use of taxpayer funded services.


Our culture attracts and rewards people who are results-oriented and strive to exceed customer expectations. We desire motivated candidates who are excited to join our fast-paced, entrepreneurial environment, and who want to make a difference in helping transform the lives of the consumers we serve. (learn more at

Position Title:

Data Engineer

Reports to:

Manager, Data Analytics

Job Summary

We are seeking an experienced Azure Data Engineer to design, build, and optimize scalable data pipelines and lake house architectures within the Azure ecosystem. This role is responsible for developing end-to-end data ingestion, transformation, and governance frameworks using Azure Data Factory, Databricks, and ADLS Gen2 to support enterprise analytics and reporting needs.

The ideal candidate will have hands-on experience managing batch and near real-time data ingestion from diverse structured and unstructured sources, implementing Spark-based transformation processes across Bronze, Silver, and Gold data layers, and establishing robust data quality, security, and monitoring frameworks. This position also requires expertise in data governance, automation, and cost optimization to ensure high-performing, secure, and reliable data platforms aligned with organizational SLAs..

Key Responsibilities

Azure Data Engineering & Lakehouse Architecture

• Design and manage scalable data ingestion pipelines using Azure Data Factory and Azure Service Bus for batch and near real-time processing

• Implement Bronze, Silver, and Gold data layer transformations using Databricks (PySpark, SparkSQL) within a lakehouse architecture

• Integrate structured, semi-structured, and unstructured data sources using formats such as Parquet, Avro, and JSON into ADLS Gen2

Data Governance, Security & Quality Management
  • Establish data quality frameworks and validation processes using Databricks and Azure Data Factory
  • Configure RBAC and ACL-based access controls to secure sensitive datasets and ensure compliance
  • Manage credential security with Azure Key Vault and enforce governance standards across data platforms.
Automation, Monitoring & Cloud Optimization
  • Automate pipeline orchestration using Databricks Workflows and CI/CD tools such as Azure DevOps, GitHub Actions, and Terraform
  • Monitor pipeline health and performance using Azure Monitor, logging, and alerting to meet SLA requirements
  • Optimize ADLS storage performance and manage cloud costs using Azure Cost Management best practices

All other duties assigned

Required Skills:

• Azure Data Factory for ETL/ELT operations.

• Build and support self-service BI solutions using Azure Databricks and the Lakehouse architecture

• Develop data pipelines and transformations using PySpark and Spark SQL

• Enable analytics using Databricks AI/BI features and Genie for business users

• Apply ML techniques for data insights, predictions, and feature engineering

• Collaborate with analytics and business teams to deliver scalable, governed BI and ML solutions

• Databricks (PySpark, SparkSQL) for data transformations.

• Azure Data Lake Storage (ADLS Gen2).

• SQL Server, PostgreSQL, Cosmos DB, CRM, and ERP systems.

• Data Governance, RBAC, and ACLs for managing permissions.

• CI/CD tools: Azure DevOps, GitHub Actions, Terraform.

• Azure Monitoring, Alerting, and Logging tools.

Qualifications:

Education:

Bachelor's degree in Computer Science, Information Systems, Data Science, or a related field (Master's preferred).

Minimum 4-5 years experience

Substantial professional experience in a related field may be considered in lieu of formal degree.

Preferred Attributes:

Must have AI/ML Skill

Working Conditions:


Remote work.

Compensation Range: $90,000-$120,000

The above is intended to describe the general contents and requirements of work being performed by people assigned to this classification. It is not intended to be construed as an exhaustive statement of all duties, responsibilities, or skills of personnel so classified

PPL is an Equal Opportunity Employer dedicated to celebrating diversity and intentionally creating a culture of inclusion. We believe that we work best when our employees feel empowered and accepted, and that starts by honoring each of our unique life experiences. At PPL, all aspects of employment regarding recruitment, hiring, training, promotion, compensation, benefits, transfers, layoffs, return from layoff, company-sponsored training, education, and social and recreational programs are based on merit, business needs, job requirements, and individual qualifications. We do not discriminate on the basis of race, color, religion or belief, national, social, or ethnic origin, sex, gender identity and/or expression, age, physical, mental, or sensory disability, sexual orientation, marital, civil union, or domestic partnership status, past or present military service, citizenship status, family medical history or genetic information, family or parental status, or any other status protected under federal, state, or local law. PPL will not tolerate discrimination or harassment based on any of these characteristics.

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
  • $170k - $210k

     ..., and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You will... 
    Suggested
    Remote work
    Work visa
    Shift work

    Mark43

    New York, NY
    13 days ago
  • TBD Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information,...
    Suggested

    Gen Digital Inc

    New York, NY
    4 days ago
  •  ...About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions:2 Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office per week) Experience: 10+ years specifically Key Skills: Snowflake, SQL, Python, Spark, AWS-... 
    Suggested
    Work experience placement
    Work at office
    3 days per week

    Inizio Partners

    Jersey City, NJ
    3 days ago
  • $175k - $255k

     ...deserve, we'd love to meet you. About the Role The Revenue Engine team at Charlie Health services all parts of our business...  ...externally sourced datasets, and building user-facing products. As a data engineer on the Revenue Engine team, you will be responsible for... 
    Suggested
    Full time
    Work at office
    Local area

    Charlie Health Outreach

    New York, NY
    1 day ago
  •  ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions in modern cloud environments. This role requires full lifecycle ownership across Snowflake pipelines, data modeling, and... 
    Suggested

    TheStaffed

    New York, NY
    1 day ago
  • $220k - $300k

     ...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines... 
    Local area
    Remote work
    Flexible hours

    Bayview Asset Management

    New York, NY
    2 days ago
  •  ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location... 
    Remote work

    VBeyond

    Jersey City, NJ
    3 days ago
  •  ...Role: Lead Data Engineer Location: New York Mode of Work: Onsite 60/hour. Responsibilities - Lead the design and implementation of a robust, scalable, and reusable data ingestion framework using Microsoft Fabric - Building a... 

    Maintec Technologies

    New York, NY
    23 hours ago
  • Job Description: Must Have : DBT Core , Snowflake and Python, AWS Airflow , Container services(Docker) , Terraform Good to Have : BI tooling experience(Power BI or Tableau), understanding of Agile processes( Kanban or Jira) . We need strong person as this...

    ECHO IT SOLUTIONS INC .

    New York, NY
    6 days ago
  •  ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business...  ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science... 

    MetLife

    New York, NY
    23 hours ago
  • $160k - $220k

     ...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we... 
    Full time
    Worldwide
    Relocation
    Flexible hours
    Shift work
    Night shift
    Day shift

    Deliberate AI

    New York, NY
    1 day ago
  • $220k - $230k

     ...Who We Are: Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress...  ...Teams. Who You Are: You're a senior, hands-on data engineer with 8+ years of experience designing, building, and operating production... 
    Local area
    Flexible hours

    Galaxy USA

    New York, NY
    4 days ago
  •  ...Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ | Onsite Employment Type: Full-Time NOTE - Must have taken care of team size of Minimum of 10 or more people and sole contributer required... 
    Full time

    Centraprise

    Jersey City, NJ
    1 day ago
  •  ...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical... 

    TMX Group

    New York, NY
    23 hours ago
  •  ...We’re hiring a hands-on Data Engineer to build scalable data platforms across key corporate functions including Finance, Compliance, Facilities, RESO, and HCG. This is a longterm contract role, onsite in Manhattan. What You’ll Do Design and optimize data pipelines... 
    Contract work

    GQR

    New York, NY
    3 hours ago
  • $130k - $225k

     ...place to sharpen your craft alongside people who take their work seriously, you'll fit right in. About The Role As a Data & Backend Engineer building our Data Platform, you'll design and build our data infrastructure from the ground up: ingestion pipelines that span... 
    Flexible hours

    SafeLease Insurance Services LLC

    New York, NY
    4 days ago
  •  ...Snowflake Data Engineer At least 8-10 years of hands-on experience in Snowflake & related data platforms. Working knowledge of Python, especially for automation and data orchestration use cases. Experience with SAML and SCIM integrations for identity and access management... 

    Diversity Nexus

    New York, NY
    1 day ago
  •  ...Data Engineer Primary Location : New York City, New York V-Soft Consulting is currently hiring for a Data Engineer for our premier client in New York City, New York. Education and Experience " B.S. or B.A in Computer Science or related field... 
    Currently hiring
    Local area

    V-Soft Consulting Group

    New York, NY
    3 days ago
  • $73.15k - $95k

     ...We also have specialist offerings, including content, commerce, multicultural and future-proofed data capabilities. Job Description We are looking for a AI Engineer to lead the design, development, and deployment of AI-powered systems across the organization.... 
    Temporary work
    Freelance
    Flexible hours

    Starcom Mediavest Group Germany Gmbh

    New York, NY
    1 day ago
  • $66.23 - $70.23 per hour

     ...Genesis10 is currently seeking a Data Engineer for a hybrid position with a Global Financial Institution located in Jersey City, NJ. This is a 12 month contract opportunity. This role involves building systems to gather, store, and process large volumes of data for analysis... 
    Hourly pay
    Permanent employment
    Contract work
    Remote work

    Genesis10

    Jersey City, NJ
    a month ago
  • $150k - $200k

     ...Data Engineer Location: New York Metro (Hybrid) Pay: $150k - $200k base + bonus About the Role & Company This is an opportunity to join a highly technical, growth-focused investment organisation operating at the intersection of technology, data, and capital... 

    Harnham

    New York, NY
    4 days ago
  •  ...Data Engineer Duration: Long Term Contract Location: Jersey City, NJ Client: Mphasis/ Banking Job Responsibilities Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional... 
    Long term contract

    RAPS CONSULTING INC

    Jersey City, NJ
    1 day ago
  • $100k - $131k

     ...Intelligence for Imagination for more information about Fractal Job Overview Design, develop, enhance, and maintain scalable data pipelines across heterogeneous datasets in enterprise-scale data warehousing projects using GCP technologies such as BigQuery, Cloud... 
    Hourly pay
    Full time
    Local area

    Fractal, Inc.

    New York, NY
    2 days ago
  •  ...Job Title- Data Engineer Location- New York, NY 10112 Reporting Type- Onsite Duration: 10 months Summary This role involves building and delivering advanced data science and AI/ML solutions in an agile environment, with a focus on... 

    campus4tech

    New York, NY
    2 days ago
  •  ...Job description below and if you are interested , please forward your updated resume to ****@*****.*** Job Title: Data Engineer Location: Remote Duration: 6 to 12 Months Contract Client: Deloitte Required Skills Must... 
    Contract work
    Remote work

    Navtech

    Jersey City, NJ
    1 day ago
  • $200k - $300k

     ...to uncover insights about companies, industries, and the broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You'll work alongside a talented team with diverse skills, backgrounds, and perspectives... 
    Work experience placement

    Point72

    New York, NY
    1 day ago
  • $80k - $100k

     ...Data Engineer New York, US Who We Are Verve has created a more efficient and privacy-focused way to buy and monetize advertising. Verve is an ecosystem of demand and supply technologies fusing data, media, and technology together to deliver results and growth... 
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work
    3 days per week

    Jun Group | Verve

    New York, NY
    1 day ago
  • $195k - $230k

     ...by Forbes. Check out the latest Whatnot updates on our news and engineering blogs and join us as we enable anyone to turn their passion...  ...bring people together through commerce. Role At Whatnot data engineers build foundational data systems that power product development... 
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Home office

    Whatnot

    New York, NY
    2 days ago
  •  ...Data Engineer Princeton, NJ/New York, NY About Us Edgestream Partners is a team of scientists, engineers, and investment professionals dedicated to developing quantitative models of financial markets and deploying them in systematic trading strategies continuously... 
    H1b
    Visa sponsorship

    Edgestream

    New York, NY
    1 day ago
  • $150k - $200k

     ...fundamental understanding of individual assets with a quantitative, data-driven process. We build proprietary technology and develop...  ...Bachelor's in a technology related field (e.g. Engineering, Computer Science, etc.) Strong skills programming in Python... 
    Summer work

    Benton Partners

    New York, NY
    23 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!