Data Engineer
$90k - $120kPublic Partnerships
It's fun to work in a company where people truly BELIEVE in what they're doing!
We're committed to bringing passion and customer focus to the business. Public Partnerships LLC supports individuals with disabilities or chronic illnesses and aging adults, to remain in their homes and communities and "self" direct their own long-term home care. Our role as the nation's largest and most experienced Financial Management Service provider is to assist those eligible Medicaid recipients to choose and pay for their own support workers and services within their state-approved personalized budget. We are appointed by states and managed healthcare organizations to better serve more of their residents and members requiring long-term care and ensure the efficient use of taxpayer funded services.Our culture attracts and rewards people who are results-oriented and strive to exceed customer expectations. We desire motivated candidates who are excited to join our fast-paced, entrepreneurial environment, and who want to make a difference in helping transform the lives of the consumers we serve. (learn more at Position Title: Data Engineer Reports to: Manager, Data Analytics Job Summary We are seeking an experienced Azure Data Engineer to design, build, and optimize scalable data pipelines and lake house architectures within the Azure ecosystem. This role is responsible for developing end-to-end data ingestion, transformation, and governance frameworks using Azure Data Factory, Databricks, and ADLS Gen2 to support enterprise analytics and reporting needs. The ideal candidate will have hands-on experience managing batch and near real-time data ingestion from diverse structured and unstructured sources, implementing Spark-based transformation processes across Bronze, Silver, and Gold data layers, and establishing robust data quality, security, and monitoring frameworks. This position also requires expertise in data governance, automation, and cost optimization to ensure high-performing, secure, and reliable data platforms aligned with organizational SLAs.. Key Responsibilities Azure Data Engineering & Lakehouse Architecture • Design and manage scalable data ingestion pipelines using Azure Data Factory and Azure Service Bus for batch and near real-time processing • Implement Bronze, Silver, and Gold data layer transformations using Databricks (PySpark, SparkSQL) within a lakehouse architecture • Integrate structured, semi-structured, and unstructured data sources using formats such as Parquet, Avro, and JSON into ADLS Gen2 Data Governance, Security & Quality Management
- Establish data quality frameworks and validation processes using Databricks and Azure Data Factory
- Configure RBAC and ACL-based access controls to secure sensitive datasets and ensure compliance
- Manage credential security with Azure Key Vault and enforce governance standards across data platforms.
- Automate pipeline orchestration using Databricks Workflows and CI/CD tools such as Azure DevOps, GitHub Actions, and Terraform
- Monitor pipeline health and performance using Azure Monitor, logging, and alerting to meet SLA requirements
- Optimize ADLS storage performance and manage cloud costs using Azure Cost Management best practices
Remote work. Compensation Range: $90,000-$120,000 The above is intended to describe the general contents and requirements of work being performed by people assigned to this classification. It is not intended to be construed as an exhaustive statement of all duties, responsibilities, or skills of personnel so classified PPL is an Equal Opportunity Employer dedicated to celebrating diversity and intentionally creating a culture of inclusion. We believe that we work best when our employees feel empowered and accepted, and that starts by honoring each of our unique life experiences. At PPL, all aspects of employment regarding recruitment, hiring, training, promotion, compensation, benefits, transfers, layoffs, return from layoff, company-sponsored training, education, and social and recreational programs are based on merit, business needs, job requirements, and individual qualifications. We do not discriminate on the basis of race, color, religion or belief, national, social, or ethnic origin, sex, gender identity and/or expression, age, physical, mental, or sensory disability, sexual orientation, marital, civil union, or domestic partnership status, past or present military service, citizenship status, family medical history or genetic information, family or parental status, or any other status protected under federal, state, or local law. PPL will not tolerate discrimination or harassment based on any of these characteristics. If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in New York, NY vacancy
$170k - $210k
..., and we are therefore committed to embracing diversity of thought and experience within our team. We are looking for a Lead Data Engineer to join our team. This is a high-impact, strategic role focused equally on technical leadership and hands-on execution. You will...SuggestedRemote workWork visaShift work$175k - $255k
...deserve, we'd love to meet you. About the Role The Revenue Engine team at Charlie Health services all parts of our business... ...externally sourced datasets, and building user-facing products. As a data engineer on the Revenue Engine team, you will be responsible for...SuggestedFull timeWork at officeLocal area- ...Lead Snowflake Data Engineer Our client is seeking a Lead Snowflake Data Engineer to design, own, and deliver end-to-end data engineering solutions in modern cloud environments. This role requires full lifecycle ownership across Snowflake pipelines, data modeling, and...Suggested
$220k - $300k
...Overview The Lead Data Engineer on the Nebula team plays a significant technical leadership role in shaping and scaling the data foundation that powers analytics, reporting, AI development, and operational decision-making across the organization. This role combines...SuggestedLocal areaRemote workFlexible hours- TBD Gen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information,...Suggested
- ...About the job Lead Data Engineer Job Title: Lead Data Engineer No of Positions:2 Location: Jersey City/ Bedford, NJ (Hybrid) (3 days from office per week) Experience: 10+ years specifically Key Skills: Snowflake, SQL, Python, Spark, AWS-...Work experience placementWork at office3 days per week
- ...Hi, Position: Lead Data Engineer Experience Required: 12 years+ Location: Jersey City, NJ | Onsite Employment Type: Full-Time NOTE - Must have taken care of team size of Minimum of 10 or more people and sole contributer required...Full time
$220k - $230k
...Who We Are: Galaxy is a global leader in digital assets and data center infrastructure, delivering solutions that accelerate progress... ...Teams. Who You Are: You're a senior, hands-on data engineer with 8+ years of experience designing, building, and operating production...Local areaFlexible hours- ...the vision and achieving the goals of our three core lines of business: Indexing, Digital Distribution, and Data & Analytics. Made up of developers, data engineers, designers, and project managers, the platform team is the engine that drives forward the technical...
- ...Lead Data Engineer - Palantir & PySpark (Lead Data engineer role where experience should be on both hands on and leading the team.) Candidate preference : Should be in the United States and from East coast. Experience : 8-15 Years Location...Remote work
- ...Role: Lead Data Engineer Location: New York Mode of Work: Onsite 60/hour. Responsibilities - Lead the design and implementation of a robust, scalable, and reusable data ingestion framework using Microsoft Fabric - Building a...
- ...Proposition: The position sits within the newly consolidated Data and Analytics (D&A) organization supporting the U.S. Business... ...data science, from data infrastructure, data governance, data engineering, data modeling, data analysis to business intelligence, data science...
$160k - $220k
...Lead Data Engineer Deliberate AI | Hybrid (NYC or Boston) | Full-Time About Deliberate AI: We're a venture-backed company at the frontier of precision mental health. In partnerships with some of the world's top ranked medical schools and psychiatric hospitals, we...Full timeWorldwideRelocationFlexible hoursShift workNight shiftDay shift- Job Description: Must Have : DBT Core , Snowflake and Python, AWS Airflow , Container services(Docker) , Terraform Good to Have : BI tooling experience(Power BI or Tableau), understanding of Agile processes( Kanban or Jira) . We need strong person as this...
- ...We’re hiring a hands-on Data Engineer to build scalable data platforms across key corporate functions including Finance, Compliance, Facilities, RESO, and HCG. This is a longterm contract role, onsite in Manhattan. What You’ll Do Design and optimize data pipelines...Contract work
$100k - $125k
Blackstone is the world's largest alternative asset manager. We seek to create positive economic impact and long-term value for our investors, the companies we invest in, and the communities in which we work. We do this by using extraordinary people and flexible capital...Local areaFlexible hours$130k - $200k
...Data Engineer Shaped is an API for developers to seamlessly add personalized ranking and recommendation into their products. These frictionless discovery experiences help end-users find what they want faster, and, consequently, grow conversion and engagement business...Work at officeRemote work- ...About the Position We are looking for a Data Engineer to turn messy, real-world datasets into reliable inputs for research and trading. Jane Street depends on data from a wide variety of sources to understand markets and the global economy-think world news, decades...
- ...developing tomorrow's breakthrough treatments. Position Details: As part of the Center for Data Analytics, Innovation, and Rigor team, you will report to Rubric Engineering and Measurement Specialist. You will develop infrastructure to support large-scale AI...Full timeWork experience placementWork at officeLocal area
$140k - $160k
...inclusion, and diversity. We are seeking an experienced Java Developer with 5-7 years of hands-on expertise to join our engineering team. This role is ideal for someone who can take ownership of complex technical challenges, drive solutions end-to-end, and...Shift work- ...including BOND, IVP, Spark Capital, Greylock, and Conviction. Join us and help build the platform engineers turn to to ship AI products. THE ROLE We're hiring a Data Engineer to build and scale Baseten's internal data platform. This role sits at the...Flexible hours
- ...Duties and Responsibilities Data Infrastructure & Pipeline Engineering • Design, build, and operate scalable data pipelines across Salesforce, Snowflake, and external systems (ticketing, lottery, partners) • Leverage Fivetran and API-based ingestion frameworks...
- ...Data Engineer New York, New York, United States About the Job Required Qualifications: ~ Strong in Python with 3+ years hands-on coding experience ~3+ years experience in designing and building Microservices ~3+ years experience with REST API design...
- ...our unparalleled access to a wide range of publicly available data sources. About our Team: KEPL is a fast-growing team at... ...Requirements ~ Master/PhD degree in math, computer science, engineering, or other related fields. ~1-3 years of professional...
- ...people that stand behind them. To do that well, we need to connect the dots - across properties, people, businesses, documents, market data - into a unified system that powers our financial and technology products at scale. Your mission? Build the system that levels the...Live inWork at officeLocal areaWork from home
$65 - $70 per hour
...Position: Data Engineer- AWS Location: Jersey City, New Jersey Duration: Contract Job ID: 172543 Job Overview: As a Data Engineer III specializing in Python, Spark, and Data Lake technologies within the Consumer and Community Bank, you will be a key...Full timeContract work- ...Position Responsibilities Data Engineer Location : Jersey City, NJ / Columbus, OH ( 3 days onsite 2 days remote) look for nearby candidates (only w2 Required) Must Have Skills: Python/Spark/PySpark/AWS Job Description...Remote work
$130k - $400k
...Data Engineer Location: San Francisco or New York City Company Stage: Series C / Late-Stage (AI / Enterprise) Office Type: Onsite (5 Days a Week) Salary: $130,000 – $400,000 + Equity This high-growth AI company is building the infrastructure that powers how human...Work at officeRelocation package- ...Senior Or Staff Data Engineer We're hiring a Senior or Staff Data Engineer to build FLORA's data function from scratch. You'd be the first data hire, working directly with the CTO and Head of Product to define what data means here: how we capture it, store it, analyze...Flexible hours
- ...Primary. The team is headquartered in New York and brings deep expertise in finance and AI. About the Role You'll be the first Data Engineer at Tabs, building the core data infrastructure that powers our internal KPIs, customer insights, and our AI systems. Your...Full timeContract workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data engineer manager New York, NY
- data science developer New York, NY
- junior data developer New York, NY
- etl data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- junior big data engineer New York, NY



