Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

ETL Data Platform Developer

Machine Intelligence Technologies, LLC

Key Responsibilities Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse ,warehouse, sql) and Azure Data Factory. Build and maintain a metadata driven Lakehouse architecture with threaded datasets to support multiple consumption patterns. Develop agent specific data lakes and an orchestration layer for an uber agent that can query across agents to answer customer questions. Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics and AI tools. Ensure data quality, lineage, and governance across all ingestion and transformation processes. Collaborate with product teams to understand data needs and deliver scalable solutions. Optimize performance and cost across storage and compute layers. Required Qualifications 7+ years of experience in data engineering with a focus on Microsoft Azure Data stack and Fabric technologies. Strong expertise in: Executive written and oral communication Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks) Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2 Power BI and/or other visualization tools SQL, Python and PySpark/ Scala Experience working with structured and semi structured data (JSON, XML, CSV, Parquet). Proven ability to build metadata driven architectures and reusable components. Familiarity with agent based architectures and conversational AI integration is a plus. Strong understanding of data modeling, data governance, and security best practices. MACHINE INTELLIGENCE TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. MACHINE INTELLIGENCE TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will MACHINE INTELLIGENCE TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract #J-18808-Ljbffr

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the ETL Data Platform Developer in Brooklyn, NY vacancy
  • American Tire Distributors seeks a Senior Data Engineer to identify trends, manage master data, and automate data management across multiple domains. You will design data pipelines to ETL data into data warehouses or data lakes and implement data models that support critical... 
    Suggested
    Remote job

    American Tire Distributors Inc.

    Brooklyn, NY
    2 days ago
  • CoStar Group in Atlanta is seeking a Data Migration Specialist to design, map, and load data...  ...into the CoStar Real Estate Manager platform. You will validate data conversions and troubleshoot...  ...data needs, providing training on the ETL product, and managing multiple tasks to... 
    Suggested

    Relha LLC

    Brooklyn, NY
    5 days ago
  • Capgemini is seeking a Junior Data Migration Engineer to join our Westlake TX team. The role focuses on building and maintaining ETL/ELT pipelines, performing data extraction, transformation, and loading tasks, and supporting validation under guidance from senior engineers... 
    Suggested

    Capgemini

    Brooklyn, NY
    1 day ago
  • Zenith, part of Publicis Groupe, is seeking a Data Engineer to design, build, and maintain scalable ETL/ELT pipelines. You will transform large datasets using cloud-native technologies (AWS, Databricks) and develop relational data models to support reporting and analytics... 
    Suggested

    Publicis Groupe

    Brooklyn, NY
    4 days ago
  • Data Engineering (Python + SQL with ETL) Location: Duration: 12Months+ Extension Hourly Rate: Depending on Experience (DOE) Work Authorization: Good hands...  ...using Python and SQL. Expert in writing complex SQLs Develop reusable scripts for data extraction from various... 
    Suggested
    Hourly pay
    Permanent employment
    Contract work
    Local area

    Machine Intelligence Technologies, LLC

    Brooklyn, NY
    4 days ago
  • RevSpring is seeking a Senior Software Engineer to design and implement data pipelines in Python, DBT, and ETL processes. You will collaborate with product managers, data engineers, and business leaders to translate requirements into scalable data solutions that handle... 

    RXinsider LTD.

    Brooklyn, NY
    4 days ago
  • Hamilton Lane is seeking an ETL Data Engineer to design, develop, and maintain scalable data pipelines using Python, PySpark, and Snowflake. You will...  ...and reporting. The role emphasizes cloud data platforms, data modeling, and performance optimization, with strong... 

    Hamilton Lane

    Brooklyn, NY
    2 days ago
  • Compunnel, Inc. is seeking a Senior AWS Big Data Engineer for the United States market....  ...role demands 12+ years in data engineering, ETL development, data analysis, and technical...  ...to build and maintain scalable data platforms. You will design, implement and optimize... 

    Compunnel, Inc.

    Brooklyn, NY
    3 days ago
  • Integrated Data Services (IDS) is seeking a Data Engineer to support Navy acquisition transformation by building scalable pipelines, APIs, and data products. You will work hands-on with production ETL/ELT pipelines, data models, and REST API integrations in an IL-4/5 environment... 
    Remote work

    Integrated Data Service Inc

    Brooklyn, NY
    4 days ago
  •  ...in the United States. You will collaborate with senior developers, offshore teams, and business stakeholders to deliver...  ...years in software engineering, 2+ years of healthcare data experience, strong SQL/Oracle, ETL, and OOAD skills, plus Java or .NET experience and excellent... 
    Remote job

    Cotiviti

    Brooklyn, NY
    3 days ago
  • $56.19k - $87.56k

     ...Hybrid) About The Role We are seeking a Data Engineer with experience in ETL development, data processing, and...  ...to support modernization efforts. Develop and maintain ETL pipelines using Python...  ...with large-scale enterprise data platform Life At Capgemini Flexible work Healthcare... 
    Full time
    Local area
    Flexible hours

    Capgemini

    Brooklyn, NY
    1 day ago
  • Curant Health in Smyrna, GA is seeking a Data Engineer II to design, build, and support scalable data solutions across the organization. You will focus on ETL/ELT pipelines, data integrations, and data processing frameworks to meet operational, clinical, and BI needs. The... 

    Curant Health

    Brooklyn, NY
    4 days ago
  • Harrison Street seeks an experienced Data Engineer to design, build, and maintain data pipelines, data platforms, and analytics infrastructure. You will transform data for...  ...and data scientists, implement scalable ETL, and ensure data quality and security across the... 

    Harrison Street

    Brooklyn, NY
    2 days ago
  • Zenith, part of Publicis Groupe, is seeking a Data Engineer to design and maintain scalable ETL/ELT pipelines. You will assemble and transform large datasets...  ...and ensure performance and reliability of the data platform. Collaboration with the data engineering team and... 

    Publicis Groupe ANZ

    Brooklyn, NY
    4 days ago
  • Guidehouse is hiring a Senior Data Engineer to design, build, and operate Azure Lakehouse architectures using Azure Databricks,...  ...analytical and operational workloads in a federal context. You will develop scalable ETL/ELT pipelines with Spark, Delta Lake, Python, SQL, and Scala;... 

    JobCubby

    Brooklyn, NY
    2 days ago
  • $100k - $120k

    A leading technology company is seeking a Sr. Azure Data Engineer in Union City, New Jersey. The ideal candidate will have over 10 years of experience in data warehousing and ETL development, with strong skills in Informatica PowerCenter, Azure Data Factory, and SQL solutions... 
    Remote work
    Flexible hours

    Cognizant

    Union City, NJ
    5 days ago
  • System One is seeking an AWS Data Engineer for a remote contract-to-hire position. The role focuses on building and operating AWS-native data lakehouse pipelines, leveraging PySpark and Python to deliver analytics-ready datasets. Candidates should have 6+ years of data... 
    Remote job
    Contract work

    System One

    Brooklyn, NY
    4 days ago
  •  ...Chase within the Corporate Sector - AIML Data Platforms and Machine Learning Center of...  ...objectives.Job responsibilitiesDesigns, develops and maintains production grade softwareEngineers...  ...Firehose for large-scale data ingestion and ETL with AWS Glue.Developing and automating... 

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  •  ...Commercial & Investment Banking - Data Analytics - Payments...  ...maintains scalable data pipelines and ETL/ELT workflows for batch and...  ...Kafka, and FlinkDevelops data platform components including data cataloging...  ...-on familiarity with Internal Developer Portals such as Backstage —... 

    JP Morgan Chase

    Jersey City, NJ
    6 hours ago
  •  ...Commercial & Investment Banking - Data Analytics - Payments...  ...maintains scalable data pipelines and ETL/ELT workflows for batch and...  ...Kafka, and FlinkDevelops data platform components including data cataloging...  ..., and SecurityExperience developing Agentic AI, LLMs, RAG architectures... 

    JP Morgan Chase

    Jersey City, NJ
    4 days ago
  •  ...testing, reviews, and production issue resolution while documenting technical decisions and maintaining code artifacts. You will work with Python, Spark, and AWS on data/analytics projects and may relocate or travel for assignments as needed. #J-18808-Ljbffr Infosys Limited
    Relocation

    Infosys Limited

    Brooklyn, NY
    1 day ago
  • $142.32k - $213.48k

     ...architecture and ensuring our platforms provide a first-class customer...  ...and progress together.The Sr Data Engineer, AVP is an intermediate...  ...judgementRecommend and develop security measures in post implementation...  ...SkillsData Warehouse/ETL design and development methodologies... 
    Full time

    Citigroup

    Jersey City, NJ
    1 day ago
  •  ...This collaborative team brings together data developers, business analysts, and data analysts to...  ...transformation logic. Design and maintain ETL pipelines using Python, Azure Data...  ...Data Factory or another enterprise ETL platform. ~ Knowledge of data warehousing concepts... 

    Axiom Path

    Jersey City, NJ
    13 days ago
  • Databricks is seeking a Senior Software Engineer for the Data Platform team to help build the Data Intelligence Platform that automates...  ...at scale across multiple clouds and geographies. You will develop tooling, ETL frameworks, telemetry APIs, and governance components,... 

    Uncover

    Brooklyn, NY
    5 days ago
  •  ...are passionate about enabling data teams to solve the world's toughest...  ...data and AI infrastructure platform, so our customers can focus on...  ...on our platform. We develop and operate one of the largest...  ...code tooling. Design the base ETL framework used by all pipelines... 
    Worldwide

    Uncover

    Brooklyn, NY
    5 days ago
  • Harnham is seeking a Senior Data Engineer to lead the design and implementation of a modern data platform from the ground up in a healthcare-focused organization. You will...  ...reporting. Responsibilities include building scalable ETL/ELT pipelines, optimizing cloud data storage,... 

    Harnham

    Brooklyn, NY
    4 days ago
  • Sayari is seeking a Data Engineer to power a world model by building scalable ETL pipelines and graph-based data orchestration. You will join an autonomous team that delivers high-visibility data products and collaborates across AI/ML and product functions. Ideal candidates... 
    Work at office

    JobCubby

    Brooklyn, NY
    3 days ago
  • $61k - $101k

     ...professional experience in software engineering or data platform development. We need advanced...  ...and security. We require experience developing Agentic AI, LLMs, RAG architectures, MCP...  ...maintain scalable data pipelines and ETL/ELT workflows for both batch and real-time... 
    Full time

    J.P. Morgan

    Jersey City, NJ
    4 days ago
  • LucyRx is seeking a Senior Data Engineer to design and optimize large-scale data architectures and data pipelines. You will mentor junior...  ...strong SQL and Python skills, and deep knowledge of data warehousing concepts, ETL tools, and data governance. #J-18808-Ljbffr LucyRx
    Remote work

    LucyRx

    Brooklyn, NY
    4 days ago
  •  ...the Commercial & Investment Banking – Data Analytics – Payments Technology team, you...  ...maintains scalable data pipelines and ETL/ELT workflows for batch and real-time processing...  ...Spark, Airflow, Kafka, and Flink Develops data platform components including data cataloging,... 

    JPMorgan Chase & Co.

    Jersey City, NJ
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to ETL Data Platform Developer. Be the first to apply!