Data Engineer - GenAI Platforms
VBeyond
We are looking for a Data Engineer with strong Generative AI exposure to design, build, and maintain scalable data pipelines and data platforms that power AI/ML and GenAI applications. The ideal candidate should have strong experience in modern data engineering tools along with hands-on Python development and API frameworks.
Key Responsibilities- Design, build, and maintain scalable data pipelines using modern data engineering tools.
- Develop and manage data transformation workflows using dbt and Dagster.
- Build robust data models and pipelines supporting analytics and AI workloads.
- Develop backend services and APIs using Python and FastAPI to enable data access for AI applications.
- Work with PostgreSQL and SQL to design efficient schemas and optimize queries.
- Process and analyze data using Pandas and Python-based data frameworks.
- Integrate structured and unstructured data pipelines to support Generative AI applications.
- Collaborate with AI/ML engineers to enable LLM-powered applications and data pipelines.
- Implement data quality, monitoring, and performance optimization practices.
- Participate in architecture design discussions and contribute to scalable data platform design.
- Strong programming experience in Python.
- Experience working with Dagster for orchestration.
- Hands-on experience with dbt for data transformation and modeling.
- Advanced SQL skills and experience with PostgreSQL.
- Experience working with Pandas for data processing.
- Experience building APIs using FastAPI.
- Solid understanding of data pipeline design and ETL/ELT processes.
- Familiarity with building data infrastructure for AI/ML or GenAI use cases.
- Experience designing Star Schema / Dimensional Data Models.
- Familiarity with Medallion Architecture (Bronze, Silver, Gold layers).
- Experience with Generative AI frameworks or LLM integrations.
- Knowledge of RAG pipelines, vector databases, or embedding workflows.
Exposure to cloud platforms such as AWS / GCP / Azure.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - GenAI Platforms in New York, NY vacancy
- ...Senior Data Engineer - Cloud & AI Platforms Location: US / Canada (Remote/Hybrid) Type: Contract / Full-Time Overview: We... ...pipelines (Python, PyTorch, MLOps) ~ Exposure to GenAI frameworks such as LangChain or agent-based systems...SuggestedFull timeContract workRemote work
Navitas Healthcare LLC
New York, NY2 days ago $124k - $135k
..., Mission or Department Overview The Data Platform Mission aims to empower the organization... ...organization. We are looking for Analytics Engineers that can help develop a new function... ...you submit your own work and not use GenAI tools to generate substantive content during...SuggestedWork at officeLocal areaFlexible hoursNew York Times
New York, NY5 days ago$50k - $105k
Brain Labs Digital LTD. is looking for a motivated Data Engineer in New York, New York with 2 to 5 years of experience to design and manage scalable data solutions on GCP. The ideal candidate will work closely with cross-functional teams to build and maintain data pipelines...SuggestedFull time- A biotech firm in New York is seeking a Senior Data Engineer to transform Real World Data into analytics-ready assets. This role involves modeling data, building scalable pipelines, and conducting analyses to inform scientific decisions. The ideal candidate has over 5 years...SuggestedWork at office3 days per week1 day per week
$122k - $200k
...responsible for defining and leading the engineering approach for complex features to... ...the cloud infrastructure layer for the GenAI platform across AWS, Azure, and GCP, enabling secure... ...Familiarity with: Vector databases, data pipelines, or retrieval-based architectures...SuggestedShift workDay shift- Perennial Resources International is looking for a skilled professional to expand its analytics portfolio mainly through Python development. Responsibilities include creating dashboards for senior leadership and integrating generative AI capabilities into existing tools...
- Anaplan Inc is looking for a Senior Data Engineer in Pennsylvania to drive the development of AI capabilities across their platform. This position involves working with advanced data engineering and machine learning techniques to enhance business planning applications....
$159.6k - $296.4k
...to make the world a better, more connected place. Your New Role … CNN is seeking a Sr. Staff Data Engineer to serve as the technical authority for CNN’s Data Platform — the foundation that powers analytics, data science, machine learning, and AI across CNN’s...Temporary workLocal areaWarner Bros. Discovery
New York, NY5 days ago- ...from how humans reason, and a new kind of collaborative organization that puts human values first. About the Role Data Engineers on the Platform team at Basis build trustworthy data pipelines with comprehensive provenance and quality gates, curate documented...Full timeWork at office
Basis Research
New York, NY2 days ago $176k - $179.5k
Technology & Digital Platform Data Engineer - US Defense Public Sector Job ID: 106488 Boston Chicago New York City San Francisco... ...capabilities that ingest data into a data system used by GenAI applications. Work includes but is not limited to creation of...Hourly payApprenticeshipWork at officeEasy workMcKinsey & Company
New York, NY2 days ago$110k - $130k
...Department Overview As a Software Engineer on the Experimentation &... .... You will work with Product, Data, and other engineering teams... ...products and systems to the data platform, powering data-informed... ...submit your own work and not use GenAI tools to generate substantive...Local areaFlexible hoursNew York Times
New York, NY4 days ago$200k - $250k
...Senior Data Engineer, Unified Platform Chicago, New York City DRW is a diversified trading firm with over 3 decades of experience bringing sophisticated technology and exceptional people together to operate in markets around the world. We value autonomy and the ability...Temporary workFlexible hoursDRW
New York, NY5 days ago- Provectus IT, Inc. is looking for a Senior Generalist Engineer to manage and enhance a sophisticated Healthcare AI platform already in production. The role involves backend development, data engineering, and operations in a remote-first, fully flexible work environment...Remote jobFlexible hours
- A leading fintech and e-commerce platform is seeking a Senior Data Engineer to design, build, and manage the data platform crucial for analytics and machine learning. The ideal candidate will have at least 5 years of experience in data engineering, proficiency in Python...
- A technology consulting firm in New York is seeking a Platform Engineer on GCP with extensive experience in Kubernetes and IRIS for Health. The ideal candidate will have 5-7 years of experience with IRIS for Health and 2-3 years in working with H7L/CCDA/FHIR conversion...
$90k - $115k
A leading pharmaceutical company in Secaucus, NJ, is seeking a Data Engineer to design high-performance data architectures and oversee data platforms. This role includes driving data governance and collaborating on Master Data Management frameworks. Ideal candidates will...Full time$120k - $140k
Spectrum 360 A NJ Non Profit Corp. is seeking a Senior Data Engineer to design and maintain cloud-native data pipelines and platforms. This role involves collaboration with cross-functional teams to ensure data quality and security, while also driving improvements in engineering...$176k - $210k
Komodo Health Inc is seeking a Senior Data Engineer based in San Francisco to develop and maintain AWS cloud infrastructure and enhance data quality. The ideal candidate will have a strong proficiency in Python and expert knowledge of AWS services, along with experience...$145k - $160k
A leading fitness company is seeking a Data Engineer to enhance its data platform and drive data practices. The ideal candidate will have over 6 years of experience in data engineering, strong skills in Python and SQL, along with hands-on knowledge of the AWS ecosystem...- A leading cloud consulting firm is seeking a Data Engineer to work remotely. You will be the trusted advisor for clients transitioning to Google Cloud, covering areas such as ETL, data warehousing, and streaming data systems. The ideal candidate has over 5 years of experience...Remote work
- January, located in New York, NY, is seeking a Senior Data Engineer to transform how data expands access to credit. The role involves ownership and optimization of the data platform, implementing self-healing data pipelines, and ensuring data accessibility for diverse teams...
$150k - $220k
Verantos is seeking a Senior Data Engineer to lead the design and evolution of our data platform architecture. This fully remote position emphasizes building robust data pipelines and mentoring other data engineers. The ideal candidate will possess 8+ years of data engineering...Remote job- A leading insurance and reinsurance company is seeking a Senior Data Engineer for the DBX Platform with a focus on machine learning and feature engineering. The role involves building scalable data pipelines and optimizing data workflows. Candidates should have strong...Flexible hours
- Synergy Interactive is seeking a seasoned Data Engineer to join their dynamic team in New York, NY. The ideal candidate will have extensive... ..., particularly in market and credit counterparty risk platforms, and a strong understanding of financial services. Responsibilities...
- LGBT Great in New York City is hiring a Senior Data Engineer to support private equity and private debt strategies through innovative data infrastructure. The role includes developing scalable ETL data pipelines, optimizing data for analytics, and ensuring data quality...Work at officeRemote work2 days per week
- Anchorage Digital is seeking a mid-senior level engineer for their Asset Data Team to develop advanced data import systems for crypto asset management... ..., contributing to a growing and dynamic digital asset platform. This fully remote position allows for collaboration...Remote job
- Tessera Labs is seeking a Senior Data Engineer to design and build scalable data solutions that harmonize data across ERP systems including Sage, Oracle, and NetSuite. The role emphasizes collaboration with ERP functional teams to translate business logic into effective...Remote job
- MAP SSG is seeking a Data Engineer to build the data infrastructure for business intelligence and operational analytics. In this role based in New York City, you will design data pipelines, integrate various healthcare data sources, and model complex domains to enable real...Work at office
- A data technology company in New York is looking for a Data Engineer to design and build batch and real-time data warehouses. The ideal candidate will have over 7... ...developing efficient ETL pipelines, maintaining data platforms, and working in a fast-paced fintech environment...
$200k - $250k
An innovative healthcare startup is seeking a highly driven Data Engineer to design and implement scalable data infrastructure. You will work closely with product and engineering teams, owning critical client integrations and ensuring data accuracy. Ideal candidates have...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - GenAI Platforms. Be the first to apply!
Related searches
- staff data engineer New York, NY
- data engineering intern summer New York, NY
- senior data integration developer New York, NY
- data engineer graduate New York, NY
- data engineer contract New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- software data engineer New York, NY
- hadoop big data developer New York, NY
- data developer New York, NY