Engenheiro de Dados Sênior: Pipelines, Spark & Lakehouse
Stefanini
Stefanini procura engenheiro(a) de dados para projetar, desenvolver e otimizar pipelines em ambientes de dados escaláveis. O profissional atuará com Databricks, Lakehouse e Data Warehouse, assegurando performance, governança e qualidade de dados. Você colaborará com Arquitetura, Segurança e Infraestrutura, apoiando estimativas técnicas e evolução das soluções em um ambiente corporativo global. #J-18808-Ljbffr Stefanini
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Engenheiro de Dados Sênior: Pipelines, Spark & Lakehouse in New York, NY vacancy
- A Solfácil procura Engenheira de Dados Sênior para liderar arquitetura de dados, pipelines distribuidos e infraestrutura AWS via IaC. Atua... ...escalável, com foco em Data Lake/Lakehouse na AWS, particionamento, tuning de jobs Spark e estratégias FinOps. #J-18808-Ljbffr...Pipeline
- Grupo Stefanini procura Engenheiro de Dados para sustentar, manter e evoluir pipelines de dados que suportam projetos de IA, atuando em ambientes de alta complexidade... ...: Python, SQL, Airflow, Azure Data Factory, Spark, Databricks, MongoDB, com foco em qualidade de dados...Pipeline
- DigAI está buscando um(a) Engenheiro(a) de Inteligência Artificial para compor o Banco de Talentos... ...de vida da IA, desde a análise de dados até a implantação em produção. A vaga oferece... ...científicas, além de experiência em pipelines completos e colaboração com equipes...Pipeline
- Estamos com oportunidade para Arquiteto de Dados / Cientista de Dados na empresa Revna. A... ...Principais conhecimentos técnicos: Apache Spark MinIO Apache Iceberg dbt Trino... ...processamento distribuído, engenharia de dados, pipelines de processamento, governança e visualiza...Pipeline
- aQuality Digital está buscando profissional para atuar na arquitetura de dados e pipelines para IA, garantindo disponibilidade de dados para cientistas e demais usuários. Você irá colaborar na prototipagem de modelos de IA Generativa para resolver problemas de negócio...PipelineRemote work
- ...Regazzo procura um Desenvolvedor Full Stack Sênior com foco em Python no backend e React no... ...em produtos digitais com arquitetura de microsserviços. O candidato ideal terá experi... ...Azure DevOps, incluindo Boards, Repos e Pipelines, além de práticas de qualidade e testes...Pipeline
- ...Experience in data engineering or data analysis and development of data-oriented solutions; experience with AI projects and automation of pipelines; knowledge of Python, SQL, Databricks, and PySpark; knowledge of CI/CD and versioning with GitHub; mastery of ETL/ELT processes;...PipelineRemote workFlexible hours
- ...client.Job DescriptionMinimum exp 5 years.Must have both (Scala/Spark) Required Experience:(1) Software development and design in... ...Unix/Linux, CentOS(5) Hands on experience in AWS: S3 / EMR / Data Pipeline / LambdaAdditional InformationAll your information will be kept...Pipeline
EROS Technologies
New York, NY3 days ago - ...parte del Banco del Futuro en Covalto! Impulsamos el crecimiento de las PyMEs en México con tecnología de vanguardia y soluciones... ...al cliente desde el primer contacto, integración de expediente, pipeline y seguimiento post-venta. Presentación de casos: Defender operaciones...Pipeline
- Singularis RH está buscando Executivo(a) de Vendas para conduzir negociações estratégicas e fechar novos negócios. Você atuará no relacionamento... ...o crescimento das empresas atendidas. O papel envolve gerir o pipeline de vendas, usar o CRM para manter informações atualizadas e...PipelineRemote work
- ...vision, design, and deployment of its enterprise AI-Ready Data Lakehouse . This high-impact, hands-on role bridges clinical datasets... ...Server, with strong experience in AWS environments. Data Pipelines & Engineering: Hands-on proficiency with modern ELT toolsets...PipelineRemote work
Sud Recruiting
New York, NY1 day ago - GitLab busca un Recruiter para el área de Investigación y Desarrollo, con experiencia o interés en reclutamiento técnico, para apoyar... ...optimizar estrategias, manteniendo procesos transparentes para los candidatos y asegurando pipelines diversos. #J-18808-Ljbffr MuyRemotoPipelineRemote workFlexible hours
- Nuestro cliente, líder en consultoría de selección de personal, busca un Consultor de Selección de Talento Senior para su oficina en... .... Sólidas habilidades de networking y capacidad para construir pipelines de talento robustos. Excelentes habilidades de comunicación, negociaci...Pipeline
- PostHog es una empresa enfocada en ofrecer herramientas avanzadas de análisis y observabilidad de productos mediante software open-... ...seguridad, coordinando equipos y análisis post-mortem. Construir pipelines de observabilidad para rastrear actividades sospechosas en la...PipelineRemote work
- El turismo requiere profesionales capaces de crear soluciones bien diseñadas, estructuradas y alineadas a las necesidades reales de... ...certificaciones. Gestionar de manera autónoma su tiempo, tareas, agenda y pipeline de clientes. Desarrollar presencia digital esencial para...PipelineFreelanceRemote workFlexible hours
- Talentzo Delhi is seeking a data engineering support professional to assist with pipelines and ETL workflows. You will work with Apache Spark to process data and help ensure data quality, collaborating with engineering and analytics teams. The role involves handling MySQL...Pipeline
- Vermont Solutions busca un Ingeniero/a de Datos con 3-4 años de experiencia para unirse a un equipo tecnológico en entorno bancario, trabajando en pipelines y APIs en una plataforma analítica basada en cloud. Se valorará capacidad de diseño de procesos ETL/ELT, experiencia...PipelineFreelanceRemote work
- UST is seeking a Backend Developer Analyst with 2+ years in big data and Spark to design and maintain datalake pipelines. You will work with Spark, Scala and SQL, orchestrate workflows with Control-M and Airflow, and ensure data quality and production readiness in a collaborative...PipelineRemote jobFlexible hours
- ...teams to deliver shared data platforms and pipelines. Location: NYC area, on-site 3 days a... ...experience with Databricks, including Spark and distributed data processing ~... ...Experience with Delta Lake and modern data lakehouse architectures Familiarity with data governance...Pipeline3 days per week
Highbridge Consulting LLC
New York, NY3 days ago $182k - $250k
...with distributed computing with Apache Spark™ and knowledge of Spark runtime internals... ...architectures and applications that combine data pipelines, ML/AI models, and user‑facing... ...Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more, follow...PipelineWorldwideDatabricks Inc.
New York, NY2 days ago- ...Genie, Lakebase, Agent Bricks, Lakeflow, Lakehouse, and Unity Catalog. To learn more,... ...with distributed computing with Apache Spark™ and knowledge of Spark runtime internals... ...architectures and applications that combine data pipelines, ML/AI models, and user‑facing...PipelineWorldwide
Databricks
New York, NY1 day ago - All Jobs > Territory Manager - PA, NJ, DE, MD & NY Double E is a global manufacturing company with more than 50 years of innovation... ...understanding and product market fit. Develop and convert a robust pipeline of prospects across targeted categories. Maintain good data...Pipeline
- ...relational and ETL technologies to a modern lakehouse platform, and establish engineering... ...Server and SSIS workloads using Databricks, Spark, and Delta Lake. Design clear,... ...Spark performance. Embed data quality, pipeline health, observability, and SLA monitoring...PipelineFull time
Madison-Davis, LLC
New York, NY1 day ago $200k - $225k
...you architect feature engineering pipelines that are computed over terabytes of... ...production. This is a 70/30 split DS/DE role. Ensure model and feature... ...primary data transformation surface Spark, Iceberg, Trino, AWS Glue for Lakehouse workloads Modal for ML eng Frontier...PipelineWork at officeRelocation package- ...for a Backend Developer Analyst with solid experience in Apache Spark and Scala development to join the SIMA Squad, working in an... ...Scala. Develop and optimize ETL processes and data transformation pipelines. Perform unit, integration, and end-to-end testing to ensure solution...PipelineRemote jobWork experience placementSummer workWork from homeFlexible hours
$215.2k - $245.6k
...learning, distributed microservices, lakehouse architecture, and full-stack... ...languages such as Python and Spark, along with open-source... ...reusability across data platforms and pipelines Serve as an ambassador for... ...Data Engineer 4 Wilmington, DE: $179,400 - $204,700 for Data...PipelineFull timePart timeInternshipLocal areaCapital One
New York, NY1 day ago- ...U.S., except from AK, AL, AR, DE, HI, IA, ID, IN, KS, KY, LA, MT... ...occupation. Position requires: Spark for Data Engineering including batch and streaming pipelines Advance SQL including complex queries... ...to support petabyte scale LakeHouse implementations Data Modeling to...PipelineTemporary workRemote work
- ...CloudFormation). Integrate Databricks with CI/CD pipelines for code deployment and environment... ..., PowerShell, Bash). Familiarity with Spark concepts (clusters, executors, jobs,... ...Certified Data Engineer Associate/Professional, Lakehouse Fundamentals, Administrator). Experience...PipelineWork experience placementRemote work
- ...to big companies. What we look for? We are looking for Apache Spark (Backend Developer Analyst) with at least 2 years of experience... ...Will Be Design, develop and maintain datalake pipelines using Spark, Scala and SQL. Orchestrate batch workflows and dependencies...PipelineRemote jobSummer workWork from homeFlexible hours
- ...tech stack including Databricks, AWS, Python, SQL, Spark and CI/CD Build scalable data pipelines supporting business intelligence, advanced analytics... ...Experience building scalable data pipelines and lakehouse architectures Knowledge of CI/CD, automated testing...PipelineFull time
twentyAI
New York, NY3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engenheiro de Dados Sênior: Pipelines, Spark & Lakehouse. Be the first to apply!
