Senior Data Engineer
1872 Consulting
Data Engineer
Responsibilities
- Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources.
- Develop versatile software components to extract useful information from various unstructured or semi-structured text data.
- Implement advanced search functionalities and improve the efficiency of search indexing.
- Work closely with data scientists to develop, test and iterate data models and algorithms.
- Contribute to company-wide data privacy compliance efforts.
Required
- Minimum 6 years of experience in the field
- Extensive experience in building large scale data pipelines with mainstream big data stack.
- Strong expertise in extracting useful information from unstructured and semi-structured text data.
- Strong software development skills and highly proficient with Java is a plus.
- Professional working experience with Elasticsearch, Apache Beam, Spark, and GCP Dataflow a big plus.
- Strong expertise in NLP or Text Mining is also a big plus.
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in New York, NY vacancy
- ...A high end technical consulting firm is seeking a Senior Big Data Developer based in NYC. The ideal candidate will have extensive experience... ...technologies and will be responsible for developing data engineering solutions in a fast-paced investment banking environment....Senior
Wissen Australia Pty
New York, NY2 days ago - ...A leading global alternative investment firm is seeking a Senior Data Engineer to design and build robust solutions for data extraction and processing. The ideal candidate will have over 5 years of experience in Data Engineering, strong Python skills, and a background...Senior
Point72
New York, NY4 days ago - ...A leading health technology firm is seeking a Senior Data Engineer to join their team. This remote role focuses on Epic Clarity development and revenue cycle data extraction. The ideal candidate will bring 5 to 7 years of experience and expertise in writing Clarity queries...SeniorRemote work
Ensemble Health Partners
New York, NY5 days ago - ...iTechStack is looking for a skilled developer to design and implement data processing systems using technologies like Apache Spark and Java. The role involves developing hive scripts and redshift scripts, requiring strong knowledge of Spark, Pyspark, and related frameworks...Senior
iTechStack Inc
New York, NY1 day ago - ...Diligent Robotics is seeking a Founding Senior Data Engineer to design and build our BigQuery data warehouse. This hands-on role involves significant architectural responsibilities, setting standards, and collaborating with an analytics team. Ideal candidates will have...Senior
Diligent Robotics
New York, NY5 days ago - ...DACOMA cerca un Senior Data Engineer (Snowflake) per progettare e ottimizzare pipeline dati su piattaforme cloud, con esperienza in ambito retail e fashion. I candidati devono dimostrare una solida capacità analitica e di problem solving. Il ruolo prevede l'implementazione...Senior
DACOMA
New York, NY2 days ago - ...Senior Data Engineer Exp Location: Jersey City, NJ / Atlanta, GA / Plano, TX Responsibilities: Data Ingest Data Quality Management and Support Team to ingest data from/to Snowflake, On Prem, or Azure to Palantir and perform necessary data grooming and...SeniorShift work
Futran Tech Solutions Pvt. Ltd.
Jersey City, NJ4 days ago $120k - $140k
...A leading media company in the United States is seeking a Data Engineer to own their complex data layer. The role emphasizes deep expertise in PostgreSQL, schema design, and zero-downtime migrations. Responsibilities include optimizing the database for high volume AI generation...SeniorHYGO
New York, NY5 days ago- ...A leading independent jobs platform is seeking an experienced Data Engineer to work remotely. You will design and implement data pipelines while optimizing data flows using technologies like Spark and Kafka. Candidates should have a minimum of 5 years in data engineering...SeniorRemote work
MBO Partners
New York, NY5 days ago - ...Jusbrasil, localizado nos Estados Unidos, está em busca de um(a) Data Engineer para projetar e manter pipelines de dados. A função implica em garantir a qualidade e integridade dos dados ao longo do seu ciclo e colaborar com equipes multidisciplinares. Os candidatos devem...Senior
JusBrasil
New York, NY5 days ago - ...Convo Communications is seeking a Data Engineer to enhance its data infrastructure. You will be the main resource for data expertise and will inherit existing pipelines, improving and rebuilding where necessary. This role requires a high degree of independence, and you...Senior
Convo Communications
New York, NY2 days ago - ...A leading technology company is seeking a Senior Data Engineer to design and build scalable data infrastructure. You will play a vital role in automating data processes and collaborating with cross-functional teams. Ideal candidates will have over 4 years of experience...SeniorRemote work
CloudDevs
New York, NY5 days ago - 3Pillar is looking for a Senior Data Engineer to join our innovative team. In this pivotal role, you'll develop and manage ETL pipelines using advanced technologies such as MongoDB and Snowflake. Your contributions will directly impact data analytics for our clients. We...SeniorRemote workFlexible hours
3Pillar
New York, NY4 days ago $90 - $125 per hour
...Obsidian is seeking a Data Engineering Expert to advance AI evaluations in data engineering. You will build pipeline tasks, ensuring verifiable outcomes and structured workflows.The ideal candidate holds a BS or MS in CS and has over 3 years of experience in data engineering...SeniorObsidian
New York, NY2 days ago- ...Mitratech India is seeking a Data Migration Engineer to handle data migrations from clients’ legacy systems to its products. This role involves script writing, execution, and working closely with Business Analysts to ensure data integrity. Ideal candidates will have over...Senior
Mitratech India
New York, NY3 days ago - ...A leading healthcare ad technology company is seeking a Sr. Data Engineer to design and maintain scalable data processing systems. The ideal candidate will have 8+ years of experience in data engineering with strong skills in SQL and Python, as well as recent experience...SeniorRemote work
PulsePoint
New York, NY5 days ago - ...An established industry player is seeking a seasoned Informatica Developer with over 7 years of experience in data integration and analysis. This role emphasizes expertise in Informatica PowerCenter and IICS, along with strong skills in relational databases and SQL. The...Senior
TechDigital Group
New York, NY5 days ago - ...A fast-paced tech company in the United States is seeking a Senior Data Engineer to join their Data Engineering team. This role focuses on solving complex technical challenges and providing reliable data solutions. Candidates should have over 5 years of experience with...SeniorRemote work
SUPER LLC Defunct
New York, NY5 days ago - ...A leading financial technology firm is seeking a Data Engineer to support real-time data and reporting platforms. The role requires significant experience with financial trading data, proficiency in Java and Python with Groovy scripting for customization, and a problem...Senior
Memx Inc
New York, NY5 days ago $125k - $156.3k
...A leading healthcare technology company is seeking a Senior Software Engineer to design and build data products that support genomics research and translational science. This remote position requires expertise in data engineering, bioinformatics, and strong proficiency...SeniorRemote workNatera
New York, NY2 days ago- ...A technology company is seeking a Senior Data Engineer to design and operate systems converting unstructured leasing documents into reliable JSON outputs. In this remote position, the ideal candidate will leverage Python, collaborate across teams, and implement effective...SeniorRemote work
South Geeks
New York, NY4 days ago - ...A stealth-mode AI startup is seeking a Senior Engineer to architect and evolve multi-tenant graph data systems. This role involves designing scalable architectures, building backend services, and optimizing performance. The ideal candidate has over 5 years of experience...Senior
Standard Template Labs
New York, NY1 day ago - ...A technology solutions company in Kentucky is seeking a Senior Engineer to lead the development of automated extraction and analysis capabilities. This role involves integrating high-fidelity data and developing algorithms for target tracking. The ideal candidate has...SeniorFlexible hours
Erias Ventures
Brooklyn, NY2 days ago $163.13k
...Progressive Data Jobs is seeking a Senior Technical Analyst who will manage the acquisition and maintenance of civic data across the United States. You will apply your experience in Python and SQL to enhance data workflows and ensure data reliability. This role offers...SeniorRemote workProgressive Data Jobs
New York, NY3 days ago$150k
...A staffing agency is seeking a Senior Data Engineer to architect next-generation data pipelines transforming complex US mortgage data. The ideal candidate will have expertise in Apache Airflow and Neo4j, with experience in the mortgage and banking sector. Responsibilities...SeniorRemote workTalentDome Staffing
New York, NY5 days ago$100k - $130k
...Celigo is hiring a Senior Data Engineer to architect and maintain a Snowflake-based data ecosystem. The ideal candidate will design scalable ELT pipelines and collaborate across teams to ensure data quality. Requirements include a degree in Computer Science and significant...SeniorRemote workCeligo
New York, NY5 days ago- ...A new consulting start-up is looking for a part-time Sr Data Engineering Consultant based in the United States. This role requires a minimum of 4 years experience in data engineering, focusing on enhancing data infrastructure and driving the adoption of DataBricks. Candidates...SeniorPart timeFlexible hours
Kruse Consulting, Inc.
New York, NY5 days ago - ...A high-growth organization is seeking a Senior Data Engineer to shape modern data platform architecture using Microsoft Fabric and Lakehouse technologies. You will be responsible for driving design decisions, translating requirements into scalable solutions, and enhancing...SeniorRemote work
InterEx Group
New York, NY5 days ago - ...A leading consumer insights firm in New York is seeking a Senior Data and Software Engineer I to enhance their API ecosystem. This role involves designing high-performance RESTful APIs and collaborating on data integration projects, with a strong focus on security and...Senior
Affinity Solutions
New York, NY1 day ago - ...Senior Data Engineer- Jersey city, NJ Must have: Spark, Scala, Java, AWS (EMR) Nice to have: Python, S3 EC2, EKS, Hadoop, Impala, Hive, Airflow Domain knowledge a plus Data set size is 500m-1b rows per batch His resume review focuses...Senior
Apex Informatics
Jersey City, NJ3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data engineer manager New York, NY
- data science developer New York, NY
- junior data developer New York, NY
- etl data engineer New York, NY
- entry level big data engineer New York, NY
- data engineer New York, NY
- big data cloud engineer New York, NY
- junior big data engineer New York, NY