Big Data Engineer
Purple Drive
Overview: Skills: Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and optimizes storage/processing using Hadoop ecosystem and Greenplum. Ensures data quality, security, and compliance through governance frameworks. Implements orchestration, monitoring, and performance tuning for reliable, cost-efficient operations. Expertise in Hadoop ecosystem (HDFS, Hive, Spark, Kafka) and MPP databases like Greenplum for large-scale data processing and optimization. Collaborates with Data Owners and stakeholders to translate business rules into technical solutions. Delivers curated datasets, lineage, and documentation aligned with SLAs and regulatory standards. Subject matter expert having experiance of interacting with client, understanding the requirement, and guiding the team. Documenting the requirements crlearly with defined scope and must play a anchor role in setting the reight expectations and delivering as per the schedule
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
- ...Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
VortalSoft
New York, NY2 days ago - ...Big Data Engineer Job Type: Full Time Employment Location: Phoenix, AZ or New York Experience Required: 6+ Years Responsibilities: Minimum 6 years of experience on Big Data Hadoop technologies & software development Hands on experience on Big Data platforms...Big dataFull time
Syntricate Technologies
New York, NY5 days ago - ...Big Data Engineer Mandatory skills include Apache Spark, Hive, Kafka, Amazon Glue, Google Dataflow, Talend MDM, Hadoop, Presto, and strong experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer. Job overview: We're seeking a highly skilled Data...Big data
Omni Inclusive
Jersey City, NJ2 days ago - ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various... ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...Big data
Cpus Engineering Staffing Solutions Inc.
New York, NY3 days ago - ...Title: Data Engineer Join a forward-thinking and innovative organization that values growth, collaboration, and cutting-edge technology. We... ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling...Big data
Glint Tech Solutions
Jersey City, NJ3 days ago - ...Azure Data Engineer Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is... ...Factory, Azure Databricks, and other Azure services. Fluent with Big Data technologies like Spark, Kafka and Hive. Expert level...Big data
InterSources
Weehawken, NJ5 days ago - ...We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives.... ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of...Big data
Compunnel
Jersey City, NJ3 days ago - ...the energy sector by creating a unified data network. Backed by experienced founders and... ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are... ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or...Big data
Texture
New York, NY3 days ago - ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
- ...Job Title Responsibilities Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple... ...in building large scale data pipelines with mainstream big data stack. Strong expertise in extracting useful information...Big dataWork experience placement
1872 Consulting
New York, NY5 days ago - ...Data Engineer Our client is a process driven investment management group consisting of a team of researchers, traders and technologists... ...availability. Minimum Requirements: Production grade, big data ETL pipeline experience. Building and maintaining distributed...Big data
Quanta Search
New York, NY20 days ago - ...reliably. Join our team to help build the data infrastructure that supports and scales our... ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible... .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow....Big data
Tavily
New York, NY3 days ago - ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Hands-on Tech lead responsible for designing a... ...solving skills, and algorithms. Must Haves: Strong experience in Big Data Technologies such as Hadoop Data Management Tools for...Big data
Cardinal Integrated
New York, NY5 days ago - ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C Description... ...data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data...Big data
Concord IT Systems
New York, NY3 days ago - ...Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...Big data
Saransh
New York, NY3 days ago - ...Data Engineer NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part... ...and programming skills (Python/Scala/Java). • Experience with big data tools and orchestration systems. • Knowledge of cloud data...Big data
NTT DATA
Jersey City, NJ1 day ago - ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial... ...and best practices in data engineering, cloud technologies, and big data processing. Qualifications Bachelor's or Master's degree in...Big dataFull timeWork at officeRemote work
Urban SDK
New York, NY1 day ago - ...Job Description Role - Sr Data Engineer || Fulltime || Jersey City , NJ Experience Required - 6+ Years Must Have Technical/Functional Skills • Strong hands-on experience in Big Data technologies and distributed data processing frameworks. • Proficiency...Big dataFull time
Diverse Lynx
Jersey City, NJ5 days ago $165k - $230k
...We’re hiring a Senior Data Engineer to own data at truly massive scale. You’ll design and run pipelines that clean, enrich, and serve data... ...negotiate and run data partnerships. Nice to have Experience with big data, columnar storage formats, vector indexes, and privacy/...Big dataPermanent employmentWork at officeMonday to FridayRaylu
New York, NY4 days ago$60 - $70 per hour
...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions... ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data...Big dataHourly paySciata
New York, NY3 days ago- ...Job Description Job Title: Sr. Data engineer Location: Atlanta, GA - Onsite Duration: / Term: 6+ months Contract Job Description: Proficiency... ..., Python, Java, or SQL). Experience in Snowflake. Knowledge of big data technologies like Hadoop and Spark. Experience with ETL (...Big dataContract work
6AM City
New York, NY2 days ago - ...Our client provides data-driven, action-oriented solutions to business problems through... ...logistics industries. ROLE We are seeking 2 Data Engineers with 5-8 years of experience in... ...projects AWS Solutions Architect or AWS Big Data Certification preferred Ability to thrive...Big dataWork experience placement
Inizio Partners Corp
New York, NY1 day ago - ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer... ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience...Big data
Qode
New York, NY2 days ago - ...transform large datasets from various sources. Build and optimize data architectures and data models to support analytics and... ...NoSQL databases (e.g., PostgreSQL, MongoDB). Experience with big data frameworks such as Apache Spark , Hadoop , or Kafka ....Big data
Purple Drive
Jersey City, NJ1 day ago $100 - $130 per hour
...Data Engineer - Databricks A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-... ...administration experience Experience with CI/CD pipelines Experience with Big Data query and transformation tools such as Presto, Hive,...Big dataRemote workOpen Systems Technologies
New York, NY1 day ago- ...Data Engineer - : Apache Airflow, Apache NiFi "• Orchestration: Apache Airflow, Apache NiFi. • Programming: Java (Core), Python (for Airflow), Unix Shell Scripting. • Big Data/Storage: Apache Spark, MinIO, AWS S3. • Security: SSL/TLS, Certificate Management, IAM...Big data
Diverse Lynx
New York, NY4 days ago - ...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...AI, ML, and cloud innovation. Your next big opportunity starts here! Experience Level...Big dataFull time
Quantiphi
Jersey City, NJ3 days ago - Big Data Pyspark Developer Job Req Id: 25925026 Location(s): Pune, Maharashtra, India Job Type: On-Site/Resident Posted: Jun. 04,... ...4-8 years of experience with software building and platform engineering Experience in Data Engineering, focused on Big Data ecosystems...Big data
$75k - $90k
...Overview The New York Mets are seeking a Data Engineer for its Data Engineering Technology team. This position will support operations in both... ...implementing scalable data‑quality solutions. Knowledge of big‑data frameworks, databases, orchestration, and tools such as Google...Big dataFlexible hoursNew York Mets
New York, NY3 days ago- ...Position We are looking for an experienced AWS Data Engineer to join the team that develop a data-centric platform that empowers multiple... ...variety of data sources using Python, SQL, scripting, and AWS big data technologies. Design and implement complex ETL...Big dataRemote workHome officeFlexible hours
Grinteq
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- remote data engineer New York, NY
- data engineer intern New York, NY
- entry level big data engineer New York, NY
- big data devops engineer New York, NY
- entry level data engineer New York, NY
- data engineer New York, NY
- data engineer contract New York, NY
- software data engineer New York, NY
- data engineer graduate New York, NY
- data intelligence engineer New York, NY