Big Data Engineer
Omni Inclusive
Big Data EngineerWe're seeking a highly skilled Data Engineer, Big Data Engineer to build scalable data pipelines, develop ML models, and integrate big data systems. You'll work with structured, semi-structured, and unstructured data, focusing on optimizing data systems, building ETL pipelines, and deploying AI models in cloud environments.Key Responsibilities:Data Ingestion: Build scalable ETL pipelines using Apache Spark, Talend, AWS Glue, Google Dataflow, Apache NiFi. Ingest data from APIs, file systems, and databases.Data TransformationValidation: Use Pandas, Apache Beam, and Dask for data cleaning, transformation, and validation. Automate data quality checks with Pytest, Unittest.Big Data Systems: Process large datasets with Hadoop, Kafka, Apache Flink, Apache Hive. Stream real-time data using Kafka, Google Cloud PubSub.Task Queues: Manage asynchronous processing with Celery, RQ, RabbitMQ, or Kafka. Implement retry mechanisms and track task status.Scalability: Optimize for performance with distributed processing (Spark, Flink), parallelization (joblib), and data partitioning.CloudStorage: Work with AWS, Azure, GCP, Databricks. Store and manage data with S3, BigQuery, Redshift, Synapse Analytics, and HDFS.Required Skills:ETL Data Processing: Expertise in Apache Spark, AWS Glue, Google Dataflow, Talend.Big Data Tools: Proficient with Hadoop, Kafka, Apache Flink, Hive, Presto.Databases: Strong experience with MySQL, PostgreSQL, MongoDB, Cassandra.Machine Learning: Hands-on with TensorFlow, PyTorch, Scikit-learn, XGBoost.Cloud Platforms: Experience with AWS, Azure, GCP, Databricks.Task Management: Familiar with Celery, RQ, RabbitMQ, Kafka.Version Control: Git for source code management.Desirable Skills:Real-time Data Processing: Experience with Apache Pulsar, Google Cloud PubSub.Data Warehousing: Familiarity with Redshift, BigQuery, Synapse Analytics.Scalability Optimization: Knowledge of load balancing (NGINX, HAProxy) and parallel processing.Data Governance: Use of MLflow, DVC, or other tools for model and data versioning.Tools Technologies: ETL: Apache Spark, Talend, AWS Glue, Google Dataflow. Big Data: Hadoop, Kafka, Apache Flink, Presto. Databases: MySQL, PostgreSQL, MongoDB, Cassandra. Cloud: AWS, GCP, Azure, Databricks. Storage: S3, BigQuery, Redshift, Synapse Analytics, HDFS. Version Control: Git.
- ...Job Description: Core Java, spring boot, Oracle, microservices, Kafka, app-engine (Containers), REST/Web services, Angular, CI/CD, Junit Must Have : Core Java , Spark experience (with Java) and Hive, Spring framework, Kafka (if not Kafka them relatively...Big data
Trinity Technology Solutions
Jersey City, NJ17 hours ago - ...specializing in the fields of Software Development, Software Consultancy, and Information Technology Enabled Services.Job DescriptionOur Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you...Big dataPermanent employmentFull timeH1b
- ...: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Python/PySparkLocation: Jersey City, NJ (3 Days onsite/week)Job... ...expertise- Experience building scalable ETL/ELT pipelines in big data environments- Strong understanding of KYC/AML and Client Onboarding...Big dataFull time3 days per week
- ...Overview: Job Description: Palantir Data Engineer We are seeking a highly skilled Palantir Data Engineer to design, develop, and... ...& Experience: Strong expertise in Palantir Foundry and big data frameworks (Spark, Hadoop) . Proficiency in Python,...Big data
Purple Drive
Jersey City, NJ17 hours ago $65 - $70 per hour
Position: Data Engineer- AWSLocation: Jersey City, New JerseyDuration: ContractJob ID: 172543Job Overview: As a Data Engineer III specializing... ...formats like JSON, AVRO, or Protobuf.Knowledge of big-data storage formats such as Parquet or Iceberg.Familiarity with...Big dataFull time$82.42k - $126.6k
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...with Hadoop ecosystem (Cloudera). Experience in working with a Big Data implementation in production environment. Experience with...Big dataFull timeTemporary workRelocation- ...Data Engineer - Jersey City, NJ - Contract W2/C2C - $74-84 Per HR We are looking for a skilled Data Engineer to join our team remotely... ...backend development. ~ Proven experience with cloud services and big data processing. ~ Strong understanding of data storage and...Big dataContract workRemote work
Mitchell Martin
Jersey City, NJ4 days ago - ...Responsibilities Develop and implement data processing frameworks using Apache spark.... ...with the latest trends and advancements in big data technologies. Skill Requirements... ...implementing scalable solutions. Knowledge of data engineering concepts and methodologies. Ability to...Big data
- ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ (Onsite) Duration : - Long term Contract Position: - Full-time INTERVIEW MODE : 2 rounds - VIDEO Technical Interview with CODING + HM Interview. MUST SKILLS : Spark, Scala, Python Technical...Big dataLong term contractFull timeWork experience placementFlexible hours
Maintec Technologies
Jersey City, NJ4 days ago - ...d love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse... ..., Polars , PySpark or DuckDB ; 2+ years of experience with Big Data technologies ( Spark , Snowflake ); Expert-level knowledge...Big dataWork at officeRemote workVisa sponsorshipWork visaFlexible hours
AgileEngine
Jersey City, NJ3 days ago - We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives.... ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of...Big data
$142.32k - $213.48k
...Development, ProfessionalCompany: CitiCiti is looking for a Lead Data Engineer - AI & Distributed Analytics to architect and scale the... ...delivering large-scale, distributed data systems.Deep expertise in big data frameworks including Apache Iceberg, Startree/Apache Pinot...Big dataFull timeWork at officeRemote work$137.75k - $185k
...distinctive skills will contribute to a winning culture and team. As a Data Engineer III at JPMorgan Chase within the Consumer & Community Banking... ...formats such as JSON, AVRO, Protobuf, or similar, big-data storage formats such as Parquet, Iceberg, or similar, data...Big dataFull time- ...Only On W2 Big Data DeveloperJersey City- NJLong Term ContractHadoop, Java/Scala, Spark Big Data Developer – (Count : 1)10 Plus Years Overall IT experience, Big Data Developer with experience in building Java/Scala, Spark based applicationAt least 5 Years of strong Development...Big data
Syntricate Technologies
Jersey City, NJ5 hours ago $142.32k - $213.48k
...United StatesSalary: $142,320.00 - $213,480.00Category: Technology, Applications Development, ProfessionalCompany: CitiThe Big Data PySpark Lead Engineer is a senior level position responsible for establishing and implementing new or revised application systems and...Big dataFull time- ...can push the limits of what's possible.As a Lead Software Engineer- Financial Service Data Engineering: Pyspark / Java / BigData / Datalake / AI, at... ...for analytics-ready datasetsDeep hands‑on experience with big data and modern data platforms (e.g., Spark, Databricks, Snowflake...Big data
- ...property and casualty insurance and risk engineering services; affluent and high net worth individuals... ...a highly skilled and experienced lead data engineer to join our dynamic team. The... ...Extensive experience working with Big Data tools and building data solutions for...Big dataWork experience placementLocal area
- ...Street Newark, New Jersey 07068 7 plus years of experience in data engineering, with at least 3 years in technical leadership or lead engineer... ...Proven experience with ETL/ELT processes, data modeling, and big data frameworks. Demonstrated ability to lead, mentor, and coach...Big data
SANS Consulting Services, Inc.
Newark, NJ5 days ago - ...Data EngineerWe are seeking experienced Data Engineers in a contract capacity to join our talented Data Engineering team. In this role, you will contribute to... ...warehousing tools like Snowflake or DatabricksFamiliarity with distributed systems and big data technologies...Big dataContract work
Argyle Infotech
Brooklyn, NY5 hours ago - ...AWS Data EngineerData Engineer Job Description for Data Journey USBIEExperience developing and deploying application code using SQL, Python, spark... ...Linux, UNIX shell scriptsDeveloper experience in big data or warehouse (Hadoop, DB2 LUW) environment.Experience...Big data
Damco
Newark, NJ5 hours ago - ...Job Description Looking for data engineers with 9+ years of experience. 1. Experience developing and deploying application code using... ...Linux, UNIX shell scripts. 6. Developer experience in big data or warehouse (Hadoop, DB2 LUW) environment. 7. Experience...Big data
CEDENT
Newark, NJ1 day ago - ...Sr. Data Engineer Location: New jersey Client: Client / APEX 10+ Overall industry experience 5+ years' experience with building large scale big data applications development Bachelors in Computer Science or related field Provide technical leadership in developing...Big data
Keylent Inc
Passaic, NJ4 days ago - ...Senior Big Data Engineer Location: New Jersey (hybrid) Duration: 6+ Months We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a crucial role in designing, implementing, and maintaining...Big data
Zortech Solutions
Passaic, NJ5 days ago $77 - $82 per hour
...IRVING, TX has an immediate contract opportunity for an experienced Data Engineer Responsibilities: Partner with project managers,... ...PySpark and Python programming skills. ~ Experience with Big Data ecosystems, including Cloudera and/or Data Bricks. ~ Proficiency...Big dataContract workImmediate startAxelon
Rutherford, NJ3 days ago- ...AWS Lead Data Engineer Hybrid - 3 days from Newark, NJ office Note: Please submit local candidates who are available for an in-... ...Proven experience with ETL or ELT processes, data modeling, and big data frameworks. 16. Demonstrated ability to lead, mentor, and...Big dataSecond jobWork at officeLocal areaShift work
Ruri Software Technologies LLC
Newark, NJ3 days ago - ...Data Engineers (AWS)We are seeking a talented AWS Data Engineer to join our dynamic Data Engineering team. The ideal candidate will be responsible... ...pipelines in AWS.Knowledge of ETL/ELT, data modeling, and big data technologies.Familiarity with data warehousing concepts...Big dataHourly pay
JSR Tech Consulting
Newark, NJ5 hours ago - ...Senior AWS Data EngineerNewark, New Jersey, United StatesRole OverviewThe person will be... ...client. He/ She will work as a Senior Cloud Engineer within the CDO EDP team and will have the... ...VPC NACLs, and SCPsFamiliar with ETL and big data tool-chains such as those provided by...Big dataWork at office
Inizio Partners
Newark, NJ1 day ago - ...Data EngineerDesigning, building and maintaining efficient, reusable, and reliable architecture... ...and quality of high scale data engineering projectParticipate in the architecture and... ...with ETL/ELT processes, data modeling, and big data frameworks.Demonstrated ability to...Big data
Inizio Partners
Newark, NJ5 hours ago $70 - $75 per hour
...Duration: 6 Months (Contract To Hire) Overview As a Cloud Engineer within the AWS AI/ML platform team, you will have the opportunity... ..., KMS Keys, VPC NACLs, and SCPs. Familiar with ETL and big data tool-chains such as those provided by Hadoop/EMR, Glue, Spark,...Big dataFull timeContract workRemote workSPECTRAFORCE
Newark, NJ1 day ago- Job Summary We are seeking a Senior AWS Big Data Engineer with 12+ years of experience in data engineering, ETL development, data analysis, and technical architecture for analytics solutions. The ideal candidate will have strong expertise in Python, SQL, and AWS services...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- data center engineer Jersey City, NJ
- senior cloud data engineer Jersey City, NJ
- data infrastructure engineer Jersey City, NJ
- sr information security engineer Jersey City, NJ
- data visualization developer Jersey City, NJ
- remote data engineer Jersey City, NJ
- etl data engineer Jersey City, NJ
- data engineer analytics Jersey City, NJ
- sr data engineer Jersey City, NJ
- junior big data engineer Jersey City, NJ