Big Data Engineer
Vortalsoft Inc
Responsibilities Create and maintain data pipelines that transfer data from select location (maintaining security protocols) into our Big Data financial crime solution. Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and reporting. Develop and implement data models and schemas to support analytical applications and data visualization tools. Monitor and troubleshoot issues with our proprietary Big Data financial crime solution and provide timely resolution. Develop and implement security and data privacy measures to protect sensitive data. Develop and maintain documentation and training materials for end-users and stakeholders. Keep up to date with emerging trends and technologies in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer science, Engineering, or related field. 4+ years of experience in designing, configuring, and implementing Big Data solutions, preferably with financial crime solutions. Strong programming skills in Java, Python, or Scala. Strong understanding of data modelling, data warehousing, and ETL processes. Strong understanding of Big Data technologies and their architectures, including Hadoop, Spark, and NoSQL databases. Strong analytical and problem-solving skills. Excellent communication and interpersonal skills. Ability to work in a fast-paced, team-oriented environment. Ability to manage multiple priorities and deadlines. Experience with AWS is a plus. #J-18808-Ljbffr Vortalsoft Inc
- ...Amazon Glue, Google Dataflow, Talend MDM, Hadoop, Presto, Strong experience with MySQL, PostgreSQL, MongoDB, Cassandra. Role: Big Data Engineer Job Overview: We're seeking a highly skilled Data Engineer, Big Data Engineer to build scalable data pipelines, develop ML models...Big data
$160.81k - $170k
Barclays is seeking a Big Data Engineer, AVP, in Whippany, NJ to enhance data capabilities through automation and optimization. In this hybrid role, you will analyze system requirements, improve functionality, and oversee IT processes including Hadoop and UNIX environments...Big data- ...Azure Data Engineer Expert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is... ...Factory, Azure Databricks, and other Azure services. Fluent with Big Data technologies like Spark, Kafka and Hive. Expert level...Big data
$176.72k - $265.08k
...Citi is searching for a Senior Data Engineering Lead in Jersey City who will architect and design scalable data infrastructure, mentor a data... ...or Scala, and significant experience with cloud platforms and big data technologies. The position offers a competitive salary...Big data- ...We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives.... ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of...Big data
- ...CVS Health Corporation in New York, NY is seeking a Data Engineer to develop, manage, and optimize large-scale data pipelines and structures, ensuring data quality and accessibility. The ideal candidate will have a Master's in a related field and proficiency in programming...Big dataRemote work
- ...Job Title Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources. Develop... ...experience in building large scale data pipelines with mainstream big data stack. Strong expertise in extracting useful information...Big dataWork experience placement
- ...Data Engineer Jersey City, New Jersey, United States Title: Data Engineer Join a forward-thinking and innovative organization that values... ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling...Big data
- ...Data Engineer Our client is a process driven investment management group consisting of a team of researchers, traders and technologists... ...availability. Minimum Requirements: Production grade, big data ETL pipeline experience. Building and maintaining distributed...Big data
- ...the energy sector by creating a unified data network. Backed by experienced founders and... ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are... ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or...Big data
- ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C Description... ...data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data...Big data
- ...Senior Data Lake Engineer/Developer-Tech Lead Duration: 6 months CTH Location: New York Hands-on Tech lead responsible for designing a... ...solving skills, and algorithms. Must Haves: Strong experience in Big Data Technologies such as Hadoop Data Management Tools for...Big data
- ...seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are... ...strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open...Big data
- ...reliably. Join our team to help build the data infrastructure that supports and scales our... ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible... .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow....Big data
- ...We are seeking a talented Data Engineer with hands-on experience in building scalable data pipelines and modern cloud-based data platforms.... ...The ideal candidate will have experience working with Python and Big Data technologies such as Apache Airflow, Apache Spark, and...Big data
- ...Data Engineer NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part... ...and programming skills (Python/Scala/Java). • Experience with big data tools and orchestration systems. • Knowledge of cloud data...Big data
$60 - $70 per hour
...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions... ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data...Big dataHourly pay$165k - $230k
...We’re hiring a Senior Data Engineer to own data at truly massive scale. You’ll design and run pipelines that clean, enrich, and serve data... ...negotiate and run data partnerships. Nice to have Experience with big data, columnar storage formats, vector indexes, and privacy/...Big dataPermanent employmentWork at officeMonday to Friday- ...We are looking for a skilled Data Engineer to design, build, and maintain scalable data pipelines and platforms that support our geospatial... ...and best practices in data engineering, cloud technologies, and big data processing. Qualifications Bachelor's or Master's degree in...Big dataFull timeWork at officeRemote work
- ...Data Engineer Associate Our client, a prosperous prop trading firm with headquarters in NYC, is currently recruiting for a Data Engineer... ...on feature engineering. Improve and Support a cutting edge, Big Data market research platform. Design complex relational data...Big data
- ...Our client provides data-driven, action-oriented solutions to business problems through... ...logistics industries. ROLE We are seeking 2 Data Engineers with 5-8 years of experience in... ...projects AWS Solutions Architect or AWS Big Data Certification preferred Ability to thrive...Big dataWork experience placement
- ...Data Engineer Data engineer who has worked on setting up data pipeline in analytics projects. Should have strong knowledge of Python, AWS... ...building, and maintaining data systems and processes using AWS Big Data Platform Demonstrable, hands-on professional Data Analytics...Big data
- ...Data Engineer - : Apache Airflow, Apache NiFi "• Orchestration: Apache Airflow, Apache NiFi. • Programming: Java (Core), Python (for Airflow), Unix Shell Scripting. • Big Data/Storage: Apache Spark, MinIO, AWS S3. • Security: SSL/TLS, Certificate Management, IAM...Big data
$100 - $130 per hour
...Data Engineer - Databricks A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-... ...administration experience Experience with CI/CD pipelines Experience with Big Data query and transformation tools such as Presto, Hive,...Big dataRemote work- ...Data Engineer Sunnyvale, CA/Hoboken, NJ (open to relo candidates, just have to be able to relocate asap) 9+ months Contract Work with... ...field) and 6+ years of experience Experience leveraging big data technologies such as Hive, Hadoop, PySpark Experience building...Big dataContract workImmediate startRelocation
$70 - $85 per hour
...Data Engineer Opportunity Global Financial Firm located in Tampa, FL and JC, NJ has an immediate contract opportunity for an experienced... ...with ETL tools for data mining and analytics. Experience in big data platforms. Experience in Linux command lines. Preferred...Big dataContract workImmediate start- ...Telecom division is seeking a highly skilled, detail-oriented Data Engineer to support the Enterprise Data Science and Engineering Unit (EDSE... ...solutions capable of handling very large datasets, or “Big Data.” In addition to overseeing Big Data operations, EDSE partners...Big dataFull time
- ...transform large datasets from various sources. Build and optimize data architectures and data models to support analytics and... ...NoSQL databases (e.g., PostgreSQL, MongoDB). Experience with big data frameworks such as Apache Spark , Hadoop , or Kafka ....Big data
$75k - $90k
...Overview The New York Mets are seeking a Data Engineer for its Data Engineering Technology team. This position will support operations in both... ...implementing scalable data‑quality solutions. Knowledge of big‑data frameworks, databases, orchestration, and tools such as Google...Big dataFlexible hours- ...AI/ML Data Engineer Location: New York, NY (Hybrid – 3 Days Onsite) Duration: Contract Rate: DOE Job Overview: We are seeking an... ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable...Big dataContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- senior cloud data engineer New York, NY
- principal data engineer New York, NY
- finance data engineer New York, NY
- aws data engineer New York, NY
- data engineer New York, NY
- sr data engineer New York, NY
- software data engineer New York, NY
- junior data engineer remote New York, NY
- remote data engineer New York, NY
- junior data developer New York, NY


