Big Data Engineer
STEM Xpert
TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process. Job Description Primary Skills: Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open source products and contribution towards it would be an added advantage. Implemented and in-depth knowledge of various java, J2EE and EAI patterns. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc). Good understanding of algorithms, data structure, and performance optimization techniques. Knowledge of database principles, SQL, and experience working with large databases beyond just data access. Exposure to complete SDLC and PDLC. Capable of working as an individual contributor and within team too. Self-starter & resourceful personality with ability to manage pressure situations. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc. Role & Responsibilities Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products Active participation in the various Architecture and design calls with bigdata customers. Working with Sr. Architects and providing implementation details to offshore. Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData Responsible for Timely and quality deliveries. Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings #J-18808-Ljbffr Stem Xpert
- ...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and...Big dataWork experience placement
$160.81k - $170k
Barclays is seeking a Big Data Engineer, AVP, in Whippany, NJ to enhance data capabilities through automation and optimization. In this hybrid role, you will analyze system requirements, improve functionality, and oversee IT processes including Hadoop and UNIX environments...Big data- Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
- ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various... ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...Big data
- ...Title: Data Engineer Join a forward‑thinking and innovative organization that values growth, collaboration, and cutting‑edge technology. We... ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling...Big data
- ...We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives.... ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of...Big data
- ...the energy sector by creating a unified data network. Backed by experienced founders and... ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are... ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or...Big data
- ...in the research, trading and production processes. Role: Data Engineers are responsible for the data infrastructure. The build systems... .... Minimum Requirements: Production grade, big data ETL pipeline experience. Building and maintaining distributed...Big data
- ...Job Title Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources. Develop... ...experience in building large scale data pipelines with mainstream big data stack. Strong expertise in extracting useful information...Big dataWork experience placement
- ...CVS Health Corporation in New York, NY is seeking a Data Engineer to develop, manage, and optimize large-scale data pipelines and structures, ensuring data quality and accessibility. The ideal candidate will have a Master's in a related field and proficiency in programming...Big dataRemote work
- ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer... ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience...Big data
- ...Senior Data Engineer Position Summary The Senior Data Engineer leads complex data engineering projects, working on designing data architectures... ...PySpark for data processing. Proficiency in SQL, dealing with big data processing. Proven experience in data processing for data...Big dataWork experience placement
- ...reliably. Join our team to help build the data infrastructure that supports and scales our... ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible... .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow....Big data
- Project Description We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv. You will be a part of our data platform, that is responsible for processing, storing, and serving data for all our core systems. As a Senior Big Data Developer...Big data
- ...Title: Senior Data Engineer Location: Remote Duration: C2H Salary: 1-2Lkhs Per Month Qualifications Bachelor’s or Master’s degree in Computer... ...with cloud platforms with GCP preferred Experience using big data technologies (e.g., Hadoop, Spark) Excellent communication...Big dataRemote work
- ...AI/ML Data Engineer Location: New York, NY (Hybrid – 3 Days Onsite) Duration: Contract Rate: DOE Job Overview: We are seeking an... ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable...Big dataContract work
- ...Role: US Data Engineer Data Platforms Location : Minneapolis, MN 4 days onsite (Only Local applications will be considered) Required skills... ...Architecture on Data Platform using Machine Learning, --Deep Learning, Big Data Platforms, Natural Language Processing, Data Engineering,...Big dataLocal area
$190k - $250k
Hebbia is seeking a Data Engineer in New York City to refine its data infrastructure. The ideal candidate will architect ETL pipelines, manage... ...particularly with Python and SQL, and hands-on experience with big data technologies. They offer a competitive salary range of $19...Big data- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines... ...have a degree in Computer Science and experience with big data tools like Bigtable and Apache Spark. This...Big data
$60 - $70 per hour
Sciata is looking for a Data Engineer in Atlanta, GA. You will design, implement, and maintain the data pipeline architecture for our business... ...in data engineering, strong SQL knowledge, and is skilled with big data tools like Hadoop and Spark. This role involves...Big dataHourly pay- C the Signs is seeking a Data Engineer to enhance our LLMs and machine learning models. You will manage the data lifecycle, working with healthcare... ...'s degree in a related field and demonstrated experience with big data technologies. This role offers flexibility in work...Big dataRemote job
- Verve is seeking a full-time Data Engineer at our NYC headquarters to manage and enhance our data initiatives. The role involves collaborating... ...platforms, strong SQL skills, and a background in big data products. Enjoy a variety of benefits including unlimited...Big dataFull time
- ...platforms (i.e., Azure, GPC, AWS) Experience building automated big data pipelines Experience performing data analysis and data... ...domain knowledge Education Bachelors degree in computer science, Engineering, Statistics, Physics, Math, or related field or equivalent experience...Big data
- ...team and build large-scale, cutting-edge data platforms from the ground up! This role offers... ...the opportunity to leverage the latest Big Data technologies without the constraints... .... Collaborate with business units and engineering teams to develop a long-term Data Platform...Big data
$165k - $230k
...We’re hiring a Senior Data Engineer to own data at truly massive scale. You’ll design and run pipelines that clean, enrich, and serve data... ...negotiate and run data partnerships. Nice to have Experience with big data, columnar storage formats, vector indexes, and privacy/...Big dataPermanent employmentWork at officeMonday to Friday$175.07k - $325.13k
Warner Media, LLC. is seeking a Senior Staff Data Engineer in New York, NY. The role involves designing and delivering data pipelines that process... ...legacy ad-tech systems, and act as a domain expert in big data engineering, mentoring junior engineers alongside cross-functional...Big data$150k - $275k
...lost in the chaos of fragmented financial data, manual workflows, and opaque payer... ...You’re excited to shape the future of our engineering team and are excited to lead by example –... ...coordination and AI pipelines Familiarity with big data technologies and comfortable working...Big dataFull timePrivate practiceWork at office3 days per week- ...Position We are looking for an experienced AWS Data Engineer to join the team that develop a data-centric platform that empowers multiple... ...variety of data sources using Python, SQL, scripting, and AWS big data technologies. Design and implement complex ETL...Big dataRemote workHome officeFlexible hours
$60 - $70 per hour
...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions... ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data...Big dataHourly pay- ...Overview We seek a Junior Data Engineer with a passion for developing highly scalable data processing pipelines. The engineer will collaborate... ...and provide domain‑specific insight regarding storage, big data platform services, serverless architecture, RDBMS, DW/DM,...Big data
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- IT data engineer New York, NY
- data engineer freelance New York, NY
- senior data center engineer New York, NY
- bi data engineer New York, NY
- data operations engineer New York, NY
- data engineer machine learning New York, NY
- remote data engineer New York, NY
- data engineer intern New York, NY
- data systems engineer New York, NY
- azure data engineer New York, NY

