Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

STEM Xpert

TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process. Job Description Primary Skills: Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open source products and contribution towards it would be an added advantage. Implemented and in-depth knowledge of various java, J2EE and EAI patterns. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc). Good understanding of algorithms, data structure, and performance optimization techniques. Knowledge of database principles, SQL, and experience working with large databases beyond just data access. Exposure to complete SDLC and PDLC. Capable of working as an individual contributor and within team too. Self-starter & resourceful personality with ability to manage pressure situations. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc. Role & Responsibilities Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products Active participation in the various Architecture and design calls with bigdata customers. Working with Sr. Architects and providing implementation details to offshore. Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData Responsible for Timely and quality deliveries. Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings #J-18808-Ljbffr Stem Xpert

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
  •  ...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and... 
    Big data
    Work experience placement

    Purple Drive

    New York, NY
    3 days ago
  • $160.81k - $170k

    Barclays is seeking a Big Data Engineer, AVP, in Whippany, NJ to enhance data capabilities through automation and optimization. In this hybrid role, you will analyze system requirements, improve functionality, and oversee IT processes including Hadoop and UNIX environments... 
    Big data

    Barclays

    New York, NY
    1 day ago
  • Responsibilities Create and maintain data pipelines that transfer data from select location...  ...maintaining security protocols) into our Big Data financial crime solution. Develop,...  ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer... 
    Big data

    Vortalsoft Inc

    New York, NY
    4 days ago
  •  ...A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various...  ...ideal candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among... 
    Big data

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    4 days ago
  •  ...Title: Data Engineer Join a forward‑thinking and innovative organization that values growth, collaboration, and cutting‑edge technology. We...  ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling... 
    Big data

    Glint Tech Solutions LLC

    Jersey City, NJ
    2 days ago
  •  ...We are seeking a Data Engineer to build and maintain scalable data infrastructure that supports analytics and machine learning initiatives....  ...and programming skills in Python, Scala, or Java Experience with big data tools and workflow orchestration systems Knowledge of... 
    Big data

    Compunnel

    Jersey City, NJ
    4 days ago
  •  ...the energy sector by creating a unified data network. Backed by experienced founders and...  ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are...  ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or... 
    Big data

    Texture

    New York, NY
    4 days ago
  •  ...in the research, trading and production processes. Role: Data Engineers are responsible for the data infrastructure. The build systems...  .... Minimum Requirements: Production grade, big data ETL pipeline experience. Building and maintaining distributed... 
    Big data

    Quanta Search

    New York, NY
    19 hours ago
  •  ...Job Title Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources. Develop...  ...experience in building large scale data pipelines with mainstream big data stack. Strong expertise in extracting useful information... 
    Big data
    Work experience placement

    1872 Consulting

    New York, NY
    19 hours ago
  •  ...CVS Health Corporation in New York, NY is seeking a Data Engineer to develop, manage, and optimize large-scale data pipelines and structures, ensuring data quality and accessibility. The ideal candidate will have a Master's in a related field and proficiency in programming... 
    Big data
    Remote work

    CVS Health

    New York, NY
    2 days ago
  •  ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer...  ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience... 
    Big data

    Qode

    New York, NY
    4 days ago
  •  ...Senior Data Engineer Position Summary The Senior Data Engineer leads complex data engineering projects, working on designing data architectures...  ...PySpark for data processing. Proficiency in SQL, dealing with big data processing. Proven experience in data processing for data... 
    Big data
    Work experience placement

    Saransh

    New York, NY
    3 days ago
  •  ...reliably. Join our team to help build the data infrastructure that supports and scales our...  ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible...  .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow.... 
    Big data

    Tavily

    New York, NY
    4 days ago
  • Project Description We're looking for a Senior Big Data Developer to join our Data Engineering team in Tel Aviv. You will be a part of our data platform, that is responsible for processing, storing, and serving data for all our core systems. As a Senior Big Data Developer... 
    Big data

    Coherent Solutions, Inc.

    New York, NY
    4 days ago
  •  ...Title: Senior Data Engineer Location: Remote Duration: C2H Salary: 1-2Lkhs Per Month Qualifications Bachelor’s or Master’s degree in Computer...  ...with cloud platforms with GCP preferred Experience using big data technologies (e.g., Hadoop, Spark) Excellent communication... 
    Big data
    Remote work

    TWO95 International

    New York, NY
    2 days ago
  •  ...AI/ML Data Engineer Location: New York, NY (Hybrid – 3 Days Onsite) Duration: Contract Rate: DOE Job Overview: We are seeking an...  ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable... 
    Big data
    Contract work

    Staffing the Universe

    New York, NY
    19 hours ago
  •  ...Role: US Data Engineer Data Platforms Location : Minneapolis, MN 4 days onsite (Only Local applications will be considered) Required skills...  ...Architecture on Data Platform using Machine Learning, --Deep Learning, Big Data Platforms, Natural Language Processing, Data Engineering,... 
    Big data
    Local area

    Openkyber

    Brooklyn, NY
    4 days ago
  • $190k - $250k

    Hebbia is seeking a Data Engineer in New York City to refine its data infrastructure. The ideal candidate will architect ETL pipelines, manage...  ...particularly with Python and SQL, and hands-on experience with big data technologies. They offer a competitive salary range of $19... 
    Big data

    Hebbia

    New York, NY
    3 days ago
  • A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines...  ...have a degree in Computer Science and experience with big data tools like Bigtable and Apache Spark. This... 
    Big data

    Human Power BG

    New York, NY
    4 days ago
  • $60 - $70 per hour

    Sciata is looking for a Data Engineer in Atlanta, GA. You will design, implement, and maintain the data pipeline architecture for our business...  ...in data engineering, strong SQL knowledge, and is skilled with big data tools like Hadoop and Spark. This role involves... 
    Big data
    Hourly pay

    Sciata

    New York, NY
    5 days ago
  • C the Signs is seeking a Data Engineer to enhance our LLMs and machine learning models. You will manage the data lifecycle, working with healthcare...  ...'s degree in a related field and demonstrated experience with big data technologies. This role offers flexibility in work... 
    Big data
    Remote job

    C the Signs

    New York, NY
    5 days ago
  • Verve is seeking a full-time Data Engineer at our NYC headquarters to manage and enhance our data initiatives. The role involves collaborating...  ...platforms, strong SQL skills, and a background in big data products. Enjoy a variety of benefits including unlimited... 
    Big data
    Full time

    Verve

    New York, NY
    5 days ago
  •  ...platforms (i.e., Azure, GPC, AWS) Experience building automated big data pipelines Experience performing data analysis and data...  ...domain knowledge Education Bachelors degree in computer science, Engineering, Statistics, Physics, Math, or related field or equivalent experience... 
    Big data

    Inizio Partners Corp

    New York, NY
    3 days ago
  •  ...team and build large-scale, cutting-edge data platforms from the ground up! This role offers...  ...the opportunity to leverage the latest Big Data technologies without the constraints...  .... Collaborate with business units and engineering teams to develop a long-term Data Platform... 
    Big data

    Dropbox

    New York, NY
    2 days ago
  • $165k - $230k

     ...We’re hiring a Senior Data Engineer to own data at truly massive scale. You’ll design and run pipelines that clean, enrich, and serve data...  ...negotiate and run data partnerships. Nice to have Experience with big data, columnar storage formats, vector indexes, and privacy/... 
    Big data
    Permanent employment
    Work at office
    Monday to Friday

    Raylu

    New York, NY
    1 day ago
  • $175.07k - $325.13k

    Warner Media, LLC. is seeking a Senior Staff Data Engineer in New York, NY. The role involves designing and delivering data pipelines that process...  ...legacy ad-tech systems, and act as a domain expert in big data engineering, mentoring junior engineers alongside cross-functional... 
    Big data

    Warner Media, LLC.

    New York, NY
    5 days ago
  • $150k - $275k

     ...lost in the chaos of fragmented financial data, manual workflows, and opaque payer...  ...You’re excited to shape the future of our engineering team and are excited to lead by example –...  ...coordination and AI pipelines Familiarity with big data technologies and comfortable working... 
    Big data
    Full time
    Private practice
    Work at office
    3 days per week

    Joyful Health

    New York, NY
    3 days ago
  •  ...Position We are looking for an experienced AWS Data Engineer to join the team that develop a data-centric platform that empowers multiple...  ...variety of data sources using Python, SQL, scripting, and AWS big data technologies. Design and implement complex ETL... 
    Big data
    Remote work
    Home office
    Flexible hours

    Grinteq

    New York, NY
    2 days ago
  • $60 - $70 per hour

     ...Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions...  ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data... 
    Big data
    Hourly pay

    Sciata

    New York, NY
    4 days ago
  •  ...Overview We seek a Junior Data Engineer with a passion for developing highly scalable data processing pipelines. The engineer will collaborate...  ...and provide domain‑specific insight regarding storage, big data platform services, serverless architecture, RDBMS, DW/DM,... 
    Big data

    Unrivaled Metal Buildings

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!