Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

STEM Xpert

TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process. Job Description Primary Skills: Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open source products and contribution towards it would be an added advantage. Implemented and in-depth knowledge of various java, J2EE and EAI patterns. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc). Good understanding of algorithms, data structure, and performance optimization techniques. Knowledge of database principles, SQL, and experience working with large databases beyond just data access. Exposure to complete SDLC and PDLC. Capable of working as an individual contributor and within team too. Self-starter & resourceful personality with ability to manage pressure situations. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc. Role & Responsibilities Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products Active participation in the various Architecture and design calls with bigdata customers. Working with Sr. Architects and providing implementation details to offshore. Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData Responsible for Timely and quality deliveries. Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings #J-18808-Ljbffr Stem Xpert

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
  •  ...Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**Job Description: -**- 11+ years of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data pipelines, architectures &... 
    Big data

    Guru Schools

    New York, NY
    2 days ago
  •  ...Data Engineer Our client is a process driven investment management group consisting of a team of researchers, traders and technologists...  ...availability. Minimum Requirements: Production grade, big data ETL pipeline experience. Building and maintaining distributed... 
    Big data

    Quanta Search

    New York, NY
    14 days ago
  •  ...Data Engineer Jersey City, New Jersey, United States Title: Data Engineer Join a forward-thinking and innovative organization that values...  ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling... 
    Big data

    Glint Tech Solutions LLC

    Jersey City, NJ
    3 days ago
  •  ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C Description...  ...data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data... 
    Big data

    Concord IT Systems

    New York, NY
    2 days ago
  •  ...ONSITE And New York, NJ Only GC/Citizens Job Description: Scope of Work POSITIONAs a Lead Engineer you will have the opportunity to engineer and administer TIAA’s big data environment. Your role will be responsible for administering our Hadoop and No‑SQL ecosystem components... 
    Big data
    Temporary work
    Work at office

    Randstad

    West New York, NJ
    2 days ago
  • A CI está buscando um(a) Engenheiro(a) de Dados Sênior em Campinas. O profissional atuará em soluções baseadas em IA Generativa, focando na integração e análise de dados cadastrais. Com experiência em Python, SQL, Databricks e técnicas de Machine Learning, o candidato ideal...
    Big data

    CI

    New York, NY
    3 days ago
  • A high end technical consulting firm is seeking a Senior Big Data Developer based in NYC. The ideal candidate will have extensive experience...  ...Data technologies and will be responsible for developing data engineering solutions in a fast-paced investment banking environment.... 
    Big data

    Wissen Australia Pty

    New York, NY
    5 days ago
  • $190k - $250k

    Hebbia is seeking a Data Engineer in New York City to refine its data infrastructure. The ideal candidate will architect ETL pipelines, manage...  ...particularly with Python and SQL, and hands-on experience with big data technologies. They offer a competitive salary range of $19... 
    Big data

    Hebbia

    New York, NY
    1 day ago
  • A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines...  ...have a degree in Computer Science and experience with big data tools like Bigtable and Apache Spark. This... 
    Big data

    Human Power BG

    New York, NY
    3 days ago
  • $175.07k - $325.13k

    Warner Media, LLC. is seeking a Senior Staff Data Engineer in New York, NY. The role involves designing and delivering data pipelines that process...  ...legacy ad-tech systems, and act as a domain expert in big data engineering, mentoring junior engineers alongside cross-functional... 
    Big data

    Warner Media, LLC.

    New York, NY
    3 days ago
  •  ...Position We are looking for an experienced AWS Data Engineer to join the team that develop a data-centric platform that empowers multiple...  ...variety of data sources using Python, SQL, scripting, and AWS big data technologies. Design and implement complex ETL... 
    Big data
    Remote work
    Home office
    Flexible hours

    Grinteq

    New York, NY
    5 days ago
  • A leading advertising technology company is looking for a Data Engineer to design and build data pipelines utilizing AWS technologies. This role involves optimizing big data systems and providing actionable analytics tools. The ideal candidate will have strong expertise... 
    Big data

    She Runs It

    New York, NY
    2 days ago
  • CLEAR is seeking a Data Engineer II in New York City to enhance their secure identity platform. The role involves building scalable data systems...  ...in data engineering and is proficient in cloud services and big data tools like Snowflake, Spark, and AWS. CLEAR offers... 
    Big data

    I did my part and supported the Regular Toilet

    New York, NY
    5 days ago
  •  ...Senior Staff Data Engineer The Senior Staff Data Engineer is accountable for designing and delivering data pipelines that process billions...  ...Act as a domain expert in distributed systems, streaming, and big data engineering. · Mentor junior engineers, share best practices... 
    Big data

    Warner Bros.

    New York, NY
    4 days ago
  •  ...leading football intelligence technology company is looking for a Data Engineer to design and maintain data pipelines that support deep...  ...experience with strong Python and SQL skills, alongside expertise in big-data frameworks like Databricks and orchestration tools such as... 
    Big data
    Remote job

    SumerSports LLC

    New York, NY
    5 days ago
  •  ...Overview: **Required:****10+ yrs exp Data Analyst/Engineer with Financial client experience. Strong SQL, Big data****Required** **NY/NJ locals who can go in person interviews.****Day 1 Onsite in NewYork**Responsibilities:• Perform data enquiry, data analysis and data... 
    Big data
    Local area

    Guru Schools

    New York, NY
    2 days ago
  •  ...Role : Data Engineer Location : New York (Hybrid) Skills - Apptio, Big Data, ETL-Big Data/Data Warehousing, MS SQL, Oracle PL/SQL, Stored Proc Coding, Python, PySpark, Node/Node.JS, RDBMS, Data Analytics Job Description • Individual contributor to... 
    Big data

    Inficare

    New York, NY
    3 days ago
  •  ...Data Engineer Associate Our client, a prosperous prop trading firm with headquarters in NYC, is currently recruiting for a Data Engineer...  ...on feature engineering. Improve and Support a cutting edge, Big Data market research platform. Design complex relational data... 
    Big data

    Quanta Search

    New York, NY
    4 days ago
  •  ...Data Engineer New York, New York, United States About the Job Required Qualifications: ~ Strong in Python with 3+ years hands...  ...(i.e., Azure, GPC, AWS) ~ Experience building automated big data pipelines ~ Experience performing data analysis and data... 
    Big data

    Inizio Partners

    New York, NY
    a month ago
  • $43k - $151k

     ...PySpark Data Reconciliation Engineer We're seeking a skilled PySpark Data Reconciliation Engineer to join our team and drive the development of...  ...algorithms (deterministic and heuristic) using PySpark and relevant big data frameworks. Develop robust error handling and... 
    Big data
    Full time

    Photon

    Jersey City, NJ
    4 days ago
  •  ...Data Platform Engineer Our client is a newly established well backed hedge fund with multiple growth opportunities. You will join the Data...  ...or Sybase) and advanced knowledge of SQL ~ Experience with Big Data technologies and Hadoop ecosystem (MapReduce, Hive, Hbase... 
    Big data

    Quanta Search

    New York, NY
    4 days ago
  • A leading independent media company is seeking a Data Engineer to enhance their data infrastructure. The ideal candidate will develop data pipelines...  ...in SQL and Python, and familiarity with cloud platforms and big data technologies. This role offers competitive compensation... 
    Big data
    Remote job
    Flexible hours

    BDG

    New York, NY
    2 days ago
  • A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft...  ...candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among... 
    Big data

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    1 day ago
  •  ...About the job Data Engineer - Palantir Job Description: Palantir Data Engineer We are seeking a seasoned Data Engineer with 3...  ...and their integration into data pipelines. Experience with big data technologies like Snowflake. Strong problem-solving and... 
    Big data
    Work experience placement

    Inizio Partners

    Jersey City, NJ
    3 days ago
  • A leading data solutions firm in New York is seeking an experienced Data Engineer to design, implement, and maintain data pipelines for efficient data flow. The ideal candidate...  ...while ensuring data quality. Familiarity with big data technologies and cloud solutions is... 
    Big data
    Local area
    Relocation

    Yeah! Global

    New York, NY
    4 days ago
  • $150k - $275k

     ...lost in the chaos of fragmented financial data, manual workflows, and opaque payer...  ...You're excited to shape the future of our engineering team and are excited to lead by example...  ...coordination and AI pipelines Familiarity with big data technologies and comfortable working... 
    Big data
    Full time
    Private practice
    Work at office
    3 days per week

    Joyful Health

    New York, NY
    2 days ago
  •  ...Data Engineer (Lead) Role NY 10036 (4 Days onsite) Long term rates upto 85/hr on w2 or 100/hr on c2c self corp. (Preferred W2) Overall 10 to 15 years of exp - Min 4+ exp in hadoop, big data tech, map reduce, hive, spark etc overall 8+ Exp in developing data pipelines... 
    Big data

    Cardinal Integrated

    New York, NY
    4 days ago
  •  ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ (Onsite) Duration : - Long term Contract Position: - Full-time INTERVIEW MODE : 2 rounds - VIDEO Technical Interview with CODING + HM Interview. MUST SKILLS : Spark, Scala, Python Technical... 
    Big data
    Long term contract
    Full time
    Work experience placement
    Flexible hours

    Maintec Technologies

    Jersey City, NJ
    4 days ago
  • A leading crypto exchange is looking for a Data Engineer to join their data team. The candidate will work with cloud computing and big data technologies to build and optimize data pipelines, ensuring data accuracy. Responsibilities include managing end-to-end business requirements... 
    Big data

    Framework Ventures

    New York, NY
    5 days ago
  • EPAM Systems, Inc. is seeking an experienced Big Data Engineer to join our engineering team. This role involves migrating data warehouses to AWS services and building scalable data systems. You will develop data models and ensure best practices while collaborating with... 
    Big data
    Remote job

    EPAM Systems, Inc.

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!