Big Data Engineer
STEM Xpert
TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process. Job Description Primary Skills: Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open source products and contribution towards it would be an added advantage. Implemented and in-depth knowledge of various java, J2EE and EAI patterns. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc). Good understanding of algorithms, data structure, and performance optimization techniques. Knowledge of database principles, SQL, and experience working with large databases beyond just data access. Exposure to complete SDLC and PDLC. Capable of working as an individual contributor and within team too. Self-starter & resourceful personality with ability to manage pressure situations. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc. Role & Responsibilities Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products Active participation in the various Architecture and design calls with bigdata customers. Working with Sr. Architects and providing implementation details to offshore. Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData Responsible for Timely and quality deliveries. Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings #J-18808-Ljbffr Stem Xpert
- ...Azure), DataBricks , Scala, Java, Spark, Pyspark, Python,**Job Description: -**- 11+ years of experience with Azure Data Factory and Databricks with Big Data ecosystem tools (e.g. Hadoop, Hive) and data processing within the EDL for big data pipelines, architectures &...Big data
- ...Data Engineer Our client is a process driven investment management group consisting of a team of researchers, traders and technologists... ...availability. Minimum Requirements: Production grade, big data ETL pipeline experience. Building and maintaining distributed...Big data
- ...Data Engineer Jersey City, New Jersey, United States Title: Data Engineer Join a forward-thinking and innovative organization that values... ...SQL and programming skills (Python/Scala/Java) Experience with big data tools and cloud data platforms Knowledge of data modeling...Big data
- ...Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C Description... ...data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data...Big data
- ...ONSITE And New York, NJ Only GC/Citizens Job Description: Scope of Work POSITIONAs a Lead Engineer you will have the opportunity to engineer and administer TIAA’s big data environment. Your role will be responsible for administering our Hadoop and No‑SQL ecosystem components...Big dataTemporary workWork at office
- A CI está buscando um(a) Engenheiro(a) de Dados Sênior em Campinas. O profissional atuará em soluções baseadas em IA Generativa, focando na integração e análise de dados cadastrais. Com experiência em Python, SQL, Databricks e técnicas de Machine Learning, o candidato ideal...Big data
- A high end technical consulting firm is seeking a Senior Big Data Developer based in NYC. The ideal candidate will have extensive experience... ...Data technologies and will be responsible for developing data engineering solutions in a fast-paced investment banking environment....Big data
$190k - $250k
Hebbia is seeking a Data Engineer in New York City to refine its data infrastructure. The ideal candidate will architect ETL pipelines, manage... ...particularly with Python and SQL, and hands-on experience with big data technologies. They offer a competitive salary range of $19...Big data- A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines... ...have a degree in Computer Science and experience with big data tools like Bigtable and Apache Spark. This...Big data
$175.07k - $325.13k
Warner Media, LLC. is seeking a Senior Staff Data Engineer in New York, NY. The role involves designing and delivering data pipelines that process... ...legacy ad-tech systems, and act as a domain expert in big data engineering, mentoring junior engineers alongside cross-functional...Big data- ...Position We are looking for an experienced AWS Data Engineer to join the team that develop a data-centric platform that empowers multiple... ...variety of data sources using Python, SQL, scripting, and AWS big data technologies. Design and implement complex ETL...Big dataRemote workHome officeFlexible hours
- A leading advertising technology company is looking for a Data Engineer to design and build data pipelines utilizing AWS technologies. This role involves optimizing big data systems and providing actionable analytics tools. The ideal candidate will have strong expertise...Big data
- CLEAR is seeking a Data Engineer II in New York City to enhance their secure identity platform. The role involves building scalable data systems... ...in data engineering and is proficient in cloud services and big data tools like Snowflake, Spark, and AWS. CLEAR offers...Big data
- ...Senior Staff Data Engineer The Senior Staff Data Engineer is accountable for designing and delivering data pipelines that process billions... ...Act as a domain expert in distributed systems, streaming, and big data engineering. · Mentor junior engineers, share best practices...Big data
- ...leading football intelligence technology company is looking for a Data Engineer to design and maintain data pipelines that support deep... ...experience with strong Python and SQL skills, alongside expertise in big-data frameworks like Databricks and orchestration tools such as...Big dataRemote job
- ...Overview: **Required:****10+ yrs exp Data Analyst/Engineer with Financial client experience. Strong SQL, Big data****Required** **NY/NJ locals who can go in person interviews.****Day 1 Onsite in NewYork**Responsibilities:• Perform data enquiry, data analysis and data...Big dataLocal area
- ...Role : Data Engineer Location : New York (Hybrid) Skills - Apptio, Big Data, ETL-Big Data/Data Warehousing, MS SQL, Oracle PL/SQL, Stored Proc Coding, Python, PySpark, Node/Node.JS, RDBMS, Data Analytics Job Description • Individual contributor to...Big data
- ...Data Engineer Associate Our client, a prosperous prop trading firm with headquarters in NYC, is currently recruiting for a Data Engineer... ...on feature engineering. Improve and Support a cutting edge, Big Data market research platform. Design complex relational data...Big data
- ...Data Engineer New York, New York, United States About the Job Required Qualifications: ~ Strong in Python with 3+ years hands... ...(i.e., Azure, GPC, AWS) ~ Experience building automated big data pipelines ~ Experience performing data analysis and data...Big data
$43k - $151k
...PySpark Data Reconciliation Engineer We're seeking a skilled PySpark Data Reconciliation Engineer to join our team and drive the development of... ...algorithms (deterministic and heuristic) using PySpark and relevant big data frameworks. Develop robust error handling and...Big dataFull time- ...Data Platform Engineer Our client is a newly established well backed hedge fund with multiple growth opportunities. You will join the Data... ...or Sybase) and advanced knowledge of SQL ~ Experience with Big Data technologies and Hadoop ecosystem (MapReduce, Hive, Hbase...Big data
- A leading independent media company is seeking a Data Engineer to enhance their data infrastructure. The ideal candidate will develop data pipelines... ...in SQL and Python, and familiarity with cloud platforms and big data technologies. This role offers competitive compensation...Big dataRemote jobFlexible hours
- A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft... ...candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among...Big data
- ...About the job Data Engineer - Palantir Job Description: Palantir Data Engineer We are seeking a seasoned Data Engineer with 3... ...and their integration into data pipelines. Experience with big data technologies like Snowflake. Strong problem-solving and...Big dataWork experience placement
- A leading data solutions firm in New York is seeking an experienced Data Engineer to design, implement, and maintain data pipelines for efficient data flow. The ideal candidate... ...while ensuring data quality. Familiarity with big data technologies and cloud solutions is...Big dataLocal areaRelocation
$150k - $275k
...lost in the chaos of fragmented financial data, manual workflows, and opaque payer... ...You're excited to shape the future of our engineering team and are excited to lead by example... ...coordination and AI pipelines Familiarity with big data technologies and comfortable working...Big dataFull timePrivate practiceWork at office3 days per week- ...Data Engineer (Lead) Role NY 10036 (4 Days onsite) Long term rates upto 85/hr on w2 or 100/hr on c2c self corp. (Preferred W2) Overall 10 to 15 years of exp - Min 4+ exp in hadoop, big data tech, map reduce, hive, spark etc overall 8+ Exp in developing data pipelines...Big data
- ...Role: - Sr. Big Data Engineer Location : - Jersey City, NJ (Onsite) Duration : - Long term Contract Position: - Full-time INTERVIEW MODE : 2 rounds - VIDEO Technical Interview with CODING + HM Interview. MUST SKILLS : Spark, Scala, Python Technical...Big dataLong term contractFull timeWork experience placementFlexible hours
- A leading crypto exchange is looking for a Data Engineer to join their data team. The candidate will work with cloud computing and big data technologies to build and optimize data pipelines, ensuring data accuracy. Responsibilities include managing end-to-end business requirements...Big data
- EPAM Systems, Inc. is seeking an experienced Big Data Engineer to join our engineering team. This role involves migrating data warehouses to AWS services and building scalable data systems. You will develop data models and ensure best practices while collaborating with...Big dataRemote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- staff data engineer New York, NY
- data engineering intern summer New York, NY
- senior data integration developer New York, NY
- data engineer graduate New York, NY
- data engineer contract New York, NY
- data science developer New York, NY
- senior data center engineer New York, NY
- software data engineer New York, NY
- hadoop big data developer New York, NY
- data developer New York, NY

