Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

STEM Xpert

TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process. Job Description Primary Skills: Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open source products and contribution towards it would be an added advantage. Implemented and in-depth knowledge of various java, J2EE and EAI patterns. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc). Good understanding of algorithms, data structure, and performance optimization techniques. Knowledge of database principles, SQL, and experience working with large databases beyond just data access. Exposure to complete SDLC and PDLC. Capable of working as an individual contributor and within team too. Self-starter & resourceful personality with ability to manage pressure situations. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc. Role & Responsibilities Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products Active participation in the various Architecture and design calls with bigdata customers. Working with Sr. Architects and providing implementation details to offshore. Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData Responsible for Timely and quality deliveries. Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings #J-18808-Ljbffr Stem Xpert

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in New York, NY vacancy
  • Responsibilities Create and maintain data pipelines that transfer data from select location...  ...maintaining security protocols) into our Big Data financial crime solution. Develop,...  ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer... 
    Big data

    VortalSoft

    New York, NY
    3 days ago
  •  ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have... 
    Big data
    Full time
    Relocation
    Visa sponsorship

    AdventInfotech

    New York, NY
    3 days ago
  • $225k - $275k

     ...Role Schonfeld Strategic Advisors is seeking an experienced AI Data Engineer to join our Data Engineering team. In this role, you will be...  ...using tools like Apache Airflow, Prefect, Dagster, or similar * Big Data Technologies: Hands-on experience with distributed... 
    Big data
    Full time

    Schonfeld

    New York, NY
    3 days ago
  • $86.4k

     ...requirements)*** This job is responsible for designing and engineering data solutions for the enterprise and, working closely with business...  ...variety of environments, including traditional data warehouses, Big Data solutions, and cloud‑oriented platforms. Work with... 
    Big data
    For contractors
    Work at office
    Local area

    Highmark Health

    New York, NY
    3 days ago
  • Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows...  ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg... 
    Big data

    Saransh

    New York, NY
    4 days ago
  •  ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer...  ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience... 
    Big data

    Qode

    New York, NY
    3 days ago
  •  ...team and build large-scale, cutting-edge data platforms from the ground up! This role offers...  ...the opportunity to leverage the latest Big Data technologies without the constraints...  .... Collaborate with business units and engineering teams to develop a long-term Data... 
    Big data

    Dropbox

    New York, NY
    2 days ago
  •  ...platforms (i.e., Azure, GPC, AWS) Experience building automated big data pipelines Experience performing data analysis and data...  ...knowledge Education Bachelors degree in computer science, Engineering, Statistics, Physics, Math, or related field or equivalent... 
    Big data

    Inizio Partners Corp

    New York, NY
    4 days ago
  • Overview We seek a Junior Data Engineer with a passion for developing highly scalable data processing pipelines. The engineer will collaborate...  ...and provide domain‑specific insight regarding storage, big data platform services, serverless architecture, RDBMS, DW/DM,... 
    Big data

    Unrivaled Metal Buildings

    New York, NY
    3 days ago
  • $150k - $275k

     ...lost in the chaos of fragmented financial data, manual workflows, and opaque payer...  ...You’re excited to shape the future of our engineering team and are excited to lead by example –...  ...coordination and AI pipelines Familiarity with big data technologies and comfortable working... 
    Big data
    Full time
    Private practice
    Work at office
    3 days per week

    Joyful Health

    New York, NY
    3 days ago
  • A leading staffing company is seeking a Senior Data Engineer in New York, NY to design and build scalable data solutions utilizing various Microsoft...  ...candidate will have significant experience in data modeling, big data environments, and programming with SQL and Python, among... 
    Big data

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    3 days ago
  • We are hiring a Data Engineer on behalf of one of our prestigious Fortune 500 Healthcare clients in the United States . This is an excellent...  ...data. Build and optimize data workflows using modern cloud and big data technologies. Collaborate with data analysts, business... 
    Big data
    Visa sponsorship

    KNOWFINITY

    New York, NY
    4 days ago
  • $105k - $145k

    Bustle Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will work alongside the Director of Data...  ...with Python for scripting and automation. Cloud & Big Data Savvy: Hands‑on experience with cloud platforms (AWS, GCP,... 
    Big data
    Work at office
    Remote work
    Flexible hours

    Bdg, Inc

    New York, NY
    4 days ago
  •  ...the energy sector by creating a unified data network. Backed by experienced founders and...  ...for complex analysis by data scientists, engineers, and other stakeholders. Who we are...  ...tools like dbt You have experience with big data technologies like Hadoop, Spark, or... 
    Big data

    Texture

    New York, NY
    2 days ago
  •  ...build and productionize modular and scalable data pipelines and data infrastructure...  ...University in computer science, computer/software engineering or other relevant programs within data...  ...and data solution architecture in a Big Data environment. Experience as a Data Engineer... 
    Big data
    Remote work

    Cpus Engineering Staffing Solutions Inc.

    New York, NY
    4 days ago
  • We are seeking a Senior Big Data Engineer with 8+ years of IT experience and strong expertise in Hadoop, Spark, Python, and Snowflake. The ideal candidate will have hands‑on experience building scalable data pipelines, migrating data from Hadoop to Snowflake using PySpark... 
    Big data

    Veriipro

    New York, NY
    4 days ago
  • $200k - $220k

     ...force behind Schonfeld’s next-generation data platforms, you will architect, operate, and...  ...with quants, data scientists, and fellow engineers to achieve sub-minute SLAs, shape firm-...  ...with Python and SQL Deep expertise in big-data architecture: partitioning, sharding... 
    Big data

    Schonfeld

    New York, NY
    2 days ago
  •  ...love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse...  ..., Polars , PySpark or DuckDB ; 2+ years of experience with Big Data technologies ( Spark , Snowflake ); Expert-level... 
    Big data
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    AgileEngine

    New York, NY
    1 day ago
  •  ...and New York City. About The Role We are looking for a Senior Data Engineer to help design, build, and operate the core data platform that...  .../Presto, Redshift, BigQuery, or Snowflake. Familiarity with big data or distributed processing frameworks such as Spark (or... 
    Big data
    Work at office
    Relocation package

    Nelo

    New York, NY
    4 days ago
  •  ...Services, and Fitness & Wellness industries. We are seeking a Senior Data Engineer to join our client’s team and focus on their product. In this...  ...and processing financial transactions. Blend of skills in Big Data technologies, database management, data integration tools,... 
    Big data
    Immediate start

    Hiretruss

    New York, NY
    2 days ago
  • $175k - $200k

    Senior Data Engineer The Senior Data Engineer is responsible for designing, building, and optimizing enterprise‑scale data pipelines and analytics...  ...., Azure Synapse Analytics, Azure SQL Database, Cosmos DB) and big data technologies. Experience with semi‑structured/NoSQL... 
    Big data

    Simpson Thacher

    New York, NY
    3 days ago
  •  ...reliably. Join our team to help build the data infrastructure that supports and scales our...  ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible...  .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow... 
    Big data

    Tavily

    New York, NY
    4 days ago
  • Create/manage ETL pipelines for the data lake and Snowflake; automate data analysis/aggregation work. Design, build, and manage...  ...Live Coding; onsite may be required. Ideal Candidate: Senior Big Data Engineer with strong PySpark, AWS Glue/EMR, Snowflake, and Python skills... 
    Big data
    Live in

    BCforward

    New York, NY
    13 hours ago
  • $160k - $220k

     ...problem solvers to help us create it. Who you are As a Senior Data Engineer at Metropolis, you will play a key role in shaping data...  ...years of experience with Python, and experience building scalable Big Data solutions and ETL ecosystems Proficiency in SQL, ETL/ELT... 
    Big data
    Temporary work
    Work at office
    Local area
    Afternoon shift

    Metropolis

    New York, NY
    3 days ago
  • $112.6k - $152.81k

     ...Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business...  ...Proficiency to manipulate data (Python, R, SQL, SAS) Strong knowledge of big data analysis and storage tools and technologies Strong... 
    Big data
    Full time
    Flexible hours

    CGS Federal (Contact Government Services)

    New York, NY
    2 days ago
  • Overview Audacy is looking for a Senior Data Engineer to join our dynamic Data Engineering team. In this role, you’ll be at the forefront of...  ...platform, you’ll play a key role in shaping how Audacy utilizes big data on the magnitude of billions of rows to unlock insights,... 
    Big data
    Local area

    Audacy

    New York, NY
    4 days ago
  • $83.43k - $166.86k

     ...at a time. Required Qualifications 5+ years of experience in data engineering, software engineering, data warehousing, or related disciplines...  ...Cloud platform certifications (AWS, Azure, or Google Cloud). Big data and data engineering certifications such as DASCA Associate... 
    Big data
    Hourly pay
    Full time
    Temporary work
    Work experience placement
    Local area

    9025 CVS Shared Services Resources LLC

    New York, NY
    1 day ago
  • $185k

    Senior Data Engineer role at Trepp, Inc. Trepp's Data Platform Team is looking for individuals with strong backgrounds in programming to...  ...in application development At least 3 years of experience in big data technologies At least 1 year of experience with cloud computing... 
    Big data
    Full time
    Temporary work
    Work at office
    Work from home
    Monday to Friday
    Flexible hours

    Trepp, LLC

    New York, NY
    3 days ago
  • $120k - $140k

     ...Opportunity Omni Platform Group (OPG) is currently seeking a senior data engineer to join our technology team. In this role you will build Omni...  ...Python, C++, or other popular language. Experience with big data and/or infrastructure. Bonus for having experience in setting... 
    Big data
    Work at office
    Local area
    Immediate start

    Flywheel

    New York, NY
    4 days ago
  • $60 - $70 per hour

    Long term opportunity | $60-$70 per hour. Job Title: Data Engineer. Must be located in Atlanta, GA. Primary Responsibilities & Essential Functions...  ...from a wide variety of data sources using SQL and GCP or AWS “big data” technologies Build analytics tools that utilize the data... 
    Big data
    Hourly pay

    Sciata

    New York, NY
    13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!