Big Data Engineer
STEM Xpert
TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process. Job Description Primary Skills: Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open source products and contribution towards it would be an added advantage. Implemented and in-depth knowledge of various java, J2EE and EAI patterns. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc). Good understanding of algorithms, data structure, and performance optimization techniques. Knowledge of database principles, SQL, and experience working with large databases beyond just data access. Exposure to complete SDLC and PDLC. Capable of working as an individual contributor and within team too. Self-starter & resourceful personality with ability to manage pressure situations. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc. Role & Responsibilities Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products Active participation in the various Architecture and design calls with bigdata customers. Working with Sr. Architects and providing implementation details to offshore. Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData Responsible for Timely and quality deliveries. Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings #J-18808-Ljbffr STEM Xpert
- ...Big Data EngineerJob Type: Full Time EmploymentLocation: Phoenix, AZ or New YorkExperience Required: 6+ YearsResponsibilities:Minimum... ...frameworkHands on experience working on scheduling tools like Event Engine, Control-MHands on experience in Unix shell scriptingStrong...Big dataFull time
Syntricate Technologies
New York, NY11 hours ago - ...Coding expert in Java/Python, Hadoop Ecosystem(HDFS), Spark, Hive, Strong work experience - Agile environment preferred Data Engineer (Big Data - Hadoop, Green Plum, etc. , Data Owner) Designs and builds scalable data pipelines, integrates diverse sources, and...Big dataWork experience placement
Purple Drive
New York, NY1 day ago - ...Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
VortalSoft
New York, NY1 day ago - Job ID: 25546234Reference Number: 25-00476Title: Data EngineerLocation: New York, NYPosted Date: 2025-05-19Contact: Rishabh PandeyContact... ..., data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data...Big data
- ...building, owning, and supporting a world-class data platform for our portfolio managers and... ...are looking for an experienced and eager engineer to join our team in supporting this... ...and databases, especially timeseries and big data stores.• Strong skills in Python/Rust...Big dataWork experience placement
- Primary ResponsibilityAs a Principal Data Engineer, you must be an expert with Big Data technologies like Hadoop, Hive, Hbase, Spark, and various AWS technologies.You will architect and drive the build out of next generation data platform.As a hands-on engineer, you will...Big dataWork experience placement
- ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have...Big dataFull timeRelocationVisa sponsorship
$250k - $300k
...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside... ...’s data assets. In this role, you will:Develop and support big data processing pipelines including but not limited to...Big dataWork experience placement$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders... .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience...Big dataRemote work$170k - $230k
...to follow. If you're energized by shaping data infrastructure from zero to one inside a... ...Self-service reporting that scales spanning Engineering, Science, PM-T, and Design across... ...Preferred qualification - Experience with big data technologies such as: Hadoop, Hive,...Big dataFlexible hours- ...candidate is an inquisitive learner with a passion for security, data and analytics.The candidate must effectively collaborate with stakeholders... ...) as well as advanced designer experience in encapsulation of big data displayed via visualization toolkits aimed to drive action...Big data
- ...Senior Analytics Engineer As a Senior Analytics Engineer, you will support the BI lead data pipeline and ecosystem from end to end. You will be partnering with multiple... ...report to the Director, Business Intelligence. Required Skills: SQL Additional Skills: Big Data...Big data
Samprasoft
New York, NY5 days ago - ...Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...Big data
Saransh
New York, NY2 days ago $50k - $95k
Agency:Hearts & ScienceJob Function:Data and AnalyticsJob Subfunction: Data Science and... ...be reporting to the Senior Director, Data Engineering and be part of Data Engineering Team who... ...pipeline design/development, SQL, AWS Cloud and Big Data Technologies experience. As a Data...Big dataFull timeWork at officeLocal area3 days per week- ...Data Engineer (601/602/603) Must-Have Skills: Strong Python programming (core Python, not just PySpark) Expert-level Apache Spark / PySpark... ...Algorithms Production experience with distributed data processing AWS Big Data services (EMR, Glue) Snowflake Data Lake Control-M Airflow...Big data
VSG Business Solutions
New York, NY1 day ago $111.4k - $185k
...ve come to the right place.SDS is part of the Sales Intelligence, Technology, & Enablement organization (SITE). We are a big-data focused engineering team that provides unique, pan-Amazon datasets consolidating advertiser, seller, and vendor KPIs, exposed via data...Big dataFlexible hours$125k - $145k
...What we're buildingOur team runs a range of data and AI projects across the GPS business.A... ...forThis is a hybrid role that spans data engineering, AI product enablement, and platform... ...tuning and engineering across RDBMS and Big Data platforms such as Oracle Exadata, SQL...Big dataFull timeWork at officeFlexible hoursDay shift- ...Lead Data Engineer – Big Data & Cloud (AWS)(Python)Location: New York, NY (Onsite)Contract: 6 MonthsVisa Status: ONLY GC & USCStrong Python and Big Data expertiseJOB DESCRIPTION:We are seeking a Senior Data Engineer / Technology Lead with 10–15 years of experience to design...Big dataContract work
Argyle Infotech
New York, NY12 hours ago - ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description We are looking for an experienced Data Engineer... ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain experience...Big data
Olik Global
New York, NY1 day ago - ...AI/ML Data EngineerLocation: New York, NY (Hybrid – 3 Days Onsite)Duration: ContractRate... ...We are seeking an experienced AI/ML Data Engineer to join our data and analytics team in New... ...Python, Machine Learning, Generative AI, and big data processing and will be responsible...Big data
Staffing the Universe
New York, NY11 hours ago - Overview Job Title: Senior Data Engineer Department: DigitalReporting To: Manager, Data EngineeringEmployment Type: Full-TimeOverview:Audacy... ..., you’ll play a key role in shaping how Audacy utilizes big data on the magnitude of billions of rows to unlock insights, enhance...Big dataFull timeLocal area
- ...Data EngineerNew York, NY We are looking for a savvy Data Engineer to join our growing team of data experts. The hire will be responsible for designing, implementing... ...knowledge and experience working with and optimizing 'big data' data pipelines, architectures and data sets...Big data
1872 Consulting
New York, NY1 day ago $90k - $135.29k
DescriptionThe Mount Sinai Program for Surgical Intelligence is seeking a Data Engineer to support the development and deployment of data-driven tools... ...and SOA.Proficiency on installation and configuration of big data software and technologyKnowledge of Hadoop, Spark, Kafka...Big dataTraineeshipLocal areaImmediate startFlexible hours- ...Data Engineer The IT & Telecom division is seeking a highly skilled, detail-oriented Data Engineer to support the Enterprise Data Science... ...processing solutions capable of handling very large datasets, or "Big Data." In addition to overseeing Big Data operations, EDSE...Big data
New York City | Jobs
New York, NY4 days ago - A leading performance marketing engine in New York is seeking a Senior Data Engineer to contribute to the development of Micro Batch/Real Time streaming pipelines... ...have a degree in Computer Science and experience with big data tools like Bigtable and Apache Spark. This...Big data
£75k per year
...Data Engineering Lead - AI focused - required for an AI-First SaaS business, offering Remote Working, paying up to circa £75K + Benefits Working Pattern: This is a Remote First team who regularly get together for collaboration, planning and company events, typically every...Big dataFull timeRemote workApply Recruitment
New York, NY1 day ago- ...team and build large-scale, cutting-edge data platforms from the ground up! This role offers... ...the opportunity to leverage the latest Big Data technologies without the constraints... .... Collaborate with business units and engineering teams to develop a long-term Data Platform...Big data
Dropbox
New York, NY1 day ago $60 - $70 per hour
Sciata is looking for a Data Engineer in Atlanta, GA. You will design, implement, and maintain the data pipeline architecture for our business... ...in data engineering, strong SQL knowledge, and is skilled with big data tools like Hadoop and Spark. This role involves...Big dataHourly pay$150k - $275k
...lost in the chaos of fragmented financial data, manual workflows, and opaque payer... ...You’re excited to shape the future of our engineering team and are excited to lead by example –... ...coordination and AI pipelines Familiarity with big data technologies and comfortable working...Big dataFull timePrivate practiceWork at office3 days per weekJoyful Health
New York, NY1 day ago- ...Overview We seek a Junior Data Engineer with a passion for developing highly scalable data processing pipelines. The engineer will collaborate... ...and provide domain‑specific insight regarding storage, big data platform services, serverless architecture, RDBMS, DW/DM,...Big data
Unrivaled Metal Buildings
New York, NY1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- data center engineer New York, NY
- senior cloud data engineer New York, NY
- data infrastructure engineer New York, NY
- sr information security engineer New York, NY
- hadoop big data developer New York, NY
- data visualization developer New York, NY
- associate data engineer New York, NY
- remote data engineer New York, NY
- etl data engineer New York, NY
- data engineer analytics New York, NY