Big Data Engineer
STEM Xpert
TekWissen provides a unique portfolio of innovative capabilities that seamlessly combines clients insights, strategy, design, software engineering and systems integration. Our tightly integrated offerings are tailored to each clients requirements and span the services spectrum from Application Development/Maintenance testing, IT Consulting & staffing for IT Infrastructure Management through strategic consulting and industry-oriented business process. Job Description Primary Skills: Very strong server-side Java experience, especially in an open source, data-intensive, distributed environments. Should have worked on open source products and contribution towards it would be an added advantage. Implemented and in-depth knowledge of various java, J2EE and EAI patterns. Implemented complex projects dealing with the considerable data size (GB/ PB) and with high complexity. Well aware of various Architectural concepts (Multi-tenancy, SOA, SCA etc) and NFR’s (performance, scalability, monitoring etc). Good understanding of algorithms, data structure, and performance optimization techniques. Knowledge of database principles, SQL, and experience working with large databases beyond just data access. Exposure to complete SDLC and PDLC. Capable of working as an individual contributor and within team too. Self-starter & resourceful personality with ability to manage pressure situations. Should have experience/ knowledge on working with batch processing/ Real time systems using various Open source technologies like Solr, hadoop, NoSQL DB’s, Storm, kafka etc. Role & Responsibilities Implementation of various solutions arising out of the large data processing (GB’s/ PB’s) over various NoSQL, Hadoop and MPP based products Active participation in the various Architecture and design calls with bigdata customers. Working with Sr. Architects and providing implementation details to offshore. Conducting sessions/ writing whitepapers/ Case Studies pertaining to BigData Responsible for Timely and quality deliveries. Fulfill organization responsibilities – Sharing knowledge and experience within the other groups in the org., conducting various technical sessions and trainings #J-18808-Ljbffr Stem Xpert
- ...Linux servers troubleshooting and support tasks Oversee governance and mitigate risk Qualifications Masters or Bachelor in CIS / Engineering / Science / Mathematics / Statistics / Design… etc. Should be Mexican Citizen eligible for TN visa sponsorship Should have...Big dataFull timeRelocationVisa sponsorship
- ...Job Title: AI/ML Data Engineer (Python, GenAI, ML Modeling) Location: New York, NY (Hybrid - 3 Days Onsite) Duration: Contract... ...strong expertise in Python, Machine Learning, Generative AI, and big data processing and will be responsible for building scalable...Big dataContract work
Georgia IT Inc
New York, NY1 day ago - Responsibilities Create and maintain data pipelines that transfer data from select location... ...maintaining security protocols) into our Big Data financial crime solution. Develop,... ...in Big Data, data analytics, and data engineering. Requirements Bachelor s degree in computer...Big data
- Big Data Engineer Participate as a member of a small team to release the full potential of Big Data in AT&T through a combination of platform technology, collective human intelligence and the vast data resources available to our company. Will provide rich insight into consumer...Big data
- Big Data Engineer Location: Remote/USA Duration: 6-12+ Months Job Description: BS degree in computer science, computer engineering or equivalent 5 - 6 years of experience delivering enterprise software solutions Proficient in Spark, Scala, Python, AWS Cloud technologies...Big dataRemote work
- ...Description Build What Matters at RevStar Role Title: Data & AI Engineer (Databricks Specialist) Reports To: Data & AI Practice Lead... ...greenfield Lakehouse solutions at the bleeding edge of AI and big data? RevStar is an innovation shop and official Databricks Partner...Big dataRemote jobFull time
Revstar
New York, NY1 day ago - Job Title: Big Data Engineer Job Summary: We are seeking a highly skilled Big Data Engineer to design, develop, and maintain scalable data processing systems capable of handling large volumes of structured, semi-structured, and unstructured data. The ideal candidate...Big dataFull timeRemote work
- A leading independent media company is seeking a Data Engineer to enhance their data infrastructure. The ideal candidate will develop data pipelines... ...in SQL and Python, and familiarity with cloud platforms and big data technologies. This role offers competitive compensation...Big dataRemote jobFlexible hours
- ...building, owning, and supporting a world-class data platform for our portfolio managers and... ...are looking for an experienced and eager engineer to join our team in supporting this... ...and databases, especially timeseries and big data stores.• Strong skills in Python/Rust...Big dataWork experience placement
Balyasny Asset Management
New York, NY6 days ago - BlackRock, Inc. in New York is seeking a skilled data professional to build and maintain highly scalable data management systems. You will proactively improve Big Data processing pipelines and design predictive models that enhance investment decisions. The ideal candidate...Big data
- Veriipro in New York City is seeking a Senior Big Data Engineer with 8+ years of IT experience and hands-on expertise in Hadoop, Spark, Python, and Snowflake. You will design scalable data pipelines, migrate data from Hadoop to Snowflake using PySpark, and develop enterprise...Big data
- Job Description: Senior ML Data Engineer Feature Engineering ETL Qualifications 7 years in data engineering and at least 4 years focusing... ...a strong plus and advanced skills in Apache Spark PySpark for big data processing and analytics Proficient in Python for data manipulation...Big dataRemote job
- Job Title Responsibilities Build reliable data pipelines to clean, aggregate, and transform large volumes of data from multiple sources... ...experience in building large scale data pipelines with mainstream big data stack. Strong expertise in extracting useful information...Big dataWork experience placement
- Purple Drive We are seeking a highly skilled Palantir Data Engineer to design, develop, and maintain scalable data solutions using Palantir... ...Skills & Experience: Strong expertise in Palantir Foundry and big data frameworks (Spark, Hadoop). Proficiency in Python, PySpark...Big data
- ...Principal Data Engineer At T-Mobile, we invest in YOU! Our Total Rewards Package ensures that employees get the same big love we give our customers. All team members receive a competitive base salary and compensation package - this is Total Rewards. Employees enjoy...Big dataFull timeTemporary workPart timeWork experience placementLocal areaFlexible hours
T Mobile US
New York, NY3 days ago - Position Summary Lead complex data engineering projects; design data architectures aligned with business requirements; optimize data workflows... ...with Python scripting and PySpark. Proficiency in SQL and big data processing. Experience with data lake processing in Iceberg...Big data
- ...Job Description Job Description Job Title: Big Data Engineer Job Type: Contractor Location: Remote Job Summary: In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform...Big dataFor contractorsRemote work
YO AI Labs
New York, NY3 days ago - ...A leading data streaming platform company is looking for a Staff Product Manager to contribute to their Kafka Connect team. This role focuses on enterprise feature development and requires a strong background in technical product management. Ideal candidates will have...Big data
Confluent
New York, NY2 days ago - Role: Sr. Data Engineer Location: New York,NY Longterm Client: Mphasis | JPMC Rate: $60/Hr on C2C Description: Required Skills: Proficiency... ...data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage formats (Parquet, Iceberg, or similar), data...Big data
- Data Engineer Texture is revolutionizing the energy sector by creating a unified data network. Backed by experienced founders and ample funding... ...in ELT processes and tools like dbt You have experience with big data technologies like Hadoop, Spark, or Flink You can write...Big data
$160k - $220k
...broader economy through deep fundamental research and applying data science and engineering techniques to alternative data sets. You’ll work alongside... ...’s data assets. In this role, you will:Develop and support big data processing pipelines including but not limited to...Big dataWork experience placementPoint72
New York, NYa month ago$100 - $130 per hour
A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hrUS Citizens or GC Holders... .../CD pipelinesPresto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus Experience...Big dataRemote workOpen Systems Technologies
New York, NYa month ago- Data Engineers We’re looking for Data Engineers to help clean and reconcile critical insurance producer data across 70 operating units. In... ...reconciliation solutions. Prior work with Databricks or similar big data platforms (Spark, Hadoop). Experience integrating...Big dataContract workRemote work
- Sr. Data Engineer Sr. Data Engineer ideally with GCP experience, mainly Dataflow and Apache Beam (Java). If not GCP, AWS or Azure. Additionally... .../Unix background and hands on knowledge. Past experience with big data technologies including HDFS, Spark, Impala, Hive...Big dataWork experience placementRemote work
- ...reliably. Join our team to help build the data infrastructure that supports and scales our... ...a highly motivated and experienced Data Engineer to join our growing team. You will be responsible... .../S3 General/S3 Express. Experience with big data technologies Experience with Airflow...Big data
- Data Engineer(Cloud) Location: Durham NC, Westlake TX (Till Sept Remote) Duration: 12+ Months The Expertise and Skills You Bring Good working... ...knowledge of message queuing, stream processing, and scalable ‘big data’ data stores. Experience supporting and working with cross...Big dataRemote work
- Job Title:Lead Data Engineer - Big Data & Cloud (AWS)(Python) Location: New York, NY (Onsite) Contract: 6 Months Visa Status: ONLY GC & USC Strong Python and Big Data expertise JOB DESCRIPTION: We are seeking a Senior Data Engineer / Technology Lead with 10-15 years of...Big dataContract work
- ...Description Bustle Digital Group (BDG) is looking for a talented Data Engineer to join our growing data team. You will work alongside the... ...experience with Python for scripting and automation. Cloud & Big Data Savvy: Hands-on experience with cloud platforms (AWS, GCP...Big dataWork at officeRemote workFlexible hours
BDG
New York, NY23 days ago - Data Developer Apex Systems is now hiring Data Developers for one of our top clients in... ...operational logs (infrastructure, application engineering, etc) from various internal sources and... ...—heavy coding Python, PySpark Building big data streaming pipelines from scratch and...Big dataHourly payLocal areaImmediate startRemote work
$220k - $245k
...can. About the role: We are seeking an exceptional Senior Data Engineer with a high sense of ownership who is excited about our mission... ...distributed data processing, data warehousing, data governance, Big Data, data variance, data privacy, and data quality) ~ Expertise...Big dataWork at officeFlexible hours3 days per weekGarner Health
New York, NY17 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
- aws data engineer New York, NY
- director data engineering New York, NY
- data platform engineer New York, NY
- data engineer machine learning New York, NY
- data science developer New York, NY
- senior data engineer New York, NY
- finance data engineer New York, NY
- bi data engineer New York, NY
- principal data engineer New York, NY
- big data devops engineer New York, NY