Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Cygnus Professionals Inc

Big Data Engineer Headquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next generation global information technology Solution and Consulting company powered by strong management and leadership team with over 30 person years of experience. Today, Cygnus has strong footprints in more than 4 countries with more than 25 satisfied customers. We strive to extend our presence across industries and geographies with our industry-focused business excellence. Cygnus Professionals Inc. has been named by the US Pan Asian American Chamber of Commerce Education Foundation (USPAACC) as one of the "Fast 100 Asian American Businesses" – joining the country's fastest-growing Asian American-owned companies, based on percentage revenue growth over the immediate past two years. Job Description Greetings from Cygnus Professionals, Hope you're doing great ! I have a requirement for you Kindly go through it, If you feel comfortable and would like to apply for this role so kindly provide me your updated profile along with your contact details and rate part. Role: Big Data Engineer w/Spark Location: Palo Alto, CA Duration: Potential Contract to Hire Mode of Interview: Skype After Phone !! Need Green Card OR US Citizen OR EAD GC Candidates Only!! Position Description:

  • Experience with Java, Spark and Hadoop
  • A minimum of 2 years of experience working with distributed systems
  • Knowledge in distributed system design, data pipelining, and implementation
  • Knowledge in machine learning algorithms
  • Knowledge and experience in building large scale applications using various software design patterns and OO design principles
  • Experience with either distributed computing (Hadoop/Spark/Cloud) or parallel processing (CUDA/threads/MPI)
  • Expertise in design pattern (UML diagrams) and data modeling of large scale analytic systems
  • Experience in research, analysis, and the conversion of large amount of raw collected data and content into new sets of data that is structured and does not reduce data context in order to enable the Productization of new products
  • Worked with data warehousing and distributed/parallel processing of large data sets using parallel computing system to map/reduce computation and Linux clusters (e.g. Hadoop/Cloud technologies, HDFS); cluster;
  • Experienced in modern development methodology such as Agile, Scrum and SDLC
  • Ability to work in a research oriented, fast pace, and highly technical environment
  • Quick thinker and a fast learner, collaborative spirit, and excellent communication and interpersonal skills
Additional Information ** U.S. Citizens and those who are authorized to work independently in the United States are encouraged to apply. We are unable to sponsor at this time. ** All your information will be kept confidential according to EEO guidelines. By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website's terms and privacy policy apply I'm interested Cygnus Professionals

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Palo Alto, CA vacancy
  •  ...Java, Spark and Hadoop A minimum of 2 years of experience working with distributed systems Knowledge in distributed system design, data pipelining, and implementation Knowledge in machine learning algorithms Knowledge and experience in building large scale... 
    Big data
    Contract work
    Immediate start

    Cygnus Professionals Inc

    Palo Alto, CA
    3 days ago
  •  ...Azure – Data Factory, Databricks, Synapse, ADLS Senior Data Engineer – 8+ Years Experience Job Type: Full-Time Work Model: Hybrid Experience: 8+ Years Employment:...  ...Technical Environment Languages: Python, SQL, Scala/Java Big Data: Apache Spark, PySpark, Hadoop Cloud: AWS /... 
    Big data
    Full time
    Work at office
    Remote work

    7Th Sky Tech

    Palo Alto, CA
    5 days ago
  • Data Platform Engineer The Digital Media Solutions Lab at Samsung Research America is building a next-generation data platform to support Smart...  ...technical field. Additional Requirements: Broad knowledge of big data technology landscape (Hadoop, Spark, AWS) Experience... 
    Big data

    Omega Solutions Inc

    Mountain View, CA
    3 days ago
  • $175k - $200k

    Overview East West Bank is looking for a motivated Senior Data Engineer to contribute towards the success of our Data and Analytics Technology...  ...Scala with Databricks/Spark Experience in NoSQL Databases and Big data technologies including Azure CosmosDB or other Document... 
    Big data
    Work experience placement

    East West Bancorp, Inc.

    Palo Alto, CA
    4 days ago
  • $83.98 - $111.27 per hour

     ...Health Care is seeking a dynamic and experienced Senior Manager of Data Engineering to lead our data engineering teams. This role is critical to...  ..., Snowflake, BigQuery, Redshift). Proficiency with big data technologies (e.g., Spark, Kafka) and workflow orchestration... 
    Big data
    Hourly pay
    Full time

    Stanford Health Care

    Palo Alto, CA
    1 day ago
  •  ...Purple DriveBig Data Engineer Share Contractual Sunnyvale, CA | Bentonville, AROverview:Key ResponsibilitiesDesign, develop, and maintain big data pipelines leveraging Hadoop, Spark, and Kafka.Develop and optimize J2EE backend services for large-scale data processing and... 
    Big data

    Purple Drive

    Sunnyvale, CA
    4 days ago
  • Principal Big Data Engineer As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks... 
    Big data

    Omni Inclusive

    Santa Clara, CA
    3 days ago
  •  ...impacting millions of customers worldwide drive value from data at Walmart ScaleInteract with Walmart engineering teams across geographies to leverage expertise and...  ....Your QualificationsMin 6-10 years of Big data development experienceDemonstrates up-to-date expertise... 
    Big data
    Worldwide

    Software Technology Inc

    Sunnyvale, CA
    3 days ago
  •  ...Description Skill Agile, Civil, Database, Data Mining, Developer, Development, Java,...  ...or more years of experience in a Software Engineer, Software Developer, and/or Programmer role...  ...Java with a focus on backend/database, and Big Data solutions  * Demonstrated skill across... 
    Big data
    Full time

    Jobsbridge

    Cupertino, CA
    more than 2 months ago
  • $150.4k - $277.6k

     ...accomplish. We are seeking an exceptional engineer with a background in large scale software...  ...using cutting‑edge technologies to build data intensive systems, designing and optimizing...  ...Java or Scala ~5+ years experience with big data platforms ~ Familiarity with ML/AI... 
    Big data

    Apple

    Sunnyvale, CA
    3 days ago
  •  ...philosophy and how we use AI in our recruiting process here . We’re looking for a Staff Software Engineer to help build the next generation of Pinterest’s big data storage platform. You’ll work on some of the most exciting big data open source technologies —... 
    Big data
    Full time
    Work at office
    Relocation
    Relocation package

    Pinterest

    Palo Alto, CA
    more than 2 months ago
  • Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka,...  ...Strong proficiency in Python, SQL, and potentially Scala/Java. Big Data: Expertise in Apache Spark (Spark SQL, DataFrames,... 
    Big data

    Compunnel, Inc.

    Sunnyvale, CA
    4 days ago
  • $150.4k - $277.6k

     ...accomplish. We are seeking an exceptional engineer with a background in large scale software...  ...using cutting‑edge technologies to build data intensive systems, designing and optimizing...  ...: Java or Scala 5+ years experience with big data platforms Familiarity with ML/AI workflows... 
    Big data

    Apple

    Sunnyvale, CA
    4 days ago
  • Relig Staffing in Redwood City, California is seeking a Big Data Developer with expertise in Java, Hadoop, and Spark. The ideal candidate will have a Bachelor's degree and a minimum of 4 years of experience in Big Data Development. You will be responsible for understanding... 
    Big data

    Relig Staffing

    Redwood City, CA
    3 days ago
  • $70 - $95 per hour

     ...Job Description Job Description Data Engineer The Cloud services group is looking for world class engineers to join our technology innovation...  .... Looking for world class server software engineers with Big Data Infrastructure and Data warehousing experience to join our... 
    Big data
    Hourly pay

    Cypress HCM

    Mountain View, CA
    25 days ago
  •  ...Description Description: TSW Core is looking for a highly motivated Data Engineer. In this role, you will be responsible for designing and...  ...for both real-time and batch data processing in the big data domain, promoting their adoption in various business use cases... 
    Big data

    TSW Core LLC

    Palo Alto, CA
    3 days ago
  • $65 per hour

     ...onsite and offshore delivery models. We are currently looking for a Data Engineer to support our client in Sunnyvale, CA for a long-term contract...  ...designing, developing, testing, and deploying enterprise-grade big data solutions that drive critical business initiatives. The... 
    Big data
    Long term contract
    Local area

    DRISHTICON Inc

    Sunnyvale, CA
    3 days ago
  • $175k - $221k

     ...content intelligence. If you're inspired to dream big, innovate fast, and make a difference, we'd love...  ...A/B test, and every ML model we ship runs on the data infrastructure you'd own. We're looking for a senior engineer to build and scale the batch and streaming... 
    Big data
    Full time
    Local area
    Work from home

    NewsBreak

    Mountain View, CA
    27 days ago
  • $72k - $108k

    Role description Data Engineer Lead I - Data Engineering Who We Are: Born digital, UST transforms lives through the power of technology. We...  ...Strong proficiency in Python, SQL, and potentially Scala/Java. Big Data: Expertise in Apache Spark (Spark SQL, DataFrames, Streaming... 
    Big data
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Flexible hours

    UST

    Sunnyvale, CA
    3 days ago
  • $192.1k - $307.8k

     ...Progress starts with you. Job Description The Senior Manager, Data Engineering, leads teams in designing, building, and overseeing the deployment...  ...is responsible for establishing processes, automations, and big data systems based on business and technical requirements,... 
    Big data
    Work experience placement
    Work at office
    Local area

    Visa

    Foster, CA
    4 days ago
  • $180k - $220k

     ...Position Summary We are seeking a talented and experienced Data Platform Engineer to join our team as the Technical Lead. The ideal candidate...  ...such as Python, Java, or Scala. ~ Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh... 
    Big data
    Full time
    Local area
    Immediate start
    Flexible hours
    Shift work
    3 days per week

    Harness Inc.

    Mountain View, CA
    more than 2 months ago
  • $172k - $258k

     ...small, highly motivated, and focused on engineering excellence. This organization is for individuals...  ...ABOUT THE ROLE: At SpaceXAI, the IT Data Engineering team implements and supports...  ...integrations and real-time pipelines Big data technologies (Hadoop, MongoDB, HBase... 
    Big data
    Temporary work

    SpaceXAI

    Palo Alto, CA
    8 days ago
  • $155k - $185k

     ...Opportunity We are looking for an experienced Software Engineer with a passion for building robust and scalable data infrastructure to join our Data Platform team. In...  ...or Databricks Has experience with streaming and big data processing frameworks (e.g., Kafka, Spark) Is... 
    Big data
    Permanent employment

    Otter.ai

    Mountain View, CA
    3 days ago
  • Azure Data Engineer As a Data Engineer on the Data Science and Platform team, you will: Develop and maintain data pipelines including solutions...  ...technologies, including relational databases, data warehouse, big data (Spark), orchestration/data pipeline tools, data frames... 
    Big data
    Work experience placement

    Omega Solutions

    Santa Clara, CA
    3 days ago
  •  ...Senior Data Engineer We are looking for a Senior Data Engineer to work with a leading generative AI company in healthcare. Location: Palo Alto, CA office. This role is expected to be in our Palo Alto office five days a week. Benefits include 401k, equity, and on-... 
    Work at office

    Investigo

    Palo Alto, CA
    3 days ago
  •  ...Role: Data Engineer Location: Palo Alto, CA / Bay Area, CA (Hybrid) Duration: Long Term Contract Job Summary: We are seeking an experienced Data Engineer with strong expertise in structured and unstructured data engineering, data ingestion, connectivity, and knowledge... 
    Long term contract

    Apptad

    Palo Alto, CA
    5 days ago
  • $72 - $92 per hour

     ...employees work in their local metro area onsite at the project, significantly reducing and/or eliminating the demands to travel. As a Data Engineer you will be responsible for designing developing and maintaining data solutions that support data generation collection and... 
    Hourly pay
    Live in
    Work at office
    Local area
    Flexible hours

    Accenture

    Mountain View, CA
    3 days ago
  •  ..., collaborate, and communicate across media. Our team includes engineers, artists, and product thinkers, all passionate about building tools...  ...launching products together. About the Role We are seeking a Data Engineer to design, build, and scale the data infrastructure... 
    Work at office

    Pika Labs Inc.

    Palo Alto, CA
    5 days ago
  •  ...Recruitment Duration: 05+ Months Contract Description: Responsible for developing, refactoring, and optimizing real-time data processing applications using Apache Flink. Developing, refactoring, and optimizing batch data processing applications using... 
    Contract work

    Motion Recruitment

    Mountain View, CA
    2 days ago
  • $65 - $70 per hour

     ...Job Description Insight Global is seeking a talented Data Engineer to join our team within the Edge Network Services division. This role will support the M360 project, focusing on data analytics and metrics. As part of the ENS Analytics team, you will enable data-driven... 

    Insight Global

    Menlo Park, CA
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!