Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hadoop Developer

SonSoft Inc

Hadoop Developer

Sonsoft, Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.

Job Description

Responsibilities:

  • Responsible for data ingestion, data quality, development, production code management and testing/deployment strategy in BigData development (Hadoop).
  • Acts as a lead in identification and troubleshooting processing issues impacting timely availability of data in the BigData or delivery of critical reporting within established SLAs. Provide mentoring to Level 2 production support team.
  • Identifies and recommends technical improvements in production application solutions or operational processes in support of BigData platform and information delivery assets (ie, data quality, performance, supporting Data scientists etc.)
  • Focuses on the overall stability and availability of the BigData platform and the associated interfaces and transport protocols.
  • Researches, manages and coordinates resolution of complex issues through root cause analysis as appropriate
  • Establishes and maintains productive relationships with technical leads of key operational sources systems providing data to BigData platform.
  • Establishes and maintains productive relationships with technical leads of key infrastructure support areas, such as system/Infra engineers.
  • Participate in daily standup meetings.
  • Ensure adherence to established problem / incident management, change management and other internal IT processes
  • Responsible for communication related to any day to day issues and problem resolutions. Communication may include direct department management as well downstream/upstream application contacts and business partners.
  • Ensures comprehensive knowledge transition from development teams on new or modified applications moving to ongoing production support.
  • Seeks improvement opportunities in design, solution implementation approaches in partnership with development team for ensuring the performance and health of the BigData platform.
  • Ensures timely and accurate escalation of issues to management

Requirements:

  • At least 2+ years developing and supporting data ingestion using Talend for BigData/Hadoop. (sourced from Teradata, Oracle, files etc)
  • Java, Oozie knowledge is preferable. Talend, Pig, Python, Hive knowledge is a must.
  • Familiar with all components of the BigData stack in detail, e.g., Hadoop, Pig, Hive, HBase, Oozie
  • Advanced experience with large BigData or Data warehouse environment is a plus.
  • Possess a strong technology, data, and production support background.
  • Proven experience working with onshore/off shore support team.
  • Previous experience working in a high paced, high pressure Production Support environment.
  • Proven analytical and problem solving skills for assessment of complex production support issues and recommend / implement effective solutions
  • Previous experience in using IT Ticketing processes for managing incidents and issue resolution and conversant with established Change control / Change management standards
  • Natural technical and functional curiosity
  • Familiar with Agile Methodology.
  • Excellent communication skills.

Preferred

  • Experience in Design and architecture review.
  • Ability to work in team in diverse/ multiple stakeholder environment
  • Ability to work in Onsite Offshore model
  • Experience in Financial Services Domain.
  • Experience and desire to work in a Global delivery environment.
Qualifications
  • Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
  • At least 4 years of experience with Information Technology.
Additional Information

** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.

Note:

  1. This is a Full-Time Permanent job opportunity for you.
  2. Only US Citizen, Green Card Holder, TN Visa, GC-EAD, H4-EAD & L2-EAD can apply.
  3. No OPT-EAD & H1B Consultants please.
  4. Please mention your Visa Status in your email or resume.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Hadoop Developer in San Francisco, CA vacancy
  • A tech company is looking for a Senior Software Engineer with 8 to 11 years of experience, focusing on Hadoop management and automation. You will be responsible for setting up and managing Hadoop clusters, providing 24x7 support, and performance tuning. Candidates should... 
    Suggested

    Arka Infotech Inc

    San Francisco, CA
    5 days ago
  •  ...leading IT consulting firm in San Francisco is seeking a Senior Core Data Engineer with strong Java programming skills and experience in Hadoop MapReduce and NoSQL databases like HBase or Cassandra. The role involves ingesting large datasets, processing them, and serving the... 
    Suggested

    SA TECHNOLOGIES

    San Francisco, CA
    5 days ago
  •  ...Senior Database Engineer(Elastic/Mongo/Hadoop) Senior Database Engineer(Elastic/Mongo/Hadoop) Workplace Type : Remote - Region : San...  ...instances with TLS/SSL and/or LDAP • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-... 
    Suggested
    Remote work

    CatchProbe Intelligence Technologies

    San Francisco, CA
    5 days ago
  •  ...scale. Candidate must have experience working on distributed messaging systems like Kafka. Exposure to Spark, Hadoop and Hive is plus. Develops innovation strategies, processes, and best practices. Drives the execution of multiple business plans and projects... 
    Suggested
    Contract work

    My3Tech Inc

    San Francisco, CA
    1 day ago
  • $194k - $267k

     ...systems like Flink, Spark, Beam ~ Storage & Compute systems such as Snowflake, Hadoop ~ Coordinators and schedulers like the ones in Kubernetes, Hadoop, Mesos Experience in developing and tuning highly scalable distributed systems Excellent grasp of... 
    Suggested
    Permanent employment
    Work at office
    Local area
    Worldwide
    Flexible hours

    Okta, Inc.

    San Francisco, CA
    2 days ago
  • $171.12k - $213.9k

     ...solutions tohundreds of thousands of businessesand empower millions of developers worldwide to craft personalized customer experiences. Our...  ...systems. ~ Expertise in big data technologies such as Hadoop, Spark, Kafka, and other distributed computing systems. ~ Experience... 
    Local area
    Remote work
    Worldwide

    Twilio

    San Francisco, CA
    1 day ago
  •  ...audiences. Key Responsibilities Team Objectives: Design, develop, and modernize backend services to replace legacy mainframe...  ...: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms:... 
    Contract work
    Work at office

    Mindlance

    San Francisco, CA
    2 days ago
  • $104.33k - $156.49k

     ...Integration tools administration. Hands‑on experience with data warehouse technologies (Snowflake, Redshift) and big‑data technologies (Hadoop, Hive, Spark, Kafka, Kinesis). Experience evaluating new tools and enriching existing architecture. You are a self‑starter, hands... 
    Work experience placement
    Work at office
    Local area
    Flexible hours
    3 days per week
    1 day per week

    I did my part and supported the Regular Toilet

    San Francisco, CA
    3 days ago
  • $81.4k - $151.8k

     ...experience with SQL, NoSQL, Python, Spark, Scala ~ Experience with SSIS, Glue, cloud storage and computing services (e.g. AWS, Azure), Hadoop, Netezza ~ Experience with structured, semi structured and unstructured datasets in batch and streaming ~ Experience with data... 
    Part time
    Local area

    Bmo

    San Francisco, CA
    1 day ago
  •  ...to join our talented Team. Job Title: Full Stack Developer Location(s): San Francisco, CA. Job Description:...  ...Large Scale Databases (MySQL, Oracle, MongoDB, HBase, Cassandra, Hadoop). Test Driven Development (junit/phpunit/RSpec/Cucumber).... 

    Ampcus

    San Francisco, CA
    4 days ago
  •  ...Sr. Java Developer With Kafka Headquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next generation global information technology...  ...experience working with Kafka; experience working with Spark, Hadoop, Storm or any realtime stream analysis platform... 
    Contract work
    Local area
    Immediate start

    Cygnus Professionals

    San Francisco, CA
    2 days ago
  • $148.5k - $260.1k

     ...Infrastructure as Code \*\*(Terraform)\*\*.* Solid understanding of NoSQL, distributed systems, and big data ecosystems such as \*\*Hadoop, HDFS, and Apache Zookeeper\*\*.* Familiarity with AI/ML frameworks and experience integrating machine learning models with... 

    Salesforce, Inc.

    San Francisco, CA
    4 days ago
  •  ...have You will work with Sales and other essential partners to develop account strategies for your assigned accounts to grow their...  ...the following technologies: ~ Big data engineering (Ex: Spark, Hadoop, Kafka) ~ Data Warehousing & ETL (Ex: SQL, OLTP/OLAP/DSS) ~ Data... 
    Worldwide

    Jobleads-US

    San Francisco, CA
    4 days ago
  •  ...Senior Python Developer- AI/ML San Francisco, Bay Area, CA Employment Type: Contract About Us Sustainable Talent provides flexible...  ...with big data processing technologies, including Spark, Hadoop, or Databricks. ~ Proficiency in cloud platforms (AWS, GCP, or... 
    Contract work
    Flexible hours

    Sustainable Talent

    San Francisco, CA
    1 day ago
  • $69.84 - $77.84 per hour

     ...scale or longer-term Software Engineering challenges Design, develop, and modernize backend services to replace legacy mainframe...  ...Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms:... 
    Hourly pay
    Permanent employment
    Contract work

    Genesis10

    San Francisco, CA
    2 days ago
  •  ...of RPS) and reliable (three 9's) systems. Experience with developing complex software systems scaling to substantial data volumes or...  ...and/or real-time complex data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper. 4+ years of experience.... 

    Macpower Digital Assets Edge

    San Francisco, CA
    3 days ago
  • $102.4k - $181.2k

     ...technologies (such as Informatica, DataStage, Talend, Fivetran). 5 years of hands‑on experience in developing two or more Big Data technologies, such as Spark & Hadoop, Lakehouse architecture - such as Delta, Data Ingestion, Data Streaming applications, or ML/AI applications... 
    For contractors
    Work at office

    I did my part and supported the Regular Toilet

    San Francisco, CA
    3 days ago
  • $44k - $185k

     ...supporting innovation across the globe. You will join teams focused on developing advanced data pipelines, machine learning infrastructure, and...  ...data processing technologies, including Apache Spark, Hadoop (MapReduce), or Apache Flink. Experience with containerization... 
    Full time
    Temporary work
    Apprenticeship
    Internship
    Local area
    Flexible hours

    Webex Events (formerly Socio)

    San Francisco, CA
    18 hours ago
  •  ...supportability of the platform and the health of our products. By developing smart solutions and streamlining workflows, we drive...  ...computing environments, with a strong emphasis on Apache Spark, Hadoop, or other Distributed Systems. Database Management : Proficient... 
    Local area
    Weekend work
    Weekday work

    I did my part and supported the Regular Toilet

    San Francisco, CA
    3 days ago
  •  ...client-facing experience Strong development experience in Python and Shell Knowledgeable of Spark processing engine & Big Data/Hadoop framework Experience implementing highly available and disaster Recovery data solutions in AWS The ability to discuss and... 
    Long term contract
    Contract work
    Remote work

    LABINE AND ASSOCIATES, INC.

    San Francisco, CA
    2 days ago
  •  ...end interfaces and back-end services. Collaborate with other developers and AI engineers on data preprocessing, model training, and...  ...microservices to support large-scale Web3 application Familiarity with large-scale data processing technologies such as Hadoop or Spark.... 

    Hyphen Connect Limited

    San Francisco, CA
    4 days ago
  • $147.4k - $220.9k

     ...role in helping App Store improve the experience for users and developers every day, through analysis grounded in privacy. We build the solutions...  ...SQL ~ Hands-on experience in big data technologies, such as: Hadoop, Spark/Flink, Kafka, Airflow, Iceberg, Trino and Kubernetes ~... 
    Relocation

    Apple

    San Francisco, CA
    1 day ago
  •  ...professional expertise Demonstrated programming proficiency and experience with 1 of the following (Java, C++, Python, Scala, R, SAS, SQL, Hadoop, HTML, SPSS, VBA, Tableau, Spark, Angular, ReactJS), as well as systems design/development, and information technology course work... 
    Internship
    Worldwide

    IBM

    San Francisco, CA
    5 days ago
  •  ...initiatives for the App Store. This role involves designing and building scalable data pipelines, developing data architectures, and optimizing data processing using technologies like Hadoop and Spark. Ideal candidates should have at least 3 years of experience in data... 

    Apple Inc.

    San Francisco, CA
    4 days ago
  • $220k

     ...construction, and driving events for AV simulation. Tech-savvy customers develop and deploy software directly to our dashcams to get realtime...  ...- Tools and technologies: Docker, Terraform, Apache Spark, Hadoop, PostgreSQL/PostGIS, Redis, Prometheus, Grafana, Git, AWS... 

    Hivemapper

    San Francisco, CA
    1 day ago
  • $180.6k - $289.3k

     ...predictive models and Segmentation Engine into platform workflows. Develop processes to monitor and maintaindata quality, proactively...  ...). * Hands-on experience working with large datasets (E.g. Hadoop Ecosystem) * Demonstrated ability to clean, manipulate, analyze... 
    Work experience placement
    Work at office
    Local area
    Flexible hours

    Visa

    San Francisco, CA
    1 day ago
  •  ...design and implementation of data quality frameworks and automated validation pipelines using Python, Apache Spark, and Hadoop ecosystem tools. Develop, deploy, and maintain scalable ETL/ELT workflows using Apache Airflow and Apache NiFi to ensure seamless data... 

    Yantran LLC

    San Francisco, CA
    5 days ago
  •  ...solutions (using Chef, Vmware, Terraform) Supporting Java Applications and JVM tuning Familiar with MSSQL, MySQL, or NoSQL (Hadoop) technologies and building queries Managing Linux and Windows Operating Systems Analyzing & Automating application clustering... 
    Work experience placement

    BayOne Solutions

    San Francisco, CA
    1 day ago
  • $146k - $270k

     ...Collaborate with the other team members across different teams. Develop alert & monitoring systems and procedures for faster disaster...  ...datasets. Experience in distributed computing framework – Hadoop, Spark, Flink or Storm. Experience with messaging systems... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Local area
    Relocation package

    Microsoft Corporation

    San Francisco, CA
    3 days ago
  • $148k - $260k

     ...large scale distributed training pipelines and/or highly optimized ML inference pipelines. - Experience with MapReduce (Apache Hadoop/Spark) or orchestration frameworks (Apache Airflow, Apache Beam, Google Cloud Dataflow, AWS Step Functions). - Experience solving... 
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Waabi

    San Francisco, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hadoop Developer. Be the first to apply!