Hadoop Developer
SonSoft Inc
Hadoop Developer
Sonsoft, Inc. is a USA based corporation duly organized under the laws of the Commonwealth of Georgia. Sonsoft Inc. is growing at a steady pace specializing in the fields of Software Development, Software Consultancy and Information Technology Enabled Services.
Job Description
Responsibilities:
- Responsible for data ingestion, data quality, development, production code management and testing/deployment strategy in BigData development (Hadoop).
- Acts as a lead in identification and troubleshooting processing issues impacting timely availability of data in the BigData or delivery of critical reporting within established SLAs. Provide mentoring to Level 2 production support team.
- Identifies and recommends technical improvements in production application solutions or operational processes in support of BigData platform and information delivery assets (ie, data quality, performance, supporting Data scientists etc.)
- Focuses on the overall stability and availability of the BigData platform and the associated interfaces and transport protocols.
- Researches, manages and coordinates resolution of complex issues through root cause analysis as appropriate
- Establishes and maintains productive relationships with technical leads of key operational sources systems providing data to BigData platform.
- Establishes and maintains productive relationships with technical leads of key infrastructure support areas, such as system/Infra engineers.
- Participate in daily standup meetings.
- Ensure adherence to established problem / incident management, change management and other internal IT processes
- Responsible for communication related to any day to day issues and problem resolutions. Communication may include direct department management as well downstream/upstream application contacts and business partners.
- Ensures comprehensive knowledge transition from development teams on new or modified applications moving to ongoing production support.
- Seeks improvement opportunities in design, solution implementation approaches in partnership with development team for ensuring the performance and health of the BigData platform.
- Ensures timely and accurate escalation of issues to management
Requirements:
- At least 2+ years developing and supporting data ingestion using Talend for BigData/Hadoop. (sourced from Teradata, Oracle, files etc)
- Java, Oozie knowledge is preferable. Talend, Pig, Python, Hive knowledge is a must.
- Familiar with all components of the BigData stack in detail, e.g., Hadoop, Pig, Hive, HBase, Oozie
- Advanced experience with large BigData or Data warehouse environment is a plus.
- Possess a strong technology, data, and production support background.
- Proven experience working with onshore/off shore support team.
- Previous experience working in a high paced, high pressure Production Support environment.
- Proven analytical and problem solving skills for assessment of complex production support issues and recommend / implement effective solutions
- Previous experience in using IT Ticketing processes for managing incidents and issue resolution and conversant with established Change control / Change management standards
- Natural technical and functional curiosity
- Familiar with Agile Methodology.
- Excellent communication skills.
Preferred
- Experience in Design and architecture review.
- Ability to work in team in diverse/ multiple stakeholder environment
- Ability to work in Onsite Offshore model
- Experience in Financial Services Domain.
- Experience and desire to work in a Global delivery environment.
Qualifications
- Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
- At least 4 years of experience with Information Technology.
Additional Information
** U.S. citizens and those authorized to work in the U.S. are encouraged to apply. We are unable to sponsor at this time.
Note:
- This is a Full-Time Permanent job opportunity for you.
- Only US Citizen, Green Card Holder, TN Visa, GC-EAD, H4-EAD & L2-EAD can apply.
- No OPT-EAD & H1B Consultants please.
- Please mention your Visa Status in your email or resume.
- A tech company is looking for a Senior Software Engineer with 8 to 11 years of experience, focusing on Hadoop management and automation. You will be responsible for setting up and managing Hadoop clusters, providing 24x7 support, and performance tuning. Candidates should...Suggested
- ...leading IT consulting firm in San Francisco is seeking a Senior Core Data Engineer with strong Java programming skills and experience in Hadoop MapReduce and NoSQL databases like HBase or Cassandra. The role involves ingesting large datasets, processing them, and serving the...Suggested
- ...Senior Database Engineer(Elastic/Mongo/Hadoop) Senior Database Engineer(Elastic/Mongo/Hadoop) Workplace Type : Remote - Region : San... ...instances with TLS/SSL and/or LDAP • Candidate must also be able to develop automated solutions for ad-hoc script execution requests, ad-...SuggestedRemote work
- ...scale. Candidate must have experience working on distributed messaging systems like Kafka. Exposure to Spark, Hadoop and Hive is plus. Develops innovation strategies, processes, and best practices. Drives the execution of multiple business plans and projects...SuggestedContract work
$194k - $267k
...systems like Flink, Spark, Beam ~ Storage & Compute systems such as Snowflake, Hadoop ~ Coordinators and schedulers like the ones in Kubernetes, Hadoop, Mesos Experience in developing and tuning highly scalable distributed systems Excellent grasp of...SuggestedPermanent employmentWork at officeLocal areaWorldwideFlexible hours$171.12k - $213.9k
...solutions tohundreds of thousands of businessesand empower millions of developers worldwide to craft personalized customer experiences. Our... ...systems. ~ Expertise in big data technologies such as Hadoop, Spark, Kafka, and other distributed computing systems. ~ Experience...Local areaRemote workWorldwide- ...audiences. Key Responsibilities Team Objectives: Design, develop, and modernize backend services to replace legacy mainframe... ...: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms:...Contract workWork at office
$104.33k - $156.49k
...Integration tools administration. Hands‑on experience with data warehouse technologies (Snowflake, Redshift) and big‑data technologies (Hadoop, Hive, Spark, Kafka, Kinesis). Experience evaluating new tools and enriching existing architecture. You are a self‑starter, hands...Work experience placementWork at officeLocal areaFlexible hours3 days per week1 day per week$81.4k - $151.8k
...experience with SQL, NoSQL, Python, Spark, Scala ~ Experience with SSIS, Glue, cloud storage and computing services (e.g. AWS, Azure), Hadoop, Netezza ~ Experience with structured, semi structured and unstructured datasets in batch and streaming ~ Experience with data...Part timeLocal area- ...to join our talented Team. Job Title: Full Stack Developer Location(s): San Francisco, CA. Job Description:... ...Large Scale Databases (MySQL, Oracle, MongoDB, HBase, Cassandra, Hadoop). Test Driven Development (junit/phpunit/RSpec/Cucumber)....
- ...Sr. Java Developer With Kafka Headquartered in New Jersey (U.S), Cygnus Professionals Inc. is a next generation global information technology... ...experience working with Kafka; experience working with Spark, Hadoop, Storm or any realtime stream analysis platform...Contract workLocal areaImmediate start
$148.5k - $260.1k
...Infrastructure as Code \*\*(Terraform)\*\*.* Solid understanding of NoSQL, distributed systems, and big data ecosystems such as \*\*Hadoop, HDFS, and Apache Zookeeper\*\*.* Familiarity with AI/ML frameworks and experience integrating machine learning models with...- ...have You will work with Sales and other essential partners to develop account strategies for your assigned accounts to grow their... ...the following technologies: ~ Big data engineering (Ex: Spark, Hadoop, Kafka) ~ Data Warehousing & ETL (Ex: SQL, OLTP/OLAP/DSS) ~ Data...Worldwide
- ...Senior Python Developer- AI/ML San Francisco, Bay Area, CA Employment Type: Contract About Us Sustainable Talent provides flexible... ...with big data processing technologies, including Spark, Hadoop, or Databricks. ~ Proficiency in cloud platforms (AWS, GCP, or...Contract workFlexible hours
$69.84 - $77.84 per hour
...scale or longer-term Software Engineering challenges Design, develop, and modernize backend services to replace legacy mainframe... ...Languages: Java, Scala, SQL, HiveQL Big Data Technologies: Hadoop, Spark, HDFS, Hive, Cloudera, Hortonworks Cloud Platforms:...Hourly payPermanent employmentContract work- ...of RPS) and reliable (three 9's) systems. Experience with developing complex software systems scaling to substantial data volumes or... ...and/or real-time complex data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper. 4+ years of experience....
$102.4k - $181.2k
...technologies (such as Informatica, DataStage, Talend, Fivetran). 5 years of hands‑on experience in developing two or more Big Data technologies, such as Spark & Hadoop, Lakehouse architecture - such as Delta, Data Ingestion, Data Streaming applications, or ML/AI applications...For contractorsWork at office$44k - $185k
...supporting innovation across the globe. You will join teams focused on developing advanced data pipelines, machine learning infrastructure, and... ...data processing technologies, including Apache Spark, Hadoop (MapReduce), or Apache Flink. Experience with containerization...Full timeTemporary workApprenticeshipInternshipLocal areaFlexible hours- ...supportability of the platform and the health of our products. By developing smart solutions and streamlining workflows, we drive... ...computing environments, with a strong emphasis on Apache Spark, Hadoop, or other Distributed Systems. Database Management : Proficient...Local areaWeekend workWeekday work
- ...client-facing experience Strong development experience in Python and Shell Knowledgeable of Spark processing engine & Big Data/Hadoop framework Experience implementing highly available and disaster Recovery data solutions in AWS The ability to discuss and...Long term contractContract workRemote work
- ...end interfaces and back-end services. Collaborate with other developers and AI engineers on data preprocessing, model training, and... ...microservices to support large-scale Web3 application Familiarity with large-scale data processing technologies such as Hadoop or Spark....
$147.4k - $220.9k
...role in helping App Store improve the experience for users and developers every day, through analysis grounded in privacy. We build the solutions... ...SQL ~ Hands-on experience in big data technologies, such as: Hadoop, Spark/Flink, Kafka, Airflow, Iceberg, Trino and Kubernetes ~...Relocation- ...professional expertise Demonstrated programming proficiency and experience with 1 of the following (Java, C++, Python, Scala, R, SAS, SQL, Hadoop, HTML, SPSS, VBA, Tableau, Spark, Angular, ReactJS), as well as systems design/development, and information technology course work...InternshipWorldwide
- ...initiatives for the App Store. This role involves designing and building scalable data pipelines, developing data architectures, and optimizing data processing using technologies like Hadoop and Spark. Ideal candidates should have at least 3 years of experience in data...
$220k
...construction, and driving events for AV simulation. Tech-savvy customers develop and deploy software directly to our dashcams to get realtime... ...- Tools and technologies: Docker, Terraform, Apache Spark, Hadoop, PostgreSQL/PostGIS, Redis, Prometheus, Grafana, Git, AWS...$180.6k - $289.3k
...predictive models and Segmentation Engine into platform workflows. Develop processes to monitor and maintaindata quality, proactively... ...). * Hands-on experience working with large datasets (E.g. Hadoop Ecosystem) * Demonstrated ability to clean, manipulate, analyze...Work experience placementWork at officeLocal areaFlexible hours- ...design and implementation of data quality frameworks and automated validation pipelines using Python, Apache Spark, and Hadoop ecosystem tools. Develop, deploy, and maintain scalable ETL/ELT workflows using Apache Airflow and Apache NiFi to ensure seamless data...
- ...solutions (using Chef, Vmware, Terraform) Supporting Java Applications and JVM tuning Familiar with MSSQL, MySQL, or NoSQL (Hadoop) technologies and building queries Managing Linux and Windows Operating Systems Analyzing & Automating application clustering...Work experience placement
$146k - $270k
...Collaborate with the other team members across different teams. Develop alert & monitoring systems and procedures for faster disaster... ...datasets. Experience in distributed computing framework – Hadoop, Spark, Flink or Storm. Experience with messaging systems...Full timeTemporary workPart timeWork experience placementLocal areaRelocation package$148k - $260k
...large scale distributed training pipelines and/or highly optimized ML inference pipelines. - Experience with MapReduce (Apache Hadoop/Spark) or orchestration frameworks (Apache Airflow, Apache Beam, Google Cloud Dataflow, AWS Step Functions). - Experience solving...Full timeWork at officeRemote workWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop Developer. Be the first to apply!
- statistical programmer San Francisco, CA
- weekend developer San Francisco, CA
- developer internship San Francisco, CA
- senior mulesoft developer San Francisco, CA
- pyspark developer San Francisco, CA
- interface developer San Francisco, CA
- kafka developer San Francisco, CA
- interactive developer San Francisco, CA
- pega developer San Francisco, CA
- sas programmer San Francisco, CA

