Big Data Engineer
Central Business Solutions Llc
Data Engineer
San Jose, CA/PST Zone Duration: 1 year # of Positions: 2
Responsibilities
- Designing, developing & tuning data products, applications and integrations on large scale data platforms (Hadoop, Kafka Streaming, Hana, SQL server etc) with an emphasis on performance, reliability and scalability and most of all quality.
- Analyze the business needs, profile large data sets and build custom data models and applications to drive business decision making and customers experience
- Develop and extend design patterns, processes, standards, frameworks and reusable components for various data engineering functions/areas.
- Collaborate with key stakeholders including business team, engineering leads, architects, BSA's & program managers.
Skills
- MS/BS in Computer Science / related technical field with 4+ years of strong hands-on experience in enterprise data warehousing / big data implementations & complex data solutions and frameworks
- Strong SQL, ETL, scripting and or programming skills with a preference towards Python, Java, Scala, shell scripting
- Demonstrated ability to clearly form and communicate ideas to both technical and non-technical audiences.
- Strong problem-solving skills with an ability to isolate, deconstruct and resolve complex data / engineering challenges
- Results driven with attention to detail, strong sense of ownership, and a commitment to up-leveling the broader IDS engineering team through mentoring, innovation and thought leadership
Desired Skills
- Familiarity with streaming applications
- Experience in development methodologies like Agile / Scrum
- Strong Experience with Hadoop ETL/ Data Ingestion: Sqoop, Flume, Hive, Spark, Hbase
- Strong experience on SQL and PLSQL
- Nice to have experience in Real Time Data Ingestion using Kafka, Storm, Spark or Complex Event Processing
- Experience in Hadoop Data Consumption and Other Components: Hive, Hue HBase, Spark, Pig, Impala, Presto
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in San Jose, CA vacancy
- ...Principal Big Data Engineer As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks...Big data
Omni Inclusive
Santa Clara, CA20 hours ago $50 - $60 per hour
...Bigdata Engineer Location: Phoenix, AZ Duration: 12+ Months Client: Client / Impetus Pay Rate: $50 to $60 Max depends on experience... ...year Bachelors Year and university Total Exp US Exp. Big Data Exp. Current Location Open for Travel Open for...Big dataRelocationOmega Solutions Inc
Santa Clara, CA2 days ago- ...Big Data Engineer San Jose, CA (Remote) Experian Need 8 years of experience and hands on programming experience in any one or more programming languages like Java, Scala or Python Good experience with distributed systems like Hadoop, HDFs and No SQL databases...Big dataRemote work
Omega Solutions Inc
San Jose, CA3 days ago - ...Big Data Engineer CA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco, CA - San Jose, WA - Seattle, OR - Portland What Will I Do in This Position? As part of our Advanced Technology & Architecture...Big dataWork experience placement
ClifyX
San Jose, CA3 days ago - ...approach for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and... ...calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured...Big data
Comtech
San Jose, CA3 days ago - ...professional IT Consulting services in the US. We are actively seeking Data Engineer for one of our client, Please share your resume with current... ...building and optimizing data pipelines and integrating with big data platforms like Apache Spark and Hadoop. Develop efficient,...Big data
Rootshell Enterprise Technologies
Santa Clara, CA4 days ago - Job-ID17032030Reference21-063692 Data Engineer / Architect Client doesn't have much bandwidth for any handholding. They will grant required... ...Data warehousing & Data modeling concepts • Experience working on Big Data, BI or Analytics related projects • Advanced knowledge of...Big data
Intelliswift
Cupertino, CA5 days ago - ...Data Engineer We are seeking a highly skilled Data Engineer to join our team, focusing on building, maintaining, and optimizing our data... ...and reporting. This role requires expertise in ETL processes, big data technologies, and cloud data platforms. Key Responsibilities...Big data
Omni Inclusive
Santa Clara, CA19 hours ago - ...Data Engineer Minimum 10 years of experience Responsibilities: Data Pipeline Development: Design, build, and maintain scalable,... ...TensorFlow or PyTorch. Understanding of distributed systems, big data technologies, and real-time data processing. Experience...Big data
Yochana
San Jose, CA5 days ago - ...Data Engineer Who You Are: Data Engineers are focused on enabling a data-driven approach to optimization by sourcing, maintaining... ...research, and quality assurance testing Apply a variety of big data technologies to ingest, transform, index, aggregate, correlate...Big data
Kaav Inc.
San Jose, CA4 days ago $110k - $120k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...Big dataWorldwideSupermicro
San Jose, CA2 days ago$133.1k - $236.4k
...Individual Contributor The Opportunity Join Adobe as a Sr Data Science Engineer and be part of a team that is crafting the future of digital... ...languages such as Python, R, or Scala Experience with big data technologies like Hadoop, Spark, or Kafka Ability to...Big dataTemporary workLocal areaWorldwideRelocationAdobe
San Jose, CA5 days ago$184k - $287.5k
...artificial intelligence (AI), and deep learning. Our team develops data engineering solutions that empower AI developers in autonomous vehicle (AV... ...and AI training. The ideal candidate will bring expertise in big data processing and distributed computing to create efficient...Big dataFull timeNvidia
Santa Clara, CA4 days ago$115k - $130k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...Big dataWork at officeWorldwideNight shiftSupermicro
San Jose, CA2 days ago$267.8k - $288.56k
...robotics, mobility, healthcare, energy and data centers. With revenue of more than $11... ...distributed computing frameworks, and modern data engineering tools for efficient data processing,... ...using distributed frameworks and big data technologies, and programming in Python...Big dataPermanent employmentFull timeWork at officeRemote workWork from homeDay shift2 days per weekAnalog Devices
San Jose, CA4 days ago$80 - $85 per hour
...business transformation. As a leading product engineering firm based in Silicon Valley, we provide... ...cutting-edge technologies in AI, ML, and data analytics. Our collaborative, inclusive... ...CI/CD for Databricks workloads Big Data & Processing Frameworks Apache...Big dataHourly payBayrock Labs
Milpitas, CA5 days ago$175k - $200k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...Big dataWorldwideSuper Micro Computer
San Jose, CA1 day ago$133k - $150k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...Big dataInternshipWorldwideSupermicro
San Jose, CA2 days ago- ...GorusuCompany: SRI Tech SolutionsRole:GCP data EngineerLocation: Santa Clara, CA and Plano... ...for a highly skilled and motivated Data Engineer to join our team. The ideal candidate will... ...analyticsBig Data & Streaming: Implement and support Big Data solutions for both batch (scheduled)...Big dataFull time
SRI Tech
San Jose, CA1 day ago - ...Big Data Engineer Location: Mountain view CA (3 days onsite) Skill Set: Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (Preferably Flink) 5+ years experience with Java or Scala Strong experience working with micro services and...Big data
Kasmo Global
Mountain View, CA5 days ago $185k - $200k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.Job...Big dataFor contractorsWorldwideSuper Micro Computer
San Jose, CA1 day ago$165k - $200k
...advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers... .... We seek talented, passionate, and committed engineers, technologists, and business leaders to join us. Job...Big dataWorldwideSuper Micro Computer
San Jose, CA1 day ago$65.49 per hour
...Job Description Job Description Data Engineer 3 Job Details Data Engineer 3 (Contract) Location: San Jose, CA 95110 (Hybrid) Duration... ...~5+ years’ experience ~ Strong Python, SQL/PLSQL skills and big data technologies like Azure Databricks with enterprise data...Big dataHourly payContract workFlexible hoursCypress HCM
San Jose, CAa month ago- ...Big Data Developer Location: Columbus, OH Client: Banking / Virtusa Pay Rate: $65 - 70/Hr on c2c Need only USC/GC candidates Working proficiency in developmental toolsets with minimum of 10 plus years of experience with the following; Hive, Kafka, Scala...Big data
Omega Solutions
Santa Clara, CA5 days ago $75 - $80 per hour
...Expert), Python (Expert), AWS (Advanced), Data Modeling (Intermediate), ETL Pipelines (Expert... ...: We are seeking a Senior Data Engineer to join our AWS Infrastructure and Supply... ...on using a blend of AWS technologies and big data solutions to implement efficient,...Big dataHourly payContract workFlexible hoursAkraya Inc
Santa Clara, CA7 days ago$60 - $65 per hour
...Overview: We are seeking a highly skilled and experienced Data Engineer with a strong background in AI/ML to design, build, and... ...TensorFlow or PyTorch. Understanding of distributed systems, big data technologies, and real-time data processing. Experience...Big dataCynet Systems
San Jose, CA3 days ago- ...Big Data Developer E*Pro Consulting service offerings include contingent Staff Augmentation of IT professionals, Permanent Recruiting and Temp-to-Hire. In addition, our industry expertise and knowledge within financial services, Insurance, Telecom, Manufacturing, Technology...Big dataPermanent employmentTemporary workFlexible hours
E-Pro
San Jose, CA5 days ago - ...Big Data Engineer: Must Have: • Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential • Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the...Big data
Trinity Technology Solutions
Sunnyvale, CA2 days ago - ...Azure Data Engineer As a Data Engineer on the Data Science and Platform team, you will: Develop and maintain data pipelines including... ...technologies, including relational databases, data warehouse, big data (Spark), orchestration/data pipeline tools, data frames...Big dataWork experience placement
Omega Solutions
Santa Clara, CA5 days ago - ...Big Data Developer 12 Months Charlotte, NC • • Strong experience in Big Data Technologies and Web Applications in multi-tiered environment... ...- Stored Procedures, Functions, Triggers and packages. Data Engineer 6+ Months Remote • • Assemble large, complex data sets that meet...Big dataRemote work
PeopleNTech
Santa Clara, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer San Jose, CA
- entry level big data engineer San Jose, CA
- senior data quality engineer San Jose, CA
- senior cloud data engineer San Jose, CA
- software data engineer San Jose, CA
- data infrastructure engineer San Jose, CA
- senior data center engineer San Jose, CA
- data center engineer San Jose, CA
- senior data engineer San Jose, CA
- finance data engineer San Jose, CA