Big Data Engineer
Central Business Solutions
Data Engineer
San Jose, CA/PST Zone Duration: 1 year # of Positions: 2
Responsibilities
- Designing, developing & tuning data products, applications and integrations on large scale data platforms (Hadoop, Kafka Streaming, Hana, SQL server etc) with an emphasis on performance, reliability, scalability and most of all quality.
- Analyze the business needs, profile large data sets and build custom data models and applications to drive business decision making and customers experience
- Develop and extend design patterns, processes, standards, frameworks and reusable components for various data engineering functions/areas.
- Collaborate with key stakeholders including business team, engineering leads, architects, BSA's & program managers.
Skills
- MS/BS in Computer Science / related technical field with 4+ years of strong hands-on experience in enterprise data warehousing / big data implementations & complex data solutions and frameworks
- Strong SQL, ETL, scripting and or programming skills with a preference towards Python, Java, Scala, shell scripting
- Demonstrated ability to clearly form and communicate ideas to both technical and non-technical audiences.
- Strong problem-solving skills with an ability to isolate, deconstruct and resolve complex data / engineering challenges
- Results driven with attention to detail, strong sense of ownership, and a commitment to up-leveling the broader IDS engineering team through mentoring, innovation and thought leadership
Desired Skills
- Familiarity with streaming applications
- Experience in development methodologies like Agile / Scrum
- Strong Experience with Hadoop ETL/ Data Ingestion: Sqoop, Flume, Hive, Spark, Hbase
- Strong experience on SQL and PLSQL
- Nice to have experience in Real Time Data Ingestion using Kafka, Storm, Spark or Complex Event Processing
- Experience in Hadoop Data Consumption and Other Components: Hive, Hue HBase, Spark, Pig, Impala, Presto
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in San Jose, CA vacancy
- ...Principal Big Data Engineer As a Principal Big Data Engineer, you will be an integral member of our data ingestion and processing platform team responsible for architecture, design and development. Having the dynamic ability to adapt to conventional big-data frameworks...Big data
Omni Inclusive
Santa Clara, CA1 day ago - ...Big Data Engineer San Jose, CA (Remote) Experian Need 8 years of experience and hands on programming experience in any one or more programming languages like Java, Scala or Python Good experience with distributed systems like Hadoop, HDFs and No SQL databases...Big dataRemote work
Omega Solutions Inc
San Jose, CA3 days ago - ...Big Data Engineer CA – Los Angeles, CA - Los Alamitos, CA - Norwalk, CA - El Segundo, CA - Sacramento, CA - San Diego, CA - San Francisco, CA - San Jose, WA - Seattle, OR - Portland What Will I Do in This Position? As part of our Advanced Technology & Architecture...Big dataWork experience placement
ClifyX
San Jose, CA3 days ago $100k - $150k
...Big Data Engineer - Remote Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected...Big dataFull timeH1bLocal areaImmediate startRemote workVisa sponsorshipBright Vision Technologies
San Jose, CA3 days ago- Job Title: Big Data Engineer Location: San Jose, CA Duration: Long Term Contract Job Description Client is looking for Big Data engineers with expert level experience in developing enterprise software applications on Spark/Hadoop, NoSql, InMemory Databases. You will...Big dataLong term contractImmediate start
$45 per hour
...Responsibilities Design and build data transformations efficiently and reliably for different... ..., scalable, robust and extensible big data systems that support core products and... .... Establish solid design and best engineering practice for engineers as well as non‑technical...Big dataHourly paySummer workInternshipEllis Technologies, Inc.
San Jose, CA2 days ago$135k - $180k
...Responsibilities Create and maintain optimal data processing pipeline architecture Build... ..., and loading of data using SQL and big data technologies. Identify, design, and... ...with stakeholders including the Executive, Engineering, and Operation teams to assist with data-...Big dataPlusAI, Inc.
Santa Clara, CA23 hours ago$69.01 per hour
Job Details Team: US Digital Global Digital Commerce Data Engineer 1 (Contract) Location: San Jose, CA 95110 (Hybrid) Duration: 6/08/202... ...complex queries against large datasets Hands‑on experience with Big Data technologies such as Hadoop, Hive, Spark, or similar...Big dataHourly payContract work- ...accelerate next-generation computing—from AI and data centers to PCs, gaming, and embedded systems. Join... ...and beyond. The Role We are seeking an expert Data Engineer to design, develop, and maintain an Enterprise-wide Big Data and Data Analytics Platform. Key Responsibilities...Big data
AMD
San Jose, CA2 days ago - Remote Data Engineer needs 10 years experience Must be local top Santa Clara Cloud Platform Expertise (GCP Focus): Extensive hands-on experience... ...intelligence, advanced analytics Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming...Big dataRemote jobLocal area
- ...and utilize structured and unstructured data from diverse sources. We build the essential... ...the cleansing and organization of big data to ensure its integrity. You will work... ...visualize large datasets. Improve feature engineering and build innovative models to solve a variety...Big dataLocal area
- We are seeking a developer to join the data analytics team with at least 5 years of software... ...be a self-learner as it relates to new big data analytics technologies. Job... ...Qualifications B.Sc. degree in Computer Science, Engineering, Mathematics, Statistics or related field...Big data
$163.2k - $204k
...team members. What You’ll Do: We are looking for an experienced Data Engineer to specialize in aviation data and analytics, focusing on two... ...practices, ensuring data accuracy, compliance, and security. Leverage big data technologies and tools for large-scale data processing and...Big dataLocal areaArcher Aviation
San Jose, CA23 hours ago$129.3k - $225.3k
...Software and Services Apple's Media, Graphics, and Compute Technologies Group (MGC) is looking for a talented and dedicated big data engineer to join our Data Engineering team. The Data Engineering team within the MGC organization plays a critical role in supporting data...Big dataRelocation$184.7k - $277.6k
...started. Do you have a strong passion for using data to drive business decisions, generate... ...? We are seeking for a Senior Data Engineer to join our App Store Data team and play an... ...solving skills Hands‑on experience in modern big data technologies such as: Spark/Flink, Kafka...Big dataRelocation$148.75k - $361k
...while gaining meaningful experience across a variety of disciplines. About the team The mission of Roku's Data Engineering team is to develop a world-class big data platform so that internal and external customers can leverage data to grow their businesses. Data Engineering...Big dataWork at officeLocal areaRemote workWorldwideMonday to ThursdayFlexible hours- ...Cloud Data Engineer This role has been designed as "Onsite" with an expectation that you will primarily work from an HPE office. Hewlett... ...~1+ years of programming experience in Java ~ Expertise in big data technologies such as Apache Spark or Kafka with at least 1...Big dataWork experience placementWork at office
Hewlett Packard Enterprise
San Jose, CA5 hours ago - ...Big Data Engineer: Must Have: • Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential • Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the...Big data
Texas State Library and Archives Commision
Sunnyvale, CA2 days ago $136.5k - $276.5k
...Cloud Data Engineer This role has been designed as ‘’Onsite’ with an expectation that you will primarily work from an HPE office. Who We... ...~1+ years of programming experience in Java ~ Expertise in big data technologies such as Apache Spark or Kafka with at least 1...Big dataWork experience placementWork at officeLocal areaImmediate startHPE
San Jose, CA2 days ago$45k - $121k
...Job Title: GCP Data Engineer City: Santa Clara State/Province: California Posting Start Date: 7/10/26 Wipro... ..., including business intelligence, advanced analytics -Big Data & Streaming: Implement and support Big Data solutions for...Big dataMinimum wageLocal areaFlexible hours3 days per weekWipro
Santa Clara, CA22 hours ago$80 - $95 per hour
This range is provided by OSI Engineering. Your actual pay will be based on your skills and experience... ...Mountain View, CA is seeking a talented Data Engineer to help build secure, scalable... ...engineers with strong expertise in Big Data infrastructure and data warehousing...Big dataFull timeContract work- ...Title: Senior Data Engineer Location: Sunnyvale, CA Position: 2 Month (Contract) Summary Provide business insights,... ...fast-paced environment. Strong background in transforming big data into business insights Technical Requirements...Big dataContract work
TWO95 International
Sunnyvale, CA3 days ago - ...train AI agents to automate tasks, analyze data, and enhance team productivity. Our... ...overview We are looking for an experienced Data Engineer to join our Engineering team. The ideal candidate... ...cloud technologies, especially AWS, and big data systems, your role will be pivotal in...Big dataFlexible hours
BREVIAN
Sunnyvale, CA23 hours ago $150.4k - $277.6k
...accomplish. We are seeking an exceptional engineer with a background in large scale software... ...using cutting‑edge technologies to build data intensive systems, designing and optimizing... ...languages: Java or Scala 5+ years experience with big data platforms Familiarity with ML/AI...Big dataApple
Sunnyvale, CA2 days ago- ...Data Engineer Location: Mountain View, CA & Dallas, TX (Onsite) You Must Have BS in Computer Science/Engineering, relevant technical field,... ...experience, with specialization in Data Engineering Exp with (Big Data Eng, Hadoop, Hive, Python , PySpark, ETL & SQL, Any Cloud,...Big dataPermanent employmentContract workLocal area
Robotics Technologies LLC
Mountain View, CA23 hours ago - ...Data Platform Engineer The Digital Media Solutions Lab at Samsung Research America is building a next-generation data platform to support Smart... .... Additional Requirements: Broad knowledge of big data technology landscape (Hadoop, Spark, AWS) Experience...Big data
Omega Solutions Inc
Mountain View, CA4 hours ago $65 per hour
...onsite and offshore delivery models. We are currently looking for a Data Engineer to support our client in Sunnyvale, CA for a long-term contract... ...designing, developing, testing, and deploying enterprise-grade big data solutions that drive critical business initiatives. The...Big dataLong term contractLocal areaDRISHTICON
Sunnyvale, CA4 days ago- Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines using tools like Spark, Kafka,... ...Strong proficiency in Python, SQL, and potentially Scala/Java. Big Data: Expertise in Apache Spark (Spark SQL, DataFrames,...Big data
- ...captured, with some text truncated due to incomplete source. Lead Data Engineer We are seeking a highly skilled and strategic Lead Data... ...oriented Data Engineer II to join our team. Project Manager - Big Data Works with cross-functional project team members on numerous...Big dataRemote work
$55.21 - $69.01 per hour
...Job Description Job Description Data Engineer 1 Full-time San Jose, CA, US You’ll be joining Adobe on a contract opportunity, employed... ...complex queries on large datasets Hands-on experience with Big Data technologies such as Hadoop, Hive, Spark, or similar...Big dataPermanent employmentFull timeContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- data engineer analytics San Jose, CA
- remote data engineer San Jose, CA
- junior data engineer remote San Jose, CA
- senior cloud data engineer San Jose, CA
- senior data integration developer San Jose, CA
- data engineer machine learning San Jose, CA
- data center engineer San Jose, CA
- software data engineer San Jose, CA
- data science developer San Jose, CA
- senior data center engineer San Jose, CA