Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer with Scala/Spark and Java

Comtech LLC

Data Engineer With Scala/Spark And Java

Comtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.

Job Description

Primary Skills:

  • Big Data experience
  • 8+ years exp in Java, Python and Scala
  • With Spark and Machine Learning (3+)
  • Data mining, Data analysis

Roles and Responsibilities:

  • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
  • Work closely with our engineering team to integrate and build algorithms
  • Process unstructured data into a form suitable for analysis – and then do the analysis.
  • Support business decisions with ad hoc analysis as needed
  • Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
  • Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
  • Establish and maintain effective processes for validating and updating predictive models
  • Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
  • Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
  • Perform statistical analysis to prioritize in order to maximize success
  • Identify areas for improvement, communicating action plans
  • Perform strategic data analysis and research to support business needs
  • Identify opportunities to improve productivity via sophisticated statistical modeling
  • Explore data to identify opportunities to improve business results
  • Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
  • Gain understanding of business needs and necessary analysis where appropriate through internal discussion
Qualifications

Bachelors or Masters in related field

Additional Information

All your information will be kept confidential according to EEO guidelines.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer with Scala/Spark and Java in San Jose, CA vacancy
  •  ...focused on developing and operating large-scale big data platforms in Sunnyvale, CA. The ideal...  ...will have 3+ years of experience in software engineering, particularly with technologies like Java, Scala, and Apache Spark, and be skilled in optimizing performance and... 
    Java
    Full time
    Local area

    Programmers.io

    Sunnyvale, CA
    3 days ago
  • $147.4k - $272.1k

     ...Sunnyvale, California, is seeking an exceptional engineer to join its cybersecurity software engineering...  ...strong experience in designing and implementing data architectures and expertise in JVM languages like Java or Scala. The base pay range for this position is between... 
    Java

    Apple Inc.

    Sunnyvale, CA
    3 days ago
  •  ...We are actively looking for Data Engineers (Java/spark) for Sunnyvale, CA or Bentonville, AR Job Title: Sr Data Engineer (Java/spark)...  ...modeling & data migration protocols You have experience with Trino, Big Query , Apache Pinot You have experience... 
    Java
    Contract work
    Immediate start

    Redolent

    Sunnyvale, CA
    22 hours ago
  •  ...Data Engineer GCP Sunnyvale, California, United States Job Title: Data Engineer Location: Sunnyvale Ca Visa: USC/GC/H...  ...Airflow pipeline development GCP dataproc/ BQ Expertise Hive/Spark Python/Java expertise (scala) GoogleAds Expertise is a plus (campaign/adsgroups... 
    Java
    H1b

    Interaction24 LLC

    Sunnyvale, CA
    4 days ago
  •  ...Overview: AWS Data Engineers Location- San Jose /Costa Mesa CA Experience- 3-6...  ...on and good coding skills, preferably with Java, Scala or Python ~ Data Structures, Algorithm...  ...~ Java/Scala, SQL, Python ~ Spark, Hive, Presto ~ Airflow (Preferred... 
    Java
    Work experience placement

    r2 Technologies, Inc.

    San Jose, CA
    22 hours ago
  •  ...Data Foundations Engineer The Data Foundations Engineer designs and scales modern data...  ...analytics and ML use cases, with strong fundamentals in data modeling...  .... ~ Experience in Python, Scala, or Java. ~ Hands-on experience with Spark, Kafka, and Airflow (or similar... 
    Java

    Apolis

    Cupertino, CA
    5 days ago
  •  ...update from client for this data engineer role / Request-ID: 13145-1 _...  ...Sunnyvale, CA Also look someone with retail clients experience in...  ...for Senior Data Engineer with Spark, Scala, GCP experience....  ...programming languages: Python, Java, Scala, etc. • Experience... 
    Java

    Texas State Library and Archives Commision

    Sunnyvale, CA
    4 days ago
  •  ...related 2. 3+ years of solid Java and 2+ years experience in...  ...support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBase 3. Hands on experience with Unix, Teradata and other...  ...databases. Experience with @Scala a plus. 4. Strong communication... 
    Java
    Full time

    Redolent

    Sunnyvale, CA
    22 hours ago
  • $50 - $60 per hour

     ...Bigdata Engineer Location: Phoenix, AZ Duration:...  ...Hadoop, Hive, Kafka, Spark Batch and streaming. ~ Exp. with Cassandra. ~ Exp. with...  ...search ~ Experience with Java/J2EE & Web Services, Scala/ Python is good to...  ...Exp US Exp. Big Data Exp. Current Location... 
    Java
    Relocation

    Omega Solutions

    Santa Clara, CA
    22 hours ago
  •  ...Job Title: Data Engineer. Location: Sunnyvale, CA. Duration...  ...and development experience with relational or MPP databases...  ...with Big-Data platforms like Spark, Dremio, Hadoop, MapReduce,...  ...Hive etc. ~ Experience with Java, Scala, and Python. ~ Experience... 
    Java
    Long term contract

    Numeric

    Sunnyvale, CA
    22 hours ago
  •  ...Position: Data Engineer II Location: Sunnyvale, California Duration...  ...and systems. Collaborate with cross-functional teams to...  ...languages such as Python, Java, or Scala. Experience with data processing...  ...frameworks like Apache Spark or Hadoop. Strong... 
    Java
    Full time
    Contract work

    Pinnacle Group

    Sunnyvale, CA
    4 days ago
  •  ...Role description Senior Data Engineer Lead I - Data...  ...communities in which we live. With us, you'll create a boundless...  ...software tools such as Haddop, Spark, Kafka, etc. * Experience...  ...languages such as Python, Scala, C++, Java, and Go Experience with Continuous... 
    Java

    UST Inc

    San Jose, CA
    2 days ago
  •  ...developer in Sunnyvale, California. This role requires over 5 years of software development experience with strong data engineering skills and proficiency in Python and Java, along with knowledge of relational databases like Oracle and MySQL. The candidate should have... 
    Java

    IT Convergence, Inc.

    Sunnyvale, CA
    2 days ago
  • Job Summary Seeking a Data Engineer with Spark & Streaming skills to build real-time, scalable data pipelines...  ..., and loading using Spark (PySpark/Scala) and streaming technologies (Kafka,...  ...in Python, SQL, and potentially Scala/Java. Big Data: Expertise in Apache Spark (... 
    Java

    Compunnel, Inc.

    Sunnyvale, CA
    22 hours ago
  • $147.4k - $272.1k

     ...are seeking an exceptional engineer with a background in large scale...  ...engineering team that drives Apache Spark’s state-of-the art features...  ...-edge technologies to build data intensive systems, designing...  ...with JVM languages (Scala or Java preferred), Golang, or Swift... 
    Java
    Relocation

    Apple Inc.

    Sunnyvale, CA
    3 days ago
  • $99k - $232k

     ...Specialty/Competency: Data, Analytics & AI...  ...in data and analytics engineering focus on leveraging advanced...  ...client expectations. With your growing knowledge...  ...languages such as Python, Java, or Scala - Familiarity with...  ...like Hadoop, Spark, or Kafka is a plus... 
    Java
    Full time
    H1b

    PwC

    San Jose, CA
    16 days ago
  • Apple Inc. is seeking a Software Data Engineer for the Apple Games App Data Engineering team in Cupertino, California...  ...applications using technologies like Apache Spark, as well as a strong background in Scala or Java. This role includes the opportunity for growth within... 
    Java

    Apple Inc.

    Cupertino, CA
    3 days ago
  • $200k - $220k

     ...Job Summary We are looking for a Data DevOps Engineer with 8+ years of experience to join our ML...  ...Experience in setting up multitenant Spark & Kafka clusters. Experience...  ...Strong skills in at least Python, Scala or Java. Experience in cleaning, processing... 
    Java
    Work at office
    Remote work
    Flexible hours

    Versa Networks

    Santa Clara, CA
    1 day ago
  • $156k - $316.8k

     ...Own foundational targeting data and platform capabilities with high availability, accuracy...  ...foundational targeting rule engine, access control & auditing...  ...hands-on with big data stack (Spark/Hive/Kafka/Flink/Airflow, etc.) - Proficient in Java/Scala/Python; solid engineering... 
    Java
    Temporary work
    Local area

    Tik Tok

    San Jose, CA
    3 days ago
  • $147.4k - $272.1k

     ...designed to connect players with incredible games, foster...  ...We are seeking a software data engineer to join the Apple Games App...  ...applications using Apache Spark or Apache Flink. 5+ years...  ...programming experience in Scala (preferred) or Java. Experience with Big data:... 
    Java
    Relocation

    Apple Inc.

    Cupertino, CA
    3 days ago
  • $143k - $286k

     ...experience. As the Senior Engineering Manager for Agentic Data, you will be at the...  ...retrieval, and enriched with the necessary business logic...  ...Kafka Streams, Flink, or Spark Streaming). Semantic & AI...  ...Rigor: Fluency in Python, Java, or Scala, with a deep engineering... 
    Java
    Permanent employment
    Full time
    Temporary work
    Part time
    Flexible hours

    Walmart

    Sunnyvale, CA
    4 days ago
  • $200k - $220k

     ...communicates. Job Summary We are looking for a Data DevOps Engineer with 8+ years of experience to join our ML...  ...Experience in setting up multitenant Spark & Kafka clusters. Experience running...  .... Strong skills in at least Python, Scala or Java. Experience in cleaning, processing,... 
    Java
    Work at office
    Remote work
    Flexible hours

    Versa Networks

    Santa Clara, CA
    22 hours ago
  • $320k

    NVIDIA Gruppe is seeking a Distinguished Engineer for the Apache Spark Acceleration group. This role...  ...accelerated Apache Spark, while engaging with open source communities. The ideal...  ...systems, and proficiency in C++, Java, and Scala. The position offers a competitive salary... 
    Java

    NVIDIA Gruppe

    Santa Clara, CA
    3 days ago
  •  ...Huawei Data Lake Cloud Services Developer As a core member, you...  ...Distributed storage and query engine for heterogeneous data sources...  ...~ Excellent coding skills in Java or C++ ~ Hands-on experience...  ...Components/Frameworks, such as Hadoop, Spark, HBase, HDFS, Hive, NoSQL, and... 
    Java
    For contractors

    Netpace

    Santa Clara, CA
    2 days ago
  • $45 - $60 per hour

     ...Responsibilities The Ads Data Team builds and manages...  ...to provide students with hands-on experience in...  .../Machine Learning Engineers and other stakeholders...  ...languages such as Python, Java, Go etc. 4. Solid understanding...  ...(e.g. Apache Hadoop, Spark, Kafka, Flink) and... 
    Java
    Hourly pay
    Summer work
    Internship
    Local area

    Tik Tok

    San Jose, CA
    4 days ago
  •  ...Overview Need local candidates only. This position is for a Data Engineer with up to 2 years of experience and a Master’s degree. Responsibilities...  ...degree in a related field. Experience with PySpark, Hadoop, Scala, and ETL. Preferred Background in machine learning.... 
    Local area

    Enexus Global Inc.

    Sunnyvale, CA
    1 day ago
  • Compunnel, Inc. is seeking a Data Engineer in Sunnyvale, California to build scalable, real-time data pipelines. The ideal candidate will work with technologies like Spark, Kafka, and GCP to facilitate data processing for analytics and machine learning. Key responsibilities... 

    Compunnel, Inc.

    Sunnyvale, CA
    22 hours ago
  • $212.8k

     ...Senior/Staff Big Data Storage and Computing Engineer, Recommendation Data Ecosystem Location: San Jose...  ...storage foundation and combine it with the powerful computing...  ...in programming languages such as Java, C++, and Scala, with strong coding and problem-solving... 
    Java
    Temporary work
    Local area
    Flexible hours

    Tik Tok

    San Jose, CA
    1 day ago
  •  ...networking technology company in Santa Clara is seeking a Data DevOps Engineer with 8+ years of experience to join their ML/AI team. The role...  ...should have strong programming skills in Python, Scala, or Java. This position offers a competitive salary and a flexible... 
    Java
    Remote job
    Flexible hours

    Versa Networks

    Santa Clara, CA
    3 days ago
  • $173.5k - $331.05k

     ...Senior Data Engineer & Architect Location: San Jose, CA Job Type...  ...standards. You'll collaborate closely with Data Scientists, Analytics...  ...distributed systems (e.g., Spark, Beam). Work with Data Scientists...  .... Proficiency in Scale or Java, plus experience Python & SQL... 
    Java
    Full time
    Temporary work
    Local area
    Worldwide

    Adobe

    San Jose, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer with Scala/Spark and Java. Be the first to apply!