Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer with Scala/Spark and Java

Comtech LLC

Company Description

Comtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.

Job Description

Primary Skills:

  • Big Data experience
  • 8+ years exp in Java, Python and Scala
  • With Spark and Machine Learning (3+)
  • Data mining, Data analysis

Roles and Responsibilities:

  • Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
  • Work closely with our engineering team to integrate and build algorithms
  • Process unstructured data into a form suitable for analysis – and then do the analysis.
  • Support business decisions with ad hoc analysis as needed
  • Extract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization tools
  • Inform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processes
  • Establish and maintain effective processes for validating and updating predictive models
  • Analyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery models
  • Collaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software products
  • Perform statistical analysis to prioritize in order to maximize success
  • Identify areas for improvement, communicating action plans
  • Perform strategic data analysis and research to support business needs
  • Identify opportunities to improve productivity via sophisticated statistical modeling
  • Explore data to identify opportunities to improve business results
  • Develop understanding of business processes, goals and strategy in order to provide analysis and interpretation to management
  • Gain understanding of business needs and necessary analysis where appropriate through internal discussion
Qualifications

Bachelors or Masters in related field

Additional Information

All your information will be kept confidential according to EEO guidelines.

Summary
  • Type: Contract
  • Function: Information Technology
  • Experience level: Executive
  • Industry: Information Technology And Services
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer with Scala/Spark and Java in San Jose, CA vacancy
  •  ...Data Solutions EngineerManager Note: I am looking for a candidate who is very strong with Spark SQL and Scala programming.Data Solutions Engineer Responsibilities: As a part of our Big Data Product team,...  ...programming experience in Scala, Java or PythonExperience with... 
    Java
    Work experience placement

    Samprasoft

    Milpitas, CA
    17 hours ago
  •  ...security, and enterprise content/data management services. We...  ...EngineerSan Jose, CA3 +(with possibility of extension)•...  ...• 8+ years exp in Java, Python and Scala• With Spark and Machine Learning (3+)•...  ...).• Work closely with our engineering team to integrate and build... 
    Java

    Comtech

    San Jose, CA
    4 days ago
  •  ...Big Data Developer (Spark)Greetings for the day! My name is Suneetha from Testing Xperts, we are a global staffing, consulting and technology...  ...monthsInterview: Phone and SkypeJob description:Spark and Scala, Java, Hadoop MRUnixDesired years of experience: 10-12 years of experienceEducation... 
    Java
    Worldwide

    TestingXperts

    Cupertino, CA
    3 days ago
  •  ...Hadoop DeveloperThis engineer should come from the...  ...will be in support of data curation, ingestion,...  ...and Hive is required with understanding of partitioning...  ...strong knowledge of Spark on either Python or Scala. Basic Spark...  ...such as ftp/scp/ssh/Java/Python/SQL/etc. Our Enterprise... 
    Java

    ClifyX

    San Jose, CA
    3 days ago
  •  ...Sr Data Engineer With GCP, Spark, PythonSunnyvale, CA (Onsite) Long TermRequirements:GCP Experience• 2+ years of recent GCP experience• Experience...  ....• Experience with programming languages: Python, Java, Scala, etc.• Experience with scripting languages: Perl, Shell,... 
    Java

    InterSources

    Sunnyvale, CA
    2 days ago
  • $184.7k - $324.8k

     ..., it benefits everyone.The Data Products Engineering team is seeking versatile data...  ...critical pipelines, with strong ownership of quality...  ...batch execution contexts using Spark, Kafka, and Iceberg- Deliver...  ...languages (for example Scala, Java, or Python) and ease with picking... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184.7k - $324.8k

     ...better. Apple Services Engineering's Device Compute...  ...Analytics team provides the data foundation for Apple's...  ...performing team, work with colleagues across...  ...will build and run the Spark pipelines, design the...  ...formatsProficiency in Java or Scala, and strong SQLExperience... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  •  ...Big Data EngineerSan Jose, CA (Remote)ExperianNeed 8 years of experience and...  ...or more programming languages like Java, Scala or PythonGood experience with distributed systems like Hadoop, HDFs and No SQL databasesExperience in Spark, Hive or PrestoExperience with AWS cloud... 
    Java
    Remote work

    Omega Solutions Inc

    San Jose, CA
    3 days ago
  • $224k - $356.5k

     ...looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache Spark is the most popular data processing engine in data...  .... You will work with the open source community...  ...CUDA.Experience coding in Scala, Java, and/or C++.NVIDIA is widely... 
    Java
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184.7k - $324.8k

     ...Infrastructure (MSI) team is an engineering organization under the...  ...factory sites.As an AI Data & Infrastructure Engineer with the MSI team, you will...  ...SQL, with proficiency in Java or Scala preferred.Experience with...  ...streaming data pipelines using Spark (PySpark), Kafka, Airflow... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184.7k - $324.8k

     ...software in the world?The Core Data & Intelligence organization...  ...Data and Applied AI Engineer with a strong background in distributed...  ...-scale data pipelines with Spark and other distributed data...  ...in at least one of Java, Python or Scala, with strong SQL skills.Deep... 
    Java
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184.7k - $324.8k

     ...help shape how AI and modern data engineering & analytics come together to...  ..., or ML engineering, with the last 3+ years building and...  ...SQL engine (Trino, Presto, Spark) as in the model-serving layer...  ...high-level language (Python, Scala, Java, or Go), strong SQL, and the... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  •  ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases.... 
    Java

    Samprasoft

    Sunnyvale, CA
    3 days ago
  •  ...Sr Data Engineer (Java/spark)Location: Sunnyvale, CA or Bentonville, AR (Hybrid) Job Type: ContractRate: DOE* W2 candidates are strongly preferred...  ...modeling & data migration protocolsYou have experience with Trino, Big Query, Apache PinotYou have experience with data... 
    Java
    Immediate start

    Redolent

    Sunnyvale, CA
    2 days ago
  • $184.7k - $324.8k

     ...streams of multimodal data (including structured,...  ...By enriching this data with language and embedding...  ...seeking an experienced Data Engineer with deep expertise in...  ...including Apache Spark Strong experience...  ...proven experience with Scala, Java Hands-on experience... 
    Java
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $117k - $234k

     ...and deploy scalable, intelligent data solutions that support millions of...  ...and act on this data. Partner with engineering, AI/ML, and product teams to ensure...  ...clean, testable code in Python, Java, or Scala; experience with PySpark/Spark for distributed data processing.... 
    Java

    Walmart

    Sunnyvale, CA
    14 hours ago
  • Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob...  ...and systems.Collaborate with cross-functional teams to...  ...programming languages such as Python, Java, or Scala.Experience with data processing frameworks like Apache Spark or Hadoop.Strong knowledge of... 
    Java
    Full time

    Pinnacle Group

    Sunnyvale, CA
    4 days ago
  • $150.4k - $277.6k

     ...everyone.The Apple Ads Data Governance team develops...  ...leverage advanced data engineering and machine learning...  ...involves collaborating with cross-functional teams...  ...experience in Python, Java, Rust or similar languages...  ...tuning of Datahub, Apache Spark, Flink, Hive, Hadoop/... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $143k - $286k

     ...PermanentCompany: WalmartStaff Data Engineer designs and builds high-...  ...Engineers reliable systems with predictable latency, throughput...  ...and markets.Optimize Spark, Kafka, BigQuery, Dataproc,...  ...Airflow.Strong Python skills plus Java or Scala proficiency.Knowledge of data... 
    Java
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    14 hours ago
  •  ...skills and experience — talk with your recruiter to learn more....  ...refactoring, and optimizing real-time data processing applications using...  ...applications using Apache Spark. Migrating real-time data...  ..., Apache Flink, Apache Spark, Java or Scala (preferably Scala). Seniority... 
    Java
    Contract work

    Motion Recruitment

    Mountain View, CA
    2 days ago
  •  ...Job TitleRequired Skills: Java, Python, Scala, API development, GQL, Node.js, Hadoop, Hive, Spark using Scala, Vertex AI, Presto/Trino, Kubernetes, Automic, Airflow and Data Lake concepts, Luigi, Experience with stream-processing systems: Storm, Spark-Streaming, etc.... 
    Java

    Syntricate Technologies

    Sunnyvale, CA
    3 days ago
  • $150.4k - $277.6k

     ...Senior Data EngineerImagine what you could do here. At Apple...  ...are seeking an exceptional engineer with a background in large scale...  ...engineering team that drives Apache Spark's state-of-the art features...  ...with JVM languages (Scala or Java preferred), Spark, Golang, or... 
    Java
    Relocation

    Apple

    Sunnyvale, CA
    2 days ago
  • $65 per hour

     ...platforms. We partner with startups and Fortune 50...  ...currently looking for a Data Engineer to support our client in...  .... 3+ years of hands-on Java development experience....  ...including: Hive, Spark, Impala, HBase, Apache...  ...Experience with Java, Scala, and Python development... 
    Java
    Long term contract
    Local area

    DRISHTICON

    Sunnyvale, CA
    5 days ago
  • $149.2k - $249k

     ...critical in building the data infrastructure to...  ...an AI Data & Knowledge Engineer, you will develop infrastructure...  ...development experience with cloud database environments...  ...languages like Python, Java, R and open-source...  ...processing like Hadoop and Spark.Experience building data... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184k - $287.5k

     ...Senior Systems Software Engineer for the Apache Spark Acceleration group. GPU accelerated data processing has moved...  ...accelerate Apache Spark with an open source plugin...  ...on Kubernetes: the Java REST API, the Spark Connect...  ...workload router in Scala and Java, including interoperability... 
    Java
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $72k - $108k

    Data Engineer The Role UST is searching for a Data Engineer with spark and streaming skills builds real-time, scalable data pipelines...  ...and loading using Spark (PySpark/Scala) and streaming technologies (...  ...BigQuery, Apache Airflow, Spark/Java/ PySpark Nice to have: GCP,... 
    Java
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Flexible hours

    UST

    Sunnyvale, CA
    2 days ago
  •  ...Atlassian is looking for a Data Engineer to join our Data Engineering team...  ...practices, drive the approach with which we use data, develop backend...  ...skills using Python or Java.Working knowledge of relational...  ...scalable data pipelines using Spark (SparkSQL) with Airflow scheduler... 
    Java
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    14 hours ago
  •  ...Java Developer With ScalaLocation: Sunnyvale, CAPosition Type: Full TimeSalary: DOE US Citizen, Green Card and GC EAD Only...  ...7-8 yearsSkills:Java/J2EE, Open source frameworks and tools, Comfortable with development in Scala.Good to have - Knowledge of Apache Spark... 
    Java
    H1b
    Visa sponsorship

    Georgia IT Inc

    Sunnyvale, CA
    3 days ago
  •  ...development experience in Big Data, NoSQL Databases. Strong development Experience in Storm, Spark, HDFS, Hive and Big Data related...  ...components.Deep Understanding of JAVA, Linux/Unix.Analysis and...  ...analytics.Ability to work and liaison with teams across business units.... 
    Java

    Sonsoft

    San Jose, CA
    4 days ago
  •  ...development experience in Big Data, NoSQL Databases. Strong development Experience in Storm, Spark, HDFS, Hive and Big Data related...  ...components.Deep Understanding of JAVA, Linux/Unix.Analysis and...  ...analytics.Ability to work and liaison with teams across business units.... 
    Java
    Permanent employment
    Full time
    H1b

    Sonsoft

    San Jose, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer with Scala/Spark and Java. Be the first to apply!