Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Engineer with Scala/Spark and Java

Comtech

Company DescriptionComtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and Machine Learning (3+)Data mining, Data analysisRoles and Responsibilities:Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data into a form suitable for analysis – and then do the analysis.Support business decisions with ad hoc analysis as neededExtract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization toolsInform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processesEstablish and maintain effective processes for validating and updating predictive modelsAnalyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery modelsCollaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software productsPerform statistical analysis to prioritize in order to maximize successIdentify areas for improvement, communicating action plansPerform strategic data analysis and research to support business needsIdentify opportunities to improve productivity via sophisticated statistical modelingExplore data to identify opportunities to improve business resultsDevelop understanding of business processes, goals and strategy in order to provide analysis and interpretation to managementGain understanding of business needs and necessary analysis where appropriate through internal discussionQualificationsBachelors or Masters in related fieldAdditional InformationAll your information will be kept confidential according to EEO guidelines.SummaryType: ContractFunction: Information TechnologyExperience level: ExecutiveIndustry: Information Technology And Services

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Data Engineer with Scala/Spark and Java in San Jose, CA vacancy
  •  ...Description Primary Skills: ~ Big Data experience ~8+ years exp in Java, Python and Scala ~ With Spark and Machine Learning (3+) ~ Data mining,...  ...SQL queries, etc.). Work closely with our engineering team to integrate and build algorithms... 
    Java
    Contract work

    Comtech LLC

    San Jose, CA
    4 days ago
  •  ...Data Solutions EngineerManager Note: I am looking for a candidate who is very strong with Spark SQL and Scala programming.Data Solutions Engineer Responsibilities: As a part of our Big Data Product team,...  ...programming experience in Scala, Java or PythonExperience with... 
    Java
    Work experience placement

    Samprasoft

    Milpitas, CA
    15 hours ago
  •  ...security, and enterprise content/data management services. We...  ...EngineerSan Jose, CA3 +(with possibility of extension)•...  ...• 8+ years exp in Java, Python and Scala• With Spark and Machine Learning (3+)•...  ...).• Work closely with our engineering team to integrate and build... 
    Java

    Comtech

    San Jose, CA
    4 days ago
  •  ...Big Data Developer (Spark)Greetings for the day! My name is Suneetha from Testing Xperts, we are a global staffing, consulting and technology...  ...monthsInterview: Phone and SkypeJob description:Spark and Scala, Java, Hadoop MRUnixDesired years of experience: 10-12 years of experienceEducation... 
    Java
    Worldwide

    TestingXperts

    Cupertino, CA
    2 days ago
  •  ...Hadoop DeveloperThis engineer should come from the...  ...will be in support of data curation, ingestion,...  ...and Hive is required with understanding of partitioning...  ...strong knowledge of Spark on either Python or Scala. Basic Spark...  ...such as ftp/scp/ssh/Java/Python/SQL/etc. Our Enterprise... 
    Java

    ClifyX

    San Jose, CA
    2 days ago
  •  ...Sr Data Engineer With GCP, Spark, PythonSunnyvale, CA (Onsite) Long TermRequirements:GCP Experience• 2+ years of recent GCP experience• Experience...  ....• Experience with programming languages: Python, Java, Scala, etc.• Experience with scripting languages: Perl, Shell,... 
    Java

    InterSources

    Sunnyvale, CA
    2 days ago
  • $184.7k - $324.8k

     ..., it benefits everyone.The Data Products Engineering team is seeking versatile data...  ...critical pipelines, with strong ownership of quality...  ...batch execution contexts using Spark, Kafka, and Iceberg- Deliver...  ...languages (for example Scala, Java, or Python) and ease with picking... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184.7k - $324.8k

     ...better. Apple Services Engineering's Device Compute...  ...Analytics team provides the data foundation for Apple's...  ...performing team, work with colleagues across...  ...will build and run the Spark pipelines, design the...  ...formatsProficiency in Java or Scala, and strong SQLExperience... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  •  ...Big Data EngineerSan Jose, CA (Remote)ExperianNeed 8 years of experience and...  ...or more programming languages like Java, Scala or PythonGood experience with distributed systems like Hadoop, HDFs and No SQL databasesExperience in Spark, Hive or PrestoExperience with AWS cloud... 
    Java
    Remote work

    Omega Solutions Inc

    San Jose, CA
    2 days ago
  • $224k - $356.5k

     ...looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache Spark is the most popular data processing engine in data...  .... You will work with the open source community...  ...CUDA.Experience coding in Scala, Java, and/or C++.NVIDIA is widely... 
    Java
    Full time

    Nvidia

    Santa Clara, CA
    3 days ago
  • $184.7k - $324.8k

     ...Infrastructure (MSI) team is an engineering organization under the...  ...factory sites.As an AI Data & Infrastructure Engineer with the MSI team, you will...  ...SQL, with proficiency in Java or Scala preferred.Experience with...  ...streaming data pipelines using Spark (PySpark), Kafka, Airflow... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184.7k - $324.8k

     ...software in the world?The Core Data & Intelligence organization...  ...Data and Applied AI Engineer with a strong background in distributed...  ...-scale data pipelines with Spark and other distributed data...  ...in at least one of Java, Python or Scala, with strong SQL skills.Deep... 
    Java
    Work experience placement
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184.7k - $324.8k

     ...help shape how AI and modern data engineering & analytics come together to...  ..., or ML engineering, with the last 3+ years building and...  ...SQL engine (Trino, Presto, Spark) as in the model-serving layer...  ...high-level language (Python, Scala, Java, or Go), strong SQL, and the... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  •  ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases.... 
    Java

    Samprasoft

    Sunnyvale, CA
    3 days ago
  •  ...Sr Data Engineer (Java/spark)Location: Sunnyvale, CA or Bentonville, AR (Hybrid) Job Type: ContractRate: DOE* W2 candidates are strongly preferred...  ...modeling & data migration protocolsYou have experience with Trino, Big Query, Apache PinotYou have experience with data... 
    Java
    Immediate start

    Redolent

    Sunnyvale, CA
    2 days ago
  • $184.7k - $324.8k

     ...streams of multimodal data (including structured,...  ...By enriching this data with language and embedding...  ...seeking an experienced Data Engineer with deep expertise in...  ...including Apache Spark Strong experience...  ...proven experience with Scala, Java Hands-on experience... 
    Java
    Relocation

    Apple

    Cupertino, CA
    3 days ago
  • $117k - $234k

     ...and deploy scalable, intelligent data solutions that support millions of...  ...and act on this data. Partner with engineering, AI/ML, and product teams to ensure...  ...clean, testable code in Python, Java, or Scala; experience with PySpark/Spark for distributed data processing.... 
    Java

    Walmart

    Sunnyvale, CA
    12 hours ago
  • Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob...  ...and systems.Collaborate with cross-functional teams to...  ...programming languages such as Python, Java, or Scala.Experience with data processing frameworks like Apache Spark or Hadoop.Strong knowledge of... 
    Java
    Full time

    Pinnacle Group

    Sunnyvale, CA
    4 days ago
  • $150.4k - $277.6k

     ...everyone.The Apple Ads Data Governance team develops...  ...leverage advanced data engineering and machine learning...  ...involves collaborating with cross-functional teams...  ...experience in Python, Java, Rust or similar languages...  ...tuning of Datahub, Apache Spark, Flink, Hive, Hadoop/... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $143k - $286k

     ...PermanentCompany: WalmartStaff Data Engineer designs and builds high-...  ...Engineers reliable systems with predictable latency, throughput...  ...and markets.Optimize Spark, Kafka, BigQuery, Dataproc,...  ...Airflow.Strong Python skills plus Java or Scala proficiency.Knowledge of data... 
    Java
    Full time
    Temporary work
    Part time

    Walmart

    Sunnyvale, CA
    12 hours ago
  •  ...skills and experience — talk with your recruiter to learn more....  ...refactoring, and optimizing real-time data processing applications using...  ...applications using Apache Spark. Migrating real-time data...  ..., Apache Flink, Apache Spark, Java or Scala (preferably Scala). Seniority... 
    Java
    Contract work

    Motion Recruitment

    Mountain View, CA
    2 days ago
  •  ...Job TitleRequired Skills: Java, Python, Scala, API development, GQL, Node.js, Hadoop, Hive, Spark using Scala, Vertex AI, Presto/Trino, Kubernetes, Automic, Airflow and Data Lake concepts, Luigi, Experience with stream-processing systems: Storm, Spark-Streaming, etc.... 
    Java

    Syntricate Technologies

    Sunnyvale, CA
    2 days ago
  • $150.4k - $277.6k

     ...Senior Data EngineerImagine what you could do here. At Apple...  ...are seeking an exceptional engineer with a background in large scale...  ...engineering team that drives Apache Spark's state-of-the art features...  ...with JVM languages (Scala or Java preferred), Spark, Golang, or... 
    Java
    Relocation

    Apple

    Sunnyvale, CA
    2 days ago
  • $65 per hour

     ...platforms. We partner with startups and Fortune 50...  ...currently looking for a Data Engineer to support our client in...  .... 3+ years of hands-on Java development experience....  ...including: Hive, Spark, Impala, HBase, Apache...  ...Experience with Java, Scala, and Python development... 
    Java
    Long term contract
    Local area

    DRISHTICON

    Sunnyvale, CA
    5 days ago
  • $149.2k - $249k

     ...critical in building the data infrastructure to...  ...an AI Data & Knowledge Engineer, you will develop infrastructure...  ...development experience with cloud database environments...  ...languages like Python, Java, R and open-source...  ...processing like Hadoop and Spark.Experience building data... 
    Java
    Relocation

    Apple

    Cupertino, CA
    4 days ago
  • $184k - $287.5k

     ...Senior Systems Software Engineer for the Apache Spark Acceleration group. GPU accelerated data processing has moved...  ...accelerate Apache Spark with an open source plugin...  ...on Kubernetes: the Java REST API, the Spark Connect...  ...workload router in Scala and Java, including interoperability... 
    Java
    Full time
    Remote work

    Nvidia

    Santa Clara, CA
    3 days ago
  • $72k - $108k

    Data Engineer The Role UST is searching for a Data Engineer with spark and streaming skills builds real-time, scalable data pipelines...  ...and loading using Spark (PySpark/Scala) and streaming technologies (...  ...BigQuery, Apache Airflow, Spark/Java/ PySpark Nice to have: GCP,... 
    Java
    Full time
    Temporary work
    Part time
    Work at office
    Local area
    Flexible hours

    UST

    Sunnyvale, CA
    2 days ago
  •  ...Atlassian is looking for a Data Engineer to join our Data Engineering team...  ...practices, drive the approach with which we use data, develop backend...  ...skills using Python or Java.Working knowledge of relational...  ...scalable data pipelines using Spark (SparkSQL) with Airflow scheduler... 
    Java
    Work at office
    Local area

    Atlassian

    Mountain View, CA
    12 hours ago
  •  ...development experience in Big Data, NoSQL Databases. Strong development Experience in Storm, Spark, HDFS, Hive and Big Data related...  ...components.Deep Understanding of JAVA, Linux/Unix.Analysis and...  ...analytics.Ability to work and liaison with teams across business units.... 
    Java

    Sonsoft

    San Jose, CA
    4 days ago
  •  ...Java Developer With ScalaLocation: Sunnyvale, CAPosition Type: Full TimeSalary: DOE US Citizen, Green Card and GC EAD Only...  ...7-8 yearsSkills:Java/J2EE, Open source frameworks and tools, Comfortable with development in Scala.Good to have - Knowledge of Apache Spark... 
    Java
    H1b
    Visa sponsorship

    Georgia IT Inc

    Sunnyvale, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer with Scala/Spark and Java. Be the first to apply!