Data Engineer with Scala/Spark and Java
Comtech
Company DescriptionComtech LLC is a woman-owned small business focused on delivering end-to-end solutions and products. Since 1998, we have successfully serviced enterprises across the public and private sectors, and the Department of Defense. Our services span all aspects of business, providing a holistic approach for managing an organization.Job DescriptionPrimary Skills:Big Data experience8+ years exp in Java, Python and ScalaWith Spark and Machine Learning (3+)Data mining, Data analysisRoles and Responsibilities:Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).Work closely with our engineering team to integrate and build algorithmsProcess unstructured data into a form suitable for analysis – and then do the analysis.Support business decisions with ad hoc analysis as neededExtract data from a variety of relational databases, manipulate, explore data using quantitative, statistical and visualization toolsInform the selection of appropriate modeling techniques to ensure that predictive models are developed using rigorous statistical processesEstablish and maintain effective processes for validating and updating predictive modelsAnalyze, model, and forecast health service utilization patterns/ trends and create capability to model outcomes of what-if scenarios for novel health care delivery modelsCollaborate with internal business, analytics and data strategy partners to improve efficiency and increase applicability of predictive models into the core software productsPerform statistical analysis to prioritize in order to maximize successIdentify areas for improvement, communicating action plansPerform strategic data analysis and research to support business needsIdentify opportunities to improve productivity via sophisticated statistical modelingExplore data to identify opportunities to improve business resultsDevelop understanding of business processes, goals and strategy in order to provide analysis and interpretation to managementGain understanding of business needs and necessary analysis where appropriate through internal discussionQualificationsBachelors or Masters in related fieldAdditional InformationAll your information will be kept confidential according to EEO guidelines.SummaryType: ContractFunction: Information TechnologyExperience level: ExecutiveIndustry: Information Technology And Services
- ...Description Primary Skills: ~ Big Data experience ~8+ years exp in Java, Python and Scala ~ With Spark and Machine Learning (3+) ~ Data mining,... ...SQL queries, etc.). Work closely with our engineering team to integrate and build algorithms...JavaContract work
- ...Data Solutions EngineerManager Note: I am looking for a candidate who is very strong with Spark SQL and Scala programming.Data Solutions Engineer Responsibilities: As a part of our Big Data Product team,... ...programming experience in Scala, Java or PythonExperience with...JavaWork experience placement
- ...security, and enterprise content/data management services. We... ...EngineerSan Jose, CA3 +(with possibility of extension)•... ...• 8+ years exp in Java, Python and Scala• With Spark and Machine Learning (3+)•... ...).• Work closely with our engineering team to integrate and build...Java
- ...Big Data Developer (Spark)Greetings for the day! My name is Suneetha from Testing Xperts, we are a global staffing, consulting and technology... ...monthsInterview: Phone and SkypeJob description:Spark and Scala, Java, Hadoop MRUnixDesired years of experience: 10-12 years of experienceEducation...JavaWorldwide
- ...Hadoop DeveloperThis engineer should come from the... ...will be in support of data curation, ingestion,... ...and Hive is required with understanding of partitioning... ...strong knowledge of Spark on either Python or Scala. Basic Spark... ...such as ftp/scp/ssh/Java/Python/SQL/etc. Our Enterprise...Java
- ...Sr Data Engineer With GCP, Spark, PythonSunnyvale, CA (Onsite) Long TermRequirements:GCP Experience• 2+ years of recent GCP experience• Experience... ....• Experience with programming languages: Python, Java, Scala, etc.• Experience with scripting languages: Perl, Shell,...Java
$184.7k - $324.8k
..., it benefits everyone.The Data Products Engineering team is seeking versatile data... ...critical pipelines, with strong ownership of quality... ...batch execution contexts using Spark, Kafka, and Iceberg- Deliver... ...languages (for example Scala, Java, or Python) and ease with picking...JavaRelocation$184.7k - $324.8k
...better. Apple Services Engineering's Device Compute... ...Analytics team provides the data foundation for Apple's... ...performing team, work with colleagues across... ...will build and run the Spark pipelines, design the... ...formatsProficiency in Java or Scala, and strong SQLExperience...JavaRelocation- ...Big Data EngineerSan Jose, CA (Remote)ExperianNeed 8 years of experience and... ...or more programming languages like Java, Scala or PythonGood experience with distributed systems like Hadoop, HDFs and No SQL databasesExperience in Spark, Hive or PrestoExperience with AWS cloud...JavaRemote work
$224k - $356.5k
...looking for a Machine Learning Engineer to join the GPU accelerated Apache Spark team.Apache Spark is the most popular data processing engine in data... .... You will work with the open source community... ...CUDA.Experience coding in Scala, Java, and/or C++.NVIDIA is widely...JavaFull time$184.7k - $324.8k
...Infrastructure (MSI) team is an engineering organization under the... ...factory sites.As an AI Data & Infrastructure Engineer with the MSI team, you will... ...SQL, with proficiency in Java or Scala preferred.Experience with... ...streaming data pipelines using Spark (PySpark), Kafka, Airflow...JavaRelocation$184.7k - $324.8k
...software in the world?The Core Data & Intelligence organization... ...Data and Applied AI Engineer with a strong background in distributed... ...-scale data pipelines with Spark and other distributed data... ...in at least one of Java, Python or Scala, with strong SQL skills.Deep...JavaWork experience placementRelocation$184.7k - $324.8k
...help shape how AI and modern data engineering & analytics come together to... ..., or ML engineering, with the last 3+ years building and... ...SQL engine (Trino, Presto, Spark) as in the model-serving layer... ...high-level language (Python, Scala, Java, or Go), strong SQL, and the...JavaRelocation- ...software development or related3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBaseHands on experience with Unix, Teradata and other relational databases....Java
- ...Sr Data Engineer (Java/spark)Location: Sunnyvale, CA or Bentonville, AR (Hybrid) Job Type: ContractRate: DOE* W2 candidates are strongly preferred... ...modeling & data migration protocolsYou have experience with Trino, Big Query, Apache PinotYou have experience with data...JavaImmediate start
$184.7k - $324.8k
...streams of multimodal data (including structured,... ...By enriching this data with language and embedding... ...seeking an experienced Data Engineer with deep expertise in... ...including Apache Spark Strong experience... ...proven experience with Scala, Java Hands-on experience...JavaRelocation$117k - $234k
...and deploy scalable, intelligent data solutions that support millions of... ...and act on this data. Partner with engineering, AI/ML, and product teams to ensure... ...clean, testable code in Python, Java, or Scala; experience with PySpark/Spark for distributed data processing....Java- Position: Data Engineer IILocation: Sunnyvale, CaliforniaDuration: ContractJob... ...and systems.Collaborate with cross-functional teams to... ...programming languages such as Python, Java, or Scala.Experience with data processing frameworks like Apache Spark or Hadoop.Strong knowledge of...JavaFull time
$150.4k - $277.6k
...everyone.The Apple Ads Data Governance team develops... ...leverage advanced data engineering and machine learning... ...involves collaborating with cross-functional teams... ...experience in Python, Java, Rust or similar languages... ...tuning of Datahub, Apache Spark, Flink, Hive, Hadoop/...JavaRelocation$143k - $286k
...PermanentCompany: WalmartStaff Data Engineer designs and builds high-... ...Engineers reliable systems with predictable latency, throughput... ...and markets.Optimize Spark, Kafka, BigQuery, Dataproc,... ...Airflow.Strong Python skills plus Java or Scala proficiency.Knowledge of data...JavaFull timeTemporary workPart time- ...skills and experience — talk with your recruiter to learn more.... ...refactoring, and optimizing real-time data processing applications using... ...applications using Apache Spark. Migrating real-time data... ..., Apache Flink, Apache Spark, Java or Scala (preferably Scala). Seniority...JavaContract work
- ...Job TitleRequired Skills: Java, Python, Scala, API development, GQL, Node.js, Hadoop, Hive, Spark using Scala, Vertex AI, Presto/Trino, Kubernetes, Automic, Airflow and Data Lake concepts, Luigi, Experience with stream-processing systems: Storm, Spark-Streaming, etc....Java
$150.4k - $277.6k
...Senior Data EngineerImagine what you could do here. At Apple... ...are seeking an exceptional engineer with a background in large scale... ...engineering team that drives Apache Spark's state-of-the art features... ...with JVM languages (Scala or Java preferred), Spark, Golang, or...JavaRelocation$65 per hour
...platforms. We partner with startups and Fortune 50... ...currently looking for a Data Engineer to support our client in... .... 3+ years of hands-on Java development experience.... ...including: Hive, Spark, Impala, HBase, Apache... ...Experience with Java, Scala, and Python development...JavaLong term contractLocal area$149.2k - $249k
...critical in building the data infrastructure to... ...an AI Data & Knowledge Engineer, you will develop infrastructure... ...development experience with cloud database environments... ...languages like Python, Java, R and open-source... ...processing like Hadoop and Spark.Experience building data...JavaRelocation$184k - $287.5k
...Senior Systems Software Engineer for the Apache Spark Acceleration group. GPU accelerated data processing has moved... ...accelerate Apache Spark with an open source plugin... ...on Kubernetes: the Java REST API, the Spark Connect... ...workload router in Scala and Java, including interoperability...JavaFull timeRemote work$72k - $108k
Data Engineer The Role UST is searching for a Data Engineer with spark and streaming skills builds real-time, scalable data pipelines... ...and loading using Spark (PySpark/Scala) and streaming technologies (... ...BigQuery, Apache Airflow, Spark/Java/ PySpark Nice to have: GCP,...JavaFull timeTemporary workPart timeWork at officeLocal areaFlexible hours- ...Atlassian is looking for a Data Engineer to join our Data Engineering team... ...practices, drive the approach with which we use data, develop backend... ...skills using Python or Java.Working knowledge of relational... ...scalable data pipelines using Spark (SparkSQL) with Airflow scheduler...JavaWork at officeLocal area
- ...development experience in Big Data, NoSQL Databases. Strong development Experience in Storm, Spark, HDFS, Hive and Big Data related... ...components.Deep Understanding of JAVA, Linux/Unix.Analysis and... ...analytics.Ability to work and liaison with teams across business units....Java
- ...Java Developer With ScalaLocation: Sunnyvale, CAPosition Type: Full TimeSalary: DOE US Citizen, Green Card and GC EAD Only... ...7-8 yearsSkills:Java/J2EE, Open source frameworks and tools, Comfortable with development in Scala.Good to have - Knowledge of Apache Spark...JavaH1bVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer with Scala/Spark and Java. Be the first to apply!
- entry level big data engineer San Jose, CA
- big data engineer San Jose, CA
- senior data engineer San Jose, CA
- big data cloud engineer San Jose, CA
- senior data center engineer San Jose, CA
- junior data engineer remote San Jose, CA
- data engineer machine learning San Jose, CA
- director data engineering San Jose, CA
- data engineer San Jose, CA
- data engineer graduate San Jose, CA


