Average salary: $185,000 /yearly
More statsGet new jobs by email
- ...Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg to join our team in Bangalore, Karnātaka (IN-KA), India... ...Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with...SuggestedWork at officeRemote workFlexible hours
- ...Migration Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility... ...Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies. Performance Optimization:...Suggested
- ...Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg to join our team in Bangalore, Karnātaka (IN-KA), India... ...- *Extraction & Logic:* Python, Kafka, ANSI SQL, FTP, Apache Spark - *Data Formats:* JSON, Avro, Parquet- *Platforms:* Hadoop (...SuggestedWork at officeRemote workFlexible hours
- ...on-premises to Cloud Migration, Continuous Delivery, Big Data, Apache, Web Logic, Jenkins) in Reston, VA Apache, AWS, Big Data, Cloud... ...Docker, RDBMS, Big Data, NoSQL, HADOOP, NOSQL, Apache Kafka, Apache Spark, WebLogic, Oracle, Linux, Unix, Windows SCREENING QUESTIONS: 1...SuggestedPermanent employmentFull timeRemote work
- SIX Software Engineers ( Java, Spring, Spring boot, Apache NiFi, Maven, Hadoop, MongoDB, MS Access, Accumulo) in Baltimore, MD Accumulo, Apache Nifi, Hadoop, Java, Maven, MS Access, Spring Boot, Spring Frameworks Location: Maryland Job Function: Software Development...SuggestedFull timeRemote work
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...SuggestedFull timeLocal areaImmediate startRemote work
- ...enterprise systems using orchestration tools such as Azure Logic Apps, Apache Airflow, or Databricks Workflows. • Develop... ...Lake for large-scale data processing • SQL (T-SQL / Spark SQL) for feature engineering and data validation •...SuggestedContract workWork at officeRemote workFlexible hours
- ...Duration: 12+ Months Females are preferred Design, develop, and optimize large-scale data processing pipelines using Apache Spark (Spark SQL, Spark Core, and DataFrames) for high-volume batch and real-time data workloads. Write complex and high-performance...Suggested
- ...diagrams, integration patterns, and reference architectures. Architect scalable ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), and/or Cloud Composer orchestrations. Lead cloud-native modernization initiatives: migration from legacy platforms...Suggested
- ...experience with Cloudera on prem platform components HDFS Hive Yarn Spark Kafka HBase Experience with Cloudera Data Platform... ...Does the candidate have knowledge or learning on other BI Platform like Tableau BO Skills Mandatory Skills : Apache Spark...SuggestedFull timePart timeInternshipSeasonal workRemote work
- ...cloud platforms, and modern big data technologies such as Hadoop, Spark, and Kubernetes-based orchestration. Responsibilities:... ...Hands-on experience with Amazon EMR on EKS (Kubernetes) for running Apache Spark workloads Experience with Kubernetes resource...Suggested
- ...Expert Systems, GitHub, Tekton, Docker, Jira, Microservices, Data Architecture, Agile Software Development, SQL, Java, Spark, Cloud Architecture, Apache Kafka, REST APIs Skills Preferred: Telematics, Machine Learning, Data Modeling, Cloud Infrastructure, Data...SuggestedLocal area
- ...years demonstrated experience designing and implementing data ingestion pipelines using tools such as: Azure Data Factory Apache Kafka Apache NiFi Spark Structured Streaming or equivalent technologies. ~5+ years of experience applying de-duplication techniques at...SuggestedPermanent employmentLocal areaRemote work
- ...Architect scalable, cost-efficient pipelines using Databricks PySpark, Spark SQL, and Delta Live Tables (DLT) as appropriate. Make and... ...using Databricks Structured Streaming, Delta Live Tables, or Apache Kafka — particularly migrating from Amazon Kinesis-based architectures...SuggestedFull timeContract workWork at officeRemote workFlexible hoursShift work
- ...Define data ingestion, transformation, quality, cataloging, and governance frameworks using services like AWS Glue, Lake Formation, Apache Hudi/Delta, and DataBrew. • Experience in migration of Oracle based DWH to AWS • Develop and operationalize AI/ML pipelines...SuggestedWork at officeRemote workFlexible hours
- ...AppDynamics ~5 years of Observability alerts and Incident handling - AIOPS, Service now, Bigpanda etc ~4 years of React.js, Apache, Kafka, relational databases experience ~4 years of distributed systems, microservices architectures, and cloud native...Contract workFor contractorsWork at officeImmediate startShift work3 days per week
- ...pipelines Nice to Have: Cloud platform experience (AWS, Azure, or Google Cloud Platform) Familiarity with orchestration tools like Apache Airflow Python or scripting experience For applications and inquiries, contact: ****@*****.***...Long term contractPermanent employment
- ...optimization. Strong experience with Spring Boot and Microservices architecture. Experience building event-driven systems using Apache Kafka. Strong understanding of RESTful APIs, API security, and integration patterns. Experience with SQL Server and/or...Contract workWork experience placement
- ...Knowledge of ontology design and advanced knowledge graph architectures. Familiarity with event streaming technologies such as Apache Kafka . Experience with LLM/RAG integrations leveraging graph-based contextual retrieval. Hands-on experience with cloud-...For contractorsH1bImmediate startRemote work
- ...expressions, Optional). Frameworks : Spring Framework (Core, MVC, Data, Security) and Spring Boot . Integration : Proficiency in Apache Camel for message routing, EIP (Enterprise Integration Patterns), and component configuration. API Design : Strong...Work at officeRemote workFlexible hours
- ...Engineering for AI: Design end-to-end data solutions for unstructured data ingestion. Build robust ETL/ELT pipelines in BigQuery and Apache Beam to support model training, fine-tuning, and real-time inference Technical Leadership : Provide technical mentorship to...Local areaImmediate startShift work
$118.2k - $160k
...D weather radar and meteorological surface/upper air observational networks. Data distribution technologies like LDM, NOAAPort, Apache Kafka. Geospatial data tools such as GDAL/OGR, ESRI, ArcPy, GeoPandas. Strong working knowledge of Linux OS and scripting languages...Full timeLocal areaRemote work$78.5k - $145.9k
...Experience utilizing automation tools such as Terraform, Ansible, and Jenkins. Windows and Linux administration experience. Apache Tomcat experience is a plus Database admin experience with Microsoft SQL Server. Experience with build/releasing software in...Full timeWork at officeLocal areaRemote workFlexible hours2 days per week3 days per week- ...SaaS applications (Salesforce, Google, etc) Supporting SaaS solutions Web-based application consulting and/or support for (MS IIS, Apache) and modern Web browsers, such as Chrome, Firefox and Safari Take ownership of customer reported issues and see problems through...Full timeRemote work
- ...Familiarity with containerization technologies (Docker, Kubernetes) Experience with CI/CD pipelines and DevOps practices Understanding of message queuing systems (RabbitMQ, Apache Kafka) Knowledge of monitoring and logging tools Experience with Agile/Scrum methodologies
$89.2k - $142.5k
...relational databases (MariaDB MS SQL MySQL or Oracle) and basic SQL concepts. Exposure to web servers/app servers such as Nginx Apache and/or Tomcat. Interest in troubleshooting and debugging (ability to reproduce issues read logs and ask good questions). Ability...Full timeTemporary workWork at officeLocal areaRelocation- ...Experience with complex multi-server environments and high availability environments. Experience using Azure Data Factory, Five Tran, Spark or other similar data integration tools Experience with system monitoring, log management, and error notification. Fundamental...Long term contractFull timeContract workLocal areaRemote work
- ...Skills: Python (mandatory), TensorFlow/PyTorch/Scikit‑learn, MLflow/Kubeflow/SageMaker, Airflow/Prefect, Jenkins/GitHub Actions, SQL, Spark, Kafka (preferred). Responsibilities: Model deployment, building APIs and pipelines, CI/CD for ML, monitoring model performance...
$55 - $60 per hour
...automated build, deployment, and testing pipelines. Experience deploying and managing applications on AWS services such as Lambda, EMR, and Spark. Experience with containerized deployments and orchestration platforms. Experience troubleshooting production issues and improving...Contract work- ...and protect our customers with inventive electrical solutions. People are our most valuable asset. Inclusion and diversity means that we celebrate and encourage each other's authenticity because we understand that uniqueness sparks growth. #LI-AW1 #LI-Hybrid #INDOTH...Full timeWorldwide