Average salary: $185,000 /yearly
More statsGet new jobs by email
- ...Migration Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility... ...Schema Management: Expertise in Schema Evolution (Ref: Iceberg Apache) and enforcement strategies. Performance Optimization:...Suggested
- ...Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg to join our team in Bangalore, Karnātaka (IN-KA), India... ...Code Conversion: Translating and optimizing legacy SQL and Spark-based consumption patterns (raw and modeled) for compatibility with...SuggestedWork at officeRemote workFlexible hours
- ...Python AND Kafka AND (Hadoop OR HDFS OR Hive) AND Snowflake AND apache AND (iceberg to join our team in Bangalore, Karnātaka (IN-KA), India... ...- *Extraction & Logic:* Python, Kafka, ANSI SQL, FTP, Apache Spark - *Data Formats:* JSON, Avro, Parquet- *Platforms:* Hadoop (...SuggestedWork at officeRemote workFlexible hours
- ...on-premises to Cloud Migration, Continuous Delivery, Big Data, Apache, Web Logic, Jenkins) in Reston, VA Apache, AWS, Big Data, Cloud... ...Docker, RDBMS, Big Data, NoSQL, HADOOP, NOSQL, Apache Kafka, Apache Spark, WebLogic, Oracle, Linux, Unix, Windows SCREENING QUESTIONS: 1...SuggestedPermanent employmentFull timeRemote work
- SIX Software Engineers ( Java, Spring, Spring boot, Apache NiFi, Maven, Hadoop, MongoDB, MS Access, Accumulo) in Baltimore, MD Accumulo, Apache Nifi, Hadoop, Java, Maven, MS Access, Spring Boot, Spring Frameworks Location: Maryland Job Function: Software Development...SuggestedFull timeRemote work
- Data Systems Engineer (AWS, Snowflake, RedShift, Python, Scala, Hadoop, Spark, Kafka, Hive, API, Handling, API Development, Data Migration, Batch Data Pipelines) in Charlotte, NC API Development, AWS, AWS Lambda, Data Migration, Hadoop, Java, Oracle, Snowflake, SQL Server...SuggestedFull timeLocal areaImmediate startRemote work
- ...object storage (Amazon S3, Google Cloud Storage) and open table formats (e.g., Apache Iceberg). Develop batch and streaming pipelines using: AWS services such as AWS Glue, Apache Spark, Kinesis, and Athena GCP services such as Dataproc, Dataflow, Pub/Sub, and BigQuery...SuggestedFull timePart timeFlexible hours
- ...Architect scalable, cost-efficient pipelines using Databricks PySpark, Spark SQL, and Delta Live Tables (DLT) as appropriate. Make and... ...using Databricks Structured Streaming, Delta Live Tables, or Apache Kafka — particularly migrating from Amazon Kinesis-based architectures...SuggestedFull timeContract workWork at officeRemote workFlexible hoursShift work
$118.8k - $205.92k
...Dimensional Modeling, Normalized models, OBTs etc. Must have knowledge of one or more of ETL/ELT tools like AWS Glue, DBT, SSIS, Apache Spark, Informatica. 3 + years of hands-on experience of working on modern columnar data platforms like Snowflake, AWS Redshift,...SuggestedFull timeTemporary workWork experience placementCasual workWork at officeLocal areaRemote work- ...migration of a representative set of Hive tables and ETL jobs to an Apache Iceberg-based Data Lakehouse architecture. The engineer... ...role requiring deep expertise across the Hadoop ecosystem, Apache Spark, and the Apache Iceberg table format, with the ability to...SuggestedWork at officeRemote workFlexible hours
- ...grade PySpark Structured Streaming pipelines that ingest data into Apache Iceberg tables — operating under specific technical constraints.... ..., and writes atomically to Iceberg tables using the Iceberg Spark runtime and foreachBatch micro-batch pattern Ensure all functionality...SuggestedWork at officeRemote workFlexible hours
- ...Snowflake Develop and manage end-to-end data pipelines using Apache Airflow for orchestration and scheduling Write clean,... ...DBT certification (Analytics Engineering) Familiarity with Spark, Kafka, or streaming data pipelines Experience with Looker,...SuggestedRemote work
$77.41k - $131.6k
...experience with the engineering and support of common Web and Application hosting services activities (covering areas such as IIS, Apache, Tomcat, SSL certificates, Application Load Balancers, API services, container, and cluster services, etc.) 3+ years of experience...SuggestedFull timeContract workWork experience placementWork at officeRemote workShift work1 day per week- ...storage and processing using Lakehouse principles, including separation of storage and compute. Work with open table formats (e.g., Apache Iceberg or equivalent) and open file formats (e.g., Parquet) to enable interoperability across engines. Support schema evolution...SuggestedFull timePart timeFlexible hours
- ...architectures and security concepts/techniques (including authentication mechanisms, operating systems, DNS, NFS, SSH, Firewalls, IIS, Apache, and security applications capabilities) Good oral and written communication skills required. Training or Work Experience:...SuggestedFull timeWork experience placementLocal area
- ...curated datasets on an AWS-based lakehouse architecture. You will help evolve a transactional lakehouse using open table formats (e.g., Apache Iceberg) and implement engineering standards that keep the platform interoperable across query engines and cloud providers. You’...Full timePart timeFlexible hours
- ...role. ~ Experience delivering customer-facing SaaS products at scale. ~ Hands-on knowledge of modern data platform tools such as Apache Airflow and AWS services. ~ Strong background in data architecture, ETL/ELT processes, and data modeling. ~ Proficiency in SQL,...Remote jobFull timeCasual work
- ...clean code practices; comfortable with unit, contract, and integration tests. CI/CD Desirable / Nice‑to‑Haves Exposure to Apache Airflow (DAG authoring, scheduling, deployment in containerized/K8s environments). Event streaming (Kafka/RabbitMQ), caching (Redis...Contract workWork at officeRemote workFlexible hours
- ...Responsibilities Design, develop, and maintain enterprise-grade applications using Java and open-source frameworks (Spring Boot, Apache Camel). Build and optimize AWS cloud solutions leveraging ECS, S3, SQS, Step Functions, and Lambda serverless implementations....Contract workWork at office
- ...Experience with the following scripting languages: DOS, PowerShell, JSON, Perl, VBscript Experience with JBoss and Apache systems in support of web based applications Experience reviewing application log files and initial review of application processing...Contract workRemote work
- ...~ We are looking for a Content Management Developer to build and support content driven websites and applications using Java and Apache Sling. This role focuses on developing backend logic and CMS components that manage and deliver content efficiently.ResponsibilitiesDevelop...Remote work
- ...and IaC tools (Terraform, Pulumi, Ansible, Deployment Manager). ~ Familiarity with data pipelines and integration tools (Dataflow, Apache Beam, Pub/Sub, Kafka). ~ Excellent problem-solving, debugging, and communication skills. Preferred Experience...Work at officeRemote workFlexible hours
$65 - $75 per hour
...version control Proficient in JUnit for unit testing Experience with SQL and relational database management Familiarity with Apache Tomcat application server Strong problem-solving skills with excellent attention to detail Effective written and verbal...Full timeContract workWork experience placement- ...Modelling Language, Semantic Modelling XSD, Entity Relationship Modelling) ~ Middleware solutions (ETL – Informatica, Talend, ESB – Apache Kafka, RabbitMQ, ActiveMQ, Tibco BusinessWorks) ~ Integration architecture (SOAP XML and RESTful JSON services) ~ Databases (...Work at officeImmediate startRemote workFlexible hours
- ...solutions with MQTT, REST, gRPC, SoAP etc. ~ Experience in scalable connectivity solutions through the usage and application of Apache Kafka, UNS, EMQX/Hive MQ broker ~ Experienced in design solutions using Azure/AWS cloud inclusive of VMs, Synapse pipelines, Databricks...Monday to FridayWeekend work
$270k - $351k
...millions of events per day; 5 years of experience building and optimizing large-scale data infrastructure using BigQuery, Presto, or Spark, including expertise in distributed schema design, analytical query optimization, and cost-performance tradeoffs in production; 1...Temporary workWork at officeWork from home2 days per week3 days per week- ...layers). 2. Azure Cloud Engineering Build and maintain data solutions using key Azure services: ADLS Gen2 Synapse Pipelines / Spark Pools Azure Functions Event Hub / IoT Hub / Event Grid Ensure solutions adhere to Azure best practices for scalability and...Work at officeRemote workFlexible hours
$150k - $200k
...you are confident and comfortable using our platform. Part of this exciting journey will also have you exposed to other tools such as Spark, Hadoop, Hive, Kubernetes, with our platform being hosted on Google cloud (GCP). You will learn how to create entities and networks...Full timeTemporary workWork visa- ...edge AI solutions using frameworks like TensorRT, OpenVINO, ONNX. Ensure scalable data storage and streaming integration (Kafka, Spark, etc.). Governance, Security & Compliance Establish data governance standards for image/video datasets. Implement secure data...Work at officeRemote workFlexible hours
- ...all feel welcomed, valued and empowered to achieve our full potential is important to who we are today and where we're headed in the future. And we know that unique backgrounds, experiences and perspectives help us think bigger, spark innovation and succeed together....Full timeRemote work