Get new jobs by email
- ...the Databricks Lakehouse Platform building Bronze/Silver/Gold layers using Delta Lake and Delta Live Tables (DLT). Strong in PySpark, Spark SQL, and Databricks Workflows for orchestration. Proficient with Unity Catalog for governance, lineage, and access control, and...SuggestedRemote work
- ...Data bricks Lakehouse Platform - building Bronze/Silver/Gold layers using Delta Lake and Delta Live Tables (DLT). Strong in PySpark, Spark SQL, and Data bricks Workflows for orchestration. Proficient with Unity Catalog for governance, lineage, and access control, and...SuggestedRemote work
- ...years of experience building data pipelines in cloud environments ~4+ years of experience with Big Data technologies (e.g., Spark, Hadoop) and cloud architecture ~3+ years of experience with reporting and analytics tools (e.g., Tableau, Power BI) ~ Hands...SuggestedLong term contract
$69 - $74 per hour
...cloud computing experience. 3+ years of experience with Google BigQuery. Preferred Qualifications 5+ years of experience with Spark and Python. 3+ years of experience with secure DevOps practices and deployment automation in cloud environments. 3+ years of experience...SuggestedHourly pay- ...and SQL ~ Hands-on experience with AWS services (S3, Glue, Redshift, Lambda, EMR) ~ Experience with big data tools like Apache Spark, Hadoop, or Kafka ~ Knowledge of Machine Learning concepts and model lifecycle ~ Experience with ETL/ELT frameworks and data...SuggestedRemote work
- ...resume and contact details. Core Technical Skills: SQL Server SQL Server Integration Services Azure Synapse Spark Microsoft Fabric Required Skills & Experience: ~ Bachelor's or Master's degree in computer science, information...SuggestedContract workWork at officeRemote work
- ...equivalent): AWS or Azure Data Platform Services, Postgres/Oracle/DB2, Collibra, Databricks, Delta Lake, Python, Snowflake, ETL tools (Spark, etc.), CI/CD pipelines supporting Data Lakehouse Expertise in real time and batch data ingestion architectures (Kafka/Event...SuggestedHourly payContract work
- ...~ Proven track record building production data pipelines across complex systems ~ Strong SQL and Python skills (PySpark/Spark preferred) ~ Experience with: ~ Data ingestion (API, SFTP, batch, streaming) ~ Data modeling and transformation ~ Pipeline...SuggestedFull time
- ...Cleansing, deduplication, parsing, and merging of high-volume datasets Parsing EBCDIC/COBOL-formatted VSAM files using Spark-Cobol Library Connecting to Db2 databases using JDBC drivers for ingestion For applications and inquiries, contact: hirings...SuggestedRemote work
- ...Must be Local to Reston, NO RELO - OnSite 3 days a week. Top 5 Technical Skills: Python (Big Data Pipeline) AWS Hadoop, Spark, Hive EMR Terraform Job Description: Strong Python development to build a big-data pipeline for data processing and analysis Need strong experience...SuggestedContract workWork experience placementLocal area3 days per week
- ...preferred. Preferred Qualifications: Experience with ksqlDB, Kafka Streams, or stream processing frameworks (Flink, Spark Streaming). Exposure to event sourcing or CQRS patterns. Integration of Kafka with data lakes, warehouses, and analytics platforms...Suggested
- ...ingestion, APIs, and serverless/data processing services (e.g., Lambda, Glue). Experience working with Databricks and Apache Spark for scalable data transformation, enrichment, and analytics workflows. Proficiency in Python, Java, or Scala, and strong SQL skills...SuggestedFull timeRemote work
- ...Experience with cloud platforms and containerization (Docker, Kubernetes). ~ Familiarity with data engineering tools (e.g., Airflow, Spark) and ML Ops frameworks. ~ Solid understanding of software engineering principles and DevOps practices. ~ Ability to...Suggested
- ...Proficient SQL; relational (PostgreSQL, MySQL) and NoSQL (MongoDB) experience Cloud & Big Data: AWS/Azure/Google Cloud Platform, Spark, Hadoop, scalable storage (S3, Blob, HDFS) Ready to Apply? Take the next step in your data engineering career with this exciting...SuggestedContract work
- ...Petabyte-level data systems. Experience with cloud-native data tools and architectures (e.g., Redshift, Glue, Airflow, Apache Spark). Proficient in automated testing frameworks (PyTest, Playwright or Jest) and testing best practices. Experience developing...SuggestedLong term contractRemote work
$75 - $80 per hour
...Qualifications Knowledge of MLOps practices and ML pipelines Experience with data platforms such as Snowflake, Databricks, or Spark Familiarity with AI frameworks like TensorFlow or PyTorch Cloud certifications such as AWS Certified Solutions Architect...Full timeContract workTemporary workWork experience placementImmediate startWorldwideFlexible hours- ...platform engineer to design and build a containerized API layer that abstracts and governs interactions with engines such as Apache Spark through a well-defined API contract. This role focuses on building platform capabilities, not simply consuming existing data tools enabling...Contract work
- ...and SQL ~ Hands-on experience with AWS services (S3, Glue, Redshift, Lambda, EMR) ~ Experience with big data tools like Apache Spark, Hadoop, or Kafka ~ Knowledge of Machine Learning concepts and model lifecycle ~ Experience with ETL/ELT frameworks and data...Remote work
- ...Mobile etc) Preferred qualifications Experience with streaming API s like Kafka Understanding of Big Data/Data Lake technologies (Spark, Hadoop, Databricks etc) Understanding of Design patterns and clean coding Understanding of technical aspects of Analytic...Local area
- ...generation, and intelligent automation. - Work with large structured and unstructured datasets using tools like Pandas, NumPy, and Spark. - Implement models in production environments using Python, TensorFlow, PyTorch, or scikit-learn. - Conduct exploratory...
- ...~7+ years of experience in Software Engineering ~4+ years building big data pipelines ~4+ years of experience with: Apache Spark (PySpark / Spark SQL) Hive and Iceberg tables SQL / SQL Server or other RDBMS ~ Strong programming experience in: Python PySpark...Contract workRemote work
- ...Responsibilities : Expertise in big data processing, Core Java and Apache spark particularly within finance domain. Should have a strong experience working with financial instruments, market risk and large-scale distributed computing systems. Develop...
- ...transformation, and data reliability Real-time systems Build streaming solutions using Kafka or Azure Event Hubs Use Spark Structured Streaming for high-volume data processing API and integration Lead integrations using Spring Boot, Dell Boomi,...
- ...related discipline Minimum of 5+ years of relevant industry experience Minimum 5 years of experience developing in Hadoop echo system ( Spark, PySpark, MapReduce, Hive, Impala ) Minimum 5 years of experience with common application frameworks (JEE Spring Boot, Struts,...Remote work
- ..., improving database performance, and developing quality audits. Proficient with the Azure stack, including Synapse Analytics, Spark/Python, Azure SQL, Azure Data Factory (ADF), Kusto, among others. Knowledgeable in ETL tools, particularly Azure Data Services,...Contract work
- ...develop scalable data transformation pipelines using DBT Cloud Architect and implement Databricks-based data solutions (Delta Lake, Spark) Build and optimize data models (star/snowflake schemas) for analytics Develop ETL/ELT pipelines using modern data stack...
- ...Google Cloud Platform) ~ Familiarity with REST APIs and microservices architecture ~ Experience with data processing tools (Spark, Pandas, etc.) Preferred Qualifications Experience working in data security / cybersecurity domain Knowledge of MLOps...Contract work
$82k - $110k
...billable hour 30+. Your hard work and efficiency don't go unnoticed. ~ A supportive environment where feedback fuels growth, creativity sparks ideas, and laughter is part of the job. We know you're already doing incredible work where you are, but at North Shore...Full time- ...RapidFuzz, jellyfish Experience with LLM APIs (OpenAI, Anthropic) and prompt pipelines Strong SQL skills and experience with Spark or Dask for distributed processing Familiarity with vector databases and embedding-based retrieval Experience with ML...Work experience placement
$3,404 per month
...and perform routine maintenance on equipment and vehicles (such as cleaning/repairing of hand tools, changing oil, fluids, filters, spark plugs, belts, etc.) CW’s will work to assist in habitat management and various hunting programs in addition to or in place of other...Hourly payFull timeTemporary workSeasonal workWork at officeImmediate startFlexible hours