Cloud Data Engineer - Spark, BigQuery & Pipelines
Insight Global
Insight Global is seeking a Data Engineer to design, build, and optimize large-scale batch data pipelines in a cloud environment. The role emphasizes reliability, performance, and data quality to support analytics and downstream consumers through well-engineered big-data solutions.
The ideal candidate has strong experience with Apache Spark, Hadoop and Hive, Python or Scala, and GCP services like BigQuery, GCS, Dataproc, and Pub/Sub.
#J-18808-Ljbffr- ...Data EngineerDesigning and building ETL pipeline using Sqoop, Hive, Map Reduce and Spark on on-prem and cloud environments. Functional programming using Python and Scala for complex data transformations and in-memory computations. Using Erwin for logical/physical data...Pipeline
$109.7k - $180k
...Home OfficePosition: Data Engineer III Job Location: 811... ...databases. Creates data pipelines and transform data to... ...developing dataflows in Google Cloud Platform; Coding in... ...data warehouse in BigQuery; Developing data... ...Adhoc request with Apache Spark and PySpark; Designing...PipelineFull timeTemporary work$90k - $180k
...OfficePosition: Senior Data Engineer Job Location: 811... ...Azure, Presto, or Google BigQuery; preprocessing techniques... ...random forests; and cloud and big data environments... ..., creates data pipelines, transforms data into... ...applications with Apache Spark; Frameworks used in Hadoop...PipelineFull timeTemporary work$92k - $138k
Data EngineerLead II - Data EngineeringWho... ...a skilled Data Engineer with 6+ years of experience... ...scalable data pipelines and enterprise... ...expertise in Google Cloud Platform (GCP),... ...Airflow DAGs, Java/Spark development, and SQL... ...: · Mandatory: BigQuery, Apache Airflow, Spark...PipelineFull timeTemporary workPart timeWork at officeLocal areaFlexible hours$90k - $180k
...OfficeRole summary: As a Data Engineer III at Walmart, you will design... ...and maintain scalable data pipelines and architectures that... ...technologies such as Apache Spark and cloud platforms. Focused on delivering... ...(GCP) services such as BigQuery, GCS, and Dataproc, along with...PipelineFull timeTemporary workPart time$129.31k - $220k
...WalmartBusiness Segment: Home OfficePosition: Principal Data Engineer Job Location: 811 Excellence Dr, Bentonville, AR... ...Scala; Designing, building, and maintaining ETL pipelines using Hadoop, Apache Spark, Hive, BigQuery on cloud platforms (GCP, AWS, Azure) for scalable, secure...PipelineFull timeTemporary work- ...reinvent their business with data & AI — backed by a $3B... ...are seeking a Data Engineering, Management &... ...across data fabric design, cloud data platforms (Snowflake... ..., Azure Synapse, BigQuery), pipeline engineering, and AI-integrated... ...such as dbt, Apache Spark, Azure Data Factory,...PipelineLive inWork at officeLocal area
$127.17k - $220k
...'ll do... Position: Staff Data Engineer Job Location: 811 Excellence... ...integration tasks. Deploys pipelines using scheduling and orchestration... ...like Hadoop, Hive, Spark, and Databricks; Developing ETL... ...Developing and maintaining modules in cloud ecosystem in Tech like Google...PipelineTemporary work$110k - $220k
...summary: The Senior Manager, Data Engineering leads the design and... ...transformation, and governance within cloud and big data environments.... ...scalable, efficient data pipelines and models. Collaborating across... ...Snowflake, Azure, or Google BigQuery.Ability to design and...PipelineFull timeTemporary workPart time- ...Data EngineerDo you have boundless energy and passion for engineering data used to solve dynamic problems that will shape the future... ..., and maintaining data pipelines that our Data Scientists and Analysts... ...multi-platform environments (cloud and on-prem) that integrate...PipelineRemote work
$130k - $260k
...seeking a Distinguished Data Scientist to... ...systems — from feature engineering through production... ...end-to-end: data pipelines, feature stores,... .... Multi-cloud ML platform proficiency... ...AND GCP (Vertex AI, BigQuery, BigQuery ML). Strong... ...in Python, Spark, Scala, or R", "PhD...PipelineFull timeTemporary workPart timeHome office- ...Data EngineerClient's Cash Core Team is looking for a savvy Data Engineer to join our growing team of analytics experts. The role will... ...optimizing our data and data pipeline architecture, as well as optimizing... ...on Databricks on Azure Cloud platform, deep understanding on...PipelineWork at office2 days per week3 days per week
- ...Enterprise, Song, Supply Chain and Engineering, and Talent, with advanced capabilities in AI and Data, Industry and Process, and... ...recognized as a global leader in AI and cloud transformation, helping... ...foundations to power AI at scale — the pipelines, lakehouse substrate, and data-...PipelineWork experience placementLive inWork at officeLocal area
- ...leading capabilities in digital, cloud and security. Combining... ...engagements centered on SAP's modern data and analytics platform —... ...with Databricks-powered AI/ML pipelines and business content activation... ...Databricks, Microsoft Azure, Google BigQuery, or Snowflake in the context...PipelineWork experience placementLive inWork at officeLocal area
$110k - $220k
...Segment: Home OfficeWalmart Global Data Foundation is seeking a... ...Manager for Data Ventures Data Engineering Team to lead the architecture... ...-on development of scalable, cloud-native, AI powered data... ...continuous improvement in data pipelines, ensuring reliability and performance...PipelineFull timeTemporary workPart time- ...and latitude is required. Typically reports to a supervisor or manager.Requirement: Working on cloud experience, deploying containerized applications, building data pipelines using Azure databricks, Python, SQL, Java 9, Cloud, and Spring Boot technologies, Azure event streaming...PipelineContract work
$110k - $220k
...Role summary: As a Staff Data Engineer at Walmart, you will design... ...lead the development of data pipelines, optimize data models, and... ...architectures using SQL, Google BigQuery, and other relevant... ...and integration using SQL and cloud platforms such as Google BigQuery...PipelineHourly payFull timeTemporary workPart time- ...have minimum 2+ years’ experience in building data services in public clouds (AWS, Azure, GCP)Should be an GCP Certified engineer or should be holding certification on any... ...Docker)Should have extensive knowledge on CI/CD pipeline creation and containerizationExperience...Pipeline
- ...Are The beginning of a new Data & AI decade that will reshape... ...strong Data Architect / Data Engineering Lead who can provide technical... ...standardization, reusable frameworks, pipeline design, and downstream... ..., PySpark, SQL, and modern cloud data platforms, with the ability...PipelineTemporary workWork experience placementLive inWork at officeLocal area
- ...QA Engineer The QA Engineer will be responsible for designing, developing, running, maintaining and documenting all types of... ...programming, preferably Java, experience in working with CI/CD pipelines, working on cloud experience, deploying containerized test suites,...Pipeline
$110.3k - $180k
...OfficePosition: Senior Data Scientist - Supply... ...solutions, including context engineering, chain-of-thought... ...Utilize Docker, Kubernetes, cloud platforms (GCP/Azure)... ..., with robust CI/CD pipelines for continuous... ...transactional systems and Google BigQuery for large-scale...PipelineFull timeTemporary work$143k - $286k
...efficient and reliable systems and pipelines to support teams globally... ...mentorship and elevate engineering culture across a high-performing... ...engineering teamClosely partner with data scientists, product managers,... ...across local and cloud-based systemsAbility to proactively...PipelineFull timeTemporary workPart timeLocal area- ...transformation expertise.The LearnVantage Engineering team builds and operates the... ...back-end technologies, cloud-native development, APIs,... ...and work with relational data models and production databases... ...Docker, Kubernetes, and CI/CD pipelines.Minimum of 2 years of...PipelineWork experience placementLive inWork at officeLocal area
$144.04k - $220k
...OfficePosition: Principal, Data Scientist Job Location: 811... ...Implement data science solutions on Cloud environments :Google Cloud,... ...; Big Data technologies :BigQuery, Spark, Hive, Hadoop for Data... ...Snowflake, Collibra; Feature engineering, extraction, reduction techniques...Full timeTemporary work$110k - $220k
...not an analytics-focused data science role. It is a... ...deeply hands-on AI systems engineering position focused on... ...migrations, and streaming pipelines), telemetry, and... ...production-ready Use Google Cloud Platform (GCP) or... ...such as Kafka, Flink, Spark, OpenTelemetry, and Grafana...PipelineFull timeContract workTemporary workPart time- ...Job TitleDesigns, develops, and implements using the skillset Pyspark, Azure Databricks, Azure Data Factory, Python, Structured Streaming, Basics of Azure, Knowledge of Data Lake, Data Warehouse concept, Knowledge of SQLs, creates design documents, and performs program...
- ...leading capabilities in digital, cloud and security. Combining... ...engagements centered on SAP's modern data and analytics platform —... ...with Databricks-powered AI/ML pipelines and business content activation... ...Databricks, Microsoft Azure, Google BigQuery, or Snowflake in the context...PipelineWork experience placementLive inWork at officeLocal area
- ...that help people gain in-demand skills in cloud, data, AI, and more.You Are:You are a... ...helping shape the tooling and workflows the pipeline depends on.Accenture will continually invest... ...Architect, Cloud Architect, Cloud Engineer, or Data Architect).Minimum 1yearof experience...PipelineWork experience placementLive inWork at officeLocal area
- ...Description Job Description Job Title: Cloud Infrastructure Engineer II System One is seeking a Cloud... ...management, security updates, and data center maintenance. Perform day-to... ...and Rapid7. Proficiency with CI/CD pipelines (Jenkins, GitLab CI)....PipelinePermanent employmentLocal area
$175k - $190k
...DESCRIPTION The Platform Engineer & Operations Lead is the hands-on internal... ...for code, configuration, data products, ontology changes, and AIP... ...identity services, analytics tools, and cloud services. Partner with data engineering on pipeline reliability, orchestration,...PipelineHourly payFull timeContract workPart time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Cloud Data Engineer - Spark, BigQuery & Pipelines. Be the first to apply!
- big data cloud engineer Bentonville, AR
- senior cloud network engineer Bentonville, AR
- informatica cloud developer Bentonville, AR
- cloud engineer Bentonville, AR
- senior aws cloud engineer Bentonville, AR
- cloud developer Bentonville, AR
- cloud architect Bentonville, AR
- junior big data engineer Bentonville, AR
- data engineering intern summer Bentonville, AR
- data engineer analytics Bentonville, AR



