Cloud Data Engineer - Spark, AWS & Lake Formation
Virtusa Corporation
Virtusa is seeking a skilled professional in Plano, Texas, to work with strong knowledge in AWS Data Services, coding in Python or Java, and DevOps practices. The ideal candidate should possess a BS/BA degree or equivalent experience and demonstrate expertise in cluster computing frameworks like Spark. Familiarity with security concepts in AWS is also essential. Join us to leverage your organizational and problem-solving skills in a dynamic environment. #J-18808-Ljbffr Virtusa
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Cloud Data Engineer - Spark, AWS & Lake Formation in Plano, TX vacancy
- ...Full Stack Developer - Data & Cloud Engineering Focus Develop and... ...architectures utilizing AWS services (CloudFront... ...orchestration, S3 data lake, ELB/ALB routing, RDS... ...using AWS Kinesis, Apache Spark on EMR, and Spring... ...governance with AWS Lake Formation, Sagemaker Feature...Amazon Web Service
- ...Data Platform Engineer As a Data Platform Engineer, you will be... ...maintenance of our high-scale, cloud-based data platform,... ...data engineering and AWS cloud infrastructure... ...in: Delta Lake (ACID transactions, time... ...pipeline development. Spark & SQL: Deep understanding...Amazon Web Service
- ...Lead Software Engineer We have an opportunity to... ...Investment Banking – Data Analytics – Payments Technology... ...time processing using Spark, Airflow, Kafka, and... ...Proficiency with cloud data services (AWS S3, Glue, Redshift, Athena, EMR, Lake Formation, or equivalent) Experience...Amazon Web Service
- ...Strong documentation skills Coding: Proficiency in Python or Java Cluster Computing frameworks: Proficiency in Spark AWS Data Services: Proficiency in Lake formation, Glue ETL (or) EMR, S3, Glue Catalog, Athena, Kinesis (or) MSK, Airflow (or) Lambda + Step Functions +...Amazon Web Service
- ...Lakehouse Operations Engineer 100%... ...experience in Big Data / Data Engineering... ...tuning (Spark, Hive, Impala)... ...Hive-based data lakes • Understanding... ...strategies o File formats (Parquet/ORC) o... ...Familiarity with: o Cloud platforms (AWS, Azure) • Scripting...Amazon Web ServiceRemote work
- ...Senior Data Analyst Genesis10 is... ...Python, Apache Spark, and PySpark in... ...enterprise data engineering best practices for... ...Iceberg and Delta Lake. Implement schema... ...(ADLS) or AWS S3. Develop scalable... ..., Delta Lake, cloud data lakes (ADLS... ...open table formats ~ Experience working...Amazon Web ServiceHourly payPermanent employmentContract work
- ...Cloud Data Engineer Location: Seattle WA/ Dallas/ Plano (Seattle Preffered) Duration: 6 months... ...experience with cloud-platform technologies (AWS, Azure, GCP) ~ AWS data engineering... ...systems (e.g., data warehouses, data lakes) including data access Application Programming...Amazon Web Service
- ...Cloud Data Engineer We are looking for a skilled Cloud Data Engineer to design and build scalable... ...with exposure to multi-cloud environments (AWS/Azure/GCP). Key Responsibilities... ...HRIS, payroll, LMS, etc.). Work on data lakes, data warehouses, and APIs for data...Amazon Web ServiceImmediate startRelocation
- ...Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python) Please dont apply if you dont have PALANTIR experience... ..., merchandising, store analytics) Experience with cloud platforms (Azure, AWS, or GCP) Familiarity with orchestration tools (Airflow...Amazon Web ServiceWork from homeFlexible hours
- ...We are seeking an experienced Data Engineer with a strong background in marketing... ...pipelines and workflows in cloud environments to support... ...expertise in big data technologies, AWS services, and modern data... ...using Apache Airflow and Apache Spark. • Build and manage data infrastructure...Amazon Web Service
- JPMorgan Chase & Co. is seeking a Senior Manager of Software Engineering specializing in AWS Cloud and Data Platforms. This role involves mentoring software... ...architectural direction, and implementing secure Data Lake solutions. Candidates should have over 5 years of...Amazon Web Service
- ...highly skilled and experienced Senior Data Engineer to support an enterprise-level migration... ...deep expertise in Databricks, Spark, and modern data architecture, with a... ...concepts • SQL and SQL tuning within Data Lake (Delta Format) • Azure services: azure functions, event...Local area
- ...Overview: Job Description: Mandatory Skills: Spark, Java, Spring boot, REST API, AWS, Unix, Kubernetes, Big Data, Scripting. - Spark is Must Coding in Java, Microservices & react. Designs, develops, codes, and troubleshoots with consideration of upstream...Amazon Web Service
$43k
...Description Job Title: PySpark Data Engineer Summary: We are... ...and system resilience within Spark jobs. Optimize PySpark jobs... ...interpret data structures, formats, and relationships to... ...databases, NoSQL databases, data lakes, and streaming platforms Qualifications...Full timeFor contractors- ...Big Data Engineer We are looking for a Big Data Engineer. Please let me... ...Big Data Engineer with Java/AWS Plano, TX (Hybrid role, looking... ...More emphasis on Java side. Spark - EMR and Glue to some extent.... ...to have: Python / PySpark Data lake experience Credit Card...Amazon Web ServiceContract work
- ...Highly experienced Data Engineer with expertise in cloud engineering, data engineering... ...warehousing, particularly within the AWS and google cloud ecosystem.... ...data warehouses and data lakes. Preferably using redshift... ...Technologies: Hadoop, Spark, Athena, materialized views...Amazon Web Service
- ...manufacturing through advanced Data Analytics, AI/ML, and... ...scalable, high-impact engineering challenges across cloud, data, and intelligent... ...platforms such as AWS, Azure, or GCP... ...Exposure to Delta Lake, Lakehouse architecture, Kafka, Spark Streaming, or real-time...Amazon Web Service
- ...backed out at last moment DATA ENGINEER Location: Plano,... .... Debugging APIs, cloud services, and data lake technologies Required... ...deploying applications in AWS API development experience... ...Experience utilizing Spark and SQL Experience with...Amazon Web ServicePermanent employmentContract workImmediate startRemote work
- ...building cutting-edge data analytics & AI/ML solutions... .... Our team solves hard engineering problems at scale, with... ...PyTorch, scikit-learn, Spark, AWS Sagemaker, Azure ML).... ...~ Experience with cloud platforms (AWS, Azure,... ...architectures (e.g., data lakes, data warehouses, distributed...Amazon Web Service
- ...designing and implementing data pipelines in a cloud environment is required.... ...developing data solutions in the AWS cloud is required. ~2+... ...real-time data streams using Spark and Experience in Spark.... ...in architectural best practices in building data lakes...Amazon Web ServiceWork experience placement
- ...experienced Software Developers and Engineers who has a passion for... ...With, Terraform, AWS, Cloud Formation and Bigdata experience is mandatory... ...3+ years of experience as a Data Engineer, having built large... ...other services/platforms - Spark, EMR, RedShift, Kinesis, Kinesis...Amazon Web ServiceFull timeWork at officeLocal areaImmediate start
$99k - $164.8k
...Senior Data Engineer Kemper is one of the nation's leading specialized... ...with Snowflake, Core AWS Services, cloud-based architecture, and modern... ...using Snowflake, Python, Spark, Informatica (PowerCenter/IDMC... ..., Streams, Tasks, File Formats, External Stages Dynamic...Amazon Web ServiceWork at officeLocal area- ...Design, build, and optimize scalable data pipelines and frameworks on AWS leveraging EMR, EKS, S3, and... ...scalability, and cost optimization across cloud-based data platforms. Enforce... ...of hands-on experience in data engineering and cloud frameworks . ~...Amazon Web Service
- ...Lead Data Engineer Locations: Richmond - VA / McLean - VA / Plano... ...processing of data using cloud technologies like AWS. Develop and maintain... ...technologies such as AWS Glue, Spark, and Databricks.... ...Knowledge of open table formats such as Delta, Hudi, or Iceberg...Amazon Web ServiceLong term contractWork at office
$120k
...Title: Python PySpark/ Data Engineer Location: Plano... ...data pipelines in a cloud environment is required... ...data solutions in the AWS cloud is required.... ...time data streams using Spark and Experience in Spark... ...practices in building data lakes Submission...Amazon Web ServiceWork experience placementH1bLocal areaRelocation- ...Principal Data Engineer At Shutterfly, we make life's experiences... ...at Shutterfly on AWS, supporting the breadth... ...'s Enterprise Data Lake Identify, evaluate and... ...Expert knowledge of Python, Spark, and SQL; experience... ...) or equivalent cloud platforms (GCP, Azure)...Amazon Web Service
- ...leading financial services firm in Texas seeks a Software Engineer III to design and deliver large-scale AWS based technology solutions. Candidates should have 5+... ..., and familiarity with tools like PostgreSQL and Spark. This role offers an exciting opportunity to work in...Amazon Web Service
- Infosys Limited is looking for a skilled individual in Plano, Texas, to contribute to data warehousing and cloud applications. The role requires expertise in AWS services, efficient coding in Java/Python, and knowledge of ETL processes. Ideal candidates have a bachelor’...Amazon Web Service
- A leading technology firm in Plano, Texas is seeking a Senior Data Engineer to build scalable data solutions and mentor engineering talent.... ...least 5 years of experience in software development, expertise in AWS tools, SQL, and experience with ElasticSearch. The candidate...Amazon Web Service
$106k - $124k
...Innova Solutions is hiring a Senior Azure Data Engineer Position type: Permanent Duration: Full-time Location: Texas, USA... ...Business Enterprises (MBEs) in the United States (NMSDC, 2024) AWS Advanced Tier Services Partner with 100+ certifications...Amazon Web ServicePermanent employmentFull timeTemporary workWork experience placementImmediate startWorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Cloud Data Engineer - Spark, AWS & Lake Formation. Be the first to apply!
Related searches
- aws cloud infrastructure engineer Plano, TX
- remote cloud architect Plano, TX
- senior cloud engineer Plano, TX
- cloud architect Plano, TX
- cloud engineering manager Plano, TX
- cloud engineer remote Plano, TX
- principal cloud engineer Plano, TX
- senior principal cloud computing engineer Plano, TX
- cloud operations engineer Plano, TX
- cloud solutions architect Plano, TX

