Big Data Engineer

United IT Solutions

Irving, TX

Position: Big Data Engineer

Location: Remote

Role Summary

Excellent Scala, PySpark, Java coding experience for REST API and SOAP webservices
Excellent AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS API Gateway
Excellent Batch Application performance tuning (Spark/Hadoop/EMR, Java, python)
Must have Linux experience (Shell scripting/Python)
Excellent to have DevOps experience (GIT, GitHub, Bit Bucket, GitLab, IntelliJ IDEA, PyCharm)
Excellent to have experience creating CI/CD pipelines - Maven, Gradle, Jenkins, Artifactory, AWS Code Commit, CloudFormation

Apply

Vacancy posted 3 days ago

Similar jobs that could be interesting for youBased on the Big Data Engineer in Irving, TX vacancy

ML Data Engineer
$125k - $140k
...Data Engineer -MLWe are looking for a highly skilled and passionate Data Engineer with strong Python/PySpark experience and understanding of... ...Familiarity with ML Ops/LLM Ops and distributed systems. Experience with Big Data platform like Cloudera Hadoop and Cloud platforms like AWS...
Big data
Tata Consultancy Services
Irving, TX
3 days ago
Data Engineer
...Big Data Engineer Location: Irving, TX (Day 1 Onsite-Hybrid) Company: Hexaware Primary Skills: Hadoop, Hive & Spark Framework Responsibilities: Experience with big data processing and distributed computing systems like Spark. Implement ETL pipelines...
Big data
InterSources
Irving, TX
5 days ago
Big Data Engineer with PySpark
$154k - $194k
...Salary: $154,000 - 194,000 per year Requirements: ~7+ years of professional experience in Big Data Engineering ~ Hands-on experience with Apache Spark and PySpark ~ Programming experience with Python and/or Scala ~ Strong SQL skills and experience with relational...
Big data
Full time
VITS US
Irving, TX
1 day ago
Data Engineer
...Job Titile: Data Engineer Work Location; Irving, Texas Duration: 8+ Months Job Description: Specific Skills Experience... ...Pipeline, Apache Airflow, Argo. Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka. Experience or...
Big data
Ruri Software Technologies LLC
Irving, TX
4 days ago
Senior Data Engineer
...Role description Job Title: Sr. DATA Engineer Work Location Irving TX Job Description: Mandatory Karat Interview... ...AWS ecosystem The ideal candidate will have strong expertise in big data processing using PySpark and a deep understanding of data...
Big data
LTM
Irving, TX
4 days ago
AWS Data Engineer
$90k - $110k
...Data Engineer We are seeking a highly skilled and motivated Data Engineer to play a pivotal role in designing, building, and optimizing... ...sound and efficient data solutions. Qualifications: Big Data Frameworks Expertise: Demonstrated high proficiency in Apache...
Big data
Tata Consultancy Services
Irving, TX
1 day ago
Data Engineer
...Data EngineerGlobal Financial Firm located in Irving, TX has an immediate contract opportunity for an experienced Data Engineer.Responsibilities:Partner with project managers, business stakeholders... ...skills.Experience with Big Data ecosystems, including Cloudera...
Big data
Contract work
Immediate start
Axelon
Irving, TX
2 days ago
Principal Data Engineer
...Principal Data Engineer We are seeking a highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer... ...to enhance query performance and scalability. Leverage big data technologies and frameworks (e.g., Hadoop, Spark, Hive) to...
Big data
TXU Energy
Irving, TX
5 days ago
Data Engineer II
...Data Solutions EngineerAs a part of our Big Data Product team, the Data Solutions Engineer will be responsible for developing and validating Big data products and applications which runs on the large Hadoop cluster. The qualified engineer will be developing and testing...
Big data
Work experience placement
Samprasoft
Irving, TX
3 hours ago
Sr. Data Engineer
...Sr. Data Engineer Opportunity At Orion180At Orion180, we don't just stand out for what we do; we shine because of how we do it. Our mission... ...data flows, and parameterizing pipelines in Azure Data Factory.Big Data Compute: Proven experience processing large-scale data using...
Big data
Work at office
Orion180
Irving, TX
15 hours ago
Data Engineer II
$55 - $60 per hour
...Data Engineer II Hybrid (Miami, FL or Dallas, TX) Contract to Hire Compensation: $55 - $60 per hour ABOUT THE ROLE Brooksource... ...g., Redshift, Data Sync, Appflow, Databricks) ~ Knowledge of big data technologies (Hadoop, Spark, Kafka, HBase) and distributed...
Big data
Hourly pay
Contract work
Work at office
Local area
Brooksource
Irving, TX
5 days ago
Lead Data Engineer
...Lead Data EngineerLennar is one of the nation's leading homebuilders, dedicated to making... ...FutureThe primary mission of the Lead Data Engineer role is to help our business evolve into a... ..., Cloudwatch etc.AWS certification is big plusSnowflake Data CloudAccount AdministrationVirtual...
Big data
Live in
Lennar
Irving, TX
15 hours ago
Lead Data Engineer
...currently available and apply online. Job Summary As a Lead Data Engineer, you will be responsible for leading the design and... ...visualization tools such as Tableau or Power BI. •Experience with big data technologies such as Hadoop, Spark, or Kafka. •Experience...
Big data
Full time
Local area
Vistra
Irving, TX
3 days ago
Senior Data Platform Engineer
...Data Platform Engineer We are seeking a world-class Data Platform Engineer to take complete operational and architectural ownership of one... ...engineering, Unix Linux systems administration, and distributed big data platforms. You will design, scale, and automate massive...
Big data
Saxon Global
Irving, TX
5 days ago
Senior Data Engineer Big Data
...Description Seeking Senior Data Engineer - Big Data to join our Information Technology team in Irving. This full-time on-site position offers an exciting opportunity to architect and build large-scale data solutions that power critical business insights and drive innovation...
Big data
Full time
Raag Solutions
Irving, TX
1 day ago
Big Data Developer
...Position: Big Data Developer Location: Irving, TX Duration: Long Term Responsibilities: 1). Develop software using Hadoop technologies like Spark, Scala, Python, Hbase, Hive, Cloudera. 2). Fine tune application performance...
Big data
3B Staffing LLC
Irving, TX
3 days ago
GCP Data Engineer
...GCP Senior Big Data Engineer/ArchitectLooking for a Senior Big Data Engineer/Architect on Google Cloud Platform to help strategize, architect and implement various solutions to migrate data hosted on our on-prem platform to Google cloud Platform (GCP). The architect will...
Big data
Samprasoft
Irving, TX
2 days ago
Senior Data Platform Engineer
$107.12k - $160.68k
...We are seeking a highly skilled and motivated Senior Data Platform Engineer, AVP (Python/PySpark, Microsoft SSIS, SQL Server, ETL & Database... ...using scheduling/orchestration platforms such as AutoSys. Big Data Platforms: Work with Hadoop ecosystem technologies including...
Big data
Full time
Citigroup Inc
Irving, TX
5 days ago
Snowflake Data Engineer
...Snowflake Data Engineer At Experient, we provide experience, technology, and transformation support to our clients, creating a dynamic work... ...orchestration ~ Cloud platform proficiency ~ Knowledge of big data technologies (Hadoop, Spark, Kafka) and data visualization...
Big data
Experient
Dallas, TX
5 days ago
Data Engineer
...Job title: Data Engineer Loc: Dallas, TX Client: CVS Responsibilities: Contribute to Mail Intelligence Mission: Support... ...science, data engineering, or a related field, with a focus on big data technologies and cloud platforms. Technical Skills:...
Big data
Argyll Infotech, Inc.
Dallas, TX
5 days ago
Data Engineer
...Long Term "Responsibilities Apply engineering science and technology, including... ...equipment to the design and implementation of data warehouse and advanced analytical applications... ...Java, Scala) and SQL. Experience with big data platforms and tools (Spark, Hadoop,...
Big data
Qualis1 Inc.
Dallas, TX
2 hours ago
Data Engineer
...Purple DriveJob Title: Data EngineerLocation: Dallas, TX / Plano, TX (Onsite)Job SummaryWe are seeking a Data Engineer with strong experience in designing, building, and maintaining... ...(Kimball, star schema, SCD).Hands-on with big data frameworks (Spark, Hadoop) and NoSQL...
Big data
Purple Drive
Dallas, TX
3 days ago
Hadoop Developer / Big Data Developer
...Hadoop - HDFS, Hive, MapReduce, HBase2+ years of experience with NOSQL database - HBase1+ years of working knowledge in Kafka/Storm data pipelines6+ years of experience in working in a Data warehouse environment4+ years of Linux skills2+ years in code documentation and...
Big data
LanceSoft
Irving, TX
3 days ago
Healthcare Data Engineer
...Healthcare Data Engineer Category: Analytics and Emerging Digital Technologies Main location: United States, Georgia, Atlanta Alternate... ...recommendations• Develop scalable analytics solutions using cloud and big data platforms such as AWS, Azure, GCP, Databricks, or...
Big data
Full time
Work at office
CGI
Dallas, TX
2 days ago
Sr Data Engineer
...Sr. Data Engineer As our Sr Data Engineer, you will function as a consultant between our technology unit and other business units to understand... ...Experience with data integration from different sources into Big Data systems is preferable. That proficiency with the Cloud...
Big data
AAA - Automobile Club of Southern California
Coppell, TX
2 hours ago
Data Engineer
...Data Engineer We are seeking a talented Data Engineer with 7+ years of experience to join our team in the telecom industry. The ideal candidate... ...Python and Scala for data processing. ~ Familiarity with big data frameworks such as Apache Spark, Hadoop, or similar. ~...
Big data
Omni Inclusive
Dallas, TX
5 days ago
Data Engineer
...Data Engineer APN Consulting, Inc. is a progressive IT staffing and services company offering innovative business solutions to improve client... ...Relevant certifications (e.g., Snowflake, Azure Cloud, and Big Data) are a plus We are committed to fostering a diverse, inclusive...
Big data
Work at office
Remote work
1 day per week
APN Consulting
Dallas, TX
5 days ago
AWS Data Engineer
$150k - $170k
...valid state ID and References to be submitted Role: Senior Data Engineer Salary: $150,000-170,000 Fully remote Benefits include... ...Warehouse operations experience Tableau, Quicksight, Looker, big data and Realtime BI experience Experience with data...
Big data
Local area
Remote work
LHH
Dallas, TX
3 days ago
Data Engineer
...Location: Remote We are seeking an experienced Data Engineer to support challenging data engineering, data management, and analytics... ...since we started in 2006! We specialize in everything data from big data to data science, data engineering, software engineering, and...
Big data
Temporary work
Local area
Remote work
Illumination Works
Dallas, TX
4 days ago
Data Engineer
...Data Engineer Employment Type: Full-Time, Mid-level CGS is seeking a passionate and driven Data Engineer to support a rapidly growing... ...manipulate data (Python, R, SQL, SAS). ~ Strong knowledge of big data analysis and storage tools and technologies. ~ Strong understanding...
Big data
Full time
Flexible hours
Contact Government Services LLC
Dallas, TX
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!