Big Data Engineer
Indotronix International Corporation
Big Data Engineer (Mid-Level) - Remote | Experian | 12+ Month Contract
About the RoleJoin Experian as a Big Data Engineer and drive the development, optimization, and support of scalable, high-performance data platforms in the AWS Cloud. Leverage your expertise to build robust data pipelines and API-driven microservices powering mission-critical systems. This is a fully remote, long-term contract offering you autonomy and technical growth on innovative projects. Responsibilities
- Design, build, and maintain large-scale batch and real-time data pipelines using Spark, Hadoop, and AWS EMR
- Develop, deploy, and optimize API-based microservices leveraging Java, Scala, and AWS API Gateway
- Implement data ingestion, transformation, and automation workflows with PySpark, Snowflake, and Airflow
- Tune and scale data processing systems for maximum performance and reliability
- Collaborate cross-functionally to deliver high-quality, production-ready solutions in a cloud-first environment
- Troubleshoot and resolve complex issues in Linux-based environments using shell scripting and Python
- Ensure best practices in code versioning and CI/CD processes for continuous integration and delivery Required Skills and Experience
- 7+ years designing, developing, and testing Big Data solutions (batch and APIs)
- Deep hands-on AWS experience: EMR, EC2, ECS, S3, Step Functions, API Gateway, Airflow
- Proficiency in Scala, PySpark, Java (REST APIs, SOAP web services)
- Strong knowledge of Hadoop, HDFS, Spark, MapReduce, and Cassandra
- Experience with performance tuning in Spark, Hadoop, and EMR environments
- Solid Linux administration skills with shell scripting and Python automation
- Proven track record building data pipelines and transformations in Snowflake using Spark Preferred Skills
- Familiarity with DevOps tooling: GitHub, GitLab, Bitbucket, IntelliJ, PyCharm
- Experience with CI/CD: Maven, Gradle, Jenkins, Artifactory, AWS CodeCommit, CloudFormation Benefits
- Fully remote work environment - collaborate from anywhere in the U.S.
- Work with cutting-edge AWS and Big Data tools
- Opportunity to own challenging, high-impact projects
- Long-term contract with potential for future engagement
- Expand your expertise with a global leader in data-driven solutions How to Apply
Ready to shape the future of data engineering at Experian? Submit your resume today to take the next step in your Big Data engineering career!
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Costa Mesa, CA vacancy
- ...Big Data EngineerLocation: Costa Mesa, CA or Allen, TXDuration: FulltimeJob Description: Big Data EngineerMust Have Technical/Functional Skills: Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB)Roles & Responsibilities:Strong hands-on experience with AWS Cloud Services...Big dataImmediate startRelocation
JConnect Infotech
Costa Mesa, CA4 days ago - ...Big Data EngineerExperian12+ month contractRemote - HQ in Costa Mesa, CA• BS degree in computer science, computer engineering or equivalent• 5 – 6 years of experience delivering enterprise software solutions• Proficient in Spark, Scala, Python, AWS Cloud technologies•...Big data
Software Technology Inc
Costa Mesa, CA4 days ago - .... KEY RESPONSIBILITIES Own a component of the data platform end to end — its pipelines, tables, quality checks, monitoring... ...infrastructure cost for the jobs you own, and choose the right engine for a workload (StarRocks serving vs. batch on EMR). Build...Big dataLocal areaWorldwide
TP-Link Systems Inc.
Irvine, CA4 days ago $30 - $50 per hour
...of demand and supply technologies fusing data, media, and technology together to deliver... ...omnichannel inventory. We are looking for a Data Engineer to join our engineering team to help us... ...Familiarity with Google Cloud or AWS big data products We’re open to allowing the right...Big dataHourly payContract workWork experience placementLocal areaRemote workGrabJobs
Costa Mesa, CA3 days ago- Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines...Big data
$166k - $220k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...platform and tooling, advocating for engineering best practices, automation, and a... ...Preferred Qualifications: Experience with big data processing frameworks (e.g., Apache...Big dataFull timeWork experience placementImmediate start$52.79 - $81.94 per hour
...Description Role summary Data Engineer I is responsible for designing and developing modern, data-centric applications that support clinical... ...system. These solutions leverage cloud technologies, big data platforms, data science methodologies, and contemporary software...Big dataMinimum wageFull timeLocal areaRemote workShift workProvidence Health & Service
Irvine, CA3 days ago$119.77k - $140.9k
...Join to apply for the Lead Data Engineer role at U.S. Bank . At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses... ...—all from Day One. Job Description Responsible for working on big data compilation projects that gather and integrate voluminous...Big dataTemporary workWork experience placementU.S. Bank
Irvine, CA5 days ago- ...Big Data EngineerExperianContractProjected Duration - 12+ month contractRemote - HQ in Costa MesaBig Data Hadoop, Spark, PySparkHands on Programming – Java, Scala, PythonAWS Cloud –S3, EFS, MSK, ECS, EMR, LambdasContainerized and MicroservicesDistributed Computing constructs...Big data
Software Technology Inc
Costa Mesa, CA4 days ago $150k - $180k
...global performance and enable consumers to enjoy a seamless, effortless lifestyle. Key Responsibilities Develop and maintain the Big Data Platform by performing data cleansing, data warehouse modeling, and report development on large datasets. Collaborate with cross‑functional...Big dataLocal areaWorldwide$166k - $220k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...platform and tooling, advocating for engineering best practices, automation, and a... ...Preferred Qualifications Experience with big data processing frameworks (e.g., Apache...Big dataFull timeWork experience placementFlexible hours- ...and Instagram . Position Description: We are seeking a Senior Data Engineer to join our team and help us build the next generation of data... ...: Strong understanding of data modeling concepts and practices Big Data Technologies : Spark, Databricks, Structured Streaming Databases...Big dataRemote workWorldwide
GrabJobs
Santa Ana, CA4 days ago - ...Facebook , Instagram , X and YouTube. Job Description The Data Engineer will design and build scalable data-pipelines across... ...C++, C#, Swift/Objective C, or JavaScript ~ Experience with Big Data Management, Master Data Management tools & SQL Preferred...Big dataFull timeTemporary workLocal area
$76.73k - $127.88k
...Are you an experienced, passionate pioneer in technology who wants to work in a collaborative environment? As an experienced Data Engineer, you will have the ability to share new ideas and collaborate on projects as a consultant without the extensive demands of travel...Local areaVisa sponsorship$166k - $220k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...to the military in months, not years.ABOUT THE TEAMAs a Data Engineer on the Analytics Team, you will be collaborating with stakeholders...Full timeWork experience placementImmediate startShift work- Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain and manage the endtoend DBT project ensuring modularity reusability and adherence to established data standardsAdvanced SQL Jinja...
- ...Optum Services Inc. seeks a Principal Data Scientist in Irvine, CA to lead advanced ML... ...mentor junior scientists, and partner with engineering and product teams to deliver high-impact... ...role requires extensive experience in ML, big data, cloud deployment, and ethical ML...Big data
$226.5k - $315.05k
...500.00 - $315,054.00Job Area: Business & Data AnalyticsCompany: UnitedHealth GroupPrincipal... ...of untapped information; Partner with Engineering, Business and Technical Product teams to... ...data initiatives; -5 years of experience in Big data technologies, including Apache...Big dataWork at officeRemote work$134.5k - $265.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...Local areaVisa sponsorship$146k - $194k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...to the cloud, how it's modeled, and how it reaches the engineers, managers, and leaders who act on it.We're a new team within the...Full timeWork experience placementImmediate start$113k - $149k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...against a broad range of UAS threats. Working across product, engineering, business development, logistics, operations, and mission...Permanent employmentFull timeWork experience placementImmediate startWorldwide- Job Role : L3 Support IDMC (Informatica Intelligent Data Management)Job Location : Irvine,CaliforniaJob description : Provide L2 L3 production support for Informatica MDM platformMaintain high availability of MDM CDIPC and associated integrationsPerform root cause analysis...
- ...Job Title: Sr Data Engineer *** or RV Tech: RV Tech Worksite location: Remote with Bill rate*** please keep in mind location of the candidate. Submit at market rate*** Would prefer someone in Pacific, Mountain or Central time zone in that order, if possible....Remote workShift work
BayOne Solutions
Irvine, CA2 days ago - ...We are looking for a Senior Data Engineer to help design, build, and scale the data systems that power how Foley operates and grows. In this role, you will build reliable data pipelines, contribute to our enterprise data architecture, and help improve how data is modeled...Contract workRemote work
GrabJobs
Costa Mesa, CA4 days ago - ...We also seamlessly integrate with several 3rd party delivery services such as DoorDash, Grubhub and UberEats. We are seeking a Data Engineer to become part of our dynamic data team. In this role, you will work in a hands-on technical role on a team focused on delivering...
KFC
Irvine, CA4 days ago $110k - $140k
...Megazone Cloud is looking for a Data Engineer to be a backbone of our data‑driven culture. You are a "builder" with a true thirst for knowledge... ...with data science, development, and infrastructure to tackle big‑picture projects. Be a flexible builder: embrace a "builder"...InternshipImmediate startFlexible hoursMegazoneCloud US
Irvine, CA4 days ago- ...Megazone Cloud US is seeking a Senior Data Engineer to lead and define our data-driven culture. You will architect scalable data platforms on AWS, driving data strategy with Databricks or Snowflake, and mentor engineers in Python and SQL. We value a builder mindset, startup...
MegazoneCloud US
Irvine, CA3 days ago - ...We're looking for a hands-on Senior Data Engineer to build and support enterprise-scale data solutions using Databricks and modern cloud data technologies. This role will focus on developing scalable data pipelines, optimizing Spark workloads, orchestrating workflows,...
New York Technology Partners
Irvine, CA6 hours ago $34.47 - $38.46 per hour
...Participate in code reviews Document database design, architecture, and processes Implement and maintain database security measures Ensure data security, data integrity, and data quality Monitor database performance and resolve issues as necessary Transition efficiently...Hourly payFlexible hoursPizza Hut
Irvine, CA5 days ago$130k - $150k
...care of you. Would you like to be part of our story? Don't hesitate, come and join us! About this opportunity - Sr Data & AI Engineer - ON-SITE: IRVINE, CA Description: The Data & AI Engineer at Balt is part of the Group Data division within the IT...Work at officeRemote workBALT Group
Irvine, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- aws data engineer Costa Mesa, CA
- data science developer Costa Mesa, CA
- sr information security engineer Costa Mesa, CA
- senior data engineer Costa Mesa, CA
- data engineer machine learning Costa Mesa, CA
- junior data engineer remote Costa Mesa, CA
- data center engineer Costa Mesa, CA
- data developer Costa Mesa, CA
- senior data center engineer Costa Mesa, CA
- senior data quality engineer Costa Mesa, CA