Big Data Engineer
$100k - $120kTP-Link Systems Inc.
ABOUT US: Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world's top provider of Wi-Fi devices. The company is committed to delivering innovative products that enhance people's lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint.
We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.
Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.
KEY RESPONSIBILITIES
At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.
Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.
KEY RESPONSIBILITIES
- Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow - including their monitoring, alerting, and recovery.
- Write SQL and Python for data ingestion, transformation, and the datasets that analysts and dashboards depend on.
- Own data quality for what you build - run the checks before you ship and add new ones where they're missing; confirm the results are correct, not only that the job completed.
- Build and extend the data models for your area: fact and dimension tables following the team's layering conventions.
- Keep your jobs efficient - watch runtime and cost, and raise slow or expensive jobs rather than living with them.
- Use and extend the team's shared patterns and templates, and turn work you find yourself repeating into something automated or reusable.
- Work with analysts and business stakeholders to turn requests into datasets that actually get used.
- 2-4 years of hands-on data development in a production environment - pipelines that run on a schedule with real downstream consumers, that you were responsible for including when they broke.
- Strong SQL: window functions, complex multi-table joins, incremental loads, and the ability to work out why a query is slow.
- Python for production ETL and tooling (PySpark, pandas, boto3) - code that runs on a schedule, not only notebooks.
- Hands-on experience with Spark on a cloud platform: AWS EMR, Databricks, Glue, or equivalent.
- Production experience with a scheduler, Airflow preferred: DAG design, dependencies, retries, and reruns that are safe to repeat.
- Working understanding of dimensional modeling: fact and dimension tables, star schema, and warehouse layering.
- Comfortable working on AWS (S3 with Parquet / ORC), Linux, and Git - and comfortable picking up new tools as the platform evolves.
- Effective use of AI to solve data problems - using it to move faster on SQL, debugging, and unfamiliar schemas, with the judgment to catch output that looks right but isn't.
- Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.
- Data ingestion or CDC tooling: DataX, Sqoop, Debezium, Fivetran, or similar.
- An OLAP / MPP engine: StarRocks, Doris, ClickHouse, Redshift, or similar.
- Spark performance work: partitioning, shuffle, skew, and memory tuning.
- AWS cost optimization: EMR instance sizing and Spot strategy, S3 lifecycle policies.
- Lakehouse formats (Iceberg, Hudi, Delta), streaming (Kafka, Flink), dbt, or a data quality framework.
- QuickSight or another BI tool: dataset and permission design.
- Self-directed learning: a project, an open-source contribution, or a tool you picked up on your own and put to real use
- Free snacks and drinks
- Fully paid medical, dental, and vision insurance (partial coverage for dependents)
- Contributions to 401K funds
- Bi-annual reviews, and annual pay increases
- Health and wellness benefits, including free gym membership
- Quarterly team-building events
At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone. If you share our passion and connection to this mission, we welcome you to apply and join us in building a vibrant and inclusive team at TP-Link Systems Inc. Please, no third-party agency inquiries, and we are unable to offer visa sponsorships at this time.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Irvine, CA vacancy
- ...Big Data Engineer Location: Costa Mesa, CA or Allen, TX Duration: Fulltime Job Description: Big Data Engineer Must Have Technical/Functional Skills: Big Data, PySpark, AWS (EMR, SageMaker, DunamoDB) Roles & Responsibilities: Strong hands-on experience...Big dataFull timeImmediate startRelocation
- ...effortless lifestyle. KEY RESPONSIBILITIES Own a component of the data platform end to end - its pipelines, tables, quality checks,... ...infrastructure cost for the jobs you own, and choose the right engine for a workload (StarRocks serving vs. batch on EMR). Build components...Big dataLocal areaWorldwide
- ...Data Engineer We believe technological and cultural change starts when the focus is on developing the team's skillset, collaboration, and... ...Perform offline analysis of large data sets using components of a big data software ecosystem. Evaluate and advise on technical...Big dataWork at officeWork from home
- Compunnel, Inc. is seeking a Big Data Engineer responsible for designing and implementing scalable platforms within AWS. The role demands strong expertise in technologies including Spark, Hadoop, Scala, and Java, focusing on processing large datasets and building data pipelines...Big data
$166k - $220k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...platform and tooling, advocating for engineering best practices, automation, and a... ...Preferred Qualifications: Experience with big data processing frameworks (e.g., Apache...Big dataFull timeWork experience placementImmediate start$86.1k - $115k
...Associate Data Engineer As our Data Engineer, you will function as a consultant between our technology unit and other business units to... ...Experience with data integration from different sources into Big Data systems is preferable. Experience quality testing and coding...Big dataFull timeWork at officeLocal areaRemote work3 days per week$146k - $194k
...and international markets. ABOUT THE JOB As a Software Engineer, Data Engineering on the Maritime Digital Production team, you will... ...data engineering (e.g., Python, Java, Scala). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with...Big dataFull timeWork experience placementImmediate start$150k - $180k
...global performance and enable consumers to enjoy a seamless, effortless lifestyle. Key Responsibilities Develop and maintain the Big Data Platform by performing data cleansing, data warehouse modeling, and report development on large datasets. Collaborate with cross‑functional...Big dataLocal areaWorldwide- ...LinkedIn, Facebook, Instagram, X and YouTube. Job Description The Data Engineer will design and build scalable data-pipelines across... ..., C, C++, C#, Swift/Objective C, or JavaScript Experience with Big Data Management, Master Data Management tools & SQL Preferred Qualifications...Big dataTemporary workLocal area
$146k - $194k
...Software Engineer, Data Engineering Anduril Industries is a defense technology company with a mission to transform U.S. and allied military... ...engineering (e.g., Python, Java, Scala). Experience with big data technologies (e.g., Hadoop, Spark). Familiarity with...Big dataFull timeWork experience placementImmediate startRelocation package$119.77k - $140.9k
Join to apply for the Lead Data Engineer role at U.S. Bank . At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses... ...—all from Day One. Job Description Responsible for working on big data compilation projects that gather and integrate voluminous...Big dataTemporary workWork experience placement$166k - $220k
...operating system that turns thousands of data streams into a realtime, 3D command and control... ...platform and tooling, advocating for engineering best practices, automation, and a... ...Preferred Qualifications Experience with big data processing frameworks (e.g., Apache...Big dataFull timeWork experience placementFlexible hours- Big Data EngineerExperianContractProjected Duration - 12+ month contractRemote - HQ in Costa MesaBig Data Hadoop, Spark, PySparkHands on Programming - Java, Scala, PythonAWS Cloud -S3, EFS, MSK, ECS, EMR, LambdasContainerized and MicroservicesDistributed Computing constructs...Big data
$50 - $55 per hour
...Cloud Data Engineer Pay Range: $50.00hr - $55.00hr Requirement/Must Have: Strong expertise in cloud-based data engineering, ETL/ELT development, and big data technologies. Experience working in healthcare environments. Proficiency in AWS (Glue, EMR,...Big data$130.33k - $195.5k
Sr Data Engineer (Finance) Alignment Health is breaking the mold in conventional health care, committed to serving seniors and those who need... ...operating a cloud-based data platform and its pipelines using big data technologies. As a Data Engineer, you will develop a new data...Big dataImmediate start- ...Site role Job Description: A Data Scientist with 10 to 15 years of... ...custom Python visualizations. Feature Engineering: Lead feature engineering efforts to identify... ...stakeholders. ~ Extensive experience with big data technologies and distributed...Big data
$166k - $220k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...to the military in months, not years.ABOUT THE TEAMAs a Data Engineer on the Analytics Team, you will be collaborating with stakeholders...Full timeWork experience placementImmediate startShift work- The Data & AI Engineer is part of the Group Data division within the IT team and will provide data management solutions while helping evolve the organization's AI capabilities to support business growth, particularly in the U.S. This role will help architect, build, and...
- Snowflake DBT Data Engineer Location Irvine CA 5 Day onsite Required technical skills for DBT Snowflake roleDevelop DBT Projects Build maintain and manage the endtoend DBT project ensuring modularity reusability and adherence to established data standardsAdvanced SQL Jinja...
- ...measurable business impact. Drive design decisions across data ingestion, feature engineering, model selection, evaluation, deployment, and monitoring.... .... Platform & Innovation Drive adoption of cloud-native, big-data, and MLOps frameworks across Python, Spark, Hive, Databricks...Big data
- ...Purple Drive Data Center Engineer Share Contractual Irvine, CA Overview: JOB DESCRIPTION: Design and develop data pipelines using, Matillion or ADF and Snowflake Hands on experience in designing and developing ETL Framework tables. Need to know SFDC and Data...
$134k - $161k
...Description & Requirements Come join our family at In-N-Out Burgers! We have an excellent opportunity for a full-time Data Engineer III in the I.T. department in our Irvine, CA office . This role operates in a highly collaborative environment where Data...Full timeCasual workWork at officeRemote workRelocation packageMonday to Friday- ...Job Description • Design, develop, and deploy interactive Power BI dashboards and reports leveraging Databricks data sources • Translate business requirements into intuitive, scalable, and user-friendly visualizations • Optimize performance through efficient data...
$34.47 - $38.46 per hour
...also seamlessly integrate with several 3rd party delivery services such as DoorDash, Grubhub and UberEats. We are seeking a Data Engineer to become part of our dynamic data team. In this role, you will work in a hands-on technical role on a team focused on delivering...Hourly payFlexible hours- ...sponsorship, and C2C arrangements are not accepted. This role is hybrid near Irvine, CA. Overview We are seeking a Data Engineer to build and maintain reliable data pipelines, integrate data from multiple healthcare systems, and support enterprise reporting...
- ...Sr. Data Engineer Location: Hybrid, 3x onsite in Costa Mesa, CA Duration: Long Term Contract Top Skills: ~ Must be able to use personal workstation or options are available for rent. They are a Microsoft shop. ~10+ years of experience in data engineering or...Long term contract
$146k - $194k
...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...to the cloud, how it's modeled, and how it reaches the engineers, managers, and leaders who act on it.We're a new team within the...Full timeWork experience placementImmediate start$91.1k - $179.5k
...digital products and innovation, marketing, commerce, sales, and service. We are a team of strategists, data scientists, operators, creatives, designers, engineers, and architects. Our team balances business strategy, technology, creativity, and ongoing managed services...Local area- ...Lattice OS, an AI-powered operating system that turns thousands of data streams into a realtime, 3D command and control center. As the... ...and new product variants in development, we partner across engineering, manufacturing, supply chain, operations, business development,...Full timeWork experience placementImmediate start
- Job Role : L3 Support IDMC (Informatica Intelligent Data Management)Job Location : Irvine,CaliforniaJob description : Provide L2 L3 production support for Informatica MDM platformMaintain high availability of MDM CDIPC and associated integrationsPerform root cause analysis...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer Irvine, CA
- finance data engineer Irvine, CA
- software data engineer Irvine, CA
- data engineer machine learning Irvine, CA
- senior data quality engineer Irvine, CA
- data visualization developer Irvine, CA
- aws data engineer Irvine, CA
- data center engineer Irvine, CA
- data engineer analytics Irvine, CA
- senior data integration developer Irvine, CA


