W2 only || Lead Data Engineer || Chandler, AZ / Charlotte, NC / Minneapolis, MN / Irving, TX

Title: Lead Data Engineer
Location: Chandler, AZ / Charlotte, NC / Minneapolis, MN / Irving, TX (Hybrid)

Visa requirement- usc/gc/h4 ead /Gc ead

Duration: 12+ Months (Possible extension)

Required Qualifications

• 5+ years of experience in Data Engineering, including hands-on experience with Hadoop and Google Cloud data solutions.
• Experience creating and supporting Spark-based data processing and Kafka streaming solutions in a highly collaborative team environment.
• 2+ years of hands-on experience developing real-time data flows using Kafka, Flink, and Spark Streaming.
• 3+ years of experience with Data Lakehouse architecture and design.
• Hands-on experience with Python, PySpark, Apache Kafka, Airflow, SQL, Google Cloud Storage, BigQuery, Dataproc, and Cloud Composer.
• 2+ years of experience working with NoSQL databases, including columnar databases, graph databases, document databases, key-value stores, and associated data formats.
• Public cloud certifications such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics.
• Proven experience migrating data from on-premises environments to cloud-native platforms.
• Strong experience with the Hadoop ecosystem, including Hive, HDFS, Parquet, Iceberg, and Delta Tables.
• Deep understanding of data warehousing, cloud data architecture, data pipeline development, and workflow orchestration.
• Experience designing and implementing highly scalable and modular data pipelines with built-in data controls to automate data governance.
• Familiarity with GenAI frameworks such as LangChain and LangGraph for developing agent-based data capabilities.
• Experience with DevOps and CI/CD deployments using Git, Jenkins, Docker, and Kubernetes.
• Experience with web-based UI development using React and Node.js is a plus.

View email address on us.fitly.work