Software Engineer

Software EngineerLocation: Huston, TX (Onsite) Rate: DOE Experience: 12 plus years US Citizen, Green card Holder, H1B, and GC EAD acceptedJob DescriptionWe are seeking an experienced Senior Data Engineer with a strong background in Big Data, ETL processes, and Cloud computing to join our dynamic team. The ideal candidate will have a proven track record in handling large-scale data pipelines, cloud platforms like AWS/GCP, and the ability to manage complex data workflows using tools like Airflow, PySpark, and Hadoop. This individual should also have advanced skills in Data Analysis, Data Validation, and Data Visualization, as well as experience with Natural Language Processing (NLP) and GenAI technologies.Advanced proficiency in Python, PySpark, and SQL.Hands-on experience with Hadoop, Airflow, Hive, HBase, Kafka, and MapReduce.Familiarity with AWS/GCP cloud platforms, and technologies such as DBT, Lambda, Redshift, and Google BigQuery.Solid understanding of data visualization tools like Power BI, Tableau, and Looker.Experience in GenAI and Natural Language Processing (NLP), including Transformers and Embedding techniques.Strong experience in SQL optimization, data profiling, and data validation.Experience with real-time streaming and event-driven architectures using Kafka or Amazon Kinesis.Familiarity with containerization technologies like Docker and Kubernetes is a plus.