Lead Data Architect

LOCAL CANDIDATES ONLY - PLEASE NOTE - THIS ROLE REQUIRES 12-17 YRS. OF EXPERIENCE

Data Tech Lead from Trading and Supply Landscape

Location: Hybrid, Houston, TX 77002| Pay: $116.67/hr W2 | Duration: 6+ months (extensions possible)

Please Note: W2 ONLY - Per Client Requirement NO C2C, NO H1B, NO TN Visa, NO 1099, NO F1 – CPT & OPT

*Must be located/authorized to work in the USA without visa sponsorship or transfer now or in the future.

No C2C inquiries, please!!

If interested, please email your resume directly to View email address on click.appcast.io

Key Responsibilities

• Drive the architecture, design, and delivery of Data ecosystems for futuristic data platform.

• Define data product roadmaps and drive development of data solution using approved tech stack and related technologies.

• Align data engineering initiatives with long-term business and technology strategies.

• Provide technical leadership to ensure adherence to best practices, standards, and quality expectations.

Technical Oversight

• Lead data modelling and architecture using tools such as SAP Power Designer and WizDesign.

• Develop and optimize intelligent, Ai augmented data pipelines across ADF, ADLS, Databricks, DLT, and Structured Streaming to enable high performance data delivery.

• OLTP schema design, normalization, indexing strategy, Performance tuning for transactional systems

• Transaction management, concurrency, deadlocks

• PostgreSQL, MySQL, SQL Server expertise

• Optimize Databricks workloads with a strong focus on performance and cost efficiency.

• Implement robust security, governance, lineage, and metadata controls using Unity Catalog.

• Troubleshoot pipeline issues, ensure high data quality, and enforce SLA compliance.

• Establish data governance frameworks covering security, privacy, quality, and lifecycle management.

• Monitor pipeline performance and lead root cause analysis for data and process issues.

• Drive CI/CD and touchless change management frameworks to enable seamless deployments.

• Collaborate closely with PMs, BAs, Data Scientists, Architects, and business stakeholders.

• Translate complex technical concepts into business terms for executive audiences.

• Resolve conflicts and ensure alignment across strategic priorities.

• Stakeholder management & executive communication

Required Skills & Experience

12–17 years of experience in data engineering or data architecture

Deep expertise in:

• Azure Data Engineering (ADF, ADLS, Databricks, , DLT), AZURE Function, SQL, REST/FAST API, LogicApps

• Databricks Delta Live Tables & Structured Streaming

• Unity Catalog governance and lineage

• Strong hands-on skills in SQL, Python, Spark/Scala.

• Strong experience in data modeling, data architecture, and metadata management.

• CI/CD for application delivery (Azure DevOps/GitHub Actions)

• Containerization (Docker), Kubernetes basics

• API gateway, reverse proxies, load balancing

• Solution Data Architecture, Data Modeling tools like SAP Power Designer, BiZ Design

• Working knowledge of AI/ML, GenAI, Agentic AI, and applying AI for data engineering automation.

• Ability to envision and build future-ready, scalable data ecosystems.

Nice to Have

• Experience with Kafka, Hadoop, Spark Streaming.

• Experience with workflow tools like Airflow, Azkaban, Luigi.

• Knowledge of Power BI/QlikSense visualizations.

• Certifications in Azure Data Engineer, Databricks, AI/ML, or Data Science.

• Experience with GitHub/Azure DevOps, CI/CD, Agile/Kanban methodologies.

• Understanding of Freight Domain like Voyage Management, Chartering, Freight Pricing, Demurrage, Laytime, Port calls, Vessel scheduling

• Integration with RightAngle, Endur, Veson IMOS or Freight systems

• Knowledge of T&S business processes