Big Data Architect

Job Summary:

We are seeking an experienced IT Consultant specializing as a Big Data Architect to design, develop, and maintain an enterprise Big Data/Data Lake architecture. This role is integral to the Data Modernization Effort, supporting enterprise data operations such as IoT/Smart City projects, enterprise data warehouse, open data portal, and data science applications on a Databricks/Azure-based platform in collaboration with the Chief Data Officer team. Responsibilities:

• Coordinate IT project management, engineering, maintenance, quality assurance, and risk management activities.
• Plan, coordinate, and monitor project activities across the data platform lifecycle.
• Develop technical applications and support real-time database, network, and graphics/logic systems.
• Establish and enforce standards and procedures for system design, development, and documentation.
• Perform application upgrades, troubleshoot issues, and provide user training.
• Ensure project lifecycle compliance with District standards and procedures.
• Integrate the data platform with enterprise tools such as Esri, Tableau, MicroStrategy, API Gateways, and Oracle.

Required Skills & Certifications:

• Bachelor's degree in IT or related field, or equivalent experience.
• 16 years of experience in planning, coordinating, and monitoring projects ensuring standards compliance.
• 5 years of experience with Big Data platforms (Databricks, Data Lakes), Azure cloud architecture, security, and storage.
• Experience in data operations including runtime, warehousing, pipelines, cost, and user management.
• Proficiency with data visualization tools such as Tableau, MicroStrategy, ArcGIS, Kibana, and Oracle.
• Strong skills in SQL/NoSQL querying and data pipeline modeling and ingestion.
• 3 years of experience with REST/SOAP APIs and web services, real-time streaming/event processing, and data science tools (Notebooks, R).
• Experience with ETL and analytics using Python, Java, or R.

Preferred Skills & Certifications:

• Databricks Certified Data Engineer Professional certification.
• 2 years of experience deploying applications, gateways, agents, and models on Databricks.

Special Considerations:

• Work is onsite and requires close collaboration with internal teams.
• Compliance with District standards and procedures is mandatory throughout the project lifecycle.

Scheduling:

• Onsite location.
• Duration of assignment is 2 months.
• Interview process conducted in person.