Lead Software- solutions Architect

Description

We are seeking a highly experienced Senior Software Architect to lead the design and development of scalable, AI-native enterprise platforms. This role combines strategic technical leadership with deep hands-on engineering expertise across distributed systems, AI infrastructure, data engineering, cloud platforms, and modern software architecture.

The ideal candidate will drive the architecture and implementation of intelligent systems that integrate structured enterprise data, unstructured content, LLM-powered workflows, vector search, APIs, and AI agents into a unified platform.

You will collaborate closely with executive leadership, product, research, engineering, and data science teams to deliver next-generation AI-driven products focused on research, knowledge management, workflow automation, and customer intelligence.

Senior Architect with deep expertise in AI-native platforms, RAG/LLM systems, distributed cloud architecture, and hands-on backend engineering (Python/Java) with vector DB and AI orchestration experience."

Key Responsibilities

Architecture & Platform Engineering

• Design, build, and evolve scalable AI-native platform architectures
• Lead architectural decisions across:
• Cloud infrastructure
• Distributed systems
• APIs and microservices
• Data platforms
• AI orchestration frameworks
• Developer tooling
• Build systems capable of handling:
• Structured and unstructured data
• Embeddings and vector search
• Real-time AI workflows
• Knowledge retrieval systems
• Establish best practices around scalability, observability, security, performance, and reliability
• Architect hybrid data retrieval solutions leveraging SQL, NoSQL, graph, and vector database technologies

AI & Intelligent Systems

• Design and implement production-grade AI and LLM-powered applications
• Develop architectures for:
• Retrieval-Augmented Generation (RAG)
• Multi-agent AI systems
• Semantic and vector search
• Knowledge graphs
• AI-assisted workflow orchestration
• Automated content generation and validation
• Evaluate and integrate leading AI platforms, open-source models, and orchestration frameworks
• Build systems supporting prompt management, evaluation pipelines, observability, guardrails, and human-in-the-loop workflows
• Drive continuous AI model improvement and monitoring strategies

Hands-On Engineering Leadership

• Write and review high-quality production code
• Lead implementation of core platform components and reusable reference architectures
• Mentor engineering teams on modern cloud-native and AI-first development practices
• Establish CI/CD pipelines, testing frameworks, coding standards, and engineering best practices
• Champion AI-assisted software development workflows and automation tooling

Cross-Functional Collaboration

• Partner with product, research, data, and executive teams to translate business objectives into scalable technical solutions
• Align architecture strategy with long-term company vision and product roadmap
• Support hiring, mentoring, and scaling of high-performing engineering teams
• Lead technical initiatives across globally distributed teams

Required Technical Experience

Core Engineering

• 10+ years of software engineering and architecture experience
• Proven expertise designing and building large-scale distributed systems
• Strong hands-on programming experience with:
• Java and/or C++
• Python
• Deep understanding of:
• API design
• Microservices architecture
• Event-driven systems
• Cloud-native application development
• Extensive experience with AWS cloud infrastructure (preferred)

Data & Platform Architecture

Experience designing and implementing systems using:

• Relational databases:
• PostgreSQL
• MySQL
• SQL Server
• NoSQL databases:
• MongoDB
• Cassandra
• DynamoDB
• Redis
• Vector databases and semantic retrieval systems:
• Pinecone
• Weaviate
• Milvus
• pgvector
• Qdrant
• Chroma
• Large-scale data pipelines, ETL/ELT architectures, and distributed data processing systems

AI & LLM Ecosystem

Hands-on production experience with:

• AI platforms and LLM providers:
• OpenAI
• Anthropic
• Google Gemini
• AWS Bedrock
• AI orchestration and agent frameworks:
• LangChain
• LangGraph
• LlamaIndex
• CrewAI
• AutoGen
• Haystack
• DSPy
• AI observability and evaluation tools:
• Langfuse
• Weights & Biases
• Arize Phoenix
• Helicone
• PromptLayer
• Embeddings, semantic search, RAG systems, and knowledge retrieval architectures
• AI evaluation pipelines, fine-tuning, quality monitoring, and governance frameworks

Leadership & Communication

• Demonstrated success leading architecture initiatives for complex enterprise platforms
• Ability to balance strategic thinking with hands-on execution
• Strong communication and stakeholder management skills
• Experience mentoring senior engineers and leading cross-functional teams
• Comfortable operating in fast-paced, evolving, startup-style environments
• Experience managing and scaling geographically distributed engineering organizations

Ideal Candidate Profile

The successful candidate is:

• Passionate about building transformative AI-driven platforms
• A creative and practical technology leader with strong problem-solving abilities
• Highly collaborative and people-oriented
• A servant leader who leads by example and empowers teams
• Comfortable driving innovation while maintaining execution excellence
• Motivated by building impactful, scalable technology solutions

Education

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field required
• Master's degree preferred
• Strong foundational understanding of software engineering principles, frameworks, and emerging technology trends
• Experience leading large-scale organizational and technical transformation initiatives

Matrix is a global, dynamic, and fast-growing technology services and consulting company with over 17,000 employees worldwide . Founded in 2001, Matrix has grown through significant organic expansion and strategic acquisitions, executing some of the largest and most impactful technology projects in the market.

We specialize in the design, development, and implementation of advanced technologies, software solutions, and digital products. Our services include infrastructure and consulting, IT outsourcing and offshore delivery, training and assimilation programs, and acting as a trusted implementation and delivery partner for the world's leading software vendors.

With deep expertise across both the private and public sectors-spanning Finance, Telecom, Healthcare, Hi-Tech, Education, Defense, and Security -Matrix serves a strong customer base in Israel alongside a continuously expanding global client portfolio.

At Matrix, our people are at the heart of our success. We are a community of talented, creative, and dedicated professionals who are passionate about innovation and excellence. We actively attract, develop, and retain top talent, recognizing that every employee's contribution is critical to our continued growth and future success.

Matrix's success is built on a challenging and engaging work environment , competitive compensation and benefits, and meaningful career development opportunities. We foster a diverse, inclusive culture that encourages collaboration, continuous learning, and growth-together.

Join the winning team. Be challenged, grow your career, and enjoy the journey in a highly respected global organization.

To learn more, visit:

EQUAL OPPORTUNITY EMPLOYER: Matrix is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind. Matrix is committed to the principle of equal employment opportunity for all employees, providing employees with a work environment free of discrimination and harassment. All employment decisions at Matrix are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, family or parental status, or any other status protected by the laws or regulations in our locations. Matrix will not tolerate discrimination or harassment based on any of these characteristics. Matrix encourages applicants of all ages.