Senior Architect, Data Engineering (New York)

Are you ready to make an impact?West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of industries including Healthcare, Financial Services, Insurance, Consumer & Industrial Products, and Energy & Utilities.Responsibilities:Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft FabricDesign data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, SqoopDesign data structures for ingestion and reporting, specific to use case and technologyProvide data management expertise to our clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemesArchitect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms such as Databricks, Snowflake, and Microsoft FabricDesign data architectures that enable AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environmentsGuide and coach consultants, share best practices, perform code reviewsCoordinate activities with data source application owners to ensure integration with analytics platform and source systemsEnsure that data integrity issues are addressedLiaise and attend meetings necessary to perform duties and aid business and technical developmentPartner with business development teams to identify client needs, propose tailored solutions, and build long-term relationships with key stakeholders to drive growth opportunitiesCollaborate on crafting compelling proposals, presentations, and technical demonstrations that showcase innovative architecture solutions and align with client objectives to win new business.Qualifications:10+ years of professional experience and 5+ within consulting ecosystemVery strong technical expertise in Databricks and/or Snowflake including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloadsExperience with modern AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologiesHands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architecturesKnowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environmentDevelopment of or architecture of modern distributed architectures using modern messaging patterns and toolsStrong data engineering experience with the following core competencies:
Experience with Databricks, Snowflake, and/or FabricExperience working with relational databases (Microsoft SQL Server) and working with large unstructured data setsStrong experience with ETL procedures and ideation from scratchExperience using cloud platforms such as AWS, Azure, GCP etc.Experience with reporting tools such as PowerBI and TableauWorking knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory.Excellent organizational, verbal and written communication skillsA commitment to inclusion and diversity, and openness to new ideas and perspectivesProven experience in supporting business development efforts, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.Travel to client sites as needed (30% to 50%)Based on pay transparency guidelines, the salary range for this role can vary based on your proximity to one of our West Monroe offices (see table below). Information on our competitive total rewards package, including our bonus structure and benefits is here. Individual salaries are determined by evaluating a variety of factors including geography, experience, skills, education, and internal equity.Employees (and their families) are covered by medical, dental, vision, and basic life insurance. Employees are able to enroll in our company’s 401k plan, purchase shares from our employee stock ownership program and be eligible to receive annual bonuses. Employees will also receive unlimited flexible time off and ten paid holidays throughout the calendar year. Eligibility for ten weeks of paid parental leave will also be available upon hire date. Seattle or Washington, D.C.$199,100—$223,400 USDLos Angeles$205,400—$234,100 USDNew York City or San Francisco$215,200—$244,700 USDA location not listed above$183,800—$212,800 USDOther consultancies talk at you.At West Monroe, we work with you.We’re a global business and technology consulting firm passionate about creating measurable value for our clients, delivering real-world solutions.The combination of business and technology is not new, but how we bring them together is unique. We’re fluent in both. We know that technology alone is not the answer, but how we apply it is. We rely on data to constantly adapt and solve new challenges. Actions that work today with outcomes that generate value for years to come.At West Monroe, we zero in on the heart of the opportunity, getting to results faster and preparing people for what’s next.You’ll feel the difference in how we work. We show up personally. We’re right there in the room with you, co-creating through the challenges. With West Monroe, collaboration isn’t a lofty promise, but a daily action. We work together with you to turn vision into clear action with lasting impact.West Monroe is an Equal Employment Opportunity Employer  We believe in treating each employee and applicant for employment fairly and with dignity. We base our employment decisions on merit, experience, and potential, without regard to race, color, national origin, sex, sexual orientation, gender identity, marital status, age, religion, disability, veteran status, or any other characteristic prohibited by federal, state or local law. To learn more about diversity, equity and inclusion at West Monroe, visit . If you require a reasonable accommodation to participate in our recruiting process, please inquire by sending an email to View email address on apply.placed-app.com review our current policy regarding use of generative artificial intelligence during the application process.If you are based in California, we encourage you to read West Monroe’s Notice at Collection for California residents, provided pursuant to the California Consumer Privacy Act (CCPA) and linked here.