Data Engineer
Software Guidance & Assistance, Inc. (SGA, Inc.)
Software Guidance & Assistance, Inc., (SGA), is searching for a Data Engineer for a contract assignment with one of our premier Infrastructure Services clients. This role will be remote. Looking for a Data Engineer to build and maintain the data infrastructure powering our AI/ML initiatives — including data pipelines for model training, retrieval-augmented generation (RAG), and production ML systems. This role sits at the intersection of data engineering and applied AI, ensuring high-quality, well-governed data is available for both traditional analytics and AI consumption. Responsibilities :
- Design and build pipelines to ingest, clean, and transform structured and unstructured data (documents, PDFs, transcripts, logs) for AI/ML use cases
- Build and maintain vector embedding pipelines and support vector database integration
- Develop feature stores/pipelines for ML model training and inference
- Implement data pipelines supporting RAG architectures — chunking strategies, embedding refresh cycles, metadata tagging
- Partner with ML engineers/data scientists to understand data requirements for model training and evaluation
- Ensure data lineage, quality, and governance across pipelines feeding AI systems
- Optimize pipelines for cost and performance (e.g., Dynamic Tables, streaming ingestion)
- Support MLOps/LLMOps workflows — versioning datasets, tracking data used in model training for reproducibility and compliance
- Implement entitlement/access control logic so AI systems only access data they're authorized to use
- Strong SQL + one of Python/Scala for pipeline development
- Experience with a cloud data platform
- Experience with orchestration tools (Airflow, dbt)
- Understanding of embedding models, vector search, and RAG patterns
- Experience with unstructured data processing
- Familiarity with ML lifecycle concepts
- Experience with Snowflake Cortex, Cortex Search, or similar in-warehouse AI tooling
- Experience in a regulated industry (financial services) with data entitlement/compliance requirements
- Exposure to LLM application frameworks (LangChain, LlamaIndex)
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- senior data center engineer Phoenix, AZ
- senior cloud data engineer Phoenix, AZ
- senior data integration developer Phoenix, AZ
- data developer Phoenix, AZ
- data engineer Phoenix, AZ
- big data cloud engineer Phoenix, AZ
- data engineering intern summer Phoenix, AZ
- data engineer analytics Phoenix, AZ
- big data devops engineer Phoenix, AZ
- junior big data engineer Phoenix, AZ
