Azure Data engineer -AI Foundry
Diamondpick
- Role Summary
We are looking for ETL/Data Engineers with strong experience in BigQuery and Starburst to design, build, and optimize scalable data pipelines supporting analytics and AI-driven use cases. Key Responsibilities - Design and develop scalable ETL/ELT pipelines for structured and semi-structured data
- Build and optimize data ingestion, transformation, and loading processes into BigQuery
- Develop federated query solutions using Starburst (Trino/Presto) across heterogeneous data sources
- Implement data modeling, schema design, and partitioning strategies for performance optimization
- Ensure data quality, validation, and governance across pipelines
- Collaborate with data science and AI teams to enable downstream analytics and Gen AI use cases
- Manage scheduling, orchestration, and monitoring of ETL workflows
Preferred
Experience with cloud data platforms (GCP, AWS, Azure) Exposure to data lakehouse architectures and federated query models
Required Skills
Strong experience in Google BigQuery (data modeling, querying, performance optimization, cost management) Hands-on experience with ETL/ELT pipeline development and large-scale data processing Experience with Starburst / Trino / Presto for distributed query processing Proficiency in Python, SQL, and Spark-based processing frameworks Experience with workflow orchestration tools (Airflow, ADF, etc.) Strong understanding of data warehousing concepts and data governance
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Azure Data engineer -AI Foundry in Charlotte, NC vacancy
- ...Qualifications and Skills • Proven experience as a Data Engineer with experience in Azure cloud. • Experience implementing solutions using - • Azure cloud services • Azure Data Factory • Azure Lake Gen 2 • Azure Databases • Azure Data Fabric • API...Suggested
- ...Objectives • These roles will be part of the Data Strategy team spanning across the SMBC... ...of this strategic platform on SMBC's Azure Cloud Platform will require solutions and... ...Skills • Proven experience as a Data Engineer with experience in Azure cloud. • Experience...Suggested
- ...JOB SUMMARY We are seeking Azure Cloud & Databricks Developer to join our offshore... ...designing, developing and maintaining scalable data pipeline and ETL process using Azure... ...Databricks. SCOPE The Azure Cloud Data Engineer is responsible for strategizing,...SuggestedWeekend work
- ...Hybrid role SUMMARY: The Data Engineer designs, develops, and collaborates with a team of Azure Databricks and Actimize specialists, partnering with external vendors to deliver compliance and surveillance solutions. This role is critical to maintaining and enhancing...SuggestedAfternoon shift
- ...Job Title: Azure Data Lake Engineer Location: Charlotte, NC/Edison, NJ Duration: Contract Job Description: The individual will be responsible for designing and engineering Cloud Data platforms . The individual will require to ensure high level...SuggestedContract work
- ...Azure Data Engineer We are seeking a highly skilled and experienced Azure Data Engineer who specializes in Azure Data Factory (ADF) to join our dynamic team. As an Azure Data Engineer, you will play a crucial role in designing, developing, and implementing data integration...
- ...Senior Azure Data Engineer Location: Hybrid in Charlotte (final round is face to face in NJ office though) 6+ years exp (8+ preferred) Databricks, data lake, data factory, azure suite, pyspark, PowerBI (reports, visualization). PowerBI is a must now as reporting piece...Work experience placementWork at office
- Sharp Decisions is currently seeking a Senior Data Engineer to join our team in Charlotte, NC. This role offers a 12+ month contract where you will leverage your extensive experience with Azure cloud services and Python to implement data solutions. The ideal candidate will...Contract work
- Une grande institution financière recherche un Data Engineer II pour développer et maintenir des solutions de données dans un environnement Azure. Ce rôle exige une collaboration étroite avec des analystes de données afin d'assurer que les solutions de données sont efficaces...
- Skanska USA is seeking a Data Analytics Engineer in Charlotte, NC, to design and implement data initiatives. This role involves data modeling, utilizing Microsoft Azure, and creating intuitive visual data representations. Ideal candidates should have over 3 years of relevant...
- ...that spans across the country. Job Description CapTech Data Engineering consultants enable clients to build and maintain advanced... ...designs using at least one cloud-based solution/platform (AWS, Azure, GCP) ~ Advanced level proficiency with at least one ETL...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...Data Engineer (AWS, Azure, GCP) CapTech is an award-winning consulting firm that collaborates with clients to achieve what's possible through the power of technology. At CapTech, we're passionate about the work we do and the results we achieve for our clients. From...Work at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...Job Title : Senior Data Engineer (Azure Databricks + Pyspark/SparkSQL/Python) Location : Charlotte, NC (Hybrid) Duration: Long term Job Description: ~ Bachelor's degree or Masters Degree in Computer science, or a related field, with minimum 12+...
- Feitong Buke is looking for a Python Engineer with extensive experience in Azure and PySpark to join our Data Strategy team in Charlotte, NC. This hybrid role involves developing a strategic data platform for investment banks, and candidates should have at least 10 years...
- A leading consulting firm in Charlotte, North Carolina is looking for Data Engineering consultants. Candidates will build and maintain advanced data systems leveraging cloud platforms like AWS and GCP. Responsibilities include developing data pipelines, advising clients...Remote jobFlexible hours
$135k - $150k
AssetMark in Charlotte, NC, is looking for a skilled Data Engineer to lead the architecture and development of critical data pipelines. The... ...requires proficiency in SQL and experience with Snowflake and Azure. Offering a hybrid work schedule, competitive salary between $...- A leading workforce solutions company is seeking a Senior Data/SQL Developer for a long-term initiative in Charlotte, NC. The role requires 5+ years of SQL expertise and hands-on experience with Azure Data Factory. Responsibilities include designing and optimizing SQL...
- Sumitomo Group in Charlotte, NC is seeking a skilled professional to build and manage large-scale data pipelines using Azure technologies. This role involves collaborating with cross-functional teams to develop data-driven solutions and requires expertise in Azure Data...Flexible hours
- Skanska is seeking a Data Analytics Engineer in Charlotte, North Carolina. This role focuses on designing, implementing, and supporting enterprise... ...will have experience in data modeling and Microsoft Azure components, and must communicate effectively with stakeholders...
- 慨正橡扯 is seeking an engineer to build and modernize integration solutions leveraging AWS. The role involves supporting data transmission services and collaborating with internal teams. The ideal candidate should have experience in modernizing legacy systems and familiarity...Work at office3 days per week
- SMBC seeks a candidate to build large-scale batch and real-time data pipelines using Azure cloud technologies. You will design ETL and data integration solutions, optimize performance, and collaborate with various stakeholders. The ideal candidate has extensive experience...Work at officeWork from home
- SMBC Group is looking for a skilled data engineer in Charlotte, North Carolina to build and optimize data pipelines on the Azure cloud platform. You'll be responsible for designing ETL solutions, integrating data from various sources, and collaborating with cross-functional...Work at officeWork from home
$64 - $68 per hour
...Akkodis is seeking an Sr Data Bricks Engineer for a Contract with a client in Charlotte, NC/ Raleigh, NC. The ideal candidate is responsible... ...scalable data pipelines and analytics solutions in Azure environments. Rate Range: $64/hour to $68/hour; The rate...Hourly payContract workTemporary workLocal area- ...and groupings. Develop and optimize ETL/ELT pipelines, to load data from on premise and online systems. Ensure data solutions... ...Information technology or related field AND five (5) years as Data Engineer, Big Data Engineer, Data Architect, SQL Developer, Database...Full timeTemporary workWork at officeRemote work
$98.16k - $159.27k
...who can provide you more specific details for this role. Line of Business: Technology Solutions Job Description: The Data Engineer III provides a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition...Work at officeLocal areaWork from homeFlexible hours- ...Job Title: Sr. Data Engineer Duration: 12+ Months Location: Charlotte, NC - Hybrid Role (3 days onsite in a week) Manager Notes: • Team Duties and business impact: The Risk Data Services is a horizontal function within Risk Technology organization and...3 days per week
- ...Position- AWS Data Engineer Duration-Contract Location- Charlotte, NC /Hybrid JD Must Have: Strong experience with AWS services on big data platforms. Strong Python experience in building Dash application in AWS Spark Shell...Contract workImmediate start
- ...We are seeking a Data Engineer in Charlotte, NC (hybrid, 2 days/week Wed & Thurs) . This opportunity will start as a 18 month contrac t with a high possibility extending the contract. ** Candidates must be local to Charlotte and be a US Citizen, Green Card Holder...Contract workH1bLocal area2 days per week
- ...Senior Data Engineer / ETL Developer Charlotte, NC, US Join America's Largest Coca-Cola Bottler—Pour Your Passion into Purpose! We'... ...framework development Preferred Qualifications Experience with Azure API Management. Experience with Azure Data Factory. Experience...Work at officeRemote work
- ...Data Engineer Employment Type: Full-Time, Mid-level Department: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower...Full timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data engineer -AI Foundry. Be the first to apply!
Related searches
- azure data engineer Charlotte, NC
- azure specialist Charlotte, NC
- azure infrastructure engineer Charlotte, NC
- cloud engineer azure Charlotte, NC
- azure developer Charlotte, NC
- microsoft azure architect Charlotte, NC
- director data engineering Charlotte, NC
- junior big data engineer Charlotte, NC
- data engineer graduate Charlotte, NC
- senior data engineer Charlotte, NC

