Senior Azure Data Engineer - Python/PySpark | Databricks | ADF
Trispoke managed services
Job Title: Azure Data Engineer
Duration: Contract
Location: Charlotte, NC
Job Type: Hybrid
Pay rate: $80/hr. On W2
Client: SMBC
Job ID: SMBCADJP00001387
Job Description
*** is in the process of leading a Digital Transformation across our Americas Division as we continue to modernize our technology, focus on our data-driven approach, grow, and plan for the future. As a result of this expansion, we are seeking experienced software Data Engineers spread across Charlotte (N.C), Jersey City (N.J), and India, with 10+ years of relevant experience to support the design and development of a strategic data platform for *** Capital Markets and Nikko Securities Group.
Role Objectives
- These roles will be part of the Data Strategy team spanning across the *** Capital Markets and Nikko Securities teams, *** Americas Division's broker-dealer and swap-dealer entities.
- These roles will be involved in the active development of the data platform in close coordination with the *** team, beginning with the establishment of a reference data system for securities and pricing data, and later moving to other data domains.
- The consulting team will need to follow internal development standards to contribute to the overall agenda of the Data Strategy team.
- The implementation of this strategic platform on ***'s Azure Cloud Platform will require solutions and know-how as listed in the qualifications below.
Qualifications and Skills
- Full-stack Python/PySpark developer.
- Proven experience as a Data Engineer with experience in Azure Cloud.
- Experience implementing solutions using:
- Azure Cloud Services
- Azure Data Factory
- Azure Data Lake Gen 2
- Azure Databases
- Azure Data Fabric
- API Gateway Management
- Azure Functions
- Well versed with Azure Databricks.
- Strong SQL skills with RDBMS or NoSQL databases.
- Experience developing APIs using FastAPI or similar frameworks in Python.
- Familiarity with the DevOps lifecycle (Git, Jenkins, etc.) and CI/CD processes.
- Good understanding of ETL/ELT processes.
- Experience in the financial services industry, financial instruments, asset classes, and market data are a plus.
#AzureDataEngineer #DataEngineer #Azure #Python #PySpark #AzureDataFactory #AzureDataLake #ADLSGen2 #AzureDatabricks #AzureFunctions #FastAPI #SQL #ETL #ELT #DataEngineering #DevOps #CICD #FinancialServices #MarketData #CharlotteNC #HybridJobs #ContractJobs #SMBC
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Azure Data Engineer - Python/PySpark | Databricks | ADF in Charlotte, NC vacancy
- ...technology and building a more data-driven operating model.... ...and brings together data engineers across the U.S. and... ...contribute to a strategic Azure-based platform being built... ...processing capabilities using Python, PySpark, Azure, and Databricks. Contribute to the development...DatabricksSeniorLong term contract
Axiom Path
Charlotte, NC1 day ago - ...organization modernizing the data capabilities that... ...brings together experienced engineers and financial technology... ...platform on Microsoft Azure. The selected engineer will... ...solutions using Python, PySpark, Azure Data Factory, Azure Databricks, and Azure Data Lake Storage...DatabricksSenior
Axiom Path
Charlotte, NC16 days ago - ...Tech SolutionsRole: Azure Data EngineerLocation: Charlotte... ...: · Cloud & Data Engineer with hands-on... ...data pipelines using ADF, ADLS Gen2, Azure SQL... ...Strong background in Databricks administration and PySpark development,... ...· Strong command of Python, PySpark, and SQL performance...DatabricksHourly payLocal areaRelocation3 days per week
- ...reliable, and compliant data solutions are essential to... ...supporting cloud-based data engineering initiatives using Microsoft Azure technologies. The role... ...analytics solutions in a senior-level capacity. How You... ...Azure Data Factory, and Databricks. Do you bring proven success...DatabricksSenior
Axiom Path
Charlotte, NC16 days ago - ...environment and expanding its data-driven capabilities across... ...collaborates closely with engineering, data governance, and... ...development of a strategic Azure-based data platform used across... ...using Azure technologies, Python, PySpark, SQL, and Databricks. Help establish...DatabricksSeniorLong term contract
- Associate Data Engineer (Python / Azure) - Charlotte, NCOur client is seeking an early-career Data Engineer to join our client's team in Charlotte... ...data models, cloud platforms such as Azure and Databricks, and tools including Git, JIRA, and Confluence.Position SpecificationsLocation...Databricks
- ...Job DescriptionCapTech Data Engineering consultants enable... ...solution/platform (AWS, Azure, GCP) Advanced level proficiency... ...Snowflake, Redshift, Databricks 5+ years of experience... ...programming language (Python, Java, R, C / C# / C++... ...level: Mid-Senior LevelIndustry: Management...DatabricksSeniorWork at officeRemote workVisa sponsorshipWork visaFlexible hours
- ...Overview: Job Title: Senior Big Data Engineer Location: Charlotte, NC (Hybrid 3days... ...infrastructure Programming Python (advanced) SQL (expert level)... ..., Glue, EMR, Lambda, Redshift) Azure (ADF, Synapse, Databricks) Google Cloud (Big-Query, Dataflow...DatabricksSenior
Magicforce
Charlotte, NC3 days ago $80k - $133k
Job Family:Data Science & AnalysisTravel Required... ...:Guidehouse seeks a Senior Data Engineer to design, develop,... ...engineering solutions using Python, SQL, Spark, and... ...leveraging AWS, Azure, Databricks, and other modern technologies... ...such as Spark or PySpark.Experience designing,...DatabricksSeniorFull timeContract workFlexible hours- ...The Senior Data Engineer will design, develop, and optimize scalable... ...strong expertise in Python, SQL, cloud data... ...platforms such as AWS, Azure, or GCP. Experience... ...with Apache Spark or PySpark for distributed data... ...technologies. Experience with Databricks and Delta Lake....DatabricksSenior
Compunnel
Charlotte, NC4 days ago - ...Azure Data Engineer The organization is undergoing a Digital Transformation across its Americas... ...in software development using Python, PySpark, and related frameworks. ~ Proven experience... ...Gen2 ~ Azure Databases ~ Azure Databricks ~ Data Quality Frameworks /...Databricks
eTeam
Charlotte, NC2 days ago - ...Azure Data Engineer We are seeking a highly skilled and experienced Azure... ...specializes in Azure Data Factory (ADF) to join our dynamic team.... ...experience presenting to senior technical and business... ...Azure data services like Azure Databricks, Azure Synapse Analytics, or...Databricks
Samprasoft
Matthews, NC3 days ago - ...problems. Let's work together to achieve greatness! As a Data Engineer, you will be responsible for designing, developing, and... ...years of work experience with one or more of the following: Databricks, Pyspark, Azure Data Factory, Azure Synapse, Delta live tables, Azure...DatabricksHourly payWork experience placementLive inWork at officeLocal areaImmediate startFlexible hours
Accenture
Charlotte, NC2 days ago - ...onsite in Charlotte, NC Summary: Designs and builds data solutions using Microsoft Azure technologies. Responsibilities: Develop data... ...data security and compliance. Skills: Azure certifications, experience with Synapse, Data Factory, and Databricks.Databricks
BAMM USA
Charlotte, NC3 days ago - ...managers, technical leads, and engineers, building a strong leadership... ...-end lifecycle of enterprise data products and platforms,... ...data ecosystem. Partners with senior leaders and cross-functional... ...data lakes, real-time systems, Databricks). Familiarity with data visualization...DatabricksSeniorFull time
- ...Azure Data Engineer Location: Branchville, NJ, Charlotte, NC and Hartford CT Years of Experience... ...with a strong background in Azure Databricks to join our dynamic team. The ideal... ...Proficient in programming languages such as Python, Scala, or SQL for data manipulation...Databricks
Yantran LLC
Charlotte, NC5 days ago $139.6k - $174.5k
...benefits and healthcare navigation as a Senior Data Engineer (Analytics Engineer). You will build... ..., or related field • Strong SQL and Python; solid understanding of ETL/ELT and dimensional... ...practices • Familiarity with Spark/Databricks and cloud data warehouses (Snowflake...DatabricksSeniorWork at officeLocal areaFlexible hoursJudi Health
Charlotte, NC1 day ago- ...seeking a talented and motivated Senior Data Engineer to join our Cloud data solutions... ...on Cloud solutions, preferably in Azure. Experience with Azure cloud services... ...2, Azure Databases, Functions, Databricks, etc. Strong knowledge of Python, Java or similar high-level...DatabricksSeniorWork at officeLocal areaWork from home
SMBC Group
Charlotte, NC4 days ago $124k - $280k
...Data And Analytics Engineering Senior ManagerAt PwC, our people in data and analytics engineering focus on... ...Architect, GCP Data Engineer Microsoft Azure Solutions Architect, Azure Data... ...Snowflake Core, Snowflake Architect, Databricks Data Engineer Associate] is a plusDesigning...DatabricksSeniorPwC (US)
Charlotte, NC2 days ago- OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming data... ...Skill and ExperiencePySpark SQL, AWS, Python AWSPreferred Skill and ExperienceDashboards... ...2Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 3Technology|ETL &...SeniorFull timeTemporary workRelocation
- The Senior Manager, AI & Data Engineering leads teams responsible for building and operating reusable, governed data products and AI-ready semantic... ...AI-ready data architectures.Preferred experience with Databricks, Apache Iceberg, Kafka/Confluent, SageMaker, and modern...DatabricksSeniorFull timeFor contractorsWork at office
$120k - $160k
...including people leadership and data expertise. We expect an... ...need experience leading data engineering teams and delivering scalable... ...lakes, real-time systems, or Databricks. Preferred: familiarity with... .... We partner with senior leaders and cross-functional...DatabricksSeniorFull timeVanguard
Charlotte, NC7 days ago- ...technology solutions provider is seeking a highly experienced GCP Data Engineer for a hybrid role in Charlotte, NC. The ideal candidate will... ...or cloud engineering and expertise in Google Cloud Platform, Python, and Django. You will be responsible for designing and...SeniorLong term contract
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...Full timeTemporary workRelocation$125k - $145k
...buildingOur team runs a range of data and AI projects across the... ...hybrid role that spans data engineering, AI product enablement, and platform... ...Data Lake architecture using Python, Spark, SQL, and modern ETL... ...(e.g., Snowflake, Databricks, Delta Lake) alongside distributed...DatabricksSeniorFull timeWork at officeFlexible hoursDay shift- ...Cloud Data EngineerThis position is for a Cloud Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls... ...Design, develop, and deploy Spark program in DataBricks environment to process and analyze large...Databricks
Euclid
Charlotte, NC2 days ago - ...Lead Data Engineer with Databricks HybridCharlotte, NCRoles and ResponsibilitiesDevelop high-quality, scalable ETL/ELT pipelines using Databricks... ...debugging skills in PythonStrong hands-on experience with PySpark to build efficient data transformation and validation logicMust...Databricks
ALIS Software LLC
Charlotte, NC15 hours ago - ...Data Governance / Data Quality Engineer Client is undergoing a digital transformation... ...solutions using Collibra and Azure-based platforms. This... ...with Azure data platform (ADF, Databricks, Data Lake) Develop automation... ...and utilities using Python or similar languages...Databricks
RSD Solutions
Charlotte, NC5 days ago - Job Title: ETL Engineer Location: Charlotte, NC Type: Contract W2 OnlyDescriptionIn this... ...enhance existing ETL applications and data integration workflows.Provide... ...deploy ETL solutions using Ab Initio, PySpark, and Python.Lead and execute the migration of ETL jobs...SeniorContract work
- ...Job DescriptionCapTech Data Engineering consultants enable... ...Services (AWS), Microsoft Azure, or Google Cloud... ...categories: Languages: SQL, Python, Java, R, C# / C++ / C... ...Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop... ...level: Mid-Senior LevelIndustry: Management...DatabricksWork at officeRemote workVisa sponsorshipWork visaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Azure Data Engineer - Python/PySpark | Databricks | ADF. Be the first to apply!
Related searches
- azure developer Charlotte, NC
- azure specialist Charlotte, NC
- azure infrastructure engineer Charlotte, NC
- cloud engineer azure Charlotte, NC
- microsoft azure architect Charlotte, NC
- azure data engineer Charlotte, NC
- data platform engineer Charlotte, NC
- aws data engineer Charlotte, NC
- data science developer Charlotte, NC
- sr information security engineer Charlotte, NC