Data Engineer
Prophecy Technologies
Role Summary We are seeking an experienced Data Engineer Lead to join our onshore team and drive the design, development, and optimization of enterprise data solutions using Microsoft Azure and Microsoft Fabric. The ideal candidate will lead data engineering efforts, mentor junior engineers, and collaborate with cross-functional teams to deliver scalable and secure data platforms. Key Responsibilities - Lead the design and implementation of data pipelines and ETL processes using Azure Data Factory, Synapse, and other Azure services. - Architect and optimize data models and storage solutions for performance and scalability. - Integrate data flows within Microsoft Fabric for unified analytics and reporting. - Collaborate with stakeholders to gather requirements and translate them into technical solutions. - Ensure data quality, security, and compliance across all data engineering activities. - Mentor and guide junior data engineers in best practices and technical execution. - Troubleshoot and resolve data workflow issues and performance bottlenecks. Required Skills - Extensive experience with Azure Data Services (Data Factory, Synapse, Databricks, etc.). - Strong knowledge of Microsoft Fabric and its integration capabilities. - Proficiency in SQL, Python, and Spark for data transformation and analysis. - Experience with CI/CD pipelines and DevOps practices in data engineering. - Understanding of data governance, lineage, and metadata management
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Palo Alto, CA vacancy
- ...Mountain View, CA Contract Job Description: ~ The Data Science Engineering Analyst will play a pivotal role in analysing complex datasets, designing and implementing predictive models, and deriving actionable insights to drive business decisions. This position...SuggestedContract work
- ...we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full time positions with clients. Who Should Apply Recent computer science/engineering/mathematics...SuggestedFull timeH1bRemote work
$94.35 - $125.03 per hour
...explore our current job openings. Your best is waiting to be discovered. Day - 08 Hour (United States of America) The Lead Data Engineer will be part of a team building Stanford Health Care's (SHC) solutions incorporating Artificial Intelligence including providing...SuggestedHourly payWork experience placement- ...Data Management Specialist Overall Skills: • 10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment: • Highly proficient in SQL (Advanced SQL), • Solid understanding of Spark, including...Suggested
- ...Data Pipeline Engineer ByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire people across languages, cultures, and geographies. Dedicated to building global platforms of creation and interaction, ByteDance...Suggested
$80 per hour
...Ran Engineer Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential Role: RAN Engineer Work location: Menlo Park, California... ...for Mobile/Cellular Infrastructure, OAM interfaces, protocols, data models, configuration parameters, KPIs for RAN Knowledge of...For contractorsWork experience placement$130k
...billions of dollars each year. To learn more visit Who You Are TabaPay is looking for an experienced and proactive Data Engineer to join the team. We are looking for someone who can take initiative and operate independently all while taking pride in keeping...Work at officeFlexible hours$110k - $180k
...Data Engineer, Palo Alto Palo Alto, California, United States Rhombus Power, Inc. delivers AI-powered predictive intelligence in real time for defense and national security organizations worldwide. Our mission-built products— Ambient AI and Guardian— are transforming...Work experience placementWorldwideFlexible hoursShift work- ...software development or related2. 3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBase3. Hands on experience with Unix, Teradata and other relational databases....Local area
$145.2k - $217.8k
...Responsible for developing Sutter Health’s research analytic data infrastructure. This includes all aspects of how data is ingested... ...EDUCATION: ~ Bachelor’s degree in Computer Science, Engineering, Information Management, or Healthcare Administration TYPICAL...Full timeLive inWork at officeImmediate startWork from homeMonday to FridayShift workWeekend work- ...Data Engineer Position: W2 Location: Mountain View ,CA Duration: 12+ months Job Description: ~5+ years of experience in Data Engineering ~ Advanced SQL skills with experience in data modeling and schema design...
- ...Data Engineer Location: Mountain View, CA Duration: Contract Rate: DOE Required Skills: ~10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment ~ Highly proficient in SQL...Contract work
- ...Data Engineer Location: Mountain View CA (Onsite – Hybrid) Client: Intuit Implementation Partner: Altimetrik Overall Skills: ~10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment...
$75k - $260k
...Position Summary : GEICO is looking for an experienced engineer who enjoys building fast, reliable platforms and applications that... ...grounded in engineering excellence. This role supports our Finance Data Warehouse. Position Description : As an Engineer II, you...Hourly payWork experience placementInternshipLocal areaFlexible hours- ...Position : Data Engineer Location - Mountain View CA Duration - 6 Months + Possible extension About the Role We are seeking Senior Data Engineers to join an experienced team building robust data infrastructure to support high-impact analytics...Immediate start
$120k - $180k
...Position To Work On A Talented Team This is an exciting position to work on a very talented team of engineers. The ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract...$65 - $70 per hour
...Insight Global is seeking a talented Data Engineer to join our team within the Edge Network Services division. This role will support the M360 project, focusing on data analytics and metrics. As part of the ENS Analytics team, you will enable data-driven decision-making...- ...Data Engineer Location: Mountainview, CA (Hybrid 3 days' work from office) C2C pay rate: $70-75/hr for both the roles. Role Summary: Responsible for designing and building graph data models, knowledge graphs, and data pipelines optimized for GraphRAG and reasoning...Work at office
- ...Greetings from Rootshell Inc, One of our client is looking for Data Engineer.. Role: Data Engineer Location: Palo Alto, CA Duration: Long Term Job Description: We are looking for experienced developer resources with the below key skillset...
- ...Data Engineer Mountain View, CA (Hybrid, 2 days a week onsite and day 1 onsite) Duration: 6+ months contract Interview process: 3 rounds of Zoom video Required skills: 10+ years of overall experience in data management space and at least 5 years of working in...Contract work2 days per week
$154.9k - $209.6k
...like vehicles and robots to make more intelligent and safe decisions. Role Overview: We're looking for an Perception Data Engineer who can own data collection, scalable data systems, and sensor data workflows. You'll work cross-functionally with perception,...- ...Data Engineer Job Location: Menlo Park, CA Job Type: Full-Time / Contract Required Skills: 7 to 10+ Years of experience. Experience in advance SQL, Python, ETL, Data Modelling, Tableau or any BI tool Should be well versed in creating data pipelines using...Full timeContract work
$240k - $280k
...Data Engineer Palo Alto, CA About xAI xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization...Temporary workInternship- ...Summary: The main function of a data analyst is to coordinate changes to computer databases, test, and implement the database applying... ...required Disqualifiers ideal profile- big tech, think data engineer with analyst ability big plus. Must have a proven record of...
- ...Insight Global is looking for a Project Engineer in Mountain View, California. This role supports technical leads in developing server halls for data centers and requires 5-7 years of relevant experience. Candidates should have a background in Structural or Civil Engineering...Remote work
- ...Big Data Engineer Location: Mountain View, CA (3 days onsite) Skill Set: ~ Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (preferably Flink) ~5+ years experience with Java or Scala ~ Strong experience working with microservices...
$100k
...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply Recent...Full timeH1b$180k - $258.75k
...harmonious with TRI's robotics divisions' efforts in Diffusion Policy and Large Behavior Models. We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development workflows. This...Local areaRemote workShift work- ...intelligent, more sustainable for everyone. Role Summary The Core Data team builds and scales a bestinclass data platform and analytics... ...improve business processes and performance. As a Sr. Data Engineer, you will help build and operate the data foundation that powers...Full timeContract work
$177.65k - $196.35k
...connected through virtual collaboration, team gatherings, and a people-first culture. About the role Point is looking for a Senior Data Engineer to join a lean, high-impact data team that powers analytics for 15+ business functions across a home equity investment company....Temporary workWork experience placementRemote workHome officeFlexible hours2 days per week3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- director data engineering Palo Alto, CA
- junior big data engineer Palo Alto, CA
- senior data engineer Palo Alto, CA
- data platform engineer Palo Alto, CA
- sr information security engineer Palo Alto, CA
- senior data integration developer Palo Alto, CA
- data developer Palo Alto, CA
- data engineer Palo Alto, CA
- data infrastructure engineer Palo Alto, CA
- entry level big data engineer Palo Alto, CA

