Data Engineer
Prophecy Technologies
Role Summary We are seeking an experienced Data Engineer Lead to join our onshore team and drive the design, development, and optimization of enterprise data solutions using Microsoft Azure and Microsoft Fabric. The ideal candidate will lead data engineering efforts, mentor junior engineers, and collaborate with cross-functional teams to deliver scalable and secure data platforms. Key Responsibilities - Lead the design and implementation of data pipelines and ETL processes using Azure Data Factory, Synapse, and other Azure services. - Architect and optimize data models and storage solutions for performance and scalability. - Integrate data flows within Microsoft Fabric for unified analytics and reporting. - Collaborate with stakeholders to gather requirements and translate them into technical solutions. - Ensure data quality, security, and compliance across all data engineering activities. - Mentor and guide junior data engineers in best practices and technical execution. - Troubleshoot and resolve data workflow issues and performance bottlenecks. Required Skills - Extensive experience with Azure Data Services (Data Factory, Synapse, Databricks, etc.). - Strong knowledge of Microsoft Fabric and its integration capabilities. - Proficiency in SQL, Python, and Spark for data transformation and analysis. - Experience with CI/CD pipelines and DevOps practices in data engineering. - Understanding of data governance, lineage, and metadata management
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Palo Alto, CA vacancy
- ...we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, data analysts/data scientists, machine learning engineers for full time positions with clients. Who Should Apply Recent computer science/engineering/mathematics...SuggestedFull timeH1bRemote work
- ...Mountain View, CA Contract Job Description: ~ The Data Science Engineering Analyst will play a pivotal role in analysing complex datasets, designing and implementing predictive models, and deriving actionable insights to drive business decisions. This position...SuggestedContract work
- ...Summary: The main function of a data analyst is to coordinate changes to computer databases, test, and implement the database applying... ...required Disqualifiers ideal profile- big tech, think data engineer with analyst ability big plus. Must have a proven record of...Suggested
$94.35 - $125.03 per hour
...explore our current job openings. Your best is waiting to be discovered. Day - 08 Hour (United States of America) The Lead Data Engineer will be part of a team building Stanford Health Care's (SHC) solutions incorporating Artificial Intelligence including providing...SuggestedHourly payWork experience placement- ...Data Pipeline Engineer ByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire people across languages, cultures, and geographies. Dedicated to building global platforms of creation and interaction, ByteDance...Suggested
- ...Data Management Specialist Overall Skills: • 10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment: • Highly proficient in SQL (Advanced SQL), • Solid understanding of Spark, including...
- ...Data Engineer Mountain View, CA (Hybrid, 2 days a week onsite and day 1 onsite) Duration: 6+ months contract Interview process: 3 rounds of Zoom video Required skills: 10+ years of overall experience in data management space and at least 5 years of working in...Contract work2 days per week
$154.9k - $209.6k
...like vehicles and robots to make more intelligent and safe decisions. Role Overview: We're looking for an Perception Data Engineer who can own data collection, scalable data systems, and sensor data workflows. You'll work cross-functionally with perception,...- ...We are currently seeking a Data Engineer to join the Finance Technology and Digital Transformation team in our client's Finance Department. This role will support the rapid growth of FinTech across many departments at the law firm. Duties include the below: - Adapt and...
- ...Data Engineer Location: Mountain View, CA Duration: Contract Rate: DOE Required Skills: ~10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment ~ Highly proficient in SQL...Contract work
- ...Only Local candidates, please don't ask for relocation. Proper LinkedIn ID About the Role We are seeking Senior Data Engineers to join an experienced team building robust data infrastructure to support high-impact analytics and business needs. This role...Local areaImmediate startRelocation
- ...Data Engineer Role: Data Engineer Location: Palo Alto, CA Duration: Long Term Job Description: We are looking for experienced developer resources with the below key skillset. Python with oops concept exposure. Implementation knowledge covering SQL and Teradata...
$240k - $280k
...Data Engineer Palo Alto, CA About xAI xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization...Temporary workInternship- ...Data Engineer Job Location: Menlo Park, CA Job Type: Full-Time / Contract Required Skills: 7 to 10+ Years of experience. Experience in advance SQL, Python, ETL, Data Modelling, Tableau or any BI tool Should be well versed in creating data pipelines using...Full timeContract work
$100k - $180k
...'s Electronics Supplier Industrialization team needs a hands-on Engineer who can build at scale and maintain the supplier intelligence infrastructure... ...database infrastructure to support large-scale manufacturing data storage and analytics workloads, handling both numerical data...Hourly payFull timeContract workTemporary workFlexible hours$110k - $180k
...See the following articles to learn more about what we do: Location Palo Alto, CA Job Description Rhombus' Data Engineers are instrumental in designing and implementing data engineering activities on topical, mission-driven projects that inform our...Work experience placementWorldwideFlexible hoursShift work$145.2k - $217.8k
...Responsible for developing Sutter Health’s research analytic data infrastructure. This includes all aspects of how data is ingested... ...EDUCATION: ~ Bachelor’s degree in Computer Science, Engineering, Information Management, or Healthcare Administration TYPICAL...Full timeLive inWork at officeImmediate startWork from homeMonday to FridayShift workWeekend work- ...Data Engineer Position: W2 Location: Mountain View ,CA Duration: 12+ months Job Description: ~5+ years of experience in Data Engineering ~ Advanced SQL skills with experience in data modeling and schema design...
- ...Data Engineer Location: Mountain View CA (Onsite – Hybrid) Client: Intuit Implementation Partner: Altimetrik Overall Skills: ~10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment...
$120k - $180k
...Position To Work On A Talented Team This is an exciting position to work on a very talented team of engineers. The ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract...$75k - $260k
...Position Summary : GEICO is looking for an experienced engineer who enjoys building fast, reliable platforms and applications that... ...grounded in engineering excellence. This role supports our Finance Data Warehouse. Position Description : As an Engineer II, you...Hourly payWork experience placementInternshipLocal areaFlexible hours$80 per hour
...Ran Engineer Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential Role: RAN Engineer Work location: Menlo Park, California... ...for Mobile/Cellular Infrastructure, OAM interfaces, protocols, data models, configuration parameters, KPIs for RAN Knowledge of...For contractorsWork experience placement$130k
...billions of dollars each year. To learn more visit Who You Are TabaPay is looking for an experienced and proactive Data Engineer to join the team. We are looking for someone who can take initiative and operate independently all while taking pride in keeping...Work at officeFlexible hours- ...software development or related2. 3+ years of solid Java and 2+ years experience in design, implementation, and support of solutions big data solution in Hadoop using Hive, Spark, Drill, Impala, HBase3. Hands on experience with Unix, Teradata and other relational databases....Local area
- ...Data Engineer Location: Mountainview, CA (Hybrid 3 days' work from office) C2C pay rate: $70-75/hr for both the roles. Role Summary: Responsible for designing and building graph data models, knowledge graphs, and data pipelines optimized for GraphRAG and reasoning...Work at office
- ...Insight Global is looking for a Project Engineer in Mountain View, California. This role supports technical leads in developing server halls for data centers and requires 5-7 years of relevant experience. Candidates should have a background in Structural or Civil Engineering...Remote work
- ...Big Data Engineer Location: Mountain View, CA (3 days onsite) Skill Set: ~ Minimum of 5+ years working with Apache Flink or Spark Structured Streaming (preferably Flink) ~5+ years experience with Java or Scala ~ Strong experience working with microservices...
$100k
...Cloud World/Oracle Java One (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023... ...developers, Data analysts/ Data Scientists, and Machine Learning engineers for full-time positions with clients. Who Should Apply Recent...Full timeH1b$180k - $258.75k
...harmonious with TRI's robotics divisions' efforts in Diffusion Policy and Large Behavior Models. We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development workflows. This...Local areaRemote workShift work- ...intelligent, more sustainable for everyone. Role Summary The Core Data team builds and scales a bestinclass data platform and analytics... ...improve business processes and performance. As a Sr. Data Engineer, you will help build and operate the data foundation that powers...Full timeContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- director data engineering Palo Alto, CA
- junior big data engineer Palo Alto, CA
- senior data engineer Palo Alto, CA
- data platform engineer Palo Alto, CA
- sr information security engineer Palo Alto, CA
- senior data integration developer Palo Alto, CA
- data developer Palo Alto, CA
- data engineer Palo Alto, CA
- data infrastructure engineer Palo Alto, CA
- entry level big data engineer Palo Alto, CA

