Data Engineer
Prophecy Technologies
Role Summary We are seeking an experienced Data Engineer Lead to join our onshore team and drive the design, development, and optimization of enterprise data solutions using Microsoft Azure and Microsoft Fabric. The ideal candidate will lead data engineering efforts, mentor junior engineers, and collaborate with cross-functional teams to deliver scalable and secure data platforms. Key Responsibilities - Lead the design and implementation of data pipelines and ETL processes using Azure Data Factory, Synapse, and other Azure services. - Architect and optimize data models and storage solutions for performance and scalability. - Integrate data flows within Microsoft Fabric for unified analytics and reporting. - Collaborate with stakeholders to gather requirements and translate them into technical solutions. - Ensure data quality, security, and compliance across all data engineering activities. - Mentor and guide junior data engineers in best practices and technical execution. - Troubleshoot and resolve data workflow issues and performance bottlenecks. Required Skills - Extensive experience with Azure Data Services (Data Factory, Synapse, Databricks, etc.). - Strong knowledge of Microsoft Fabric and its integration capabilities. - Proficiency in SQL, Python, and Spark for data transformation and analysis. - Experience with CI/CD pipelines and DevOps practices in data engineering. - Understanding of data governance, lineage, and metadata management
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Data Engineer in Palo Alto, CA vacancy
$80 per hour
...Ran Engineer Possible 3 Month CTH | No Fees | Do Not Re-Post | Confidential Role: RAN Engineer Work location: Menlo Park, California... ...for Mobile/Cellular Infrastructure, OAM interfaces, protocols, data models, configuration parameters, KPIs for RAN Knowledge of...SuggestedFor contractorsWork experience placement$110k - $180k
...Data Engineer, Palo Alto Palo Alto, California, United States Rhombus Power, Inc. delivers AI-powered predictive intelligence in real time for defense and national security organizations worldwide. Our mission-built products— Ambient AI and Guardian— are transforming...SuggestedWork experience placementWorldwideFlexible hoursShift work$130k
...billions of dollars each year. To learn more visit Who You Are TabaPay is looking for an experienced and proactive Data Engineer to join the team. We are looking for someone who can take initiative and operate independently all while taking pride in keeping...SuggestedWork at officeFlexible hours- • 10+ years of overall experience in data management space and at least 5 years of working in large data sets in a data lake environment : • Highly proficient in SQL, • Solid understanding of Spark including performance tuning. • Solid understanding of the AWS Platform...Suggested
$165k - $175k
...Data Engineer Boston, Massachusetts, United States Job Openings Data Engineer Job Title: Data Engineer - AI Platform Location: Boston, Chicago, New York City, San Francisco, Silicon Valley, Washington DC Number of openings: 1 Experience: 5+ years of professional...Suggested- ...Data Engineer Role: Data Engineer Location: Palo Alto, CA Duration: Long Term Job Description: We are looking for experienced developer resources with the below key skillset. Python with oops concept exposure. Implementation knowledge covering SQL and Teradata...
$240k - $280k
...Data Engineer Palo Alto, CA About xAI xAI's mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization...Temporary workInternship$154.9k - $209.6k
...Perception Data Engineer Aeva's mission is to bring the next wave of perception to a broad range of applications from automated driving to industrial robotics, consumer electronics, consumer health, security, and beyond. Aeva is transforming autonomy with its groundbreaking...- ...Data Pipeline Engineer ByteDance is a technology company operating a range of content platforms that inform, educate, entertain and inspire people across languages, cultures, and geographies. Dedicated to building global platforms of creation and interaction, ByteDance...
$75k - $260k
...Position Summary : GEICO is looking for an experienced engineer who enjoys building fast, reliable platforms and applications that... ...grounded in engineering excellence. This role supports our Finance Data Warehouse. Position Description : As an Engineer II, you...Hourly payWork experience placementInternshipLocal areaFlexible hours$120k - $180k
...Position To Work On A Talented Team This is an exciting position to work on a very talented team of engineers. The ideal candidate's favorite words are learning, data, scale, and agility. You will leverage your strong collaboration skills and ability to extract...- ...Data Engineer Mountain View, CA (Hybrid, 2 days a week onsite and day 1 onsite) Duration: 6+ months contract Interview process: 3 rounds of Zoom video Required skills: 10+ years of overall experience in data management space and at least 5 years of working in...Contract work2 days per week
- ...Data Engineer Position: W2 Location: Mountain View ,CA Duration: 12+ months Job Description: ~5+ years of experience in Data Engineering ~ Advanced SQL skills with experience in data modeling and schema design...
$94.35 - $125.03 per hour
...explore our current job openings. Your best is waiting to be discovered. Day - 08 Hour (United States of America) The Lead Data Engineer will be part of a team building Stanford Health Care's (SHC) solutions incorporating Artificial Intelligence including providing...Hourly payWork experience placement- The Role We're looking for a Lead Data Engineer to own the data infrastructure that powers GXL's AI products (eg. Paperclip). You'll be responsible for designing, building, and maintaining the pipelines, warehouses, and systems that our research and products depend on....Visa sponsorship
$170k - $210k
...Position Summary Sr Data Engineer - Samsung Ads About Samsung Ads: Samsung Ads is a fast-growing, advanced advertising technology business that helps brands connect with audiences across Samsung Smart TVs and digital ecosystems. By leveraging the industry...Hourly payFull timeInternship$180k - $258.75k
...harmonious with TRI's robotics divisions' efforts in Diffusion Policy and Large Behavior Models. We are looking for a Senior Data Engineer to design and build the foundational data infrastructure and tools that power our autonomy research and development workflows. This...Local areaRemote workShift work- ...Job Title: Senior Data Engineer (High Priority) Location: Preferably Mountain View, CA; Hybrid Start Date: Immediate Duration: 6+ months Openings: 4 Senior Engineers About the Role We are seeking Senior Data Engineers to join an experienced...Immediate start
$168k - $241.5k
...Snowflake Data Engineer At Snowflake, we are powering the era of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the opportunity to reinvent how they work. You don't just use tools; you possess...Flexible hours- ...Sterling B2B Developer As part of the Mail Analytics Data Engineering team, you will be working on large-scale batch pipelines, data serving, data lakehouse, and analytics systems, enabling mission critical decision making, downstream, AI-powered capabilities, and...
- ...research to revolutionizing grant and investment strategies, every decision is purposeful. This firm is seeking a Senior Data Engineer to architect and build cloud-native pipelines, batch, streaming, and GenAI-enabled that turn structured and unstructured data...
- ...Scala Engineer We are looking for Scala Engineers with experience with batch and/or streaming jobs. We utilize Spark for batch jobs and... ...and batch use cases, and interacting with infrastructure and data teams to produce complex analysis across data. Required Qualifications...
- ...four 10-hour shifts with at least two days per week onsite (PT). Contract. HireArt is helping Toyota Research Institute find a Data Engineer to design and build the data systems that power advanced analytics, forecasting, and AI-driven research initiatives across CNS....Ongoing contractFull timeContract workTemporary workLocal areaVisa sponsorshipFlexible hoursShift work2 days per week
$300k
Design, build, and maintain the company's foundational data platform and common data layers to deliver general, stable, and high-performance data capabilities for core business domains. Improve the overall efficiency of data-driven business operations. Dive deep into various...Work experience placement- Job Description We are currently seeking a Data Engineer to join the Finance Technology and Digital Transformation team in our client's Finance Department. This role will support the rapid growth of FinTech across many departments at the law firm. Duties include the below...
$111.8k - $134.3k
...and CE Offline teams to execute on the following projects Key Responsibilities Migrate 2 Bureau Gateway Report Service into Partner Data Service (Experian Gateway Report Service and Equifax Gateway Report Service) Test coverage - 100% when the migration is done...Contract workWork at office- Insight Global is looking for a Project Engineer in Mountain View, California. This role supports technical leads in developing server halls for data centers and requires 5-7 years of relevant experience. Candidates should have a background in Structural or Civil Engineering...Remote job
- ...Job Description: Job Title: GCP Certified Data Engineer or Certified Machine Learning Engineer Location: Remote Duration: Part-time or Freelance Role We are seeking Professional Certified GCP engineers in Data or Machine Learning space. This assignment is...Part timeFreelanceRemote work
- ...Develop and enhance Python frameworks and libraries to support data processing, quality, lineage, governance, analysis, and machine... ...like Bigtable and Vertex Feature Store Contribute to shared Data Engineering tooling & standards to improve the productivity and quality of...Permanent employmentContract workLocal area
$156k - $227k
...MLOps) and large language model operations (LLMOps) principles and data infrastructure, including deploying text processing and... ...gTech’s Support, Professional Services, Product Management, and Engineering teams to innovate and simplify our Ads products and build the productivity...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- staff data engineer Palo Alto, CA
- data engineering intern summer Palo Alto, CA
- senior data integration developer Palo Alto, CA
- data engineer contract Palo Alto, CA
- data science developer Palo Alto, CA
- senior data center engineer Palo Alto, CA
- software data engineer Palo Alto, CA
- data developer Palo Alto, CA
- remote data engineer Palo Alto, CA
- sr data engineer Palo Alto, CA

