Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Big Data Engineer

Rite Pros, Inc

Big Data Engineer with Bachelor Degree in Computer Science, Computer Information Systems, Information Technology, or a combination of education and experience equating to the U.S. equivalent of a Bachelor’s degree in one of the aforementioned subjects. Job Duties and Responsibilities Collaborate with System Architects to design, develop, test, and implement efficient Snowflake data models aligned with enterprise data warehousing standards. Build and manage cloud and hybrid integrations using third-party ETL tools like Azure Data Factory for seamless Snowflake data pipelines. Maintain CI/CD pipelines in GitHub and Azure DevOps to ensure code quality, version control, and automated deployment for Snowflake solutions. Conduct SQL performance analysis, query optimization, and database tuning to improve efficiency and scalability in Snowflake models. Develop robust, scalable Snowflake integrations and data models following industry best practices. Perform root cause analysis on data model issues and resolve performance bottlenecks to maintain reliable Snowflake systems. Engage with customers and architects to refine requirements and communicate effectively for business alignment. Apply strong time management to prioritize concurrent tasks and deliver Snowflake projects promptly. Use analytical and problem-solving skills to address complex warehouse challenges within the Snowflake ecosystem. Work experience / Technologies required for the position At least 5+ years of experience in building and optimizing Big Data, Data pipelines, architectures and data sets. Experience in performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, meta data, dependency and workload management. A successful history of manipulating, processing and extracting value from large disconnected data sets. Working knowledge of message queuing, stream processing, and highly scalable Big Data, data stores. Experience in supporting and working with cross-functional teams in a dynamic environment. Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including AzureSQL and Snowflake. Experience with Azure cloud services: ADLS, AzureSynapse, Azure Databricks, Delta Lake Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc. Work location is Portland, ME with required travel to client locations throughout USA. Rite Pros is an equal opportunity employer (EOE). #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Portland, ME vacancy
  •  ...responsible for building out key components of data ingestion and transformation, using a...  ...Java/Scala development skills as well as Big Data processing technologies. As a member...  ...: Bachelor’s degree in Computer Science, Engineering, or similar disciplines and 5 or more... 
    Big data
    Work experience placement

    Institute for Experiential AI at Northeastern University

    Portland, ME
    3 days ago
  •  ...Responsibilities Design, develop, and maintain scalable, high-performance data solutions to handle large volumes of data across multiple...  ...-structured, and unstructured data at scale. Collaborate with engineers, product managers, data analysts and data scientists to... 
    Suggested

    Rite Pros, Inc

    Portland, ME
    5 days ago
  • $85k - $225k

     ...Join to apply for the AI Data Engineer role at Veeva Systems Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Veeva Systems

    Portland, ME
    3 days ago
  •  ...Sr Data Engineer Duration: 5 months (likely to extend) Start Date: ASAP Location: Westbrook, ME (2x per week onsite) W2/C2C: W2 Only Additional Notes This role requires an "On Call" rotation - 1 week per month/5 weeks This is the primary reason for the role; the product... 
    Suggested
    Immediate start

    DeWinter Group

    Westbrook, ME
    3 days ago
  • $80.46k - $142.72k

    Role description As an Electrical Engineer you will lead the electrical discipline of multiple concurrent data center projects through pursuit, proposal, design, and construction phases. You will be responsible for leading design efforts, serve as the engineer of record... 
    Suggested
    Full time
    Part time

    Arcadis

    Portland, ME
    1 day ago
  • Data Architect with Bachelor’s Degree in Computer Science, Computer Information Systems...  ...stakeholders, subject matter experts, QA, and engineering teams to translate business needs into...  ...and enterprise data quality frameworks. Big Data and analytics platforms including... 
    Big data
    Work experience placement

    Rite Pros, Inc

    Portland, ME
    4 days ago
  • $120k - $160k

     ...Fortune Best Workplaces in Financial Services & Insurance AI Data Scientist Sr. PRIMARY PURPOSE OF THE ROLE : To partner...  ...and libraries and data exploration, data wrangling, and feature engineering. Experience with natural language processing and healthcare data... 
    Work at office
    Local area
    Flexible hours

    Sedgwick

    Portland, ME
    16 hours ago
  • $118k - $176k

     ...who share our enthusiasm for innovation and creating the best experience for job seekers. Day to Day As a Machine Learning Engineer on our Sourcing team, you will work on developing and deploying ML and AI solutions in production. You'll be collaborating with a... 
    Work experience placement
    Local area

    Indeed

    Portland, ME
    2 days ago
  • $107.66k - $161.7k

     ...About the Team and Role: Our small engineering team works on challenging problems every...  ...and our engineers are encouraged to think big and experiment with new ideas. Using continuous...  ...Learning systems -- from prototyping, data pipelines and training, to realtime LLM application... 
    Remote job
    Full time
    Work experience placement
    Internship

    Quora

    South Portland, ME
    2 days ago
  •  ...approach to where we work. About the Role: As a Machine Learning Engineer, you will have the opportunity to collaborate closely with...  ...problems executing on a high throughput system with dynamic data. About the Job: Design, develop, and deploy machine learning... 
    Permanent employment
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Portland, ME
    2 days ago
  • $95k - $154k

     ...seeking motivated career changers interested in Java development, Python programming, full-stack development, data analytics, data science, data engineering, and ML/AI pathways. This opportunity is ideal for candidates who are serious about switching into technology and... 
    Full time

    SynergisticIT

    South Portland, ME
    1 day ago
  • $100k - $135k

     ...Capture, and Trailmaker, a software tool for data analysis. THE PRODUCT We've built...  ...unique set of technical challenges. Handling big data files, running custom data processing...  ...! THE POSITION As a Bioinformatics Engineer II within the Trailmaker development team... 
    Big data
    Remote job
    Full time
    Temporary work
    Local area
    Home office
    Flexible hours

    Parse Biosciences

    Portland, ME
    10 days ago
  • $55 per hour

     ...Distributed Systems Software Engineer, Python / Go Join to apply for the Distributed Systems Software Engineer, Python / Go role at Canonical...  ...for people who can bring deep engineering insights and a data driven approach to test automation, reporting and data analytics... 
    Full time
    Local area
    Remote work
    Worldwide

    Canonical

    Portland, ME
    4 days ago
  • $195k - $260k

     ...About the Role WEX is transforming into a data-driven enterprise through its modern Data-as-a-Service (DaaS) platform. At the core...  ...this strategy is a need for world-class technical leadership—engineers who can see across domains, design foundational systems, and set... 
    Flexible hours

    WEX

    Portland, ME
    more than 2 months ago
  • Join to apply for the Software Engineer - Python - Ubuntu Pro client - graduate level role at Canonical About the role Canonical is a leading...  ...is widely used in enterprise initiatives such as public cloud, data science, AI, engineering innovation, and IoT. We have a diverse,... 
    Full time
    Work at office
    Remote work
    Worldwide
    Flexible hours

    Canonical

    Portland, ME
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!