Senior Data Engineer - Capacity Planning & Forecasting
Virtasant
Type: Remote | Brazil, Mexico, Chile, or Colombia
Coverage: Pacific Hours (8:00 AM – 5:00 PM PST)
Experience: 10+ years
Organization: Data Platform / Infrastructure Engineering
Job Description:
We are looking for an experienced Data Engineer to join our Data Platform organization, focusing on infrastructure capacity planning, forecasting, utilization analytics, and cost optimization.
The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and analytical data models that integrate infrastructure telemetry, cloud consumption, workload demand, and financial data.
This role will play a critical part in enabling data-driven infrastructure investment decisions by providing visibility into compute, GPU, TPU, storage, and cloud resource utilization, forecasting future capacity requirements, and identifying cost optimization opportunities.
The candidate will collaborate closely with Infrastructure Engineering, Data Science, Finance, Procurement, and Business Operations teams to build reliable data products that support strategic capacity planning.
Key Responsibilities:
Data Engineering & Pipeline Development:
Design, develop, and maintain scalable ETL/ELT data pipelines to ingest, process, and transform large volumes of infrastructure and cloud consumption data.
Integrate data from multiple sources, including cloud billing systems, infrastructure telemetry, workload management platforms, and financial systems.
Develop optimized data models and analytical datasets for infrastructure utilization, capacity tracking, and cost reporting.
Implement data validation, reconciliation, monitoring, and quality checks to ensure data accuracy and reliability.
Optimize data pipelines for performance, scalability, and operational efficiency.
Capacity Planning & Forecasting:
Develop data-driven solutions to monitor and forecast infrastructure capacity requirements.
Analyze historical and current utilization trends across GPU, TPU, CPU, memory, and storage resources.
Build forecasting models to predict future compute demand based on workload growth and business requirements.
Identify capacity constraints, resource bottlenecks, underutilization, and potential infrastructure risks.
Support capacity planning through demand forecasting, scenario analysis, and capacity optimization.
Develop dashboards and reporting solutions to track available capacity, committed capacity, utilization, and projected demand.
Cloud Cost & Infrastructure Analytics:
Analyze cloud infrastructure consumption and billing data across AWS, GCP, Azure, or other cloud platforms.
Develop cost attribution models to understand infrastructure spending across workloads, teams, and business units.
Calculate key infrastructure cost metrics, including:
Cost per GPU hour
Cost per CPU hour
Cost per workload/job
Cost per inference request
Cost per million tokens
Identify cost optimization opportunities, including idle resources, underutilized infrastructure, and inefficient capacity commitments.
Partner with Finance and Procurement teams to reconcile infrastructure costs and support financial planning.
Data Modeling & Analytics:
Design and maintain dimensional and analytical data models for infrastructure capacity and financial reporting.
Develop reusable datasets and metrics to support operational and strategic decision-making.
Perform root-cause analysis of utilization anomalies, cost fluctuations, and capacity deviations.
Build automated reports and dashboards to provide actionable insights to stakeholders.
Ensure consistency between operational telemetry, consumption records, and financial reporting.
Stakeholder Collaboration:
Work closely with Infrastructure Engineering teams to understand workload patterns, infrastructure architecture, and capacity requirements.
Collaborate with Finance and Procurement teams on infrastructure budgeting, cloud commitments, and cost forecasting.
Partner with Data Science and Machine Learning teams to understand AI/ML workload requirements and compute consumption patterns.
Translate complex technical and financial data into meaningful insights and recommendations for leadership.
Qualifications:
Required Technical Skills:
Programming & Data Processing
Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization.
Proficiency in Python for data processing, automation, and analytical workflows.
Experience with Pandas, PySpark, or similar data processing frameworks.
Data Engineering
Hands-on experience building scalable ETL/ELT pipelines.
Strong understanding of data warehousing, data modeling, and distributed data processing.
Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies.
Knowledge of data quality frameworks, pipeline monitoring, and data governance.
Cloud & Infrastructure
Experience working with AWS, Google Cloud Platform, or Microsoft Azure.
Understanding of cloud billing, resource utilization, and consumption datasets.
Knowledge of compute, storage, networking, and infrastructure resource metrics.
Familiarity with GPU/TPU infrastructure and AI/ML workload consumption is desirable.
Capacity Planning & Forecasting
Understanding of capacity management, resource utilization, and demand forecasting.
Experience analyzing historical trends and predicting future resource requirements.
Knowledge of time-series forecasting, statistical modeling, and scenario analysis.
Ability to identify infrastructure bottlenecks and resource optimization opportunities.
Visualization & Reporting
Experience with Tableau, Power BI, Looker, or similar visualization tools.
Ability to develop operational dashboards and executive-level reporting.
Preferred Qualifications:
Experience in cloud infrastructure analytics or FinOps.
Exposure to GPU/TPU capacity planning and AI/ML infrastructure.
Understanding of machine learning inference workloads and compute economics.
Experience working with large-scale infrastructure telemetry datasets.
Knowledge of infrastructure cost allocation and unit economics.
Experience supporting financial forecasting, budgeting, or procurement decisions.
Key Performance Indicators (KPIs):
Data pipeline reliability and successful execution rates.
Accuracy and completeness of infrastructure utilization data.
Accuracy of capacity demand forecasts.
Visibility into infrastructure capacity and resource consumption.
Identification of cloud cost optimization opportunities.
Reduction in manual reporting and reconciliation efforts.
Timeliness and accuracy of capacity and financial reporting.
Educational Qualifications:
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Statistics, Mathematics, or a related quantitative discipline.
Equivalent practical experience in Data Engineering, Infrastructure Analytics, or Capacity Planning will also be considered.
Ideal Candidate Profile:
The ideal candidate is a technically strong Data Engineer with an analytical mindset and an understanding of infrastructure economics. They should be comfortable working with large-scale datasets, developing reliable data pipelines, analyzing resource utilization, and translating complex data into actionable capacity and cost optimization insights.
The candidate should demonstrate strong problem-solving skills, ownership, attention to detail, and the ability to collaborate across engineering and business teams.
Core Competencies: Data Engineering | SQL | Python | Cloud Analytics | Capacity Planning | Demand Forecasting | Infrastructure Optimization | FinOps | Data Modeling | Business Analytics
- ...transform how digital marketing, product, and engineering teams connect. In just five years, we’ve... ...by cutting‑edge web, mobile, cloud, data, and AI technologies. If you’re excited by... ...Are We Looking to Add to Our Team? As a Senior Data Engineer, you will focus on designing...SeniorFull time
- ...cultivating lasting relationships between organizations and the populations they support. For our client, we are looking for a Senior Data Engineer who combines strong technical expertise with ownership and sound engineering judgment. This person should be able to...SeniorFull timeFor contractorsWork at officeLocal areaRemote work
- ...on a mission to transform how digital marketing, product, and engineering teams connect. In just five years, we’ve grown at speed and are... ...experiences at scale, powered by cutting‑edge web, mobile, cloud, data, and AI technologies. If you’re excited by innovation, love...SuggestedFull time
- ...next big adventure. We are seeking Semi Senior Full Stack PHP Developer to join our team... .... About the project Join a product engineering team building and improving web-based software... ...schema design. - Participate in sprint planning, stand-ups, and other Agile ceremonies....SeniorFull timeRemote work
- ...transform how digital marketing, product, and engineering teams connect. In just five years, we’ve... ...by cutting‑edge web, mobile, cloud, data, and AI technologies. If you’re excited by... ...Are We Looking to Add to Our Team? As a Senior CRM Data Analyst at Massive Rocket, you’ll...SeniorFull time
- ...Join Nortal for your next big adventure. We are seeking Senior Python Engineer to join our team, grow with us, and teach us a few things along... ...unit tests for Python code. - Use SQL to work with application data and support data-related requirements. - Collaborate through...SeniorFull timeLocal areaRemote work
- ...Join Nortal for your next big adventure. We are seeking a Senior Fullstack Engineer to join our team, grow with us, and teach us a few things along... ...features from requirements through production and pick up planned roadmap work. The stack includes Python, FastAPI, Vue. js (...SeniorFull timeRemote work
- ...your next big adventure. We are seeking Senior Site Reliability Engineer to join our team, grow with us, and... ...scale a business-critical customer-data caching platform. The platform supports... ...toward substantially higher traffic capacity, stronger resilience, and more repeatable...SeniorFull timeRemote work
- ...Join Nortal for your next big adventure. We are seeking an AI Engineer to design and deliver innovative AI-powered solutions that drive... ...preserve contextual information while ensuring compliance with data retention, privacy, and deletion policies. - Unify Fragmented Enterprise...SeniorFull timeRemote work
- Luxury Presence is building the AI growth platform for real estate. Backed by Bessemer Venture Partners and other top investors, we're a Series C company that has hit $100M in annual recurring revenue. More than 90,000 real estate professionals, including over 30% of ...SeniorFull timeRemote work
- ...SENIOR PROJECT MANAGER Full-time (40 hours per week), Remote (overlap with CET business hours required) ABOUT US At The Global Talent... ...editorial standard. The project is AI-first: research, briefs, drafts, data checks and reporting start in AI tools by default, and you are...SeniorFull timeRemote workWorldwide
$140k - $180k
...modern software, we'd love to meet you. We're looking for a senior full-stack engineer to help build the core tools that power our business-from... ...stake ~ Medical, dental, and vision insurance ~401(k) plan ~ Remote within the Americas (HQ in Redwood City, CA)...SeniorRemote jobFull timeContract work- ...the numbers. In this role you won’t be handed a finished campaign to resize. You’ll be the visual engine of the growth team, turning brand guidelines and performance data into ads, emails, and social visuals that convert and still look like a premium beauty brand. What...SeniorFull timeRemote work
- ...industry that still runs on manual work. 75% of advisors offer no digital communication beyond email, and most still build financial plans by hand in Excel. Savvy is reinventing what it looks like to be a financial advisor. Founder Ritik Malhotra saw the fragmentation...SeniorFull timeRemote work
- ...day one, not check-ins and micromanagement. That's what the AI Engineer & Support Lead role at Nortal looks like. What working with us looks... ...and public institutions run on. Today, that means using AI and data to help organizations make better decisions, not just build what...Full timeRemote work
- ...transform how digital marketing, product, and engineering teams connect. In just five years, we’ve... ...by cutting‑edge web, mobile, cloud, data, and AI technologies. If you’re excited by... ...your time on client work, acting as the senior technical and strategic lead on one or two...Full time
- ...Join Nortal for your next big adventure. We are seeking Principal FE Engineer to join our team, grow with us, and teach us a few things along the way. Why join Nortal - Say Goodbye to Micromanagement: We champion autonomy, open communication, and respect for diversity...Full timeRemote workWorldwide
- ...Nortal for your next big adventure. We are seeking Principal Backend Engineer (Java and Golang) to join our team, grow with us, and teach us a... ..., automates regulatory reporting, and supports shared identity-data and regulatory-storage services. As a Technical Referent (L4),...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Capacity Planning & Forecasting. Be the first to apply!
- senior accountant remote Latin America
- senior devops engineer remote Latin America
- srs Latin America
- senior net developer remote Latin America
- senior ux designer remote Latin America
- remote senior project manager Latin America
- remote senior salesforce administrator Latin America
- senior Latin America
- senior network engineer remote Latin America
- senior software engineer remote Latin America

