Senior/Lead Data Solutions Architect

Job Description

Job Description

Job Title: Hadoop Architect + Data Engineer + Capacity Analytics Architect

Location: (City, State)

Duration: Contract - 12 months

Pay Range: $73.67/hr (W2)

Job ID: 409372

About BCforward

BCforward is a leading global IT consulting and workforce solutions firm providing services and support to Fortune 500 and government clients. Founded in 1998, BCforward has grown with our customers needs into a full-service business solutions provider. With delivery centers and offices across North America and India, we take pride in building long-term relationships and delivering excellence through innovation, collaboration, and integrity.

Job Description

We are seeking a Senior Data Solutions Architect to join our dynamic Enterprise Data Platforms Advanced Analytics team. The ideal candidate will have strong experience in Hadoop architecture, enterprise data lakes, capacity and resource analytics, and API-driven ETL and a proven ability to design and deliver scalable analytics solutions that drive platform insights, automate reporting, and enable data-driven decisions .

Work Arrangement:

• Hybrid. Four days onsite and one day remote for the first six months.
• Three days onsite and two days remote after six months.

Responsibilities:

• Build analytics solutions within the Enterprise Data Warehouse and enterprise data lake to deliver capacity and resource insights.
• Develop a single source of truth for capacity, storage, compute, onboarding demand, and platform hygiene data.
• Design scalable data models and analytical datasets across Hadoop and cloud platforms.
• Automate reporting and dashboards to support leadership decision-making.
• Analyze CPU, memory, and workload utilization using YARN, Hive, and Impala metrics for resource reporting.
• Leverage HDFS CLI and FSImage analysis to assess storage and compute utilization, including Ozone and object storage platforms.
• Develop API-driven ETL pipelines using cURL, PySpark, and shell scripting with Autosys scheduling and monitoring.
• Use Cloudera Manager, Pepperdata, and/or Acceldata Pulse for platform monitoring and operational insights.
• Translate complex data into actionable insights and executive-ready narratives.
• Lead POCs for emerging technologies and recommend scalable implementation strategies.

Required Skills & Qualifications:

• Deep Hadoop architecture expertise, including HDFS, HBase, Ozone, MinIO, Hive, Impala, YARN, and Hadoop CLI.
• Proficiency with FSImage analysis and storage compute utilization assessment.
• Hands-on API programming and ETL using cURL, PySpark, Python, shell scripting, and PowerShell.
• Experience with Autosys for scheduling, monitoring, and error resolution.
• Strong data modeling, advanced query writing, and analytical dataset development skills.
• Experience with Cloudera data services, Cloudera Manager, Pepperdata, and/or Acceldata Pulse.
• Familiarity with object storage and S3-compatible platforms, bucket-based storage models, and cloud storage concepts.
• Proficiency in Excel automation using VBA, Power Query, and scripting; familiarity with Tableau and Power BI.
• RDBMS experience, including Teradata and PostgreSQL.
• Demonstrated ability to operate independently with ownership, attention to detail, and a continuous improvement mindset.

Preferred Skills:

• Experience with Prometheus and Grafana for advanced platform visibility and trend analysis.
• Experience in cloud or hybrid data ecosystems and compute analytics.

Why BCforward?

At BCforward, we believe in advancing lives and careers. When you join our team, you gain access to:

• Competitive compensation and benefits.
• Opportunities for growth with global clients.
• A supportive, inclusive culture that values innovation and people.
• Exposure to cutting-edge technologies and projects.

About Our Commitment

BCforward is an equal opportunity employer. We value diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, or veteran status.

Interested? Apply Now!

If this sounds like the right opportunity for you, please apply with your most recent resume.