AI Infrastructure & Linux Systems Engineer

Job Requirements

• 10+ years of professional expertise in Ubuntu Linux systems administration and enterprise OS hardening.

• Proficiency in NVIDIA GPU hardware integration and managing specialized AI software compute stacks.

• Experience with open-source model-serving frameworks including Ollama, vLLM, SGLang, and Open WebUI.

• Experience in Docker-based containerization and deploying applications in production Linux environments.

• Experience with Tailscale for secure remote networking and complex SSH configuration management.

• Experience in Bash scripting and command-line automation to optimize infrastructure performance and tasks.

• Exceptional verbal communication skills for leading technical workshops and real-time customer demonstrations.

Job Responsibilities

• Lead the deployment and maintenance of hardened Ubuntu Linux environments for distributed AI projects.

• Architect and optimize local AI clusters utilizing NVIDIA GPU hardware and associated compute drivers.

• Implement open-source serving platforms like vLLM and SGLang to facilitate Large Language Model inference.

• Design containerized application architectures using Docker for scalable and portable AI infrastructure.

• Configure Tailscale networking solutions to ensure secure and resilient remote access to critical AI nodes.

• Execute system performance tuning and hardware troubleshooting to minimize downtime in high-compute environments.

• Author technical documentation for deployment procedures and configuration standards for diverse stakeholders.

Founded in 1999, Resourcesoft, Inc. is a leading Technology Consulting and Professional Services organization. Headquartered in Marlborough, MA, the company serves the technology needs of its clients nationwide. Resourcesoft has often been recognized by prominent rating agencies for its exemplary growth and stability. With over two decades of industry experience, the Company has evolved as a front runner in enabling project optimization. We partner with leading organizations to provide technology solutions within the financial, insurance, education, government, publishing, healthcare and pharmaceutical domains. We take pride in mentoring a workforce that is well positioned to respond to the emerging IT trends and needs. With the employees at the crux of every business endeavor, our success is driven by our expertise in pairing the right talent with the best jobs in the technology sector. We forge long term, personalized relationships with our employees to advance their career to the next level. We engage them in technology centric client projects that provide opportunities for them to evolve, innovate and deliver world class products and services. Our career opportunities offer challenging assignments and exposure to emerging and cutting edge technologies. We are committed to providing our employees with the tools necessary to accelerate their career progression, while maintaining a healthy, work-life balance. We are deeply committed to providing a workplace ambience that is both challenging and fulfilling.

Resourcesoft is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.

For more information about Resourcesoft and our services, please visit our website.