II

HPC Engineer --AI Workloads & Infrastructure (Remote)

iVedha Inc.linkedin.com
Oct 20, 2026, 12:50 AM1w ago
Full-timeRemote (Canada) · RemoteMid level (4+ yrs)

About the role

iVedha is seeking an HPC Engineer to join their operational team focused on supporting AI workloads in a high-performance computing environment. The role involves building and managing HPC compute nodes, deploying Kubernetes clusters, and orchestrating both bare-metal and virtualized environments. The engineer will also work with advanced storage technologies and ensure integration with GPU-accelerated infrastructure. Key responsibilities include managing Linux systems, container orchestration, networking, automation, and workload optimization within HPC environments. iVedha is a leading provider of cloud and managed services, supporting enterprises in modernizing IT infrastructure and accelerating digital transformation, with a focus on secure and scalable compute platforms for AI, ML, and scientific workloads.

Must have

  • 4+ years in HPC engineering, systems administration, or AI infrastructure roles.
  • Strong experience with Linux (RHEL/CentOS/Ubuntu) in HPC environments.
  • Hands-on experience with Kubernetes, Docker, and container orchestration for AI workloads.
  • Familiarity with GPU clusters, CUDA, NCCL and NVIDIA ecosystem tools.
  • Knowledge of high-speed interconnects (InfiniBand, RoCE) and networking for HPC.
  • Experience with parallel/distributed file systems (VAST, MooseFS, Lustre, GPFS).
  • Proficiency in automation and scripting (Python, Bash, Ansible).
  • Understanding of job schedulers (Slurm, PBS, Torque) and workload optimization.

Nice to have

  • Experience with cloud HPC platforms (Azure HPC, AWS ParallelCluster, or similar).
  • Familiarity with AI/ML frameworks (PyTorch, TensorFlow) and MLOps pipelines.
  • Exposure to observability tools (Prometheus, Grafana) for HPC environments.

Technologies

  • Ansible
  • AWS
  • Azure
  • Bash
  • CUDA
  • Docker
  • Grafana
  • HPC
  • Kubernetes
  • Linux
  • Machine Learning
  • MLOps
  • Observability
  • Prometheus
  • Python
  • PyTorch
  • RHEL
  • TensorFlow
  • Ubuntu

Highlights

This is a remote position. The company is based in Canada and is building next-generation sovereign AI infrastructure. No specific application deadline or method is mentioned.