Hands-on GPU/HPC infrastructure operations: K8s GPU scheduling, HAMi sharing, Slurm, observability & vLLM inference. Learn it free on a laptop; validate on one cheap GPU.

Docker GPU 算力资源管理平台

Doctor consultation app designed using flutter.

A science inference cluster — every model, from protein folding to LLMs, behind one OpenAI/Anthropic-compatible endpoint and a single key. Built to run beside HPC so agentic AI researchers can drive simulations and model inference together. Self-deploying on RKE2 with KServe/Knative + HAMi GPU.

Simulate Moore Threads MUSA and NVIDIA CUDA GPUs in Kubernetes — fake MUSA/MTML/CUDA/NVML user-space libs, mthreads-gmi/nvidia-smi tools, and a device-plugin for HAMi-style scheduling without physical GPUs.

HAMi GPU virtualization demo on GKE: vLLM + YOLOv8 multi-workload inference with fractional A100 sharing, Terraform IaC