Join Discord
-
Creare VM in Nebius cloud Folositi link-ul de invitatie din mail-ul primit, dupa care se urmeaza pasii de mai jos:
-
Din meniul din stanga se alege
Compute > Virtual Machines -
Click pe
Create virtual machine -
Se completeaza urmatoarele: a. Project:
default-project-eu-north1b. Name: ok cel generat c. Available platform:NVIDIA H100 NVLinkd. Preset:1 GPUe. Public IP address:Auto assign dynamic IPf. Username and SSH key:+ Create.Se completeaza
Username:workshopsiPublic key:
ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBov86L2J1+2EI8dtDPlVZ8Youp4pbmupiEpO+GYSYRf densemax2@densemax2
- Instalare Surogate.
curl -sSL https://surogate.ai/install.sh | bashEvaluare model antrenat:
surogate vf-eval markdown-table-qa -m "workshop/model/" -b http://localhost:8000/v1 -n 50 --max-tokens 4096Datasets: https://huggingface.co/cetusian/datasets
nvidia-smi
source .venv/bin/activate
cd gpuX
CUDA_VISIBLE_DEVICES=X surogate sft sft.yamlsurogte grpo-infer ./infer.yaml
surogate grpo-orch ./orch.yaml
surogate grpo-train ./train.yaml