@@ -100,28 +100,28 @@ For now we are using GPT-2 (AutoModelForCausalLM) or distilbert-base-uncased (Au
100100The goal is to generate text.
101101
102102``` bash
103- $ vulntrain-train-description-generation --base-model gpt2 --dataset-id CIRCL/vulnerability --repo-id CIRCL/vulnerability-description-generation-gpt2
103+ $ vulntrain-train-description-generation --base-model gpt2-xl --dataset-id CIRCL/vulnerability-scores --repo-id CIRCL/vulnerability-description-generation-gpt2-xl
104+ Dataset ID: CIRCL/vulnerability-scores
105+ Destination Hugging Face repository ID: CIRCL/vulnerability-description-generation-gpt2-xl
106+ Model will be saved to: results
107+ Starting the training process…
108+ [codecarbon WARNING @ 08:17:38] Multiple instances of codecarbon are allowed to run at the same time.
109+ [codecarbon INFO @ 08:17:38] [setup] RAM Tracking...
110+ [codecarbon INFO @ 08:17:38] [setup] CPU Tracking...
111+ [codecarbon INFO @ 08:17:40] CPU Model on constant consumption mode: Intel(R) Xeon(R) Platinum 8480+
112+ [codecarbon INFO @ 08:17:40] [setup] GPU Tracking...
113+ [codecarbon INFO @ 08:17:40] Tracking Nvidia GPU via pynvml
114+ [codecarbon INFO @ 08:17:40] >>> Tracker' s metadata:
115+ [codecarbon INFO @ 08:17:40] Platform system: Linux-6.8.0-88-generic-x86_64-with-glibc2.39
116+ [codecarbon INFO @ 08:17:40] Python version: 3.12.3
117+ [codecarbon INFO @ 08:17:40] CodeCarbon version: 2.8.4
118+ [codecarbon INFO @ 08:17:40] Available RAM : 2015.335 GB
119+ [codecarbon INFO @ 08:17:40] CPU count: 224
120+ [codecarbon INFO @ 08:17:40] CPU model: Intel(R) Xeon(R) Platinum 8480+
121+ [codecarbon INFO @ 08:17:40] GPU count: 2
122+ [codecarbon INFO @ 08:17:40] GPU model: 2 x NVIDIA H100 NVL
123+ [codecarbon INFO @ 08:17:40] Emissions data (if any) will be saved to file /home/cedric/VulnTrain/emissions.csv
104124Using CUDA (Nvidia GPU).
105- [codecarbon WARNING @ 13:28:13] Multiple instances of codecarbon are allowed to run at the same time.
106- [codecarbon INFO @ 13:28:13] [setup] RAM Tracking...
107- [codecarbon INFO @ 13:28:13] [setup] CPU Tracking...
108- [codecarbon WARNING @ 13:28:13] No CPU tracking mode found. Falling back on CPU constant mode.
109- Linux OS detected: Please ensure RAPL files exist at \s ys\c lass\p owercap\i ntel-rapl to measure CPU
110-
111- [codecarbon WARNING @ 13:28:14] We saw that you have a AMD EPYC 9124 16-Core Processor but we don' t know it. Please contact us.
112- [codecarbon INFO @ 13:28:14] CPU Model on constant consumption mode: AMD EPYC 9124 16-Core Processor
113- [codecarbon INFO @ 13:28:14] [setup] GPU Tracking...
114- [codecarbon INFO @ 13:28:14] Tracking Nvidia GPU via pynvml
115- [codecarbon INFO @ 13:28:14] >>> Tracker' s metadata:
116- [codecarbon INFO @ 13:28:14] Platform system: Linux-6.8.0-48-generic-x86_64-with-glibc2.39
117- [codecarbon INFO @ 13:28:14] Python version: 3.12.3
118- [codecarbon INFO @ 13:28:14] CodeCarbon version: 2.8.3
119- [codecarbon INFO @ 13:28:14] Available RAM : 251.586 GB
120- [codecarbon INFO @ 13:28:14] CPU count: 64
121- [codecarbon INFO @ 13:28:14] CPU model: AMD EPYC 9124 16-Core Processor
122- [codecarbon INFO @ 13:28:14] GPU count: 2
123- [codecarbon INFO @ 13:28:14] GPU model: 2 x NVIDIA L40S
124- [codecarbon INFO @ 13:28:18] Saving emissions data to file /home/cedric/VulnTrain/emissions.csv | 1/2700 [00:07< 5:45:36, 7.68s/it]
125125...
126126...
127127...
0 commit comments