Skip to content

[LLM Tutorial] Restructure codes #3850

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 9 commits into
base: main
Choose a base branch
from
Draft

[LLM Tutorial] Restructure codes #3850

Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
ad3aa6c
restructure custom code
holgerroth Nov 19, 2025
15b19da
use job.py
holgerroth Nov 19, 2025
2dd770f
Apply suggestion from @greptile-apps[bot]
holgerroth Nov 19, 2025
4773852
Apply suggestion from @greptile-apps[bot]
holgerroth Nov 19, 2025
5cf73c2
update notebooks
holgerroth Nov 19, 2025
f5b4afd
fix script path
holgerroth Nov 19, 2025
600a775
Merge branch 'llm_tutorial_update' of github.com:holgerroth/NVFlare i…
holgerroth Nov 19, 2025
6ec7706
fix wrong files
holgerroth Nov 19, 2025
989f7a2
update bert example
holgerroth Nov 19, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
0 ...aining/08.2_llm_sft/src/hf_sft_peft_fl.py → ...rated_LLM_training/08.2_llm_sft/client.py
View file
Open in desktop
File renamed without changes.
0 ...training/08.2_llm_sft/src/hf_sft_model.py → ...LLM_training/08.2_llm_sft/hf_sft_model.py
View file
Open in desktop
File renamed without changes.
6 changes: 3 additions & 3 deletions ...ated_LLM_training/08.2_llm_sft/sft_job.py → ...ederated_LLM_training/08.2_llm_sft/job.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@

def main():
args = define_parser()
train_script = "src/hf_sft_peft_fl.py"
train_script = "client.py"
client_ids = args.client_ids
num_clients = len(client_ids)

Expand Down Expand Up @@ -74,9 +74,9 @@ def main():

# Define the model persistor and send to server
# First send the model to the server
job.to("src/hf_sft_model.py", "server")
job.to("hf_sft_model.py", "server")
# Then send the model persistor to the server
model_args = {"path": "src.hf_sft_model.CausalLMModel", "args": {"model_name_or_path": model_name_or_path}}
model_args = {"path": "hf_sft_model.CausalLMModel", "args": {"model_name_or_path": model_name_or_path}}
job.to(PTFileModelPersistor(model=model_args), "server", id="persistor")

# Add model selection widget and send to server
Expand Down
0 ...ining/08.3_llm_peft/src/hf_sft_peft_fl.py → ...ated_LLM_training/08.3_llm_peft/client.py
View file
Open in desktop
File renamed without changes.
0 ...aining/08.3_llm_peft/src/hf_peft_model.py → ...M_training/08.3_llm_peft/hf_peft_model.py
View file
Open in desktop
File renamed without changes.
6 changes: 3 additions & 3 deletions ...ed_LLM_training/08.3_llm_peft/peft_job.py → ...derated_LLM_training/08.3_llm_peft/job.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@

def main():
args = define_parser()
train_script = "src/hf_sft_peft_fl.py"
train_script = "client.py"
client_ids = args.client_ids
num_clients = len(client_ids)

Expand Down Expand Up @@ -74,9 +74,9 @@ def main():

# Define the model persistor and send to server
# First send the model to the server
job.to("src/hf_peft_model.py", "server")
job.to("hf_peft_model.py", "server")
# Then send the model persistor to the server
model_args = {"path": "src.hf_peft_model.CausalLMPEFTModel", "args": {"model_name_or_path": model_name_or_path}}
model_args = {"path": "hf_peft_model.CausalLMPEFTModel", "args": {"model_name_or_path": model_name_or_path}}
job.to(PTFileModelPersistor(model=model_args), "server", id="persistor")

# Add model selection widget and send to server
Expand Down
0 ...08.4_llm_quantization/src/hf_sft_model.py → ...ing/08.4_llm_quantization/hf_sft_model.py
View file
Open in desktop
File renamed without changes.
0 ....4_llm_quantization/src/hf_sft_peft_fl.py → ...g/08.4_llm_quantization/hf_sft_peft_fl.py
View file
Open in desktop
File renamed without changes.
0 ...training/08.4_llm_quantization/sft_job.py → ...LLM_training/08.4_llm_quantization/job.py
View file
Open in desktop
File renamed without changes.
0 ...ining/08.5_llm_streaming/streaming_job.py → ...ed_LLM_training/08.5_llm_streaming/job.py
View file
Open in desktop
File renamed without changes.
0 ...llm_streaming/src/streaming_controller.py → ...8.5_llm_streaming/streaming_controller.py
View file
Open in desktop
File renamed without changes.
0 ...5_llm_streaming/src/streaming_executor.py → .../08.5_llm_streaming/streaming_executor.py
View file
Open in desktop
File renamed without changes.
Loading