Skip to content

Commit 3bd4c8d

Browse files
committed
⬆️ Update version
1 parent 0688cc6 commit 3bd4c8d

File tree

3 files changed

+23
-23
lines changed

3 files changed

+23
-23
lines changed

README.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -69,7 +69,7 @@ model = M(depth=5, dim=40).train() # on CPU
6969
l2l_model = Layer2Layer(
7070
model,
7171
layers_attr="layers", # attribute with ModuleList
72-
microbatch_size=100, # size of microbatch in minibatch :) from original paper
72+
microbatch_size=100, # size of a microbatch in a minibatch :) from original paper
7373
verbose=False # enable tqdm
7474
)
7575
```
@@ -83,9 +83,9 @@ x = torch.rand(1_000, 40) # on CPU
8383
y = torch.rand(1_000, 40) # on CPU
8484

8585
losses = []
86-
loss_fn = nn.MSELoss(reduction="sum") # since L2L calcs average loses itself, we just need to save them
86+
loss_fn = nn.MSELoss(reduction="sum") # since L2L calcs average losses itself, we just need to save them
8787

88-
optimizer = optim.AdamW(l2l_model.main_model.parameters(), lr=0.001) # optimizer looks to main model on CPu
88+
optimizer = optim.AdamW(l2l_model.main_model.parameters(), lr=0.001) # optimizer works with the main model on CPU
8989

9090
for i in trange(5000):
9191
l2l_model.zero_grad()

poetry.lock

+19-19
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

pyproject.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ build-backend = "poetry.masonry.api"
66

77
[tool.poetry]
88
name = "layer-to-layer-pytorch"
9-
version = "0.1.0"
9+
version = "0.1.1"
1010
description = "PyTorch implementation of L2L execution algorithm"
1111
readme = "README.md"
1212
authors = [

0 commit comments

Comments
 (0)