Typo in Lab 3

[OptimistiCompound]

In lab 3 Question 3.2: Patchifier, the output of the patchifier is suppose to be b (h / p * w / p) d right? I got confused by h/w in the following steps.

Here is the question section 3.2 for your review:

Question 3.2: Patchifier

The patchifier takes in an image-valued tensor of shape b 1 32 32, and patchifies it to shape b (h / p * w / p) d, where d denotes the diffusion transformer hidden dimension, p denotes the patch size, and h and w denote the image height and width, respectively. It does this in two steps:

1. Applies a convolutional layer mapping the an input of shape b 1 32 32 to b d h/p h/w.
2. Rearranges from b d h/p h/w to b (h/p h/w) d (i.e., n = h/p * h/w tokens with dimension d).