# Codeblock 9 Output==========================================================================================Layer (type:depth-idx) Output Shape Param #==========================================================================================DeiT [1, 1000] 445,440├─Patcher: 1-1 [1, 576, 768] --│ └─Conv2d: 2-1 [1, 768, 24, 24] 590,592│ └─Flatten: 2-2 [1, 768, 576] --├─ModuleList: 1-2 -- --│ └─Encoder: 2-3 [1, 578, 768] --│ │ └─LayerNorm: 3-1 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-2 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-3 [1, 578, 768] 1,536│ │ └─Sequential: 3-4 [1, 578, 768] 4,722,432│ └─Encoder: 2-4 [1, 578, 768] --│ │ └─LayerNorm: 3-5 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-6 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-7 [1, 578, 768] 1,536│ │ └─Sequential: 3-8 [1, 578, 768] 4,722,432│ └─Encoder: 2-5 [1, 578, 768] --│ │ └─LayerNorm: 3-9 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-10 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-11 [1, 578, 768] 1,536│ │ └─Sequential: 3-12 [1, 578, 768] 4,722,432│ └─Encoder: 2-6 [1, 578, 768] --│ │ └─LayerNorm: 3-13 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-14 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-15 [1, 578, 768] 1,536│ │ └─Sequential: 3-16 [1, 578, 768] 4,722,432│ └─Encoder: 2-7 [1, 578, 768] --│ │ └─LayerNorm: 3-17 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-18 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-19 [1, 578, 768] 1,536│ │ └─Sequential: 3-20 [1, 578, 768] 4,722,432│ └─Encoder: 2-8 [1, 578, 768] --│ │ └─LayerNorm: 3-21 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-22 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-23 [1, 578, 768] 1,536│ │ └─Sequential: 3-24 [1, 578, 768] 4,722,432│ └─Encoder: 2-9 [1, 578, 768] --│ │ └─LayerNorm: 3-25 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-26 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-27 [1, 578, 768] 1,536│ │ └─Sequential: 3-28 [1, 578, 768] 4,722,432│ └─Encoder: 2-10 [1, 578, 768] --│ │ └─LayerNorm: 3-29 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-30 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-31 [1, 578, 768] 1,536│ │ └─Sequential: 3-32 [1, 578, 768] 4,722,432│ └─Encoder: 2-11 [1, 578, 768] --│ │ └─LayerNorm: 3-33 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-34 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-35 [1, 578, 768] 1,536│ │ └─Sequential: 3-36 [1, 578, 768] 4,722,432│ └─Encoder: 2-12 [1, 578, 768] --│ │ └─LayerNorm: 3-37 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-38 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-39 [1, 578, 768] 1,536│ │ └─Sequential: 3-40 [1, 578, 768] 4,722,432│ └─Encoder: 2-13 [1, 578, 768] --│ │ └─LayerNorm: 3-41 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-42 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-43 [1, 578, 768] 1,536│ │ └─Sequential: 3-44 [1, 578, 768] 4,722,432│ └─Encoder: 2-14 [1, 578, 768] --│ │ └─LayerNorm: 3-45 [1, 578, 768] 1,536│ │ └─MultiheadAttention: 3-46 [1, 578, 768] 2,362,368│ │ └─LayerNorm: 3-47 [1, 578, 768] 1,536│ │ └─Sequential: 3-48 [1, 578, 768] 4,722,432├─LayerNorm: 1-3 [1, 578, 768] 1,536├─Linear: 1-4 [1, 1000] 769,000├─Linear: 1-5 [1, 1000] 769,000==========================================================================================Total params: 87,630,032Trainable params: 87,630,032Non-trainable params: 0Total mult-adds (Units.MEGABYTES): 398.43==========================================================================================Input size (MB): 1.77Forward/backward pass size (MB): 305.41Params size (MB): 235.34Estimated Total Size (MB): 542.52==========================================================================================