Training Loop Structure ("FLOBS")

Forward Pass : model(x_train)

Loss Calculation : loss = loss_fn(y_pred, y_train)

Optimizer zero_grad : optimizer.zero_grad()

Backprop/backward : loss.backward()

Step the optimizer (gradient descent) : optimizer.step()