13. PyTorch Cheatsheet

Tensors

python
x = torch.zeros(3, 3)
x = x.to("cuda")
x.requires_grad = True

python
opt.zero_grad()
loss.backward()
opt.step()

python
torch.save(model.state_dict(), "w.pt")
model.load_state_dict(torch.load("w.pt"))