White RoomNEW

What moments does Adam estimate?

What does the Adam optimizer maintain for each parameter?