We could just delete this assertion. Or we could just set the model to eval mode. Contrary to the name, it has nothing to do with whether the model is trainable or not. Eval mode just turns off train time behavior. Historically, this meant no dropout and using stored batch norm statistics rather than per-batch statistics. With modern LLM’s, this means, well, nothing—there typically are no train time specific behaviors. requires_grad controls whether gradients are tracked and only the parameters passed to the optimizer are updated.
Виктория Кондратьева (Редактор отдела «Мир»)
，详情可参考新收录的资料
How Does WIRED Test Mattresses for Back Pain?
Robbie Williams