Skip to content

[Feature Request] Documentation about recommended use of .train() and .eval() #3140

@valterschutz

Description

@valterschutz

Motivation

The ClipPPOLoss documentation says "it is highly recommended to keep your model in eval mode" and there is a ConsistentDropoutModule which makes me think that having dropout in normal nn.Modules is not recommended?

I just happened to stumble across this information in the docs, it is not mentioned in any of the tutorials that I have read.

Solution

Checklist

  • I have checked that there is no similar issue in the repo (required)

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions