Skip to content

About the parameters of drop_path_rate #12

@go-ahead-maker

Description

@go-ahead-maker

@youngwanLEE Hi, I have a question about the drop_path_rate used for small and base models:
When I provide the parameter of drop_path, e.g., 0.1, and run the code from your repo, I received a warning from the FVCore library:

"The following submodules of the model were never called during the trace of the graph. They may be unused, or they were accessed by direct calls to .forward() or via other python methods. In the latter case they will have zeros for statistics, though their statistics will still contribute to their parent calling module.
mhca_stages.1.mhca_blks.0.MHCA_layers.0.drop_path ....."

Does this indicate that drop_path is not being used?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions