Skip to content

Shared local and global parameters #31

@mfl22

Description

@mfl22

Shouldn't parameters of local and global networks be synchronized:

self.lnet = Net(N_S, N_A) # local network

lnet and gnet are not initialized with the same parameters here ? Probably lnet.load_state_dict(gnet.state_dict()) is missing.

For example, see implementation in https://github.com/ikostrikov/pytorch-a3c/blob/48d95844755e2c3e2c7e48bbd1a7141f7212b63f/train.py#L37.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions