-
Notifications
You must be signed in to change notification settings - Fork 154
Description
Epoch: [0] [ 0/14763] eta: 11:08:15 lr: 0.000000 loss: 73.4651 (73.4651) loss_bbox: 1.6559 (1.6559) loss_bbox_aux_0: 1.6158 (1.6158) loss_bbox_aux_1: 1.6716 (1.6716) loss_bbox_aux_2: 1.6248 (1.6248) loss_bbox_aux_3: 1.6560 (1.6560) loss_bbox_aux_4: 1.6559 (1.6559) loss_bbox_dn_0: 1.6234 (1.6234) loss_bbox_dn_1: 0.9902 (0.9902) loss_bbox_dn_2: 0.8882 (0.8882) loss_bbox_dn_3: 0.8902 (0.8902) loss_bbox_dn_4: 0.8986 (0.8986) loss_bbox_dn_5: 0.8986 (0.8986) loss_bbox_dn_pre: 1.2700 (1.2700) loss_bbox_enc_0: 1.9295 (1.9295) loss_bbox_pre: 1.6714 (1.6714) loss_ddf_aux_0: 0.0805 (0.0805) loss_ddf_aux_1: 0.0165 (0.0165) loss_ddf_aux_2: 0.0039 (0.0039) loss_ddf_aux_3: 0.0002 (0.0002) loss_ddf_aux_4: 0.0001 (0.0001) loss_ddf_dn_0: 0.1616 (0.1616) loss_ddf_dn_1: 0.0327 (0.0327) loss_ddf_dn_2: 0.0080 (0.0080) loss_ddf_dn_3: 0.0010 (0.0010) loss_ddf_dn_4: 0.0000 (0.0000) loss_fgl: 0.3053 (0.3053) loss_fgl_aux_0: 0.3500 (0.3500) loss_fgl_aux_1: 0.3017 (0.3017) loss_fgl_aux_2: 0.3088 (0.3088) loss_fgl_aux_3: 0.3053 (0.3053) loss_fgl_aux_4: 0.3053 (0.3053) loss_fgl_dn_0: 0.9538 (0.9538) loss_fgl_dn_1: 0.8840 (0.8840) loss_fgl_dn_2: 0.8864 (0.8864) loss_fgl_dn_3: 0.8845 (0.8845) loss_fgl_dn_4: 0.8852 (0.8852) loss_fgl_dn_5: 0.8852 (0.8852) loss_giou: 2.2363 (2.2363) loss_giou_aux_0: 2.2571 (2.2571) loss_giou_aux_1: 2.2521 (2.2521) loss_giou_aux_2: 2.2191 (2.2191) loss_giou_aux_3: 2.2383 (2.2383) loss_giou_aux_4: 2.2363 (2.2363) loss_giou_dn_0: 1.3319 (1.3319) loss_giou_dn_1: 1.1601 (1.1601) loss_giou_dn_2: 1.1076 (1.1076) loss_giou_dn_3: 1.1141 (1.1141) loss_giou_dn_4: 1.1100 (1.1100) loss_giou_dn_5: 1.1100 (1.1100) loss_giou_dn_pre: 1.2972 (1.2972) loss_giou_enc_0: 2.3951 (2.3951) loss_giou_pre: 2.3251 (2.3251) loss_mal: 0.8417 (0.8417) loss_mal_aux_0: 0.7662 (0.7662) loss_mal_aux_1: 0.9157 (0.9157) loss_mal_aux_2: 0.8898 (0.8898) loss_mal_aux_3: 0.9062 (0.9062) loss_mal_aux_4: 0.8566 (0.8566) loss_mal_dn_0: 1.2827 (1.2827) loss_mal_dn_1: 1.8120 (1.8120) loss_mal_dn_2: 1.9116 (1.9116) loss_mal_dn_3: 1.9551 (1.9551) loss_mal_dn_4: 1.8213 (1.8213) loss_mal_dn_5: 1.7617 (1.7617) loss_mal_dn_pre: 1.3267 (1.3267) loss_mal_enc_0: 0.7215 (0.7215) loss_mal_pre: 0.8059 (0.8059) time: 2.7159 data: 0.5989 max mem: 5196
../aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [14,0,0], thread: [0,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed.
../aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [14,0,0], thread: [8,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed.
../aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [14,0,0], thread: [16,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed.
../aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [14,0,0], thread: [24,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed.
../aten/src/ATen/native/cuda/IndexKernel.cu:92: operator(): block: [8,0,0], thread: [96,0,0] Assertion -sizes[i] <= index && index < sizes[i] && "index out of bounds" failed.
能否给与一些帮助?排查过标签问题