change order of itm loss init

[ankitade]

Stack from ghstack (oldest at bottom):

• [FLAVA]Separate the pretraining loss from the pretraininig model #278
• [FLAVA] Move masked prediction head to flava_for_pretraining #195
• [FLAVA]Move itm head to flava model for pretraining #132
• -> change order of itm loss init #131

Differential Revision: D38097200

[codecov-commenter]

Codecov Report

❗ No coverage uploaded for pull request base (gh/ankitade/8/base@59fa8fa). Click here to learn what that means.
The diff coverage is n/a.

@@                  Coverage Diff                  @@
##             gh/ankitade/8/base     #131   +/-   ##
=====================================================
  Coverage                      ?   93.04%           
=====================================================
  Files                         ?       47           
  Lines                         ?     2776           
  Branches                      ?        0           
=====================================================
  Hits                          ?     2583           
  Misses                        ?      193           
  Partials                      ?        0           

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 59fa8fa...73ddaa4. Read the comment docs.

[ankitade]

@ankitade has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[ankitade]

@ankitade has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[ankitade]

@ankitade has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[ankitade]

@ankitade has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.