Fix mqa parallelization#51

thomasw21 wants to merge 3 commits intomulti-query-attentionbigcode-project/Megatron-LM:multi-query-attentionfrom

thomas/fix_mqa_parallelizationbigcode-project/Megatron-LM:thomas/fix_mqa_parallelizationCopy head branch name to clipboard