Search results

Test moe compile

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 224

#224 In pytorch-labs/gpt-fast;

· HDCharles opened on Mar 13, 2025

Adding torchao apis to gpt-fast

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 208

#208 In pytorch-labs/gpt-fast;

· HDCharles opened on Oct 17, 2024

Support generation tasks for eval.py

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 206

#206 In pytorch-labs/gpt-fast;

· mostafaelhoushi opened on Oct 4, 2024

add huggingface-hub

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 205

#205 In pytorch-labs/gpt-fast;

· kunschg opened on Oct 3, 2024

update README.md

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 204

#204 In pytorch-labs/gpt-fast;

· kunschg opened on Oct 3, 2024

feat: add Llama-3.2-[1B/3B] support

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 203

#203 In pytorch-labs/gpt-fast;

· stillmatic opened on Oct 1, 2024

Add Phi-3-mini-4k-instruct bfloat16/int8

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 195

#195 In pytorch-labs/gpt-fast;

· makaveli10 opened on Aug 20, 2024

int4 quantization cpu fix

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 193

#193 In pytorch-labs/gpt-fast;

· likholat opened on Aug 1, 2024

flex_attention ver.

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 192

#192 In pytorch-labs/gpt-fast;

· joydddd opened on Jul 30, 2024

Update sdpa function with enable_gqa=True

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 191

#191 In pytorch-labs/gpt-fast;

· jainapurva opened on Jul 13, 2024

Decouple int4 weight with serialized format

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 187

#187 In pytorch-labs/gpt-fast;

· yanbing-j opened on Jul 2, 2024

[WIP] Use DTensor-based tensor parallel

CLA SignedThis label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Status: Open (in progress).

pytorch-labs/gpt-fastnumber 180

#180 In pytorch-labs/gpt-fast;

· kwen2501 opened on Jun 12, 2024