Skip to content
View jt-zhang's full-sized avatar
198 followers · 64 following

Achievements

Achievement: Pull SharkAchievement: Starstruckx3Achievement: QuickdrawAchievement: Arctic Code Vault Contributor

Achievements

Achievement: Pull SharkAchievement: Starstruckx3Achievement: QuickdrawAchievement: Arctic Code Vault Contributor

Highlights

  • Pro

Organizations

@thu-ml

Block or report jt-zhang

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
jt-zhang/README.md

Hi 😊

I am a first-year PhD student in the CS Dept. at Tsinghua University, focusing on efficient training and inference of large models.

  • WeChat WeChat ID : Zjt_Tete

Pinned Loading

  1. thu-ml/SageAttention thu-ml/SageAttention Public

    Quantized Attention achieves speedup of 2-5x and 3-11x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.

    Cuda 2.3k 206

  2. thu-ml/SpargeAttn thu-ml/SpargeAttn Public

    SpargeAttention: A training-free sparse attention that can accelerate any model inference.

    Cuda 696 55

  3. CardinalityEstimationTestbed CardinalityEstimationTestbed Public

    CardinalityEstimationTestbed

    Python 47 14

  4. Sparse_SageAttention_API Sparse_SageAttention_API Public

    Python 51 6

  5. attention-survey/Efficient_Attention_Survey attention-survey/Efficient_Attention_Survey Public

    A Survey of Efficient Attention Methods: Hardware-efficient, Sparse, Compact, and Linear Attention

    170 4