Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

LLM-Drop

university
https://github.com/CASE-Lab-UMD/LLM-Drop
Shwai-He
Activity Feed

AI & ML interests

Efficient and adaptive foundation models across language and multimodal intelligence.

Recent Activity

shwai-heĀ  updated a Space 1 day ago
LLM-Drop/README
shwai-heĀ  updated a collection 28 days ago
LLM-Drop
s1ghhhĀ  submitted a paper 28 days ago
Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?
View all activity

Papers

Drop-Then-Recovery: How Redundant Are Vision-Language-Action Models?

Demystifying When Pruning Works via Representation Hierarchies

View all Papers

Guoheng Sun's profile pictureShwai He's profile picture

LLM-Drop 's collections 1

LLM-Drop
Model weights of paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".
  • s1ghhh/Llama-3-70b-Drop

    Text Generation • 71B • Updated Oct 23, 2024 • 7 • 4
  • s1ghhh/Llama-2-70b-Drop

    Text Generation • Updated Oct 23, 2024 • 4 • 2
  • s1ghhh/Llama-2-13b-Drop8Attn

    13B • Updated Sep 8, 2024 • 3 • 2
  • s1ghhh/Llama-2-13b-Drop4Attn

    13B • Updated Sep 8, 2024 • 3 • 2
LLM-Drop
Model weights of paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".
  • s1ghhh/Llama-3-70b-Drop

    Text Generation • 71B • Updated Oct 23, 2024 • 7 • 4
  • s1ghhh/Llama-2-70b-Drop

    Text Generation • Updated Oct 23, 2024 • 4 • 2
  • s1ghhh/Llama-2-13b-Drop8Attn

    13B • Updated Sep 8, 2024 • 3 • 2
  • s1ghhh/Llama-2-13b-Drop4Attn

    13B • Updated Sep 8, 2024 • 3 • 2
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs