Hugging Face's logo
Not Lain's picture
Building on HF
246 466 590

Not Lain

not-lain
chonkie-ai
kevin25828's profile picture Miffer's profile picture roppong's profile picture
·
https://not-lain.github.io

AI & ML interests

custom AI models with HF integration, HuggingFace fellow 🤗

Recent Activity

upvoted a paper 13 days ago
ShadowPEFT: Shadow Network for Parameter-Efficient Fine-Tuning
reacted to SeanLee97's post with 🚀 13 days ago
Our lab recently released a paper where we introduce ShadowPEFT, a new Parameter-Efficient Fine-Tuning (PEFT) paradigm tailored for edge computing scenarios. Unlike traditional approaches such as LoRA and its variants, which inject trainable parameters directly into the weights of Transformer, requiring tight coupling with the backbone. ShadowPEFT instead enhances the frozen large base model by adding a lightweight, centralized, pretrainable, and detachable Shadow network. This shadow network operates in parallel with the base model, delivering learned corrections to each decoder layer. Because the shadow module is architecturally decoupled from the backbone, it can be independently trained, stored, and deployed, benefiting edge computing scenarios and edge-cloud collaboration computing. - HF Paper: https://huggingface.co/papers/2604.19254 - GitHub: https://github.com/ShadowLLM/shadow-peft - HF Collection: https://huggingface.co/collections/shadow-llm/shadow-peft-models
reacted to SeanLee97's post with 🔥 13 days ago
Our lab recently released a paper where we introduce ShadowPEFT, a new Parameter-Efficient Fine-Tuning (PEFT) paradigm tailored for edge computing scenarios. Unlike traditional approaches such as LoRA and its variants, which inject trainable parameters directly into the weights of Transformer, requiring tight coupling with the backbone. ShadowPEFT instead enhances the frozen large base model by adding a lightweight, centralized, pretrainable, and detachable Shadow network. This shadow network operates in parallel with the base model, delivering learned corrections to each decoder layer. Because the shadow module is architecturally decoupled from the backbone, it can be independently trained, stored, and deployed, benefiting edge computing scenarios and edge-cloud collaboration computing. - HF Paper: https://huggingface.co/papers/2604.19254 - GitHub: https://github.com/ShadowLLM/shadow-peft - HF Collection: https://huggingface.co/collections/shadow-llm/shadow-peft-models
View all activity

Organizations

Stanford AI's profile picture AI FILMS's profile picture OpenGVLab's profile picture MusicAI's profile picture BigScience Biomedical Datasets's profile picture OpenVINO Toolkit's profile picture Hugging Face Fellows's profile picture Gradio-Blocks-Party's profile picture scikit-learn's profile picture lora concepts library's profile picture DeepGHS's profile picture Open-Source AI Meetup's profile picture Arabic Machine Learning 's profile picture The introspector project's profile picture East China Normal University's profile picture Kornia AI's profile picture Tune a video concepts library's profile picture Keras Dreambooth Event's profile picture AI Zero to Hero's profile picture Stable Diffusion Dreambooth Concepts Library's profile picture The Waifu Research Department's profile picture AI Indonesia Community's profile picture M.O.F.U.'s profile picture ShoukanLabs's profile picture Blog-explorers's profile picture Arabic Clip's profile picture BangumiBase's profile picture CyberHarem's profile picture Touhou AI Experimental Group (MOFU)'s profile picture Tensor Diffusion's profile picture OpenOrca's profile picture huggingPartyParis's profile picture Multi🤖Transformers's profile picture Team Tonic's profile picture That Time I got Reincarnated as a Hugging Face Organization's profile picture ZeroGPU Explorers's profile picture LocalLLaMA's profile picture BrainPulse's profile picture MLX Community's profile picture INNOVA AI's profile picture Pine's profile picture Social Post Explorers's profile picture Tunisia.AI's profile picture Cohere Labs Community's profile picture M4-ai's profile picture takara.ai's profile picture Dev Mode Explorers's profile picture Chinese LLMs on Hugging Face's profile picture Paris AI Running Club's profile picture AI4Health's profile picture Stable Diffusion Community (Unofficial, Non-profit)'s profile picture Hugging Face for Legal's profile picture Hugging Face Discord Community's profile picture phxia's profile picture Arilio's profile picture Data Tonic (Alignment Lab)'s profile picture open/ acc's profile picture Data Is Better Together Contributor's profile picture Donut Earthers 🍩's profile picture Chonkie Inc.'s profile picture None yet's profile picture Hugging Face Agents Course's profile picture Bitsandbytes Community's profile picture Hugging Face Context Course's profile picture Agents-MCP-Hackathon's profile picture mermory's profile picture Hugging Science's profile picture MCP-1st-Birthday's profile picture nanochat students's profile picture Unsloth Jobs Explorers's profile picture