Hi there π. This is Liu Zujing(εη₯ι), a Master student at Captain in Wuhan University, China since 2023, advised by Prof.Gui-song Xia and Prof.Yuan Gao. I obtained my bachelor degree in Computer Science and Technology also in Wuhan University and got the honor degree from Hongyi Honor College.
Iβm currently working on model compression and acceleration, including:
- π Pruning Language Model and Multi-modality Model.
- π₯οΈ Inference acceleration of LLMs and MLLMs.
π₯ News
- 2023.09: Β ππ Back to WHU and start to work towards a Masters Degree.
- 2023.06: Β ππ Got my bachelor degree from WHU! Farewell all my friends!
π Publications
Arxiv
(πNEW)Optimization-based Structural Pruning for Large Language Models without Back-Propagation
Yuan Gao, Zujing Liu, Weizhong Zhang, Bo Du, Gui-Song Xia
- A novel optimization-based structural pruning method for LLM that optimizes directly for model loss.
- Learning pruning mask using Bernoulli distribution via policy gradient estimator to avoid back-propagation.
- Superior performance compared to existing techniques, with efficient computation on a single GPU.
π Honors and Awards
- 2019-2023(B.Eng.) Second-Class Academic Scholarship of Wuhan University (2021), National Endeavor Scholarship, Outstanding Students of Wuhan University (2021)
π Educations
- 2023.06 - (now), M.Eng. in Computer Science, School of Computer, Wuhan University
- 2019.09 - 2023.06, B.Eng. in Computer Science, School of Computer, Wuhan University
π» Internships
Iβm actively seeking internship and visiting opportunities π₯Ίπ€