Zujing Liu

Zujing Liu

Wuhan University

Hi there πŸ‘‹. This is Liu Zujing(刘η₯–靖), a Master student at Captain in Wuhan University, China since 2023, advised by Prof.Gui-song Xia and Prof.Yuan Gao. I obtained my bachelor degree in Computer Science and Technology also in Wuhan University and got the Honor Degree from Hongyi Honor College.

I’m currently working on model compression and inference acceleration on LLMs and MLLMs, including:

  • πŸ”­ Structural Pruning, Knowledge Distillation and Quantization.
  • πŸ–₯️ KV Cache Optimization and Implicit Chain of Thought (CoT) Inference

πŸ’» Internships

I'm actively seeking internship and visiting opportunities πŸ₯ΊπŸ€—

πŸ”₯ News

  • 2024.06: Β πŸŽ‰πŸŽ‰ Our paper on optimization-based structural pruning is available on Arxiv, with latest update on 2024.10.
  • 2023.09: Β πŸŽ‰πŸŽ‰ Back to WHU and start to work towards a Masters Degree.
  • 2023.06: Β πŸŽ‰πŸŽ‰ Got my bachelor degree from WHU! Farewell all my friends!

πŸ“ Publications

Arxiv
sym

(🎈NEW)Bypass Back-propagation: Optimization-based Structural Pruning for Large Language Models via Policy Gradient

Yuan Gao*, Zujing Liu*, Weizhong Zhang, Bo Du, Gui-Song Xia

  • A novel optimization-based structural pruning method for LLM that optimizes directly for model loss.
  • Learning pruning mask using Bernoulli distribution via policy gradient estimator to avoid back-propagation.
  • Superior performance compared to existing techniques, with efficient computation on a single GPU.

* Equal contribution

πŸŽ– Honors and Awards

  • 2019-2023(B.Eng.) Second-Class Academic Scholarship of Wuhan University (Top 10%), Outstanding Students of Wuhan University (Top 10%)

πŸ“– Educations

  • 2023.09 - (now), M.Eng. in Computer Science, School of Computer, Wuhan University
  • 2019.09 - 2023.06, B.Eng. in Computer Science, School of Computer, Wuhan University