About Me

I am a Second-year Ph.D. student in the Department of Computer Science and Engineering (CSE) at The Chinese University of Hong Kong (CUHK), under the supervision of Prof. John C.S. Lui (ACM/IEEE fellow). Before this, I earned my Master's degree and B.Eng. from the School of Cyber Science and Engineering (CSE) at Wuhan University (WHU), where I was mentored by Prof. Ruiting Zhou.

My previous research focused on edge intelligence, particularly on optimizing model training and inference and GPU resource sharing through online learning methods. Currently, my research interests lie in online algorithms, learning-augmented algorithms, and AI systems optimization. I focus on designing efficient online decision-making algorithms with theoretical guarantees, particularly for resource management and optimization in LLM-based systems. I am also interested in leveraging machine learning and LLM-based predictions to improve online algorithms, as well as exploring their applications to LLM-based systems and agents. Please feel free to contact me.

---

Publications

(* Corresponding Author)

• [NeurIPS ’26] HiLoRA: Adaptive Hierarchical LoRA Routing for Training-Free Domain Generalization
  Ziyi Han, Huanyu Wang, Zeyu Zhang, Xiangxiang Dai, Xutong Liu, John C.S. Lui.
  Accepted by The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS), 2026.
• [NeurIPS ’26] Steering Frozen LLMs: Adaptive Social Alignment via Online Prompt Routing
  Zeyu Zhang, Xiangxiang Dai, Ziyi Han, Xutong Liu, John C.S. Lui.
  Accepted by The Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS), 2026.
• [LATA ’26] Confidence-Aware Learning-Augmented Algorithms for the Bahncard Problem
  Ziyi Han, Bo Sun, Xuchuang Wang, Mohammad Hajiesmai, John C.S. Lui.
  Workshop on Learning-augmented Algorithms: Theory and Applications – 2026 – SIGMETRICS 2026
• [TMC ’26] Online Outcome-Driven Configuration Selection with Adaptive Grouping for Live Video Streams
  Xiangxiang Dai, Zeyu Zhang, Ziyi Han, Xutong Liu, Peng Yang, John C.S. Lui.
  IEEE Transactions on Mobile Computing (TMC), 2026.
• [INFOCOM ’26] Faster, Smaller, and Smarter: Task-Aware Expert Merging for Online MoE Inference
  Ziyi Han, Xutong Liu, Ruiting Zhou, Xiangxiang Dai, John C.S. Lui.
  IEEE International Conference on Computer Communications (INFOCOM), 2026
• [ToN ’25] Online Scheduling with Trajectory Prediction for Collaborative DNN Inference in Vehicular Networks
  Ziyi Han, Ruiting Zhou, Haisheng Tan, John C.S. Lui.
  IEEE Transactions on Networking (ToN), 2025.
• [TPDS ’24] InSS: An Intelligent Scheduling Orchestrator for Multi-GPU Inference with Spatio-Temporal Sharing
  Ziyi Han, Ruiting Zhou, Chengzhong Xu, Yifan Zeng, and Renli Zhang.
  IEEE Transactions on Parallel and Distributed Systems (TPDS), 2024.
• [CSCWD ’24] SAFE: Intelligent Online Scheduling for Collaborative DNN Inference in Vehicular Network
  Ruiting Zhou, Ziyi Han*, Yifan Zeng, Zhi Zhou, Libing Wu, Wei Wang.
  IEEE 27th International Conference on Computer Supported Cooperative Work in Design (CSCWD), 2024.
• [IWQoS ’24] Efficient Online DNN Inference with Continuous Learning in Edge Computing
  Yifan Zeng, Ruiting Zhou, Lei Jiao, Ziyi Han, Jieling Yu.
  IEEE/ACM 32nd International Symposium on Quality of Service (IWQoS), 2024.
• [TMC ’24] Eris: An Online Auction for Scheduling Unbiased Distributed Learning over Edge Networks
  Jinlong Pang, Ziyi Han, Ruiting Zhou, Renli Zhang, John C.S. Lui, Hao Chen.
  IEEE Transactions on Mobile Computing (TMC), 2024.
• [JSA ’22] Online Scheduling Algorithms for Unbiased Distributed Learning over Wireless Edge Networks
  Jinlong Pang, Ziyi Han, Ruting Zhou, Haisheng Tan, Yue Cao.
  Journal of Systems Architecture (JSA), 2022.
• [ICPADS ’21] Online Scheduling Unbiased Distributed Learning over Wireless Edge Networks
  Ziyi Han, Ruiting Zhou, Jinlong Pang, Haisheng Tan*, Yue Cao.
  IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS), 2021. (Outstanding Paper Award)

Preprints

---

Internships and Research Experiences

• 2025.06-2025.08, Research Intern at Huawei 2012 Lab, Hangzhou, China; Leader: Prof. Haibo Chen (ACM/IEEE Fellow).

---

Selected Awards

• [2021-2023] First Prize of Cybersecurity Excellence Scholarship (top 30%)
• [2022] First Prize Scholarship of Academic Excellence (top 10%)
• [2022] Huawei Scholarship
• [2021] Wuhan University 2021 Outstanding Bachelor's Degree Thesis (top 10%)