{"id":410,"date":"2024-07-08T15:14:43","date_gmt":"2024-07-08T13:14:43","guid":{"rendered":"https:\/\/site.uit.no\/ccgrid2025\/?page_id=410"},"modified":"2025-03-20T09:27:23","modified_gmt":"2025-03-20T08:27:23","slug":"prof-kai-li","status":"publish","type":"page","link":"https:\/\/site.uit.no\/ccgrid2025\/prof-kai-li\/","title":{"rendered":"Professor Kai Li"},"content":{"rendered":"\n
\n
\n
\n

Professor<\/h2>\n\n\n\n

Kai Li<\/h2>\n<\/div>\n\n\n\n
\"\"<\/figure>\n\n\n\n
Personal Page<\/a><\/h6>\n<\/div>\n\n\n\n
\n

Designing a Practical CDN Cache<\/strong><\/h2>\n\n\n\n

Abstract<\/h4>\n\n\n\n

Machine learning is transforming system designs, including caching strategies for Content Distribution Networks (CDNs). In this talk, I will share how we leverage ML to enhance CDN cache performance by treating cache replacement as a predictive optimization problem based on historical access patterns.\u00a0\u00a0Building a practical ML-driven CDN cache presents several key challenges: (1) Developing and refining an ML model that sustains high prediction accuracy in dynamic, real-world CDN environments, (2) Minimizing eviction overhead to match the efficiency of heuristic-based approaches, (3) Ensuring seamless integration into existing CDN architectures without disrupting performance, and (4) Balancing ML model storage requirements with available cache space to optimize overall capacity and efficiency.\u00a0\u00a0We will discuss the solutions implemented in two learned CDN cache systems that achieve significantly lower miss ratios than state-of-the-art heuristics while maintaining comparable throughput, with only modest increases in CPU utilization. Our prototypes have been validated on diverse production workloads, and our collaborations with industry partners have resulted in successful deployment in a large-scale CDN network.<\/em><\/p>\n\n\n\n

Bio<\/h4>\n\n\n\n

Kai Li<\/strong> is the Paul M. Wythes ’55, P’86 and Marcia R. Wythes P’86 Professor at Princeton University. He received his B.S. from Jilin University, M.S. from the University of Science and Technology of China, and Ph.D. from Yale University. His research spans parallel and distributed systems, storage systems, and systems support for machine learning.\u00a0\u00a0He was an early advocate for using networks of PCs and servers to solve computational problems in parallel. His Ph.D. dissertation pioneered distributed shared memory, enabling data sharing across networks without physically shared memory. At Princeton, he led the development of user-level communication mechanisms for computer clusters\u2014foundational to InfiniBand, a communication standard widely deployed in today’s high-performance clusters.\u00a0\u00a0As co-founder of Data Domain, Inc., Li led the creation of deduplication storage systems achieving 20\u201330\u00d7 lossless compression for backup data. This innovation allowed cost-effective replacement of tape libraries, revolutionizing data center storage for backup and disaster recovery.\u00a0\u00a0Data Domain product line has dominated the market for the past two decades.\u00a0\u00a0He was the co-PI of ImageNet, which propelled\u00a0\u00a0deep learning to the forefront of machine learning and sparked what many call the deep learning revolution. He has received numerous honors and awards, including eight most influential or test-of-time paper awards across various areas in computer science. He has been elected as an ACM Fellow, an IEEE Fellow, and a member of the US National Academy of Engineering.<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Professor Kai Li Personal Page Designing a Practical CDN Cache Abstract Machine learning is transforming system designs, including caching strategies […]<\/p>\n","protected":false},"author":123651,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"disabled","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ngg_post_thumbnail":0,"footnotes":""},"class_list":["post-410","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/pages\/410","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/users\/123651"}],"replies":[{"embeddable":true,"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/comments?post=410"}],"version-history":[{"count":3,"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/pages\/410\/revisions"}],"predecessor-version":[{"id":1152,"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/pages\/410\/revisions\/1152"}],"wp:attachment":[{"href":"https:\/\/site.uit.no\/ccgrid2025\/wp-json\/wp\/v2\/media?parent=410"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}