所属单位：国际商学院

发表刊物：European Journal of Operational Research

项目来源：国家自然科学基金项目

摘要：Modern high-end computing systems, such as storage servers used in Youtube and Tiktok, serve large numbers of concurrent streams, each of which requires aggressive prefetching. This multi-stream prefetching problem, which strives to serve as many requests as possible from the memory cache and minimize response time, remains as an open challenge in computer science research. To address the efficient resource management for data prefetching, this paper introduces a novel method adopted from inventory management of multiple products in operations research. It proposes a unique constrained multi-stream (Q, r) model which simultaneously determines the prefetching degree (order quantity) Q and trigger distance (reorder point) r for each application stream, taking into account the distinct data request rates of the streams. The model has the objective of minimizing the cache miss level (backorder level), which determines the access latency, as well as constraints on the cache space (inventory space) and the total prefetching frequency (total order frequency). Specifically, the disk access time (lead time) is a function of both the prefetching degree and the total prefetching frequency, the latter of which represents the system load. We present the analytical properties of the model, provide numerical optimization examples, and conduct sensitivity analysis to further demonstrate the insights of this prefetching problem. Significantly, an empirical evaluation proves the effectiveness of the prefetching policy provided by our model.

论文类型：期刊论文

卷号：1

ISSN号：0377-2217

是否译文：否

发表时间：2022-10-01

第一作者：王军

合写作者：Qi Yuan,Zhe Zhang,朱晓燕