We use cookies to improve your experience with our site.
吕方, 崔慧敏, 王蕾, 刘磊, 武成岗, 冯晓兵, 游本中. 一种面向多核处理器系统的I/O敏感的动态调度策略[J]. 计算机科学技术学报, 2014, 29(1): 21-37. DOI: 10.1007/s11390-013-1409-2
引用本文: 吕方, 崔慧敏, 王蕾, 刘磊, 武成岗, 冯晓兵, 游本中. 一种面向多核处理器系统的I/O敏感的动态调度策略[J]. 计算机科学技术学报, 2014, 29(1): 21-37. DOI: 10.1007/s11390-013-1409-2
Fang Lv, Hui-Min Cui, Lei Wang, Lei Liu, Cheng-Gang Wu, Xiao-Bing Feng, Pen-Chung Yew. Dynamic I/O-Aware Scheduling for Batch-Mode Applications on Chip Multiprocessor Systems of Cluster Platforms[J]. Journal of Computer Science and Technology, 2014, 29(1): 21-37. DOI: 10.1007/s11390-013-1409-2
Citation: Fang Lv, Hui-Min Cui, Lei Wang, Lei Liu, Cheng-Gang Wu, Xiao-Bing Feng, Pen-Chung Yew. Dynamic I/O-Aware Scheduling for Batch-Mode Applications on Chip Multiprocessor Systems of Cluster Platforms[J]. Journal of Computer Science and Technology, 2014, 29(1): 21-37. DOI: 10.1007/s11390-013-1409-2

一种面向多核处理器系统的I/O敏感的动态调度策略

Dynamic I/O-Aware Scheduling for Batch-Mode Applications on Chip Multiprocessor Systems of Cluster Platforms

  • 摘要: 在机群、数据中心等现代平台的发展过程中,批处理始终作为一种重要的服务类型而倍受关注。然而,来自多用户的资源竞争却成为导致批处理任务性能低下的主要原因之一。其中,I/O资源竞争是平台服务中最为严重的性能瓶颈之一,它不仅会对单个任务的并发、并行性能造成影响,严重的I/O资源冲突会对整批任务的执行效率产生负面影响。

    经过对大规模服务器中I/O资源冲突的深入分析,作者指出软件调度策略是导致并发性能影响的重要因素之一,并在此基础上提出了一种I/O敏感的动态调度策略,用于缓解和降低I/O冲突所引发的负面影响。我们在曙光机群中的一台64核服务器上对该优化策略进行了全面评估,评估内容包括加权加速比、吞吐率以及任务的平均执行时间等三方面的优化效果。对15组长度不等的任务进行评估的结果说明动态调度策略对于缓解I/O资源冲突是非常有效的。在加权加速比方面,动态调度策略可以取得7% ~ 431%的性能提升,在其它两方面动态策略也可以获得明显提升。评估结果说明一个良好的I/O敏感的调度策略对于降低和缓解大规模服务器中的I/O资源冲突,提高现代平台的性能是必要的且行之有效的。

     

    Abstract: Efficiency of batch processing is becoming increasingly important for many modern commercial service centers, e.g., clusters and cloud computing datacenters. However, periodical resource contentions have become the major performance obstacles for concurrently running applications on mainstream CMP servers. I/O contention is such a kind of obstacle, which may impede both the co-running performance of batch jobs and the system throughput seriously. In this paper, a dynamic I/O-aware scheduling algorithm is proposed to lower the impacts of I/O contention and to enhance the co-running performance in batch processing. We set up our environment on an 8-socket, 64-core server in Dawning Linux Cluster. Fifteen workloads ranging from 8 jobs to 256 jobs are evaluated. Our experimental results show significant improvements on the throughputs of the workloads, which range from 7% to 431%. Meanwhile, noticeable improvements on the slowdown of workloads and the average runtime for each job can be achieved. These results show that a well-tuned dynamic I/O-aware scheduler is beneficial for batch-mode services. It can also enhance the resource utilization via throughput improvement on modern service platforms.

     

/

返回文章
返回