An SMDP model for a multiclass multi-server queueing control problem considering conversion times

Author: Zhang Zhicong   Li Na   Li Shuai   Yan Xiaohui   Guo Jianwen  

Publisher: Edp Sciences

E-ISSN: 1290-3868|48|4|615-639

ISSN: 0399-0559

Source: RAIRO - Operations Research, Vol.48, Iss.4, 2014-07, pp. : 615-639

Disclaimer: Any content in publications that violate the sovereignty, the constitution or regulations of the PRC is not accepted or approved by CNPIEC.

Previous Menu Next

Abstract

We address a queueing control problem considering service times and conversion times following normal distributions. We formulate the multi-server queueing control problem by constructing a semi-Markov decision process (SMDP) model. The mechanism of state transitions is developed through mathematical derivation of the transition probabilities and transition times. We also study the property of the queueing control system and show that optimizing the objective function of the addressed queueing control problem is equivalent to maximizing the time-average reward.