Investigating the Effect of Changes in Model Parameters on Optimal Control Policies, Time to Absorption, and Mixing Times

Authors

  • Kathleen Johnson Department of Mathematics, University of Kentucky, Lexington, KY Author
  • Daniel Plaugher Department of Toxicology and Cancer Biology, University of Kentucky, Lexington, KY Author
  • David Murrugarra Department of Mathematics, University of Kentucky, Lexington, KY Author

DOI:

https://doi.org/10.30707/

Keywords:

oolean networks, Markov decision processes, Optimal control, Time to absorption, Mixing time

Abstract

Many processes in biology and medicine have been modeled using Markov decision processes which provides a rich algorithmic theory for model analysis and optimal control. An optimal control problem for stochastic discrete systems consists of deriving a control policy that dictates how the system will move from one state to another such that the probability of reaching a desired state is maximized. In this paper, we focus on the class of Markov decision processes that is obtained by considering stochastic Boolean networks equipped with control actions. Here, we study the effect of changes in model parameters on optimal control policies. Specifically, we conducted a sensitivity analysis on optimal control policies for a Boolean model of the T-cell large granular lymphocyte (\textit{T-LGL}). For this model, we quantified how the choice of propensity parameters impacts the effectiveness of the optimal policy and then we provide thresholds at which the effectiveness is guaranteed. We also examined the effect on the optimal control policies of the level of noise that is usually added for simulations. Finally, we studied the effect on changes in the propensity parameters on the time to absorption and the mixing time for a Boolean model of the Repressilator.

 

Downloads

Published

2023-12-18

Issue

Section

Research

How to Cite

Investigating the Effect of Changes in Model Parameters on Optimal Control Policies, Time to Absorption, and Mixing Times. (2023). Letters in Biomathematics, 10(1), 193–206. https://doi.org/10.30707/

Most read articles by the same author(s)

Similar Articles

41-50 of 70

You may also start an advanced similarity search for this article.