(427d) Simultaneous Multi-Parametric Hybrid Model Predictive Control and Estimation with Application to the Intravenous Anaesthesia

Simultaneous Multi-Parametric Hybrid Model Predictive Control and Estimation with Application to the Intravenous Anaesthesia

Ioana Nascu^a,b, Richard Oberdieck^a,b, Efstratios N. Pistikopoulos^b*

^aDept. of Chemical Engineering, Centre for Process Systems Engineering (CPSE), Imperial College London SW7 2AZ, Lodnon, U.K

^bArtie McFerrin Department of Chemical Engineering, Texas A&M, College Station TX (^*stratos@tamu.edu)

Keywords: Anaesthesia, Explicit/Multi-Parametric Model Predictive Control, Hybrid Systems, Moving Horizon Estimation

The control of biomedical systems has become a very important and challenging research area during the last decades. One of the important challenges in controlling such systems is the presence of strong nonlinearities. These nonlinearities are included in the pharmacodynamic model, part of the mathematical model of the system which is usually represented by the Hill curve and it describes the relation between the concentration of the drug and the effect observed on the patient. Due to the S – shape characteristic of the Hill curve, a piecewise linearization around three points can be performed, resulting in a piece-wise affine formulation. The control of such a system translates in a hybrid model predictive control (hMPC) problem (Bemporad and Morari 1999) and the solution of a mixed-integer quadratic programming (MIQP) problem formulation. Since the online implementation of hMPC needs the online solution of an MIQP problem, this will introduce a high computational burden. When dealing with biomedical systems a fast control action is of great importance since the lack of it can affect the patient’s safety. A way to deal with this issue is by solving the hMPC problem explicitly offline via the solution of a multi-parametric mixed-integer quadratic programming (mp-MIQP) problem where the initial states are treated as parameters and the optimization problem is solved as a function thereof (Pistikopoulos 2009). For the solution of such problems, recently novel solution procedures have been developed (Oberdieck and Pistikopoulos 2014).

The implementation of hybrid explicit/multi-parametric MPC, and in general, MPC is that it is based on the assumption that accurate, noise-free information is available for all states of the system. However, in reality, state information needs to be inferred from the available, likely noisy, output measurements using a state estimator. Dealing with system constraints entails the simultaneous use of moving horizon estimation (MHE) which can be implemented in a multi-parametric fashion (Darby and Nikolaou 2007, Voelker, Kouramas et al. 2010). By using mp-MHE we will be able to estimate the state of each individual patient when dealing with biomedical processes. This is very important since it will be able to overcome the challenge of inter- and intra- patient variability that is found in such systems. Since most biomedical process can be treated as a hybrid systems due to the piece affine formulation of the Hill function, the mp-MHE will be reformulated into a novel hybrid mp-MHE formulation that will be implemented simultaneously with hybrid multi parametric model based predictive control.

This new development is integrated in PAROC, a comprehensive step-by-step framework and software solution for the general design, operational optimization and control of process systems (Pistikopoulos, Diangelakis et al. 2014). The framework includes a high-fidelity model of the system that is approximated if the model is too complicated using discrete time models in state space form via model order reduction techniques or system identification techniques. The system model in the state space form is used to formulate an optimization problem subject to the state space model and constraints. The state space model used by the hybrid mp-MPC controller is estimated using the newly developed hybrid mp-MHE. The resulting hybrid multi-parametric programming problem is solved with state-of-the-art techniques and the solution is validated against the original high fidelity model.

In this paper the presented framework is applied on the intravenous anaesthesia process. Intravenous is an important part of surgery and intensive care unit and it represents the reversed pharmacological state of the patient where hypnosis, analgesia and muscle relaxation are guaranteed (Bailey and Haddad 2005). During the last decades, there has been a lot of research on the development of PID tuning techniques, model based strategies using predictive, (Ionescu, Machado et al. 2014), (Hodrea, Morar et al. 2012), robust (Caiado Daniela, Lemos João et al. 2013), adaptive (Haddad, Hayakawa et al. 2003), (Nascu, Nascu et al. 2012) and multi-parametric MPC (Nascu, Lambert et al. 2014), (Krieger and Pistikopoulos 2014) for the control of depth of anaesthesia. Nevertheless, control of anaesthesia, is still not a trivial task and poses a variety of challenges that need to be addressed; from the presence of nonlinearities, inter- and intra- patient variability, multivariable characteristics, variable time delays, model analysis variability.

In order to control the depth of anaesthesia and for the first step of the framework, a model that captures the dynamical response of the patient is required. The PK-PD models most commonly used for Propofol are the 4^th order compartmental model described by (Schnider, Minto et al. 1998), (Minto, Schnider et al. 1997). The pharmacokinetic (PK, the linear part) – pharmacodynamic (PD, the nonlinear part) blocks denote compartmental models, used to represent the distribution of drugs in the body, i.e. mass balance. In each compartment the drug concentration is assumed to be uniform, assuming perfect and instantaneous mixing. The transport rate of the drug leaving the compartment is assumed to be proportional to the drug concentration. Once we have the state space of the model, the next step of the framework will be focused in designing the simultaneous hybrid control and estimation and their solution via mp MIQP. For this study, the simulations are performed on a set of 12 virtual generated patients under constraints and the presence of noise in the induction and maintenance phase. The performances of the controller are evaluated for the whole set of patients and under the effect disturbances and the existence of constraints. The implementation of this framework on the intravenous anaesthesia process represents an important step in the control of DOA since is able to deal with two major challenges in the process of anaesthesia: the nonlinearity by using the piece-wise linearization of the Hill curve and the inter and intra patient variability by using estimation techniques to obtain the states of each individual patients. Another advantage of the simultaneous hybrid mp-MPC and hybrid mp-MHE is that is able to overcome the noise that can corrupt the required data.

References

Bailey, J. M. and W. M. Haddad (2005). "Drug dosing control in clinical pharmacology." IEEE Control System Magazine 25: 35-31.

Bemporad, A. and M. Morari (1999). "Control of systems integrating logic, dynamics, and constraints." Automatica 35(3): 407-427.

Caiado Daniela, V., M. Lemos João and A. Costa Bertinho (2013). Robust control of depth of anesthesia based on H∞ design. Archives of Control Sciences. 23: 41.

Darby, M. L. and M. Nikolaou (2007). "A parametric programming approach to moving-horizon state estimation." Automatica 43(5): 885-891.

Haddad, W. M., T. Hayakawa and J. M. Bailey (2003). Nonlinear Adaptive Control for Intensive Care Unit Sedation and Operating Room Hypnosis.

Hodrea, R., R. Morar and I. Nascu (2012). "Predictive Control of Neuromuscular Blockade." Automation Computers Applied Mathematics 21(4).

Ionescu, C., J. T. Machado, R. De Keyser, J. Decruyenaere and M. M. R. F. Struys (2014). "Nonlinear dynamics of the patient’s response to drug effect during general anesthesia." Communications in Nonlinear Science and Numerical Simulation(0).

Krieger, A. and E. N. Pistikopoulos (2014). "Model predictive control of anesthesia under uncertainty." Computers and Chemical Engineering 71: 699-707.

Minto, C. F., T. W. Schnider, T. D. Egan, E. J. Youngs, H. J. Lemmens, P. L. Gambus, V. Billard, J. F. Hoke, K. H. Moore, D. J. Hermann, K. T. Muir, J. W. Mandema and S. L. Shafer (1997). "Influence of age and gender on the pharmacokinetics and pharmacodynamics of reminfetanil. I. Model development." Anesthesiology 86: 10-23.

Nascu, I., R. S. C. Lambert, A. Krieger and E. N. Pistikopoulos (2014). Simultaneous multi-parametric model predictive control and state estimation with application to distillation column and intravenous anaesthesia. Computer Aided Chemical Engineering. 33: 541-546.

Nascu, I., I. Nascu, C. M. Ionescu and R. De Keyser (2012). Adaptive EPSAC predictive control of the hypnotic component in anesthesia.

Oberdieck, R. and E. Pistikopoulos (2014). "Explicit hybrid model-predictive control: The exact solution." Automatica submitted.

Pistikopoulos, E., N. A. Diangelakis, R. Oberdieck, M. M. Papathanasiou, I. Nascu and M. Sun (2014). "PAROC - an Integrated Framework and Software Platform for the Design, Operational Optimization and Advanced Model-Based Control of Process Systems." Chemical Engineering Science submitted.

Pistikopoulos, E. N. (2009). "Perspectives in multiparametric programming and explicit model predictive control." AIChE Journal 55: 1918-1925.

Schnider, T. W., C. F. Minto, P. L. Gambus, C. Andresen, D. B. Goodale, S. L. Shafer and E. J. Youngs (1998). "The influence of method of administration and covariates on the pharmacokinetics of propofol in adult volunteers." Anesthesiology 88(5): 1170-1182.

Voelker, A., K. Kouramas and E. N. Pistikopoulos (2010). Simultaneous constrained moving horizon state estimation and model predictive control by multi-parametric programming. Proceedings of the IEEE Conference on Decision and Control.