An Incursion to Deep-Learning for Process Regulation
DOI:
https://doi.org/10.30973/progmat/2021.13.2/4Keywords:
Model construction, Model Validation, Predictive Model, Deep Learning, Reinforcement LearningAbstract
A model which represents a physical process is usually composed by conservation equations, transfer mechanisms, and closure equations. These equations vary in the degree of certainty. This paper describes the incorporation of physical and empirical models. The empirical part is constructed by Deep Learning. This work describes the principles which have promoted Deep Learning as a complementary tool for the approximation of process engineering when is used for model-based control. In addition of the stability and accuracy to deal with unmeasured disturbances, a robust strategy is to use Reinforcement Learning thus the principles of this strategy are also described.
References
W. McCulloch and W. Pitts. A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics., Vol. 5, pp. 115–133, 1943. https://doi.org/10.1007/BF02478259
F. Rosenblatt. The perceptron: A probabilistic model for information storage and organization in the brain, Psychological Review, Vol. 65, pp. 386– 408, 1958. https://psycnet.apa.org/doi/10.1037/h0042519
M. Minsky and S. Papert. Perceptrons, Cambridge, MA: MIT Press, 1969.
Rumelhart, D.E., Hinton, G. E. and Williams, R. J. Learning Internal Representation by Error Propagation. In D. E. Rumelhart and J. L. McClelland, eds., Parallel Distributed Processing: Explorations in the Microstructure of Cognition, Cambridge, MA: MIT Press, 1986.
Hinton, G. E., Osindero, S. and Yee-Whye The. A Fast Learning Algorithm for Deep Belief Nets. Neural Computation 18, 1527–1554 (2006). Massachusetts Institute of Technology. https://doi.org/10.1162/neco.2006.18.7.1527
Hagan, M. T., H. B. Demuth, M. H. Beale and Orlando De Jesús. Neural Network Design. Editorial : Martin Hagan; 2nd edition, 2014.
Dong, H., Z. Ding and S. Zhang. Deep Reinforcement Learning – Fundamentals, Research and Applications. Springer, 2020. https://doi.org/10.1007/978-981-15-4095-0
Bengio, Y. Learning Deep Architectures for AI. Foundations and Trends in Machine Learning, Vol. 2, No. 1 (2009) 1–127. http://dx.doi.org/10.1561/2200000006
Goodfellow I., Y. Bengio and A. Courville. Deep Learning. MIT Press, (2016)
Amini A. "Introduction to Deep Learning". MIT 6.S191 (2020)
Tribus, M., & McIrvine, E. C. . Energy and information. Scientific American, (1971) 225(3), 179-190. https://www.jstor.org/stable/24923125
Dennis, J., R.B. Schnabel R. Numerical Methods for Unconstrained optimization and Nonlinear equations. SIAM, (1996).
Koller D., N. Friedman. Probabilistic Graphical Models. The MIT Press, (2009).
Hernandez J.A. , R.J. Romero, D. JuárezRomero, R.F. Escobar, J. Siqueiros. A. Neural network approach and thermodynamic model of waste energy recovery in a heat transformer in a water purification processes. Desalination (ISSN: 0011-9164) (2009) 243, pp 273-285. https://doi.org/10.1016/j.desal.2008.05.015
Griewank A., G. F. Corliss Automatic Differentiation of Algorithms, SIAM(1991)
Juarez-Romero D., Molina-Espinoza J. M. , Zamora-Moctezuma J. R., Leder R. Evaluating Algorithmic Properties of Dynamic Simulation Models by Operating Overloading. Memorias de Simposium de Software y Optimización, Cuernavaca, Mor, CICOS09, Cuernavaca (2009)ISBN 978-607-00-1970-8
Innes M. , Differentiable Programming with Julia, Mar21, London Users Group Meeting, (2019).
Martens, J. . Deep learning via hessian-free optimization. In International Conference on Machine Learning (ICML-10),(2010, June) Vol. 27, pp. 735-742.
Nocedal, J. and Wright S. J. Numerical Optimization. Springer (1999)
LeBlanc T.J., M. Scott and C.M. Brown. Large-Scale parallel Programming Experience with the BBN Buterfly Parallel processor. Comp. Sci. Report, U. Rochester, (1988). https://doi.org/10.1145/62115.62131
Müller, D., Esche, E., and Wozny, G. An algorithm for the identification and estimation of relevant parameters for optimization under uncertainty. Computers & Ehemical Engineering, (2014) 71, 94-103. https://doi.org/10.1016/j.compchemeng.2014.07.007
Niesser M. http://niesser.github.10/12DL (2020)
Yuan Z. and K.E. Herold Using a Multiproperty Free Energy Correlation. HVAC&R Research, (2005) v 11, 3 p377-393.
Beale M.H., M.T. Hagan, Howard B. Demuth. Deep Learning Toolbox. UG, Mathworks (2020).
Zu K. , E. A. Müller. Generating a Machine Learned Equation of State for Fluid Properties. ArXiv, (2020).
Bishop C. Pattern Recognition and Machine learning. Springer.(2006)
Björk A., Numerical Methods for LeastSquares Problems. SIAM (2006)
Qin S.J. Integrated Framework of Systems, Data, and Industrial Intelligence towards Industry 4.0. Abstract of Plenary talk - IFAC conference, july, Germany (2020).
Tran, T., Marsh, L., & Hunjet, R. Reinforcement Learning with Model Predictive Control-Recent Development. Conference paper, ICOCTA, Sidney (2019).
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Programación Matemática y Software
This work is licensed under a Creative Commons Attribution 4.0 International License.
Usted es libre de:
 |
Compartir — compartir y redistribuir el material publicado en cualquier medio o formato. |
 |
Adaptar — combinar, transformar y construir sobre el material para cualquier propósito, incluso comercialmente. |
Bajo las siguientes condiciones:
 |
Atribución — Debe otorgar el crédito correspondiente, proporcionar un enlace a la licencia e indicar si se realizaron cambios. Puede hacerlo de cualquier manera razonable, pero de ninguna manera que sugiera que el licenciador lo respalda a usted o a su uso. |
| Sin restricciones adicionales: no puede aplicar términos legales o medidas tecnológicas que restrinjan legalmente a otros a hacer cualquier cosa que permita la licencia. |
