STOCHASTIC APPROXIMATION TECHNIQUES APPLIED TO PARAMETER ESTIMATION IN A BIOLOGICAL MODEL
DOI:
https://doi.org/10.47839/ijc.2.2.211Keywords:
Stochastic approximation, optimization, nonlinear identification, biotechnologyAbstract
Simultaneous perturbation stochastic approximation (SPSA) is a class of optimization algorithms which compute an approximation of the gradient and/or the Hessian of the objective function by varying all the elements of the parameter vector simultaneously and therefore, require only a few objective function evaluations to obtain first or second-order information. Consequently, these algorithms are particularly well suited to problems involving a large number of design parameters. In this study, their potentialities are assessed in the context of nonlinear system identification. To this end, a challenging modeling application is considered, i.e. dynamic modeling of batch animal cell cultures from sets of experimental data. The performance of the optimization algorithms are discussed in terms of efficiency, accuracy and ease of use.References
G. Bastin, D. Dochain. On-line estimation and adaptive control of bioreactors, Elsevier, 1990.
Ph. Bogaerts, R. Hanus. Macroscopic modelling of bioprocesses with a view to engineering applications. In: Focus on Biotechnology, Vol. 4 (Engineering and Manufacturing for Biotechnology) (Ph. Thonart, M. Hofman, Eds.), Kluwer, (2000).
C. Renotte, A. Vande Wouwer, M. Remy. Neural Modeling and Control of a Heat Exchanger based on SPSA Techniques. Proceedings of the Workshop “ACC”, 2000, pp.3299-3303.
P. Sadegh. Constrained Optimization via Stochastic Approximation with a Simultaneous Perturbation Gradient Approximation, Automatica 33 (1997), pp. 889-892.
J. Spall. Multivariate Stochastic Approximation Using a Simultaneous Perturbation Gradient Approximation, IEEE Trans. Automat. Contr. 37 (1992), pp.332-341.
J. Spall. Adaptive Stochastic Approximation by the Simultaneous Perturbation Method, IEEE Trans. Automat. Contr. 45 (2000), pp.1839-1853.
A. Vande Wouwer, C. Renotte, M. Remy. On the Use of Simultaneous Perturbation Stochastic Approximation for Neural Network Training. Proceedings of the Workshop “ACC”, 1999, pp.388-392.
X. Zhu, J. Spall. A Modified Second Order SPSA Optimization Algorithm for Finite Samples, Int. J. of Adaptive Control and Signal Processing 16 (2002). pp. 397-409.
Downloads
Published
How to Cite
Issue
Section
License
International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
• Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.