Design and Comparison Base Analysis of Adaptive Estimator for Completely Unknown Linear Systems in the Presence of OE Noise and Constant Input Time Delay

Basit Öğe Kaydı
dc.authoridTutsoy, Onder/0000-0001-6385-3025
dc.contributor.authorTutsoy, Önder
dc.date.accessioned2025-01-06T17:36:05Z
dc.date.available2025-01-06T17:36:05Z
dc.date.issued2016
dc.description.abstractIn this paper, an adaptive estimator (AE) is introduced to learn the approximate Q-function and control policy by only using the noisy states and control signals of the unknown linear, discrete time systems having constant input time delay. The system measurements are uncertain owing to output error (OE)-type noise acting randomly on the system measurements. Therefore, this research differs from the designed AE in the literature since previous research ignores the role of the external random disturbances on AE-based learning. In order to compare the AE-based learning results with traditional system identification (SI) approaches, a modified version of the OE model structure for unstable systems is reviewed and parameters of a second-order unstable system with constant input time delay are identified. The simulation results demonstrate that the designed AE efficiently minimizes the stochastic cost function and the temporal difference error by learning the approximate solution for the Hamilton-Jacobi-Bellman (HJB) equation. It is noted that the error in the Q-function obtained with the AE is slightly larger than the Q-function attained with the identified OE parameters. However, as the noise standard deviation increases, the error in the AE-based learning results reduces whereas the error in the OE-based learning increases. This indicates that even though the added random noise deteriorates the performance of the OE predictor, it improves the learning efficiency of the AE since it acts like exploration noise.
dc.identifier.doi10.1002/asjc.1184
dc.identifier.endpage1029
dc.identifier.issn1561-8625
dc.identifier.issn1934-6093
dc.identifier.issue3
dc.identifier.scopus2-s2.0-84973162938
dc.identifier.scopusqualityQ1
dc.identifier.startpage1020
dc.identifier.urihttps://doi.org/10.1002/asjc.1184
dc.identifier.urihttps://hdl.handle.net/20.500.14669/1751
dc.identifier.volume18
dc.identifier.wosWOS:000376612500019
dc.identifier.wosqualityQ3
dc.indekslendigikaynakWeb of Science
dc.indekslendigikaynakScopus
dc.language.isoen
dc.publisherWiley
dc.relation.ispartofAsian Journal of Control
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/closedAccess
dc.snmzKA_20241211
dc.subjectAdaptive estimator
dc.subjectconstant input time delay
dc.subjectmodified OE model structure
dc.subjectnoisy measurements
dc.subjectQ-function learning
dc.subjectsystem identification
dc.subjectunknown linear system
dc.titleDesign and Comparison Base Analysis of Adaptive Estimator for Completely Unknown Linear Systems in the Presence of OE Noise and Constant Input Time Delay
dc.typeArticle

Dosyalar

Koleksiyon

WoS İndeksli Yayınlar Koleksiyonu
Scopus İndeksli Yayınlar Koleksiyonu