Skip to main content
Springer Nature Link
Log in

Stochastic LQ Control with Extra Measurability Restriction

  • Published:
Journal of Systems Science and Complexity Aims and scope Submit manuscript

Abstract

Different from the standard linear quadratic (LQ) problem for stochastic systems, the LQ problem considered in the paper has extra measurability restrictions. The problem also appears in the LQ control problem for stochastic systems with delays, rational expectations problems, asymmetric information control, and so on. The essential difficulty lies in that one has to optimize the input and its conditional expectations simultaneously. The stochastic maximum principle (SMP) and orthogonal decomposition technique are the key tools. Firstly, the authors establish the SMP and convert the original problem into forward and backward stochastic difference equations (FBSDEs) with extra measurability restrictions. Secondly, the authors resolve the FBSDEs by using the orthogonal decomposition technique and obtain the analytical solution to the underlying problem. Thirdly, the authors explore the essential distinction between the problem and the standard stochastic LQ control problem. Finally, numerical examples are given to illustrate the obtained results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (France)

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Wonham W M, On a matrix Riccati equation of stochastic control, SIAM Journal on Control, 1968, 6(4): 681–697.

    Article  MathSciNet  Google Scholar 

  2. Choi J, Ko H S, and Lee K S, Constrained linear quadratic optimal control of chemical processes, Computers & Chemical Engineering, 2000, 24(2–7): 823–827.

    Article  Google Scholar 

  3. Zhou X and Li D, Continuous-time mean-variance portfolio selection: A stochastic LQ framework, Applied Mathematics and Optimization, 2000, 42): 19–33.

    Article  MathSciNet  Google Scholar 

  4. Hu Y and Zhou X, Constrained stochastic LQ control with random coefficients, and application to portfolio selection, SIAM Journal on Control and Optimization, 2005, 44(2): 44–466.

    Article  MathSciNet  Google Scholar 

  5. Liu Y and Han C, Optimal output tracking control and stabilization of networked control systems with packet losses, Journal of Systems Science & Complexity, 2021, 34(2): 602–617.

    Article  MathSciNet  Google Scholar 

  6. Zhang H, Li L, Xu J, et al., Linear quadratic regulation and stabilization of discrete-time systems with delay and multiplicative noise, IEEE Transactions on Automatic Control, 2015, 60(10): 2599–2613.

    Article  MathSciNet  Google Scholar 

  7. Li H, Xu J, and Zhang H, Linear quadratic regulation for discrete-time systems with input delay and colored multiplicative noise, Systems & Control Letters, 2020, 143): 104740.

    Article  MathSciNet  Google Scholar 

  8. Xu J and Zhang H, Solution to delayed FBSDEs and application to the stochastic LQ problem with input delay, IEEE Transactions on Circuits and Systems II: Express Briefs, 2017, 65(6): 769–773.

    Google Scholar 

  9. Lucas and Robert E, An equilibrium model of the business cycle, Journal of Political Economy, 1975, 83(6): 1113–1144.

    Article  Google Scholar 

  10. Blanchard O J and Kahn C M, The solution of linear difference models under rational expectations, Econometrica: Journal of the Econometric Society, 1980, 48(5): 1305–1311.

    Article  MathSciNet  Google Scholar 

  11. Başar T, Some thoughts on rational expectations models, and alternate formulations, System-Theoretic Methods in Economic Modelling II, 1989, 18(6/7): 591–604.

    MathSciNet  Google Scholar 

  12. Li L, Zhang H, and Fu M, Linear quadratic regulation for discrete-time systems with multiplicative noise and multiple input delays, Optimal Control Applications and Methods, 2017, 38(3): 295–316.

    Article  MathSciNet  Google Scholar 

  13. Xu J, Zhang H, and Başar T, Decentralized LQG control with d-step delayed information sharing pattern, IEEE Transactions on Automatic Control, 2022, 68(1): 604–611.

    Article  MathSciNet  Google Scholar 

  14. Nayyar N, Kalathil D, and Jain R, Optimal decentralized control with asymmetric one-step delayed information sharing, IEEE Transactions on Control of Network Systems, 2016, 5(1): 653–663.

    Article  MathSciNet  Google Scholar 

  15. Zhang H, Wang H, and Li L, Adapted and casual maximum principle and analytical solution to optimal control for stochastic multiplicative-noise systems with multiple input-delays, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC), 2012, 2122–2127.

  16. Yong J and Zhou X, Stochastic Controls: Hamiltonian Systems and HJB Equations, Springer Science & Business Media, Berlin, 1999.

    Book  Google Scholar 

  17. Rami M A, Chen X, and Zhou X, Discrete-time indefinite LQ control with state and control dependent noises, Journal of Global Optimization, 2002, 23): 245–265.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao, 266590, China

    Hongxia Wang, Yuxi Hu, Zixing Li & Lianfeng Song

Authors
  1. Hongxia Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yuxi Hu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zixing Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lianfeng Song
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hongxia Wang.

Ethics declarations

The authors declare no conflict of interest.

Additional information

This work was supported by the Original Exploratory Program Project of National Natural Science Foundation of China under Grant No. 62250056, the Joint Funds of the National Natural Science Foundation of China under Grant No. U23A20325, the Major Basic Research of Natural Science Foundation of Shandong Province under Grant No. ZR2021ZD14, and the High-level Talent Team Project of Qingdao West Coast New Area under Grant No. RCTD-JC-2019-05.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, H., Hu, Y., Li, Z. et al. Stochastic LQ Control with Extra Measurability Restriction. J Syst Sci Complex 37, 1003–1022 (2024). https://doi.org/10.1007/s11424-024-2501-0

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11424-024-2501-0

Keywords

Search

Navigation