Preview

Proceedings of the Voronezh State University of Engineering Technologies

Advanced search

Search for all solutions to the dynamic programming problem if their multicriteria estimates coincide

https://doi.org/10.20914/2310-1202-2020-1-398-403

Abstract

Among the mathematical methods used in economics, a prominent place is occupied by the dynamic programming method, with the help of which the optimal control of multi-stage processes is organized. The disadvantage of this method is the impossibility of calculating all solutions to the problem if their criteria-based estimates coincide. The fact of the existence of several optimal trajectories of a multi-step process may mean that the task is not set correctly, in the sense that the assigned criteria do not fully characterize the system under study. This means that the traditional method of dynamic programming needs to be refined in case of the existence of several optimal trajectories with the same value of the criterion. This article proposes the most general version of such refinement, namely, a multi-criteria numerical scheme is generalized. For a more visual representation of calculations and the result of the study, we will describe the discrete dynamic programming problem in terms of graph theory. In this case, it reduces to the problem of finding the optimal path on a directed graph. To solve it, a three-stage algorithm is proposed, the composition of which includes the following steps. The first stage is the construction of optimal criteria estimates for paths from the initial vertex to all the others. To perform this stage, the most universal method is the multicriteria version of the Ford – Bellman method. The second stage is the construction of a graph of optimal paths. In the original graph, arcs are selected that are part of the optimal paths. Of these, using the original algorithm, a subgraph is formed in which all paths are optimal. It is analytically proved that this algorithm gives the correct result (correct). The third stage is enumeration of all paths in the constructed subgraph. Numerical experiments showed that the proposed three-stage method works efficiently on oriented graphs of any type in a sufficiently large range of dimensions. The proposed algorithm with minimal changes can be used to solve an arbitrary discrete dynamic programming problem.

About the Authors

Y. V. Bugaev
Voronezh State University of Engineering Technologies
Russian Federation
Dr. Sci. (Phys.-Math.), professor, higher mathematics and information technology department, Revolution Av., 19 Voronezh, 394036, Russia


L. A. Korobova
Voronezh State University of Engineering Technologies
Cand. Sci. (Engin.), associate professor, higher mathematics and information technology department, Revolution Av., 19 Voronezh, 394036, Russia


I. Y. Shurupova
Military Training and Scientific Center of the Air Force "Air Force Academy" named after prof. N.E. Zhukovsky and Yu.A. Gagarina
Cand. Sci. (Phys.-Math.), lecturer, math department, st. Old Bolsheviks, 54 "A", Voronezh, 394064, Russia


References

1. Tarasenko A.V., Egorova I.L. Bellman's optimality principle in the problem of optimal distribution of funds between enterprises for the expansion of production. University Herald. 2019. no 10. pp. 132–138. (in Russian).

2. Paraev Yu.I., Grekova T.I., Poluektova K.O. Optimal management of a single-sector economy with a random change in the capital-labor ratio. Tomsk State University Bulletin. Management, computer engineering and computer science. 2018.

3. no. 42. pp. 23–29. (in Russian).

4. Skvortsov Yu.S., Ryndin N.A., Amoa A.Zh.K.K. A dynamic crop rotation model based on the Bellman equation with a finite horizon. Modeling, Optimization and Information Technology. 2019. vol. 7. no. 1 (24). pp. 449–458. (in Russian).

5. Kataev A.V., Kataeva T.M. Network business model for the development of a regional industrial complex in the context of digitalization. Bulletin of the Taganrog Institute of Management and Economics. 2019. No. 2 (30). pp. 26–28. (in Russian).

6. Si Y., Yang W., Zhou H. A simulation analysis on regional logistics development based on system dynamics: The case of Yunnan province. 5 th International Conference on Industrial Engineering and Applications (ICIEA). Singapore. 2018. pp. 560–564.

7. Castellacci F., Natera J.M. The dynamics of national innovation systems: A panel cointegration analysis of the coevolution between innovative capability and absorptive capacity. Research Policy. 2013. vol. 42. no. 3. pp. 579–594.

8. Uriona-Maldonado M., Grobbelaar S.S. Innovation system policy analysis through system dynamics modeling: A systematic review. Science and Public Policy. 2019. vol. 46. no. 1. pp. 28–44.

9. Ferraz J.C., Coutinho L. Investment policies, development finance and economic transformation: Lessons from BNDES. Structural Change and Economic Dynamics. 2019. vol. 48. no. C. pp. 86–102.

10. Valencic R., Wawrosz P. Limits of neoclassical utility theory and some possible ways how to overcome them. Journal of International Scientific Publications Volume. 2016. no. 10. pp. 23–31.

11. Bugaev Yu.V., Korobova L.A. The use of the duality apparatus in the assignment problem on a network model. Modern methods of applied mathematics, control theory and computer technology (PMTUKT 2019): Sat. tr XII international conf. 2019. pp. 100-104. (in Russian).

12. Blinov I.V., Bugaev Yu.V., Chikunov S.V. A generalization of the Floyd-Warshall algorithm to the case of several criteria. Bulletin of the Tambov State Technical University. 2009. vol. 15. no. 4. pp. 885–892. (in Russian).


Review

For citations:


Bugaev Y.V., Korobova L.A., Shurupova I.Y. Search for all solutions to the dynamic programming problem if their multicriteria estimates coincide. Proceedings of the Voronezh State University of Engineering Technologies. 2020;82(1):398-403. (In Russ.) https://doi.org/10.20914/2310-1202-2020-1-398-403

Views: 523


Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.


ISSN 2226-910X (Print)
ISSN 2310-1202 (Online)