Works matching Markov processes

Results: 5000

On Conditioned Limit Structure of the Markov Branching Process without Finite Second Moment.

Published in:

Malaysian Journal of Mathematical Sciences, 2017, v. 11, n. 3, p. 393

By:

Imomov, A.

Publication type:

Article

A law of large numbers for branching Markov processes by the ergodicity of ancestral lineages.

Published in:

ESAIM: Probability & Statistics, 2019, v. 23, p. 638, doi. 10.1051/ps/2018029

By:

Marguet, Aline

Publication type:

Article

Markov Limid processes for representing and solving renewal problems.

Published in:

Annals of Operations Research, 2014, v. 219, n. 1, p. 63, doi. 10.1007/s10479-012-1220-4

By:

Jørgensen, Erik;
Kristensen, Anders;
Nilsson, Dennis

Publication type:

Article

Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems Part 2--Applications in Transportation, Industries, Communications and Networking and More Topics.

Published in:

Machine Learning & Knowledge Extraction, 2021, v. 3, n. 4, p. 863, doi. 10.3390/make3040043

By:

Xuanchen Xiang;
Simon Foo;
Huanyu Zang

Publication type:

Article

Exponential and gamma form for tail expansions of first-passage distributions in semi-markov processes.

Published in:

Advances in Applied Probability, 2022, v. 54, n. 4, p. 1291, doi. 10.1017/apr.2022.4

By:

Butler, Ronald W.

Publication type:

Article

PIECEWISE-DETERMINISTIC MARKOV PROCESSES AS LIMITS OF MARKOV JUMP PROCESSES.

Published in:

Advances in Applied Probability, 2012, v. 44, n. 3, p. 729, doi. 10.1239/aap/1346955262

By:

FRANZ, UWE;
LIEBSCHER, VOLKMAR;
ZEISER, STEFAN

Publication type:

Article

Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach.

Published in:

Mathematics of Operations Research, 2004, v. 29, n. 3, p. 492, doi. 10.1287/moor.1040.0089

By:

Feinberg, Eugene A.

Publication type:

Article

THE COMPLEXITY OF DECENTRALIZED CONTROL OF MARKOV DECISION PROCESSES.

Published in:

Mathematics of Operations Research, 2002, v. 27, n. 4, p. 819, doi. 10.1287/moor.27.4.819.297

By:

Bernstein, Daniel S.;
Givan, Robert;
Immerman, Neil;
Zilberstein, Shlomo

Publication type:

Article

OPTIMAL CONTROL OF INFINITE-DIMENSIONAL PIECEWISE DETERMINISTIC MARKOV PROCESSES AND APPLICATION TO THE CONTROL OF NEURONAL DYNAMICS VIA OPTOGENETICS.

Published in:

Networks & Heterogeneous Media, 2017, v. 12, n. 3, p. 417, doi. 10.3934/nhm.2017019

By:

RENAULT, VINCENT;
THIEULLEN, MICHÈLE;
TRÉLAT, EMMANUEL

Publication type:

Article

The Transformation Method for Continuous-Time Markov Decision Processes.

Published in:

Journal of Optimization Theory & Applications, 2012, v. 154, n. 2, p. 691, doi. 10.1007/s10957-012-0015-8

By:

Piunovskiy, Alexey;
Zhang, Yi

Publication type:

Article

Optimal replacement of a system according to a semi-Markov decision process in a semi-Markov environment.

Published in:

Optimization Methods & Software, 2003, v. 18, n. 2, p. 181, doi. 10.1080/1055678031000111803

By:

Qiying Hu;
Wuyi Yue

Publication type:

Article

Fast MCMC Sampling for Markov Jump Processes and Extensions.

Published in:

Journal of Machine Learning Research, 2013, v. 14, n. 11, p. 3295

By:

Vinayak Rao;
Yee Whte Teg

Publication type:

Article

Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty.

Published in:

Medical Decision Making, 2010, v. 30, n. 4, p. 474, doi. 10.1177/0272989X09353194

By:

Alagoz, Oguzhan;
Hsu, Heather;
Schaefer, Andrew J.;
Roberts, Mark S.

Publication type:

Article

A Hybrid Genetic/Optimization Algorithm for Finite-Horizon,Partially Observed Markov Decision Processes.

Published in:

INFORMS Journal on Computing, 2004, v. 16, n. 1, p. 27, doi. 10.1287/ijoc.1020.0024

By:

Zong-Zhi Lin;
Bean, James C.;
White III, Chelsea C.

Publication type:

Article

THE LIMIT BEHAVIOR OF DUAL MARKOV BRANCHING PROCESSES.

Published in:

Journal of Applied Probability, 2008, v. 45, n. 1, p. 176, doi. 10.1239/jap/1208358960

By:

Yangrong Li;
Pakes, Anthony G.;
Jia Li;
Anhui Gu

Publication type:

Article

Page importance computation based on Markov processes.

Published in:

Information Retrieval Journal, 2011, v. 14, n. 5, p. 488, doi. 10.1007/s10791-011-9164-x

By:

Gao, Bin;
Liu, Tie-Yan;
Liu, Yuting;
Wang, Taifeng;
Ma, Zhi-Ming;
Li, Hang

Publication type:

Article

可数状态空间的平均成本马氏决策过程.

Published in:

Control Theory & Applications / Kongzhi Lilun Yu Yinyong, 2021, v. 38, n. 11, p. 1707, doi. 10.7641/CTA.2021.10763

By:

张俊玉;
吴怡婷;
夏俐;
曹希仁

Publication type:

Article

On Risk-Sensitive Piecewise Deterministic Markov Decision Processes.

Published in:

Applied Mathematics & Optimization, 2020, v. 81, n. 3, p. 685, doi. 10.1007/s00245-018-9485-x

By:

Guo, Xin;
Zhang, Yi

Publication type:

Article

Bayesian multiple changepoints detection for Markov jump processes.

Published in:

Computational Statistics, 2020, v. 35, n. 3, p. 1501, doi. 10.1007/s00180-020-00956-6

By:

Shaochuan, Lu

Publication type:

Article

Points Gained in Football: Using Markov Process-Based Value Functions to Assess Team Performance.

Published in:

Operations Research, 2021, v. 69, n. 3, p. 877, doi. 10.1287/opre.2020.2034

By:

Chan, Timothy C. Y.;
Fernandes, Craig;
Puterman, Martin L.

Publication type:

Article

Uniqueness and Extinction of Weighted Markov Branching Processes.

Published in:

Methodology & Computing in Applied Probability, 2005, v. 7, n. 4, p. 489, doi. 10.1007/s11009-005-5005-y

By:

Anyue Chen;
Junping Li;
Ramesh, N.

Publication type:

Article

Estimation in Stationary Markov Renewal Processes, with Application to Earthquake Forecasting in Turkey.

Published in:

Methodology & Computing in Applied Probability, 2005, v. 7, n. 1, p. 119, doi. 10.1007/s11009-005-6658-2

By:

Alvarez, Enrique

Publication type:

Article

Entropy Maximization for Markov and Semi-Markov Processes.

Published in:

Methodology & Computing in Applied Probability, 2004, v. 6, n. 1, p. 109, doi. 10.1023/B:MCAP.0000012418.88825.18

By:

Girardin, Valerie

Publication type:

Article

Analysis of a time–cost trade-off in a resource-constrained GERT project scheduling problem using the Markov decision process.

Published in:

Annals of Operations Research, 2024, v. 338, n. 1, p. 535, doi. 10.1007/s10479-024-05896-8

By:

Sadri, Shadi;
Ghomi, S. M. T. Fatemi;
Dehghanian, Amin

Publication type:

Article

A primer on partially observable Markov decision processes (POMDPs).

Published in:

Methods in Ecology & Evolution, 2021, v. 12, n. 11, p. 2058, doi. 10.1111/2041-210X.13692

By:

Chadès, Iadine;
Pascal, Luz V.;
Nicol, Sam;
Fletcher, Cameron S.;
Ferrer‐Mestres, Jonathan

Publication type:

Article

Inspection and maintenance planning for offshore wind structural components: integrating fatigue failure criteria with Bayesian networks and Markov decision processes.

Published in:

Structure & Infrastructure Engineering: Maintenance, Management, Life-Cycle Design & Performance, 2022, v. 18, n. 7, p. 983, doi. 10.1080/15732479.2022.2037667

By:

Hlaing, Nandar;
Morato, Pablo G.;
Nielsen, Jannie S.;
Amirafshari, Peyman;
Kolios, Athanasios;
Rigo, Philippe

Publication type:

Article

The Compositional Construction of Markov Processes.

Published in:

Applied Categorical Structures, 2011, v. 19, n. 1, p. 425, doi. 10.1007/s10485-010-9233-0

By:

Albasini, Luisa de Francesco;
Sabadini, Nicoletta;
Walters, Robert F. C.

Publication type:

Article

Opportunistic scheduling for a two‐way relay network using Markov decision process.

Published in:

IET Communications (Wiley-Blackwell), 2016, v. 10, n. 13, p. 1846, doi. 10.1049/iet-com.2016.0076

By:

Meshgi, Hadi;
Zhao, Dongmei

Publication type:

Article

Partially observable Markov decision process‐based sensing scheduling for decentralised cognitive radio networks with the awareness of channel switching delay and imperfect sensing.

Published in:

IET Communications (Wiley-Blackwell), 2016, v. 10, n. 6, p. 651, doi. 10.1049/iet-com.2014.1260

By:

Hoan, Tran Nhut Khai;
Koo, Insoo

Publication type:

Article

Markov processes and some PCF quadratic polynomials.

Published in:

Research in Number Theory, 2019, v. 5, n. 3, p. N.PAG, doi. 10.1007/s40993-019-0165-y

By:

Goksel, Vefa

Publication type:

Article

Reliability assessment for electrical power generation system based on advanced Markov process combined with blocks diagram.

Published in:

International Journal of Electrical & Computer Engineering (2088-8708), 2021, v. 11, n. 5, p. 3647, doi. 10.11591/ijece.v11i5.pp3647-3659

By:

Tawfiq, A. A.;
el-Raouf, M. Osama abed;
El-Gawad, A. A.;
Farahat, M. A.

Publication type:

Article

On discrete-time semi-Markov processes.

Published in:

Discrete & Continuous Dynamical Systems - Series B, 2021, v. 26, n. 3, p. 1499, doi. 10.3934/dcdsb.2020170

By:

Pachon, Angelica;
Polito, Federico;
Ricciuti, Costantino

Publication type:

Article

Approximating exit times of continuous Markov processes.

Published in:

Discrete & Continuous Dynamical Systems - Series B, 2020, v. 25, n. 9, p. 3631, doi. 10.3934/dcdsb.2020076

By:

Kruse, Thomas;
Urusov, Mikhail

Publication type:

Article

A Sensitivity‐Based Construction Approach to Variance Minimization of Markov Decision Processes.

Published in:

Asian Journal of Control, 2019, v. 21, n. 3, p. 1166, doi. 10.1002/asjc.1875

By:

Huang, Yonghao;
Chen, Xi

Publication type:

Article

HEAT KERNEL INTEREST RATE MODELS WITH TIME-INHOMOGENEOUS MARKOV PROCESSES.

Published in:

International Journal of Theoretical & Applied Finance, 2012, v. 15, n. 1, p. 1250007-1, doi. 10.1142/S0219024911006553

By:

AKAHORI, JIRÔ;
MACRINA, ANDREA

Publication type:

Article

ON GIRSANOV AND GENERALIZED FEYNMAN–KAC TRANSFORMATIONS FOR SYMMETRIC MARKOV PROCESSES.

Published in:

Infinite Dimensional Analysis, Quantum Probability & Related Topics, 2007, v. 10, n. 2, p. 141, doi. 10.1142/S0219025707002671

By:

CHUAN-ZHONG CHEN;
ZHI-MING MA;
WEI SUN

Publication type:

Article

Variational Principles for Asymptotic Variance of General Markov Processes.

Published in:

Acta Mathematica Sinica, 2023, v. 39, n. 1, p. 107, doi. 10.1007/s10114-022-1226-z

By:

Huang, Lu Jing;
Mao, Yong Hua;
Wang, Tao

Publication type:

Article

Subordination in the sense of Bochner of L-semigroups and associated Markov processes.

Published in:

Acta Mathematica Sinica, 2014, v. 30, n. 2, p. 187, doi. 10.1007/s10114-014-2751-1

By:

Lupaşcu, Oana

Publication type:

Article

Simulation-Based Algorithms for Markov Decision Processes: Monte Carlo Tree Search from AlphaGo to AlphaZero.

Published in:

Asia-Pacific Journal of Operational Research, 2019, v. 36, n. 06, p. N.PAG, doi. 10.1142/S0217595919400098

By:

Fu, Michael C.

Publication type:

Article

QUANTITATIVE APPROXIMATION OF THE PROBABILITY DISTRIBUTION OF A MARKOV PROCESS BY FORMAL ABSTRACTIONS.

Published in:

Logical Methods in Computer Science (LMCS), 2015, v. 11, n. 3, p. 1, doi. 10.2168/LMCS-11(3:8)2015

By:

SADEGH ESMAEIL ZADEH SOUDJANI;
ABATE, ALESSANDRO

Publication type:

Article

Portfolio Allocation under the Vendor Managed Inventory: A Markov Decision Process.

Published in:

Journal of Applied Sciences & Environmental Management, 2016, v. 20, n. 4, p. 1127, doi. 10.4314/jasem.v20i4.29

By:

EZUGWU, V. O.;
IGBINOSUN, L. I.

Publication type:

Article

Variance reduced value iteration and faster algorithms for solving Markov decision processes.

Published in:

Naval Research Logistics, 2023, v. 70, n. 5, p. 423, doi. 10.1002/nav.21992

By:

Sidford, Aaron;
Wang, Mengdi;
Wu, Xian;
Ye, Yinyu

Publication type:

Article

Markov additive processes for degradation with jumps under dynamic environments.

Published in:

Naval Research Logistics, 2021, v. 68, n. 7, p. 908, doi. 10.1002/nav.21982

By:

Shu, Yin;
Feng, Qianmei;
Kao, Edward P. C.;
Coit, David W.;
Liu, Hao

Publication type:

Article

Continuous-time Markov processes, orthogonal polynomials and Lancaster probabilities.

Published in:

ESAIM: Probability & Statistics, 2020, v. 24, p. 100, doi. 10.1051/ps/2020004

By:

Mena, Ramsés H.;
Palma, Freddy

Publication type:

Article

Empirical Estimator of Stationary Distribution for Semi-Markov Processes.

Published in:

Communications in Statistics: Theory & Methods, 2005, v. 34, n. 4, p. 987, doi. 10.1081/STA-200054441

By:

LIMNIOS, N.;
OUHBI, B.;
SADEK, A.

Publication type:

Article

Hoeffding's Inequality for Stopped Martingales and Semi-Markov Processes.

Published in:

Communications in Statistics: Theory & Methods, 2005, v. 34, n. 3, p. 713, doi. 10.1081/STA-200052150

By:

Limnios, Nikolaos;
Lee, Mei-Ling Ting

Publication type:

Article

Multi-level hierarchic Markov processes as a framework for herd management support.

Published in:

Annals of Operations Research, 2000, v. 94, n. 1-4, p. 69, doi. 10.1023/A:1018921201113

By:

Kristensen, Anders Ringgaard;
Jørgensen, Erik

Publication type:

Article

NON-PARAMETRIC BAYESIAN INFERENCE FOR INHOMOGENEOUS MARKOV POINT PROCESSES.

Published in:

Australian & New Zealand Journal of Statistics, 2008, v. 50, n. 3, p. 257, doi. 10.1111/j.1467-842X.2008.00516.x

By:

Berthelsen, Kasper K.;
Møller, Jesper

Publication type:

Article

Long-Range Dependence of Markov Renewal Processes.

Published in:

Australian & New Zealand Journal of Statistics, 2004, v. 46, n. 1, p. 155, doi. 10.1111/j.1467-842X.2004.00321.x

By:

Vesilo, R. A.

Publication type:

Article

Optimal Approximation of Average Reward Markov Decision Processes.

Published in:

Computational Mathematics & Mathematical Physics, 2025, v. 65, n. 3, p. 567, doi. 10.1134/S0965542524702191

By:

Sapronov, Y. F.;
Yudin, N. E.

Publication type:

Article