Works matching Markov processes

Results: 5000

Uniqueness and Extinction of Weighted Markov Branching Processes.

Published in:

Methodology & Computing in Applied Probability, 2005, v. 7, n. 4, p. 489, doi. 10.1007/s11009-005-5005-y

By:

Anyue Chen;
Junping Li;
Ramesh, N.

Publication type:

Article

Estimation in Stationary Markov Renewal Processes, with Application to Earthquake Forecasting in Turkey.

Published in:

Methodology & Computing in Applied Probability, 2005, v. 7, n. 1, p. 119, doi. 10.1007/s11009-005-6658-2

By:

Alvarez, Enrique

Publication type:

Article

Entropy Maximization for Markov and Semi-Markov Processes.

Published in:

Methodology & Computing in Applied Probability, 2004, v. 6, n. 1, p. 109, doi. 10.1023/B:MCAP.0000012418.88825.18

By:

Girardin, Valerie

Publication type:

Article

Optimal replacement of a system according to a semi-Markov decision process in a semi-Markov environment.

Published in:

Optimization Methods & Software, 2003, v. 18, n. 2, p. 181, doi. 10.1080/1055678031000111803

By:

Qiying Hu;
Wuyi Yue

Publication type:

Article

On Conditioned Limit Structure of the Markov Branching Process without Finite Second Moment.

Published in:

Malaysian Journal of Mathematical Sciences, 2017, v. 11, n. 3, p. 393

By:

Imomov, A.

Publication type:

Article

A primer on partially observable Markov decision processes (POMDPs).

Published in:

Methods in Ecology & Evolution, 2021, v. 12, n. 11, p. 2058, doi. 10.1111/2041-210X.13692

By:

Chadès, Iadine;
Pascal, Luz V.;
Nicol, Sam;
Fletcher, Cameron S.;
Ferrer‐Mestres, Jonathan

Publication type:

Article

Points Gained in Football: Using Markov Process-Based Value Functions to Assess Team Performance.

Published in:

Operations Research, 2021, v. 69, n. 3, p. 877, doi. 10.1287/opre.2020.2034

By:

Chan, Timothy C. Y.;
Fernandes, Craig;
Puterman, Martin L.

Publication type:

Article

Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems Part 2--Applications in Transportation, Industries, Communications and Networking and More Topics.

Published in:

Machine Learning & Knowledge Extraction, 2021, v. 3, n. 4, p. 863, doi. 10.3390/make3040043

By:

Xuanchen Xiang;
Simon Foo;
Huanyu Zang

Publication type:

Article

Inspection and maintenance planning for offshore wind structural components: integrating fatigue failure criteria with Bayesian networks and Markov decision processes.

Published in:

Structure & Infrastructure Engineering: Maintenance, Management, Life-Cycle Design & Performance, 2022, v. 18, n. 7, p. 983, doi. 10.1080/15732479.2022.2037667

By:

Hlaing, Nandar;
Morato, Pablo G.;
Nielsen, Jannie S.;
Amirafshari, Peyman;
Kolios, Athanasios;
Rigo, Philippe

Publication type:

Article

Markov Limid processes for representing and solving renewal problems.

Published in:

Annals of Operations Research, 2014, v. 219, n. 1, p. 63, doi. 10.1007/s10479-012-1220-4

By:

Jørgensen, Erik;
Kristensen, Anders;
Nilsson, Dennis

Publication type:

Article

A law of large numbers for branching Markov processes by the ergodicity of ancestral lineages.

Published in:

ESAIM: Probability & Statistics, 2019, v. 23, p. 638, doi. 10.1051/ps/2018029

By:

Marguet, Aline

Publication type:

Article

Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach.

Published in:

Mathematics of Operations Research, 2004, v. 29, n. 3, p. 492, doi. 10.1287/moor.1040.0089

By:

Feinberg, Eugene A.

Publication type:

Article

THE COMPLEXITY OF DECENTRALIZED CONTROL OF MARKOV DECISION PROCESSES.

Published in:

Mathematics of Operations Research, 2002, v. 27, n. 4, p. 819, doi. 10.1287/moor.27.4.819.297

By:

Bernstein, Daniel S.;
Givan, Robert;
Immerman, Neil;
Zilberstein, Shlomo

Publication type:

Article

OPTIMAL CONTROL OF INFINITE-DIMENSIONAL PIECEWISE DETERMINISTIC MARKOV PROCESSES AND APPLICATION TO THE CONTROL OF NEURONAL DYNAMICS VIA OPTOGENETICS.

Published in:

Networks & Heterogeneous Media, 2017, v. 12, n. 3, p. 417, doi. 10.3934/nhm.2017019

By:

RENAULT, VINCENT;
THIEULLEN, MICHÈLE;
TRÉLAT, EMMANUEL

Publication type:

Article

On Risk-Sensitive Piecewise Deterministic Markov Decision Processes.

Published in:

Applied Mathematics & Optimization, 2020, v. 81, n. 3, p. 685, doi. 10.1007/s00245-018-9485-x

By:

Guo, Xin;
Zhang, Yi

Publication type:

Article

Page importance computation based on Markov processes.

Published in:

Information Retrieval Journal, 2011, v. 14, n. 5, p. 488, doi. 10.1007/s10791-011-9164-x

By:

Gao, Bin;
Liu, Tie-Yan;
Liu, Yuting;
Wang, Taifeng;
Ma, Zhi-Ming;
Li, Hang

Publication type:

Article

Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty.

Published in:

Medical Decision Making, 2010, v. 30, n. 4, p. 474, doi. 10.1177/0272989X09353194

By:

Alagoz, Oguzhan;
Hsu, Heather;
Schaefer, Andrew J.;
Roberts, Mark S.

Publication type:

Article

The Transformation Method for Continuous-Time Markov Decision Processes.

Published in:

Journal of Optimization Theory & Applications, 2012, v. 154, n. 2, p. 691, doi. 10.1007/s10957-012-0015-8

By:

Piunovskiy, Alexey;
Zhang, Yi

Publication type:

Article

Bayesian multiple changepoints detection for Markov jump processes.

Published in:

Computational Statistics, 2020, v. 35, n. 3, p. 1501, doi. 10.1007/s00180-020-00956-6

By:

Shaochuan, Lu

Publication type:

Article

可数状态空间的平均成本马氏决策过程.

Published in:

Control Theory & Applications / Kongzhi Lilun Yu Yinyong, 2021, v. 38, n. 11, p. 1707, doi. 10.7641/CTA.2021.10763

By:

张俊玉;
吴怡婷;
夏俐;
曹希仁

Publication type:

Article

Exponential and gamma form for tail expansions of first-passage distributions in semi-markov processes.

Published in:

Advances in Applied Probability, 2022, v. 54, n. 4, p. 1291, doi. 10.1017/apr.2022.4

By:

Butler, Ronald W.

Publication type:

Article

PIECEWISE-DETERMINISTIC MARKOV PROCESSES AS LIMITS OF MARKOV JUMP PROCESSES.

Published in:

Advances in Applied Probability, 2012, v. 44, n. 3, p. 729, doi. 10.1239/aap/1346955262

By:

FRANZ, UWE;
LIEBSCHER, VOLKMAR;
ZEISER, STEFAN

Publication type:

Article

Fast MCMC Sampling for Markov Jump Processes and Extensions.

Published in:

Journal of Machine Learning Research, 2013, v. 14, n. 11, p. 3295

By:

Vinayak Rao;
Yee Whte Teg

Publication type:

Article

Analysis of a time–cost trade-off in a resource-constrained GERT project scheduling problem using the Markov decision process.

Published in:

Annals of Operations Research, 2024, v. 338, n. 1, p. 535, doi. 10.1007/s10479-024-05896-8

By:

Sadri, Shadi;
Ghomi, S. M. T. Fatemi;
Dehghanian, Amin

Publication type:

Article

A Hybrid Genetic/Optimization Algorithm for Finite-Horizon,Partially Observed Markov Decision Processes.

Published in:

INFORMS Journal on Computing, 2004, v. 16, n. 1, p. 27, doi. 10.1287/ijoc.1020.0024

By:

Zong-Zhi Lin;
Bean, James C.;
White III, Chelsea C.

Publication type:

Article

THE LIMIT BEHAVIOR OF DUAL MARKOV BRANCHING PROCESSES.

Published in:

Journal of Applied Probability, 2008, v. 45, n. 1, p. 176, doi. 10.1239/jap/1208358960

By:

Yangrong Li;
Pakes, Anthony G.;
Jia Li;
Anhui Gu

Publication type:

Article

An Algorithm for Asymptotic Mean and Variance for Markov Renewal Process of M/G/1 Type with Finite Level.

Published in:

Methodology & Computing in Applied Probability, 2022, v. 24, n. 1, p. 195, doi. 10.1007/s11009-021-09846-w

By:

Shin, Yang Woo

Publication type:

Article

Quasi-Stationary Asymptotics for Perturbed Semi-Markov Processes in Discrete Time.

Published in:

Methodology & Computing in Applied Probability, 2017, v. 19, n. 4, p. 1047, doi. 10.1007/s11009-016-9530-7

By:

Petersson, Mikael

Publication type:

Article

Extremes of Markov-additive Processes with One-sided Jumps, with Queueing Applications.

Published in:

Methodology & Computing in Applied Probability, 2011, v. 13, n. 2, p. 221, doi. 10.1007/s11009-009-9140-8

By:

Dieker, A.;
Mandjes, M.

Publication type:

Article

Estimating Stochastic Dynamical Systems Driven by a Continuous-Time Jump Markov Process.

Published in:

Methodology & Computing in Applied Probability, 2006, v. 8, n. 4, p. 431, doi. 10.1007/s11009-006-0423-z

By:

Chiquet, Julien;
Limnios, Nikolaos

Publication type:

Article

Moment Solutions for the State Exiting Counting Processes of a Markov Renewal Process.

Published in:

Methodology & Computing in Applied Probability, 1999, v. 1, n. 3, p. 247, doi. 10.1023/A:1010065426139

By:

Rossetti, Manuel D.;
Clark, Gordon M.

Publication type:

Article

OVERVIEW OF MARKOV DECISION PROCESS APPLICATIONS.

Published in:

Multi-Knowledge Electronic Comprehensive Journal For Education & Science Publications (MECSJ), 2020, n. 31, p. 1

By:

Alqahtani, Jawaher Saad;
Kamel, Mahomud;
Rabie, Osamah

Publication type:

Article

Wiener-Hopf Factorizations for a Multidimensional Markov Additive Process and their Applications to Reflected Processes.

Published in:

Stochastic Systems, 2012, v. 2, n. 1, p. 67, doi. 10.1287/12-SSY069

By:

Miyazawa, Masakiyo;
Zwart, Bert

Publication type:

Article

马尔可夫过程的低秩谱估计.

Published in:

Journal of South China Normal University (Natural Science Edition) / Huanan Shifan Daxue Xuebao (Ziran Kexue Ban), 2022, v. 54, n. 4, p. 101, doi. 10.6054/j.jscnun.2022063

By:

贲树军;
翁艺鸿

Publication type:

Article

改进Markov过程的异构无线网络垂直切换算法.

Published in:

Journal of Jilin University (Science Edition) / Jilin Daxue Xuebao (Lixue Ban), 2019, v. 57, n. 3, p. 633, doi. 10.13413/j.cnki.jdxblxb.2018225

By:

闫丽;
高婷

Publication type:

Article

Health Status-Based Predictive Maintenance Decision-Making via LSTM and Markov Decision Process.

Published in:

Mathematics (2227-7390), 2023, v. 11, n. 1, p. 109, doi. 10.3390/math11010109

By:

Zheng, Pan;
Zhao, Wenqin;
Lv, Yaqiong;
Qian, Lu;
Li, Yifan

Publication type:

Article

Non-Homogeneous Semi-Markov and Markov Renewal Processes and Change of Measure in Credit Risk.

Published in:

Mathematics (2227-7390), 2021, v. 9, n. 1, p. 55, doi. 10.3390/math9010055

By:

Vassiliou, P.-C.G.

Publication type:

Article

Some characterizations for Markov processes at first passage.

Published in:

ALEA. Latin American Journal of Probability & Mathematical Statistics, 2022, v. 19, n. 2, p. 1649, doi. 10.30757/ALEA.v19-63

By:

Vidmar, Matija

Publication type:

Article

On the exponential functional of Markov Additive Processes, and applications tomulti-type self-similar fragmentation processes and trees.

Published in:

ALEA. Latin American Journal of Probability & Mathematical Statistics, 2018, v. 15, p. 1257, doi. 10.30757/ALEA.v15-47

By:

Stephenson, Robin

Publication type:

Article

SHM-informed life-cycle intelligent maintenance of fatigue-sensitive detail using Bayesian forecasting and Markov decision process.

Published in:

Structural Health Monitoring, 2024, v. 23, n. 1, p. 187, doi. 10.1177/14759217231160412

By:

Lai, Li;
Dong, You;
Smyl, Danny

Publication type:

Article

Asymptotic Optimality of Semi-Open-Loop Policies in Markov Decision Processes with Large Lead Times.

Published in:

Operations Research, 2023, v. 71, n. 6, p. 2061, doi. 10.1287/opre.2021.0088

By:

Bai, Xingyu;
Chen, Xin;
Li, Menglong;
Stolyar, Alexander

Publication type:

Article

Quantile Markov Decision Processes.

Published in:

Operations Research, 2022, v. 70, n. 3, p. 1428, doi. 10.1287/opre.2021.2123

By:

Li, Xiaocheng;
Zhong, Huaiyang;
Brandeau, Margaret L.

Publication type:

Article

Technical Note—Cyclic Variables and Markov Decision Processes.

Published in:

Operations Research, 2020, v. 68, n. 4, p. 1231, doi. 10.1287/opre.2019.1913

By:

Haviv, Avery

Publication type:

Article

Easy Affine Markov Decision Processes.

Published in:

Operations Research, 2019, v. 67, n. 6, p. 1719, doi. 10.1287/opre.2018.1836

By:

Ning, Jie;
Sobel, Matthew J.

Publication type:

Article

Series Expansions for Continuous-Time Markov Processes.

Published in:

Operations Research, 2010, v. 58, n. 3, p. 756, doi. 10.1287/opre.1090.0738

By:

Heidergott, Bernd;
Hordijk, Arie;
Leder, Nicole

Publication type:

Article

The Compositional Construction of Markov Processes.

Published in:

Applied Categorical Structures, 2011, v. 19, n. 1, p. 425, doi. 10.1007/s10485-010-9233-0

By:

Albasini, Luisa de Francesco;
Sabadini, Nicoletta;
Walters, Robert F. C.

Publication type:

Article

Rendezvous planning for multiple autonomous underwater vehicles using a Markov decision process.

Published in:

IET Radar, Sonar & Navigation (Wiley-Blackwell), 2017, v. 11, n. 12, p. 1762, doi. 10.1049/iet-rsn.2017.0098

By:

Yordanova, Veronika;
Griffiths, Hugh;
Hailes, Stephen

Publication type:

Article

A SURVEY OF PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES: THEORY, MODELS, AND ALGORITHMS.

Published in:

Management Science, 1982, v. 28, n. 1, p. 1, doi. 10.1287/mnsc.28.1.1

By:

Monahan, George E.

Publication type:

Article

THE LIMIT PROPERTIES DIFFUSION PROCESS IN A SEMI-MARKOV ENVIRONMENT.

Published in:

Journal of Applied Mathematics & Computational Mechanics, 2018, v. 17, n. 1, p. 5, doi. 10.17512/jamcm.2018.1.01

By:

Chabanyuk, Yaroslav;
Rosa, Wojciech

Publication type:

Article

Markov processes and some PCF quadratic polynomials.

Published in:

Research in Number Theory, 2019, v. 5, n. 3, p. N.PAG, doi. 10.1007/s40993-019-0165-y

By:

Goksel, Vefa

Publication type:

Article