A law of large numbers for branching Markov processes by the ergodicity of ancestral lineages.
- Published in:
- ESAIM: Probability & Statistics, 2019, v. 23, p. 638, doi. 10.1051/ps/2018029
- By:
- Publication type:
- Article
Works matching Markov processes
Results: 5000
1
2
Optimal replacement of a system according to a semi-Markov decision process in a semi-Markov environment.
- Published in:
- Optimization Methods & Software, 2003, v. 18, n. 2, p. 181, doi. 10.1080/1055678031000111803
- By:
- Publication type:
- Article
3
Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty.
- Published in:
- Medical Decision Making, 2010, v. 30, n. 4, p. 474, doi. 10.1177/0272989X09353194
- By:
- Publication type:
- Article
4
Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach.
- Published in:
- Mathematics of Operations Research, 2004, v. 29, n. 3, p. 492, doi. 10.1287/moor.1040.0089
- By:
- Publication type:
- Article
5
THE COMPLEXITY OF DECENTRALIZED CONTROL OF MARKOV DECISION PROCESSES.
- Published in:
- Mathematics of Operations Research, 2002, v. 27, n. 4, p. 819, doi. 10.1287/moor.27.4.819.297
- By:
- Publication type:
- Article
6
Uniqueness and Extinction of Weighted Markov Branching Processes.
- Published in:
- Methodology & Computing in Applied Probability, 2005, v. 7, n. 4, p. 489, doi. 10.1007/s11009-005-5005-y
- By:
- Publication type:
- Article
7
Estimation in Stationary Markov Renewal Processes, with Application to Earthquake Forecasting in Turkey.
- Published in:
- Methodology & Computing in Applied Probability, 2005, v. 7, n. 1, p. 119, doi. 10.1007/s11009-005-6658-2
- By:
- Publication type:
- Article
8
Entropy Maximization for Markov and Semi-Markov Processes.
- Published in:
- Methodology & Computing in Applied Probability, 2004, v. 6, n. 1, p. 109, doi. 10.1023/B:MCAP.0000012418.88825.18
- By:
- Publication type:
- Article
9
On Conditioned Limit Structure of the Markov Branching Process without Finite Second Moment.
- Published in:
- Malaysian Journal of Mathematical Sciences, 2017, v. 11, n. 3, p. 393
- By:
- Publication type:
- Article
10
Exponential and gamma form for tail expansions of first-passage distributions in semi-markov processes.
- Published in:
- Advances in Applied Probability, 2022, v. 54, n. 4, p. 1291, doi. 10.1017/apr.2022.4
- By:
- Publication type:
- Article
11
Markov Limid processes for representing and solving renewal problems.
- Published in:
- Annals of Operations Research, 2014, v. 219, n. 1, p. 63, doi. 10.1007/s10479-012-1220-4
- By:
- Publication type:
- Article
12
Inspection and maintenance planning for offshore wind structural components: integrating fatigue failure criteria with Bayesian networks and Markov decision processes.
- Published in:
- Structure & Infrastructure Engineering: Maintenance, Management, Life-Cycle Design & Performance, 2022, v. 18, n. 7, p. 983, doi. 10.1080/15732479.2022.2037667
- By:
- Publication type:
- Article
13
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes.
- Published in:
- Applied Mathematics & Optimization, 2020, v. 81, n. 3, p. 685, doi. 10.1007/s00245-018-9485-x
- By:
- Publication type:
- Article
14
The Transformation Method for Continuous-Time Markov Decision Processes.
- Published in:
- Journal of Optimization Theory & Applications, 2012, v. 154, n. 2, p. 691, doi. 10.1007/s10957-012-0015-8
- By:
- Publication type:
- Article
15
Points Gained in Football: Using Markov Process-Based Value Functions to Assess Team Performance.
- Published in:
- Operations Research, 2021, v. 69, n. 3, p. 877, doi. 10.1287/opre.2020.2034
- By:
- Publication type:
- Article
16
Page importance computation based on Markov processes.
- Published in:
- Information Retrieval Journal, 2011, v. 14, n. 5, p. 488, doi. 10.1007/s10791-011-9164-x
- By:
- Publication type:
- Article
17
Fast MCMC Sampling for Markov Jump Processes and Extensions.
- Published in:
- Journal of Machine Learning Research, 2013, v. 14, n. 11, p. 3295
- By:
- Publication type:
- Article
18
A Hybrid Genetic/Optimization Algorithm for Finite-Horizon,Partially Observed Markov Decision Processes.
- Published in:
- INFORMS Journal on Computing, 2004, v. 16, n. 1, p. 27, doi. 10.1287/ijoc.1020.0024
- By:
- Publication type:
- Article
19
Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems Part 2--Applications in Transportation, Industries, Communications and Networking and More Topics.
- Published in:
- Machine Learning & Knowledge Extraction, 2021, v. 3, n. 4, p. 863, doi. 10.3390/make3040043
- By:
- Publication type:
- Article
20
可数状态空间的平均成本马氏决策过程.
- Published in:
- Control Theory & Applications / Kongzhi Lilun Yu Yinyong, 2021, v. 38, n. 11, p. 1707, doi. 10.7641/CTA.2021.10763
- By:
- Publication type:
- Article
21
OPTIMAL CONTROL OF INFINITE-DIMENSIONAL PIECEWISE DETERMINISTIC MARKOV PROCESSES AND APPLICATION TO THE CONTROL OF NEURONAL DYNAMICS VIA OPTOGENETICS.
- Published in:
- Networks & Heterogeneous Media, 2017, v. 12, n. 3, p. 417, doi. 10.3934/nhm.2017019
- By:
- Publication type:
- Article
22
A primer on partially observable Markov decision processes (POMDPs).
- Published in:
- Methods in Ecology & Evolution, 2021, v. 12, n. 11, p. 2058, doi. 10.1111/2041-210X.13692
- By:
- Publication type:
- Article
23
THE LIMIT BEHAVIOR OF DUAL MARKOV BRANCHING PROCESSES.
- Published in:
- Journal of Applied Probability, 2008, v. 45, n. 1, p. 176, doi. 10.1239/jap/1208358960
- By:
- Publication type:
- Article
24
Analysis of a time–cost trade-off in a resource-constrained GERT project scheduling problem using the Markov decision process.
- Published in:
- Annals of Operations Research, 2024, v. 338, n. 1, p. 535, doi. 10.1007/s10479-024-05896-8
- By:
- Publication type:
- Article
25
PIECEWISE-DETERMINISTIC MARKOV PROCESSES AS LIMITS OF MARKOV JUMP PROCESSES.
- Published in:
- Advances in Applied Probability, 2012, v. 44, n. 3, p. 729, doi. 10.1239/aap/1346955262
- By:
- Publication type:
- Article
26
Bayesian multiple changepoints detection for Markov jump processes.
- Published in:
- Computational Statistics, 2020, v. 35, n. 3, p. 1501, doi. 10.1007/s00180-020-00956-6
- By:
- Publication type:
- Article
27
Irreversible Markov processes for phylogenetic models.
- Published in:
- Numerical Linear Algebra with Applications, 2003, v. 10, n. 7, p. 577, doi. 10.1002/nla.337
- By:
- Publication type:
- Article
28
Continuous-time Markov processes, orthogonal polynomials and Lancaster probabilities.
- Published in:
- ESAIM: Probability & Statistics, 2020, v. 24, p. 100, doi. 10.1051/ps/2020004
- By:
- Publication type:
- Article
29
STOCHASTIC COMPARISONS FOR NON--MARKOV PROCESSES.
- Published in:
- Mathematics of Operations Research, 1986, v. 11, n. 4, p. 608, doi. 10.1287/moor.11.4.608
- By:
- Publication type:
- Article
30
MARKOV DECISION DRIFT PROCESSES; CONDITIONS FOR OPTIMALITY OBTAINED BY DISCRETIZATION.
- Published in:
- Mathematics of Operations Research, 1985, v. 10, n. 1, p. 160, doi. 10.1287/moor.10.1.160
- By:
- Publication type:
- Article
31
STORAGE PROCESSES WITH MARKOV ADDITIVE INPUT AND OUTPUT.
- Published in:
- Mathematics of Operations Research, 1984, v. 9, n. 3, p. 424, doi. 10.1287/moor.9.3.424
- By:
- Publication type:
- Article
32
Explicit Forward Recursive Estimators for Markov Modulated Markov Processes.
- Published in:
- Stochastic Models, 2012, v. 28, n. 3, p. 359, doi. 10.1080/15326349.2012.699750
- By:
- Publication type:
- Article
33
Laws of Large Numbers and Functional Central Limit Theorems for Generalized Semi-Markov Processes.
- Published in:
- Stochastic Models, 2006, v. 22, n. 2, p. 201, doi. 10.1080/15326340600648997
- By:
- Publication type:
- Article
34
A functional central limit theorem for Markov additive processes with an application to the closed Lu–Kumar network.
- Published in:
- Stochastic Models, 2001, v. 17, n. 4, p. 459, doi. 10.1081/STM-120001219
- By:
- Publication type:
- Article
35
Solving Markov decision processes by d-graph algorithms.
- Published in:
- Control & Cybernetics, 2012, v. 41, n. 3, p. 577
- By:
- Publication type:
- Article
36
A linear programming based approach for composite-action Markov decision processes.
- Published in:
- RAIRO -- Operations Research, 2019, v. 53, n. 5, p. 1749, doi. 10.1051/ro/2018081
- By:
- Publication type:
- Article
37
A hybrid Markov process-mathematical programming approach for joint location-inventory problem under supply disruptions.
- Published in:
- RAIRO -- Operations Research, 2018, v. 52, n. 4/5, p. 1147, doi. 10.1051/ro/2018012
- By:
- Publication type:
- Article
38
NON-PARAMETRIC BAYESIAN INFERENCE FOR INHOMOGENEOUS MARKOV POINT PROCESSES.
- Published in:
- Australian & New Zealand Journal of Statistics, 2008, v. 50, n. 3, p. 257, doi. 10.1111/j.1467-842X.2008.00516.x
- By:
- Publication type:
- Article
39
Long-Range Dependence of Markov Renewal Processes.
- Published in:
- Australian & New Zealand Journal of Statistics, 2004, v. 46, n. 1, p. 155, doi. 10.1111/j.1467-842X.2004.00321.x
- By:
- Publication type:
- Article
40
Consistent estimation for discretely observed Markov jump processes with an absorbing state.
- Published in:
- Statistical Papers, 2013, v. 54, n. 4, p. 993, doi. 10.1007/s00362-013-0515-0
- By:
- Publication type:
- Article
41
The structure of the local time of Markov processes indexed by Lévy trees.
- Published in:
- Probability Theory & Related Fields, 2024, v. 189, n. 1/2, p. 1, doi. 10.1007/s00440-023-01258-w
- By:
- Publication type:
- Article
42
Sufficiency of Markov Policies for Continuous-Time Jump Markov Decision Processes.
- Published in:
- Mathematics of Operations Research, 2022, v. 47, n. 2, p. 1266, doi. 10.1287/moor.2021.1169
- By:
- Publication type:
- Article
43
Core Nonemptiness of Stratified Pooling Games: A Structured Markov Decision Process Approach.
- Published in:
- Mathematics of Operations Research, 2020, v. 45, n. 4, p. 1445, doi. 10.1287/moor.2019.1038
- By:
- Publication type:
- Article
44
On the Asymptotic Optimality of Finite Approximations to Markov Decision Processes with Borel Spaces.
- Published in:
- Mathematics of Operations Research, 2017, v. 42, n. 4, p. 945, doi. 10.1287/moor.2016.0832
- By:
- Publication type:
- Article
45
Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities.
- Published in:
- Mathematics of Operations Research, 2016, v. 41, n. 2, p. 656, doi. 10.1287/moor.2015.0746
- By:
- Publication type:
- Article
46
Splitting Randomized Stationary Policies in Total-Reward Markov Decision Processes.
- Published in:
- Mathematics of Operations Research, 2012, v. 37, n. 1, p. 129, doi. 10.1287/moor.1110.0525
- By:
- Publication type:
- Article
47
On Average Reward Semi-Markov Decision Processes with a General Multichain Structure.
- Published in:
- Mathematics of Operations Research, 2004, v. 29, n. 2, p. 339, doi. 10.1287/moor.1030.0077
- By:
- Publication type:
- Article
48
ACHIEVING TARGET STATE-ACTION FREQUENCIES IN MULTICHAIN AVERAGE-REWARD MARKOV DECISION PROCESSES.
- Published in:
- Mathematics of Operations Research, 2002, v. 27, n. 3, p. 545, doi. 10.1287/moor.27.3.545.316
- By:
- Publication type:
- Article
49
HOW DOES THE VALUE FUNCTION OF A MARKOV DECISION PROCESS DEPEND ON THE TRANSITION PROBABILITIES?
- Published in:
- Mathematics of Operations Research, 1997, v. 22, n. 4, p. 872, doi. 10.1287/moor.22.4.872
- By:
- Publication type:
- Article
50
Self-Adapting Network Relaxations for Weakly Coupled Markov Decision Processes.
- Published in:
- Management Science, 2025, v. 71, n. 2, p. 1779, doi. 10.1287/mnsc.2022.01108
- By:
- Publication type:
- Article