Works matching Markov processes
Results: 5000
Uniqueness and Extinction of Weighted Markov Branching Processes.
- Published in:
- Methodology & Computing in Applied Probability, 2005, v. 7, n. 4, p. 489, doi. 10.1007/s11009-005-5005-y
- By:
- Publication type:
- Article
Estimation in Stationary Markov Renewal Processes, with Application to Earthquake Forecasting in Turkey.
- Published in:
- Methodology & Computing in Applied Probability, 2005, v. 7, n. 1, p. 119, doi. 10.1007/s11009-005-6658-2
- By:
- Publication type:
- Article
Entropy Maximization for Markov and Semi-Markov Processes.
- Published in:
- Methodology & Computing in Applied Probability, 2004, v. 6, n. 1, p. 109, doi. 10.1023/B:MCAP.0000012418.88825.18
- By:
- Publication type:
- Article
On Conditioned Limit Structure of the Markov Branching Process without Finite Second Moment.
- Published in:
- Malaysian Journal of Mathematical Sciences, 2017, v. 11, n. 3, p. 393
- By:
- Publication type:
- Article
OPTIMAL CONTROL OF INFINITE-DIMENSIONAL PIECEWISE DETERMINISTIC MARKOV PROCESSES AND APPLICATION TO THE CONTROL OF NEURONAL DYNAMICS VIA OPTOGENETICS.
- Published in:
- Networks & Heterogeneous Media, 2017, v. 12, n. 3, p. 417, doi. 10.3934/nhm.2017019
- By:
- Publication type:
- Article
A Hybrid Genetic/Optimization Algorithm for Finite-Horizon,Partially Observed Markov Decision Processes.
- Published in:
- INFORMS Journal on Computing, 2004, v. 16, n. 1, p. 27, doi. 10.1287/ijoc.1020.0024
- By:
- Publication type:
- Article
A primer on partially observable Markov decision processes (POMDPs).
- Published in:
- Methods in Ecology & Evolution, 2021, v. 12, n. 11, p. 2058, doi. 10.1111/2041-210X.13692
- By:
- Publication type:
- Article
THE LIMIT BEHAVIOR OF DUAL MARKOV BRANCHING PROCESSES.
- Published in:
- Journal of Applied Probability, 2008, v. 45, n. 1, p. 176, doi. 10.1239/jap/1208358960
- By:
- Publication type:
- Article
Fast MCMC Sampling for Markov Jump Processes and Extensions.
- Published in:
- Journal of Machine Learning Research, 2013, v. 14, n. 11, p. 3295
- By:
- Publication type:
- Article
A law of large numbers for branching Markov processes by the ergodicity of ancestral lineages.
- Published in:
- ESAIM: Probability & Statistics, 2019, v. 23, p. 638, doi. 10.1051/ps/2018029
- By:
- Publication type:
- Article
Optimal replacement of a system according to a semi-Markov decision process in a semi-Markov environment.
- Published in:
- Optimization Methods & Software, 2003, v. 18, n. 2, p. 181, doi. 10.1080/1055678031000111803
- By:
- Publication type:
- Article
Markov Decision Processes: A Tool for Sequential Decision Making under Uncertainty.
- Published in:
- Medical Decision Making, 2010, v. 30, n. 4, p. 474, doi. 10.1177/0272989X09353194
- By:
- Publication type:
- Article
Analysis of a time–cost trade-off in a resource-constrained GERT project scheduling problem using the Markov decision process.
- Published in:
- Annals of Operations Research, 2024, v. 338, n. 1, p. 535, doi. 10.1007/s10479-024-05896-8
- By:
- Publication type:
- Article
Markov Limid processes for representing and solving renewal problems.
- Published in:
- Annals of Operations Research, 2014, v. 219, n. 1, p. 63, doi. 10.1007/s10479-012-1220-4
- By:
- Publication type:
- Article
Exponential and gamma form for tail expansions of first-passage distributions in semi-markov processes.
- Published in:
- Advances in Applied Probability, 2022, v. 54, n. 4, p. 1291, doi. 10.1017/apr.2022.4
- By:
- Publication type:
- Article
PIECEWISE-DETERMINISTIC MARKOV PROCESSES AS LIMITS OF MARKOV JUMP PROCESSES.
- Published in:
- Advances in Applied Probability, 2012, v. 44, n. 3, p. 729, doi. 10.1239/aap/1346955262
- By:
- Publication type:
- Article
Recent Advances in Deep Reinforcement Learning Applications for Solving Partially Observable Markov Decision Processes (POMDP) Problems Part 2--Applications in Transportation, Industries, Communications and Networking and More Topics.
- Published in:
- Machine Learning & Knowledge Extraction, 2021, v. 3, n. 4, p. 863, doi. 10.3390/make3040043
- By:
- Publication type:
- Article
On Risk-Sensitive Piecewise Deterministic Markov Decision Processes.
- Published in:
- Applied Mathematics & Optimization, 2020, v. 81, n. 3, p. 685, doi. 10.1007/s00245-018-9485-x
- By:
- Publication type:
- Article
The Transformation Method for Continuous-Time Markov Decision Processes.
- Published in:
- Journal of Optimization Theory & Applications, 2012, v. 154, n. 2, p. 691, doi. 10.1007/s10957-012-0015-8
- By:
- Publication type:
- Article
Bayesian multiple changepoints detection for Markov jump processes.
- Published in:
- Computational Statistics, 2020, v. 35, n. 3, p. 1501, doi. 10.1007/s00180-020-00956-6
- By:
- Publication type:
- Article
Points Gained in Football: Using Markov Process-Based Value Functions to Assess Team Performance.
- Published in:
- Operations Research, 2021, v. 69, n. 3, p. 877, doi. 10.1287/opre.2020.2034
- By:
- Publication type:
- Article
Page importance computation based on Markov processes.
- Published in:
- Information Retrieval Journal, 2011, v. 14, n. 5, p. 488, doi. 10.1007/s10791-011-9164-x
- By:
- Publication type:
- Article
可数状态空间的平均成本马氏决策过程.
- Published in:
- Control Theory & Applications / Kongzhi Lilun Yu Yinyong, 2021, v. 38, n. 11, p. 1707, doi. 10.7641/CTA.2021.10763
- By:
- Publication type:
- Article
Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach.
- Published in:
- Mathematics of Operations Research, 2004, v. 29, n. 3, p. 492, doi. 10.1287/moor.1040.0089
- By:
- Publication type:
- Article
THE COMPLEXITY OF DECENTRALIZED CONTROL OF MARKOV DECISION PROCESSES.
- Published in:
- Mathematics of Operations Research, 2002, v. 27, n. 4, p. 819, doi. 10.1287/moor.27.4.819.297
- By:
- Publication type:
- Article
Optimizing African Port Hinterland Connectivity Using Markov Processes, Max-Flow, and Traffic Flow Models: A Case Study of Dar es Salaam Port.
- Published in:
- Applied Sciences (2076-3417), 2025, v. 15, n. 4, p. 1966, doi. 10.3390/app15041966
- By:
- Publication type:
- Article
An Algorithm for Asymptotic Mean and Variance for Markov Renewal Process of M/G/1 Type with Finite Level.
- Published in:
- Methodology & Computing in Applied Probability, 2022, v. 24, n. 1, p. 195, doi. 10.1007/s11009-021-09846-w
- By:
- Publication type:
- Article
Quasi-Stationary Asymptotics for Perturbed Semi-Markov Processes in Discrete Time.
- Published in:
- Methodology & Computing in Applied Probability, 2017, v. 19, n. 4, p. 1047, doi. 10.1007/s11009-016-9530-7
- By:
- Publication type:
- Article
Extremes of Markov-additive Processes with One-sided Jumps, with Queueing Applications.
- Published in:
- Methodology & Computing in Applied Probability, 2011, v. 13, n. 2, p. 221, doi. 10.1007/s11009-009-9140-8
- By:
- Publication type:
- Article
Estimating Stochastic Dynamical Systems Driven by a Continuous-Time Jump Markov Process.
- Published in:
- Methodology & Computing in Applied Probability, 2006, v. 8, n. 4, p. 431, doi. 10.1007/s11009-006-0423-z
- By:
- Publication type:
- Article
Moment Solutions for the State Exiting Counting Processes of a Markov Renewal Process.
- Published in:
- Methodology & Computing in Applied Probability, 1999, v. 1, n. 3, p. 247, doi. 10.1023/A:1010065426139
- By:
- Publication type:
- Article
ON THE MONOTONICITY OF FLUCTUATION SPECTRA FOR THREE-STATE MARKOV PROCESSES.
- Published in:
- Fluctuation & Noise Letters, 2007, v. 7, n. 3, p. L181, doi. 10.1142/S0219477507003830
- By:
- Publication type:
- Article
基于马尔可夫决策过程的电动汽车充电站能量管理策略.
- Published in:
- Electric Power Automation Equipment / Dianli Zidonghua Shebei, 2022, v. 42, n. 10, p. 92, doi. 10.16081/j.epae.202208031
- By:
- Publication type:
- Article
On a New Characterization of Harris Recurrence for Markov Chains and Processes.
- Published in:
- Mathematics (2227-7390), 2023, v. 11, n. 9, p. 2165, doi. 10.3390/math11092165
- By:
- Publication type:
- Article
Health Status-Based Predictive Maintenance Decision-Making via LSTM and Markov Decision Process.
- Published in:
- Mathematics (2227-7390), 2023, v. 11, n. 1, p. 109, doi. 10.3390/math11010109
- By:
- Publication type:
- Article
A Machine Learning–Enabled Partially Observable Markov Decision Process Framework for Early Sepsis Prediction.
- Published in:
- INFORMS Journal on Computing, 2022, v. 34, n. 4, p. 2039, doi. 10.1287/ijoc.2022.1176
- By:
- Publication type:
- Article
Response Operators for Markov Processes in a Finite State Space: Radius of Convergence and Link to the Response Theory for Axiom A Systems.
- Published in:
- Journal of Statistical Physics, 2016, v. 162, n. 2, p. 312, doi. 10.1007/s10955-015-1409-4
- By:
- Publication type:
- Article
Portfolio Allocation under the Vendor Managed Inventory: A Markov Decision Process.
- Published in:
- Journal of Applied Sciences & Environmental Management, 2016, v. 20, n. 4, p. 1127, doi. 10.4314/jasem.v20i4.29
- By:
- Publication type:
- Article
Methodology for the formation of a special course on applications of Markov processes.
- Published in:
- Revista Espacios, 2020, v. 41, n. 9, p. 287
- By:
- Publication type:
- Article
STOCHASTIC ATTRACTORS FOR NON-ERGODIC MARKOV PROCESSES:: SOME EXAMPLES.
- Published in:
- Stochastics & Dynamics, 2006, v. 6, n. 3, p. 395, doi. 10.1142/S0219493706001815
- By:
- Publication type:
- Article
A SURVEY OF PARTIALLY OBSERVABLE MARKOV DECISION PROCESSES: THEORY, MODELS, AND ALGORITHMS.
- Published in:
- Management Science, 1982, v. 28, n. 1, p. 1, doi. 10.1287/mnsc.28.1.1
- By:
- Publication type:
- Article
Laws of Large Numbers and Functional Central Limit Theorems for Generalized Semi-Markov Processes.
- Published in:
- Stochastic Models, 2006, v. 22, n. 2, p. 201, doi. 10.1080/15326340600648997
- By:
- Publication type:
- Article
A functional central limit theorem for Markov additive processes with an application to the closed Lu–Kumar network.
- Published in:
- Stochastic Models, 2001, v. 17, n. 4, p. 459, doi. 10.1081/STM-120001219
- By:
- Publication type:
- Article
Aircraft Flight Autonomous Decision-Making Method Based on Target Predicted Trajectory and Markov Decision Process.
- Published in:
- Actuators, 2024, v. 13, n. 12, p. 496, doi. 10.3390/act13120496
- By:
- Publication type:
- Article
Representing stochastic damage evolution in disordered media as a jump Markov process using the fiber bundle model.
- Published in:
- International Journal of Damage Mechanics, 2017, v. 26, n. 1, p. 146, doi. 10.1177/1056789516650249
- By:
- Publication type:
- Article
Semi‐selfish mining based on hidden Markov decision process.
- Published in:
- International Journal of Intelligent Systems, 2021, v. 36, n. 7, p. 3596, doi. 10.1002/int.22428
- By:
- Publication type:
- Article
A functional central limit theorem for Markov additive arrival processes and its applications to queueing systems.
- Published in:
- Queueing Systems, 2016, v. 84, n. 3/4, p. 381, doi. 10.1007/s11134-016-9496-8
- By:
- Publication type:
- Article
Wide-sense regeneration for Harris recurrent Markov processes: an open problem.
- Published in:
- Queueing Systems, 2011, v. 68, n. 3/4, p. 305, doi. 10.1007/s11134-011-9238-x
- By:
- Publication type:
- Article
NON-PARAMETRIC BAYESIAN INFERENCE FOR INHOMOGENEOUS MARKOV POINT PROCESSES.
- Published in:
- Australian & New Zealand Journal of Statistics, 2008, v. 50, n. 3, p. 257, doi. 10.1111/j.1467-842X.2008.00516.x
- By:
- Publication type:
- Article
Long-Range Dependence of Markov Renewal Processes.
- Published in:
- Australian & New Zealand Journal of Statistics, 2004, v. 46, n. 1, p. 155, doi. 10.1111/j.1467-842X.2004.00321.x
- By:
- Publication type:
- Article