Search results for "Markov"
showing 10 items of 628 documents
Bayesian methods in cost-effectiveness studies: objectivity, computation and other relevant aspects.
2009
In a probabilistic sensitivity analysis (PSA) of a cost-effectiveness (CE) study, the unknown parameters are considered as random variables. A crucial question is what probabilistic distribution is suitable for synthesizing the available information (mainly data from clinical trials) about these parameters. In this context, the important role of Bayesian methodology has been recognized, where the parameters are of a random nature. We explore, in the context of CE analyses, how formal objective Bayesian methods can be implemented. We fully illustrate the methodology using two CE problems that frequently appear in the CE literature. The results are compared with those obtained with other popu…
Energy Harvesting Powered Packet Transmissions in Duty-Cycled WSNs: A DTMC Analysis
2017
Energy harvesting (EH) promises an extended lifetime for wireless sensor networks (WSNs), supplying sensor nodes with accumulated energy from natural sources. Different from battery powered sensors, nodes in EH-enabled WSNs are equipped with an energy harvesting accessory in order to extract energy from surrounding sources. Based upon the harvested energy, sensor nodes perform data exchange activities. In this paper, we develop two discrete time Markov chain (DTMC) models to analyze the performance of packet transmissions in such a WSN while employing a generic synchronous medium access control (MAC) protocol. Using the proposed DTMC models, we investigate the effect of EH over a specific s…
Markov Chain Analysis of CA and CF with Multiple Types of Users
2019
In the previous chapter, we studied in depth the impact of CA and CF on traffic flows in systems where there exists only one type of users with one type of flows. In this chapter, the influence of CA and CF is studied in a more complicated scenario, i.e., the one in which multiple users exist, and where users have different priorities in using channel resources. CRN is a typical example for such a system, and we study the CRNs where PUs and SUs have one type of flows for each.
A Single radio based channel datarate-aware parallel rendezvous MAC protocol for cognitive radio networks
2009
Channel hopping based parallel rendezvous multichannel MAC protocols have several advantages since they do not need a control channel, require only one transceiver, and produce higher system capacity. However, channel hopping sequences in existing parallel rendezvous MAC protocols have been designed as irrelevant to channel datarates, leading to under-utilization of channel resources in multi-rate multi-channel networks. Considering that datarates among channels may be different, we propose a dynamic parallel rendezvous multichannel MAC protocol for synchronized cognitive radio networks in which the secondary users adjust their own distinct hopping sequences according to the datarates of th…
Frame Based Equipment Medium Access in LTE-U: Mechanism Enhancements and DTMC Modeling
2017
To address the challenge of ever-growing data rate demand and benefit from the popularity of WiFi capability in mobile phones, 3GPP is studying techniques which enable the coexistence of WiFi and LTE in the unlicensed band, known as LTEU. Two flavors of the listen before talk (LBT) principle, referred to as load based equipment (LBE) and frame based equipment (FBE), are recommended by 3GPP. In this paper, we investigate two enhanced FBE mechanisms, i.e., 1) enhanced FBE (E-FBE); and 2) backoff and idle time reduction FBE (BITR-FBE) for the purpose of improving FBE. After presenting the idea of E-FBE, we propose BITR-FBE which can further improve throughput, shorten delay and reduce energy c…
Stationary and non-stationary stochastic response of linear fractional viscoelastic systems
2012
Abstract A method is presented to compute the stochastic response of single-degree-of-freedom (SDOF) structural systems with fractional derivative damping, subjected to stationary and non-stationary inputs. Based on a few manipulations involving an appropriate change of variable and a discretization of the fractional derivative operator, the equation of motion is reverted to a set of coupled linear equations involving additional degrees of freedom, the number of which depends on the discretization of the fractional derivative operator. As a result of the proposed variable transformation and discretization, the stochastic analysis becomes very straightforward and simple since, based on stand…
Markov Chain Analysis of CA and CF with a Single Type of Users
2019
In this chapter, we study the impact of CA and CF on traffic flows in the simplest system where there is one single type of flows generated by one single type of users. We will use CTMC to model the system, and the goal is to deliver the elementary concept of CTMC analysis for a system with CA and CF.
A New Tool for the Modeling of AI and Machine Learning Applications: Random Walk-Jump Processes
2011
Published version of an article from the book: Hybrid artificial intelligent systems, Lecture notes in computer science. The original publication is available at www.springerlink.com, http://dx.doi.org/10.1007/978-3-642-21219-2_2 There are numerous applications in Artificial Intelligence (AI) and Machine Learning (ML) where the criteria for decisions are based on testing procedures. The most common tools used in such random phenomena involve Random Walks (RWs). The theory of RWs and its applications have gained an increasing research interest since the start of the last century. [1]. In this context, we note that a RW is, usually, defined as a trajectory involving a series of successive ran…
A Short Presentation of LucSim
2017
LucSim is a cellular automata (CA) dedicated to geographical analysis and spatial simulation for researchers and advanced planning institutes, providing user-friendly software in order to analyze and simulate land use changes and dynamics. Two complementary models are integrated in the CA: (1) a Markov Chain used to calculate transition matrices from a date to another, and (2) a Decision Tree able to automatically determine a set of transition rules to be applied on land use data. LucSim includes GIS compatibility functions allowing to display ESRI shapefiles and is based on raster georeferenced images saved in TIF format. It was mostly applied on French urban case studies.
Non-reversible Monte Carlo simulations of spin models
2011
Abstract Monte Carlo simulations are used to study simple systems where the underlying Markov chain satisfies the necessary condition of global balance but does not obey the more restrictive condition of detailed balance. Here, we show that non-reversible Markov chains can be set up that generate correct stationary distributions, but reduce or eliminate the diffusive motion in phase space typical of the usual Monte Carlo dynamics. Our approach is based on splitting the dynamics into a set of replicas with each replica representing a biased movement in reaction-coordinate space. This introduction of an additional bias in a given replica is compensated for by choosing an appropriate dynamics …