We examine Bayesian cyclic networks, here defined as complete directed graphs in which the nodes, representing the domains of discrete or continuous variables, are connected by directed edges representing conditional probabilities between all pairs of variables. The prior probabilities associated with each domain are also included as probabilistic edges into each domain. Such networks provide a graphical representation of the inferential connections between variables, and substantially extend the standard definition of “Bayesian networks”, usually defined as one-directional (acyclic) directed graphs. In a binary system, the proposed representation provides a graphical expression of Bayes’ theorem. In higher-dimensional systems, further probabilistic relations can be recovered from the network cyclic properties and the joint probability of all variables. In particular, adopting a Markovian assumption leads to the theorem that the mutual information between any pair of variables on the network must be equivalent. Analysis of a hybrid Bayesian cyclic network of two continuous and two discrete variables of the form of a commutative diagram – provides a framework for more computationally efficient reduced-order Bayesian inference, involving initial simplification by an order reduction process.
Skip Nav Destination
Article navigation
26 July 2016
BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING: 35th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering
19–24 July 2015
Potsdam, NY, USA
Research Article|
July 26 2016
Bayesian cyclic networks, mutual information and reduced-order Bayesian inference
Robert K. Niven;
Robert K. Niven
*School of Engineering and Information Technology,
The University of New South Wales
, Canberra ACT 2600, Australia
. Email r.niven@adfa.edu.au
Search for other works by this author on:
Bernd R. Noack;
Bernd R. Noack
†Institut Pprime,
CNRS - Université de Poitiers - ENSMA
, CEAT, 86036 Poitiers Cedex, France
Search for other works by this author on:
Eurika Kaiser;
Eurika Kaiser
†Institut Pprime,
CNRS - Université de Poitiers - ENSMA
, CEAT, 86036 Poitiers Cedex, France
Search for other works by this author on:
Louis Cattafesta;
Louis Cattafesta
**Department of Mechanical Engineering,
Florida State University
, Tallahassee, FL 32301, USA
Search for other works by this author on:
Laurent Cordier;
Laurent Cordier
†Institut Pprime,
CNRS - Université de Poitiers - ENSMA
, CEAT, 86036 Poitiers Cedex, France
Search for other works by this author on:
Markus Abel
Markus Abel
‡Ambrosys GmbH / Institut für Physik und Astronomie,
Universität Potsdam
, Potsdam, Germany
Search for other works by this author on:
AIP Conf. Proc. 1757, 020008 (2016)
Citation
Robert K. Niven, Bernd R. Noack, Eurika Kaiser, Louis Cattafesta, Laurent Cordier, Markus Abel; Bayesian cyclic networks, mutual information and reduced-order Bayesian inference. AIP Conf. Proc. 26 July 2016; 1757 (1): 020008. https://doi.org/10.1063/1.4959049
Download citation file:
Citing articles via
Related Content
Approximate Bayesian Inference by Adaptive Quantization of the Hypothesis Space
AIP Conference Proceedings (November 2005)
On The Relationship between Bayesian and Maximum Entropy Inference
AIP Conference Proceedings (November 2004)
Bayesian inference for inverse problems
AIP Conference Proceedings (May 2002)
Information theoretic approach to Bayesian inference
AIP Conference Proceedings (May 2002)
Bayesian Inference of Tumor Hypoxia
AIP Conference Proceedings (December 2009)