We examine Bayesian cyclic networks, here defined as complete directed graphs in which the nodes, representing the domains of discrete or continuous variables, are connected by directed edges representing conditional probabilities between all pairs of variables. The prior probabilities associated with each domain are also included as probabilistic edges into each domain. Such networks provide a graphical representation of the inferential connections between variables, and substantially extend the standard definition of “Bayesian networks”, usually defined as one-directional (acyclic) directed graphs. In a binary system, the proposed representation provides a graphical expression of Bayes’ theorem. In higher-dimensional systems, further probabilistic relations can be recovered from the network cyclic properties and the joint probability of all variables. In particular, adopting a Markovian assumption leads to the theorem that the mutual information between any pair of variables on the network must be equivalent. Analysis of a hybrid Bayesian cyclic network of two continuous and two discrete variables of the form of a commutative diagram – provides a framework for more computationally efficient reduced-order Bayesian inference, involving initial simplification by an order reduction process.

1.
J.
Pearl
,
Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference
,
Morgan Kaufmann
,
San Francisco, USA
,
1988
.
2.
C.M.
Bishop
,
Pattern Recognition and Machine Learning
,
Springer
,
NY
,
2006
.
3.
J.R.
Norris
,
Markov Chains
,
Cambridge UP
,
1997
.
4.
G.R.
Grimmett
&
D.R.
Stirzaker
,
Probability and Random Processes
,
Oxford UP
,
2001
.
5.
M.O.
Rabin
,
Probabilistic Automata, Information and Control
6
(
3
):
230
245
,
1963
.
6.
T.
Bayes
,
R.
Price
,
An essay towards solving a problem in the doctrine of chance
,
Phil. Trans. Royal Soc. London
,
53
:
370
418
,
1763
.
7.
P.
Laplace
,
Mémoire sur la probabilité des causes par les événements
,
l’Academie Royale des Sciences
,
6
:
621
656
,
1774
.
8.
E.T.
Jaynes
,
Probability Theory: The Logic of Science
,
Cambridge University Press
,
Cambridge
,
2003
.
9.
S.S.
Epp
,
Discrete Mathematics with Applications
, 4th ed.,
Brooks Cole
,
2010
.
10.
D.
Cheng
,
X.
Hu
,
T.
Shen
,
Analysis and Design of Nonlinear Control Systems
,
Springer Press Beijing
,
2010
.
11.
B.R.
Noack
,
M.
Morzynski
,
G.
Tadmor
(eds),
Reduced-Order Modelling for Flow Control
,
Springer Wien
,
NY
,
2011
.
12.
E.
Kaiser
,
B.R.
Noack
,
L.
Cordier
,
A.
Spohn
,
M.
Segond
,
M.
Abel
.,
G.
Daviller
,
J.
Östh
,
S.
Krajnović
,
R.K.
Niven
,
Cluster-based reduced-order modelling of a mixing layer
,
J. Fluid Mech.
,
754
:
365
414
,
2014
.
This content is only available via PDF.