Skip to main content

BAYESIAN NETWORKS in Machine Learning

So basically this topic is a mix of three theories namely:

  1. Graph Theory
  2. Probability Theory
  3. Bayes Theory

1. Graph Theory

 Graph theory is a mathematical field for the study of Graphs.

Graph = Nodes (or vertices) + Arcs (or lines, or edges!)

So a node can be anything that you want, a company, profits or a band.

The thing is- you can have many nodes- but they have to have some form of relation between them. Graphs can be directed and undirected as shown below.


2. Probability Theory

Probability is a measure of the likelihood of something happening. And is always a value between 0 and 1. The more likely, the closer the value is to 1 and vs-versa.

Probability = (Particular Event)➗(All Possible Events)

An example is coin flip. The probability of getting heads is 0.50 - and this brings us to our next idea, conditional probability.

Instead of one event at a time, what is the the probability of getting a heads twice? Which then becomes

P(Heads|Heads)

The '|' simply means 'given that' (the last value was). And as per our example is 0.50*0.50. You might ask- why multiply? Or what does multiply mean? Or cant we just add?  Well that's because we want to find the intersection of both H and H sets.

3. Bayes Theory

This is an extension of conditional probability. While using Bayes you are using conditional probability to calculate another one.

P(A|B) = P(B|A) * P(A)/P(B)

ie. Posterior = Likelihood*Prior/Evidence

If you want more i refer to this article.

For great examples, follow this link. 

Sample code : 
How AI can help fight Cholera. Feel free to contribute! https://goo.gl/kmcvKv


 


Labels:

Comments

Post a Comment

Popular posts from this blog

Gentlest introduction : The Cloud

How it began To me the concept of cloud started when people began virtualizing their systems using the like of Virtual-box and VMware. What bough this a;long was the evolution/advent of technology which made it possible for software so simulate hardware. Originally software could not simulate hardware drivers but the moment that became possible- virtualization was born. A few years after- companies started offering this virtualization at a much grander scale and Infrastructure as a service was born. Lets get down to the three cloud components namely: Infrastructure as a Service (IAAS) This outsourced hardware meaning that one noways noes not need to setup servers, air-con and the like of access control but could 'rent' from someone and one of the great things about this was that a backup not only meant software but also meant hardware (as software could now simulate hardware) so recovery in case of disaster became easier. Platform as a Service (PAAS) This is ...
Post a Comment
Read more

Deploy Django app online for free!

So after a number of lines of code, brilliance and dreaming. Your next dream is for the world to see. Of course you can walk around with your computer and doing a 'manage.py runserver' But cumon guys, lets embrace the cloud. Not like this guy though! I choose to deploy on  PythonAnywhere . So you ask why? 1) Free amazing support - You actually talk to a live human ! 2) Easy - Very easy 3) Affordable - As you scale up, it gets way better! So by now I assume you are already on a version control system (So I will not waste much energy on that one). Maybe Ill someday write on my two favs  Github  and  Bitbucket . STEP 1: Create an account on pythonanywhere. Kindly note that your username will be included in your apps url. So it will be like : " yourUsername .pythonanywhere.com" STEP 2: Select other and set a bash console. STEP 3: Push your code from version control This will push from (in my example) github to your pythonanywhere. You...
1 comment
Read more

Artificial Neural Networks - Intro for beginners

The perceptron Single node perceptron Perceptrons form the basis for ANNs. Perceptron takes input and produces output as below: Input ➡️ Activation Function ➡️ Output Input If the weight is 0- input remains unaltered coming into the perceptron. Below is what happens to the input ∑ w i z i  ≽ t then y = 1. Else y = 0.  i t is the threshold which is set by the outgoing part. So the key to output is based on the weighted sum and the threshold. Activation function This is the processing part of the neuron and this determines output. So most commonly the ones used are the Sigmoid function and the hyperbolic tangent. QUESTION: Which activation function should I use? I am going to talk of three key activation functions a) Sigmoid The Sigmoid returns 0 or 1 and in code can be written as return 1.0/(1.0+Math.exp(-x) A Sigmoid is a mathematical curve having the characteristic S shape. DISADVANTAGE: Descending Gradient b) Tanh DISAD...
Post a Comment
Read more