Every supervised learning problem encounters either bias or variance error. Please refer to this page if you want to get more intuition about bias and variance error as it will help in understanding this post. Once you know where(bias or variance) your model is doing wrong, it becomes easier to get the next direction. This…

# Tag: bayes error

## What is Bayes Error ? What is the best approximation to bayes error ?

Bayes error is the lowest possible error one can achieve on a set of data samples. Suppose there are 10000 images of an object like chair and the machine learning task is to detect those objects. We find out that the best achievable accuracy is 99.25% by anyone in the world. Bayes error in this…

## Whether to reduce bias error or variance error ?

Supervised learning model’s error can be decomposed in form of bias error and variance error. Read here to get the best intuition about bias and variance error. When a model doesn’t perform well either on training data or testing data, either of bias error or variance error or both error might be the issue. Therefore…