Browsed by
Tag: incremental learning

Ensemble Technique: Solution to complex problems in Predictive analytics

Ensemble Technique: Solution to complex problems in Predictive analytics

What is Ensemble technique ? As discussed in previous few posts about predictive analytics challenges, Ensemble technique is a solution for most of them. Incremental learning environment, specifically demands for ensemble based algorithms for problem solving due to dynamic data generation functions. Ensemble technique is a class of meta-algorithms that merge various machine learning algorithms into single predictive model in order to reduce variance (bagging), bias (boosting), or increase predictions quality. Let us see a real world example to understand what ensemble technique exactly does….

Read More Read More

Concept drift: A Challenge in predictive analytics

Concept drift: A Challenge in predictive analytics

What is concept drift? In predictive analytics, machine learning, and incremental learning the concept drift is an event that occurs when the statistical properties of the output parameter, which the model is trying to forecast, alters over time in unexpected behaviors. This results in glitches because the forecasts become less correct as time passes. In stream data mining, where input data arrives based on time instance this issue is prominent. In other words, online learning suffers most from concept drift problem. Let…

Read More Read More

Incremental Classification: Gaussian Naïve Bayes Algorithm with example

Incremental Classification: Gaussian Naïve Bayes Algorithm with example

Naïve Bayes algorithm Naïve Bayes is easy and effective technique for predictive modeling in machine learning. Incremental learning expects one at a time data instance while training. To achieve this in classification, simplest form of system is available in the literature of machine learning and statistics, i.e. Gaussian Naive Bayes. Before proceeding to read about this wonderful technique, make sure that you have read the basic concepts of machine learning and incremental learning as a pre-requisite. Naïve Bayes Algorithm: Introduction…

Read More Read More

All About Incremental Learning

All About Incremental Learning

Incremental learning is specialized category of machine learning techniques. It is relevant with time series analysis. Plain time series analysis statistical techniques have simple computational approaches, while in incremental learning one needs to implement specific algorithms to handle time component in the data and extract useful information/tend out of it. Statistical time series analysis techniques tend to cancel the non-stationary component of the data while incremental machine learning techniques handle non stationary data and hence are special. In this post,…

Read More Read More

Stochastic Gradient Descent Technique with Example

Stochastic Gradient Descent Technique with Example

General idea In previous post, we talked about gradient descent optimization technique. Read full article here. In this post we will discuss about incremental/online version of gradient descent optimization algorithm Batch strategies, for example, restricted memory BFGS, which utilize the full preparing set to figure the following refresh to parameters at every emphasis will in general meet exceptionally well to nearby optima. They are likewise straight forward to get working gave a decent off the rack execution (for example minFunc)…

Read More Read More

error

Enjoy this blog? Please spread the word :)