Unsupervised Learning — Technology Wiki

Overview

Direct Answer

Unsupervised learning is a machine learning paradigm where algorithms identify inherent patterns, clusters, and structures within datasets without requiring pre-labelled target variables. The model learns directly from raw data, inferring underlying relationships through statistical or geometric properties alone.

How It Works

Algorithms operate by optimising an objective function based solely on input features—typically minimising distances between similar data points or maximising explained variance. Common techniques include clustering algorithms (k-means, hierarchical clustering), dimensionality reduction (principal component analysis), and density estimation, which partition or transform data based on intrinsic characteristics rather than predetermined categories.

Why It Matters

Organisations value this approach because labelled datasets are expensive and time-consuming to produce at scale, whilst unlabelled data is abundantly available. It enables rapid exploratory analysis, discovery of unexpected customer segments, and cost-effective preprocessing before supervised tasks, directly reducing data annotation burden and accelerating time-to-insight.

Common Applications

Applications span customer segmentation in retail, anomaly detection in network security and fraud prevention, document clustering in content management, and gene expression analysis in genomics research. Recommendation systems leverage collaborative filtering to identify user behaviour patterns without explicit preference labels.

Key Considerations

Validation is inherently challenging—without ground truth labels, assessing result quality requires domain expertise and intrinsic metrics (silhouette score, within-cluster variance). Results remain highly sensitive to algorithm selection, initialisation, and hyperparameters, often requiring substantial experimentation.

Cross-References(1)

Machine Learning

Referenced By2 terms mention Unsupervised Learning

Other entries in the wiki whose definition references Unsupervised Learning — useful for understanding how this concept connects across Machine Learning and adjacent domains.

Clustering·Machine Learning GloVe·Natural Language Processing

Related in MLOps & Production

Machine Learning

A subset of AI that enables systems to automatically learn and improve from experience without being explicitly programmed.

Supervised Learning

A machine learning paradigm where models are trained on labelled data, learning to map inputs to known outputs.

Reinforcement Learning

A machine learning paradigm where agents learn optimal behaviour through trial and error, receiving rewards or penalties.

Multi-Task Learning

A machine learning approach where a model is simultaneously trained on multiple related tasks to improve generalisation.

Online Learning

A machine learning method where models are incrementally updated as new data arrives, rather than being trained in batch.

Batch Learning

Training a machine learning model on the entire dataset at once before deployment, as opposed to incremental updates.

Active Learning

A machine learning approach where the algorithm interactively queries a user or oracle to label new data points.

Ensemble Learning

Combining multiple machine learning models to produce better predictive performance than any single model.

Feature Selection

The process of identifying and selecting the most relevant input variables for a machine learning model.

Epoch

One complete pass through the entire training dataset during the machine learning model training process.

Model Serialisation

The process of converting a trained model into a format that can be stored, transferred, and later reconstructed for inference.

Model Serving

The infrastructure and processes for deploying trained machine learning models to production environments for real-time predictions.

More in Machine Learning

Decision Tree

Supervised Learning

A tree-structured model where internal nodes represent feature tests, branches represent outcomes, and leaves represent predictions.

Loss Function

Training Techniques

A mathematical function that measures the difference between predicted outputs and actual target values during model training.

Boosting

Supervised Learning

An ensemble technique that sequentially trains models, each focusing on correcting the errors of previous models.

Lasso Regression

Feature Engineering & Selection

A regularised regression technique that adds an L1 penalty, enabling feature selection by driving some coefficients to zero.

Deep Reinforcement Learning

Reinforcement Learning

Combining deep neural networks with reinforcement learning to enable agents to learn complex decision-making from raw sensory input.

Mini-Batch

Training Techniques

A subset of the training data used to compute a gradient update during stochastic gradient descent.

Model Calibration

MLOps & Production

The process of adjusting a model's predicted probabilities so they accurately reflect the true likelihood of outcomes, essential for risk-sensitive decision-making.

Underfitting

Training Techniques

When a model is too simple to capture the underlying patterns in the data, resulting in poor performance on both training and test data.