Category: General AI/ML

Warm Starting

Warm Starting refers to the practice of using the solution of a previous problem as the starting point for solving a new, related problem, which can improve convergence speed.

DINO

DINO is a self-supervised learning method that uses knowledge distillation to learn visual representations without labeled data.

Self-Supervised Learning

Self-supervised learning is a type of machine learning where the model learns to predict parts of the input from other parts, often using unlabeled data.

Linear Probes

Linear probes are simple linear classifiers that are trained on top of the features extracted from a pre-trained model to evaluate its performance on a specific task.