Tag: Technique

Linear Gradient Matching

Linear Gradient Matching is a method that optimizes synthetic images to induce gradients in a linear classifier similar to those produced by real data when processed through a pre-trained feature extractor.

Dataset Distillation

Dataset distillation is the process of creating a smaller synthetic dataset that retains the performance characteristics of a larger real dataset when used for training models.

Warm Starting

Warm Starting refers to the practice of using the solution of a previous problem as the starting point for solving a new, related problem, which can improve convergence speed.