Classification is one of the most frequently solved problems using machine learning. Unfortunately, it cannot handle a case with a number of classes, varying over time, and require all the data to be labelled. There is another approach, designed to solve cases when we can’t perform full data annotation and/or would like to dynamically modify the number of classes. Similarity learning is capable of solving such problems even with extreme classification. We’re going to show how to use such models in production.