Model Distillation Isn't Using a Smaller Model. It's Training Your Own.
Model distillation trains a brand-new small model to imitate a larger teacher model's outputs on one narrow task, so production runs on the cheap model instead of paying frontier prices for every call. Here is the actual mechanism, what OpenAI's Model Distillation feature and
