Microsoft found that small language models can exceed the performance of much larger ones when trained to specialize in a single area. Researchers fine-tuned the Mistral 7B model to create Orca ...

Shuchi Goyal, Gauri Sankar Datta, Abhyuday Mandal, A Hierarchical Bayes Unit-Level Small Area Estimation Model for Normal Mixture Populations, Sankhyā: The Indian Journal of Statistics, Series B (2008 ...