Here's a (brief) summary of language model finetuning, the various approaches that exist, their purposes, and what we know about how they work.