StarCoder is a collection of models. Used to autocomplete code, make modifications to code via instructions, and explain code snippets.
StarCoderBase - 15B
StarPii - StarEncoder PII detector
Trained for 1T tokens and 15B parameters.
8K context length.
Trained on The Stack 1.2 (permissive licensing).