Visualize predicted turn endings. The coloring is based on log-odds, centered on the threshold. Red means agent should reply; Blue means agent should wait
If <|im_start|> is present it will treat input as formatted convo. if not it will format it as convo with 1 user message.