How function calling really works

Explains logit biasing to enforce structured outputs and demonstrates an open-source LLM’s function-calling mechanism for selecting tools, with implementation details and live demo.

Overview

A detailed description of how to use logit biasing to guarantee structured output, then a demonstration of an open source LLM using function calling to select tools.

Tech stack