Icon

Text Generation Inference (TGI)

Contains nodes that connect to Hugging Face's text generation inference server.

This category contains 2 nodes.

HF TGI LLM Connector Deprecated

Select an LLM from a dedicated Text Generation Inference Server.

HF TGI LLM Selector 

Select an LLM available from a dedicated Text Generation Inference Server.