Icon

Text Generation Inference (TGI)

Contains nodes that connect to Hugging Face's text generation inference server.

This category contains 2 nodes.

HF TGI Chat Model Connector 

Connects to a dedicated Text Generation Inference Server.

HF TGI LLM Connector 

Connects to a dedicated Text Generation Inference Server.