HF TEI Embeddings Connector

This node can connect to locally or remotely hosted TEI servers which includes Text Embedding Inference Endpoints of popular embedding models that are deployed via Hugging Face Hub.

Protected endpoints require a connection with a HF Hub Authenticator node in order to authenticate with Hugging Face Hub.

The Text Embeddings Inference Server is a toolkit for deploying and serving open source text embeddings and sequence classification models.

For more details and information about integrating with the Hugging Face Embeddings Inference and setting up a server, refer to Text Embeddings Inference GitHub.

Note: If you use the Credentials Configuration node and do not select the "Save password in configuration (weakly encrypted)" option for passing the API key via the HF Hub Authenticator node, the Credentials Configuration node will need to be reconfigured upon reopening the workflow, as the credentials flow variable was not saved and will therefore not be available to downstream nodes.

Options

Text Embeddings Inference server URL

The URL where the Text Embeddings Inference server is hosted e.g. http://localhost:8080/.

Batch size

How many texts should be sent to the embeddings endpoint in one batch.

Input Ports

Icon

An optional Hugging Face Hub connection that can be used to access protected Hugging Face inference endpoints.

Output Ports

Icon

Connection to an embeddings model hosted on a Text Embeddings Inference server.

Popular Predecessors

  • No recommendations found

Popular Successors

  • No recommendations found

Views

This node has no views

Workflows

  • No workflows found

Links

Developers

You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.