What embeddings model is used for the uploaded documents? #39

New Issue

2026-02-15T16:29:31-05:00

yindo commented

2026-02-15 16:29:31 -05:00

Originally created by @algsupport on GitHub (Oct 2, 2023).

I saw the project on the youtube. Seems excellent.

I was wondering. When uploading a new document, what is the embeddings model used to convert it?

Is it possible to chose a custom one? If so, how can it be done?

Thank you.

Originally created by @algsupport on GitHub (Oct 2, 2023). I saw the project on the youtube. Seems excellent. I was wondering. When uploading a new document, what is the embeddings model used to convert it? Is it possible to chose a custom one? If so, how can it be done? Thank you.

yindo added the question label 2026-02-15 16:29:31 -05:00

yindo commented

2026-02-15 16:29:32 -05:00

@timothycarambat commented on GitHub (Oct 2, 2023):

Custom embedding models arent supported at this time just because we haven't expanded the scope yet. Right now its just the normal 1536 text-ada-embedding-002 by OpenAI. Obviously not everyone uses that and if you tried to edit or add a doc and the dimensions dont match it would stop you from doing so.

Are you using a Hugging face model for embeddings?

@timothycarambat commented on GitHub (Oct 2, 2023): Custom embedding models arent supported at this time just because we haven't expanded the scope yet. Right now its just the normal 1536 text-ada-embedding-002 by OpenAI. Obviously not everyone uses that and if you tried to edit or add a doc and the dimensions dont match it would stop you from doing so. Are you using a Hugging face model for embeddings?

yindo commented

2026-02-15 16:29:32 -05:00

@algsupport commented on GitHub (Oct 2, 2023):

Yes, I would want to use a hugging face model if possible.
text-ada-embedding-002 works too, but would be more convinient to select the embeddings model.

Would you mind if I try to add it myself (Of course I will make a pull request if I succeed.)? Could you point me towards the part of the code that would be responsible for the embeddings CRUD?

Thank you

@algsupport commented on GitHub (Oct 2, 2023): Yes, I would want to use a hugging face model if possible. text-ada-embedding-002 works too, but would be more convinient to select the embeddings model. Would you mind if I try to add it myself (Of course I will make a pull request if I succeed.)? Could you point me towards the part of the code that would be responsible for the embeddings CRUD? Thank you

yindo commented

2026-02-15 16:29:32 -05:00

@timothycarambat commented on GitHub (Oct 2, 2023):

It is used in several areas (job for each vectorDB at this time).

If you look for anywhere openAi.embedTextChunk or openAi.embedTextChunks is used - that is the only place embeddings are currently used!

@timothycarambat commented on GitHub (Oct 2, 2023): It is used in several areas (job for each vectorDB at this time). If you look for anywhere `openAi.embedTextChunk` or `openAi.embedTextChunks` is used - that is the only place embeddings are currently used!

yindo commented

2026-02-15 16:29:32 -05:00

@andsty commented on GitHub (Nov 28, 2023):

can we have support on hugging face embeddings as well? or is not possible?

@andsty commented on GitHub (Nov 28, 2023): can we have support on hugging face embeddings as well? or is not possible?

yindo commented

2026-02-15 16:29:33 -05:00

@timothycarambat commented on GitHub (Nov 29, 2023):

You can, but it is supported via LocalAI and not via the HuggingFace API directly. Is that what you are using for embedding currently?

@timothycarambat commented on GitHub (Nov 29, 2023): You can, but it is supported via LocalAI and not via the HuggingFace API directly. Is that what you are using for embedding currently?

yindo commented

2026-02-15 16:29:33 -05:00

@hasani114 commented on GitHub (Jul 14, 2024):

Any plan on adding this feature? Since this post, openai also released another model for embeddings. Also there are more specialized embeddings models being developed by companies like voyage ai etc which we'd like to be able to use.

Thanks!

@hasani114 commented on GitHub (Jul 14, 2024): Any plan on adding this feature? Since this post, openai also released another model for embeddings. Also there are more specialized embeddings models being developed by companies like voyage ai etc which we'd like to be able to use. Thanks!

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: Mintplex-Labs/vector-admin#39