Joshua Lochner f0ef2e8eee Update tokenizer apply_chat_template functionality (#647) ...

* Allow custom kwargs in `tokenizer.apply_chat_template`

* Update jinja dependency version

* Add `tokenizer_kwargs` options

* Add support for dictionaries of chat templates in the tokenizer config

* Add `CohereTokenizer`

* `apply_chat_template` is no longer async

* Add unit test for multiple chat templates

* Update tokenizers.js

* Also update when `chat_template` is undefined

* Support setting tokenizer and text from URL

* Update Claude tokenizer display name

* Add Cohere Command-R tokenizer to playground

* Add `Grok1Tokenizer`

* Throw error if chat template object is malformed

* Improved error checking

* Remove redundant error check

* `template_dict` can be a null-prototype object

2024-03-20 15:22:01 +02:00

..

adaptive-retrieval

Create adaptive retrieval demo (#587)

2024-02-21 15:16:51 +02:00

code-completion

Bump vite from 4.5.1 to 4.5.2 in /examples/code-completion (#536)

2024-01-25 15:18:18 +02:00

cross-encoder

Create cross-encoder demo (#617)

2024-03-06 17:31:57 +02:00

demo-site

New models and refactoring (#276)

2023-09-08 15:17:05 +02:00

depth-anything-client

Create depth anything demo (#540)

2024-01-25 17:58:40 +02:00

electron

Improve electron example template (#342)

2023-10-04 17:45:25 +02:00

extension

Improve example browser extension template (#325)

2023-09-23 03:34:10 +02:00

next-client

Update sharp dependency version (#400)

2023-11-18 12:58:21 +02:00

next-server

Update Next.js Dockerfile HOSTNAME (#461)

2023-12-20 01:53:45 +02:00

node

Create example Node.js application

2023-05-17 12:34:48 +02:00

node-audio-processing

[WIP] Add MMS and Wav2Vec2 models (Closes #209) (#220)

2023-08-14 22:18:44 +02:00

react-translator

Update .eslintrc.cjs

2023-05-12 03:24:04 +02:00

remove-background-client

Add remove-background demo (#576)

2024-02-07 14:31:52 +02:00

segment-anything-client

Add SAM demo (#513)

2024-01-11 02:10:38 +02:00

semantic-audio-search

Bump vite from 5.0.6 to 5.0.12 in /examples/semantic-audio-search (#537)

2024-01-25 15:18:29 +02:00

semantic-image-search

Update Next.js Dockerfile HOSTNAME (#461)

2023-12-20 01:53:45 +02:00

semantic-image-search-client

Update sharp dependency version (#400)

2023-11-18 12:58:21 +02:00

text-to-speech-client

Add support for text-to-speech (w/ Speecht5) (#345)

2023-10-23 16:31:46 +02:00

tokenizer-playground

Update tokenizer apply_chat_template functionality (#647)

2024-03-20 15:22:01 +02:00

vanilla-js

Add JavaScript tutorial to the docs (#271)

2023-09-17 21:47:09 +02:00

video-object-detection

Create video object detection demo (#607)

2024-02-27 19:35:12 +02:00

zero-shot-classification

Bump vite from 5.0.11 to 5.0.12 in /examples/zero-shot-classification (#548)

2024-01-29 13:45:22 +02:00