Mintplex-Labs/tiktoken
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/tiktoken.git synced 2026-07-01 18:48:04 -04:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Tat Dat Duong
2023-06-02 18:09:42 +02:00
parent c4a61809d5
commit c7faff0e33
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+3 -3
View File
@@ -6,7 +6,9 @@ OpenAI's models, forked from the original tiktoken library to provide JS/WASM bi
This repository contains the following packages:
- `tiktoken` (formally hosted at `@dqbd/tiktoken`): WASM bindings for the original Python library, providing full 1-to-1 feature parity.
- `js-tiktoken`: Pure JavaScript port of the original library with the core functionality, suitable for environments where WASM is not well supported or not desired (such as edge runtimes).
- `js-tiktoken`: Pure JavaScript port of the original library with the core functionality, suitable for environments where WASM is not well supported or not desired (such as edge runtimes).
Documentation for `js-tiktoken` can be found in [here](https://github.com/dqbd/tiktoken/blob/main/js/README.md). Documentation for the `tiktoken` can be found here below.
The WASM version of `tiktoken` can be installed from NPM:
@@ -14,8 +16,6 @@ The WASM version of `tiktoken` can be installed from NPM:
npm install tiktoken
```
Documentation for `js-tiktoken` can be found in [here](https://github.com/dqbd/tiktoken/blob/main/js/README.md).
## Usage
Basic usage follows, which includes all the OpenAI encoders and ranks: