Mintplex-Labs/tiktoken
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/tiktoken.git synced 2026-07-18 19:04:33 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • 8963e56f72 Merge pull request #135 from dqbd/changeset-release/main main David Duong 2025-02-13 17:12:24 -08:00
  • 3827a62f1f Version Packages github-actions[bot] 2025-02-14 01:12:15 +00:00
  • fc87e46a8f Merge pull request #134 from dqbd/dqbd/js-readme David Duong 2025-02-13 17:11:44 -08:00
  • 77ba758bfb Update guidance on lite Tat Dat Duong 2025-02-13 17:09:47 -08:00
  • e3437a351b Merge pull request #131 from dqbd/changeset-release/main David Duong 2025-02-04 02:56:32 +01:00
  • 4c0b023719 Version Packages github-actions[bot] 2025-02-04 01:55:55 +00:00
  • de252769e8 Merge pull request #130 from chenqianhe/main David Duong 2025-02-04 02:55:26 +01:00
  • 5f92348067 Add changeset Tat Dat Duong 2025-02-04 02:47:25 +01:00
  • 9fc37ed57a Correct other models as well Tat Dat Duong 2025-02-04 02:46:03 +01:00
  • 4dbb38e552 feat: add missing o3-mini chenqianhe 2025-02-03 14:51:51 +08:00
  • 5568320c5d feat: add missing gpt-4o-2024-11-20 models chenqianhe 2025-02-03 14:31:59 +08:00
  • 37c993f3f7 Merge pull request #129 from dqbd/changeset-release/main David Duong 2025-02-02 22:15:46 +01:00
  • 1c78c18408 Version Packages github-actions[bot] 2025-02-02 21:15:22 +00:00
  • a29d5239c5 Merge pull request #128 from dqbd/dqbd/o3-mini David Duong 2025-02-02 22:14:47 +01:00
  • 335b29166b Add missing types for text-embedding-* Tat Dat Duong 2025-02-02 22:11:40 +01:00
  • 5982def468 Add changeset Tat Dat Duong 2025-02-02 22:07:36 +01:00
  • 46e3c7c840 feat: add o3-mini, missing o1 model Tat Dat Duong 2025-02-02 22:06:53 +01:00
  • 638e6a253e Merge pull request #125 from dqbd/changeset-release/main David Duong 2024-12-19 21:03:01 +04:00
  • 7a8687d737 Version Packages github-actions[bot] 2024-12-19 17:02:07 +00:00
  • 9c95cc5a85 Merge pull request #124 from lmg8/main David Duong 2024-12-19 21:01:33 +04:00
  • 919eb6b9ea Add changeset Tat Dat Duong 2024-12-19 18:01:14 +01:00
  • 8a20c2d48c Merge remote-tracking branch 'origin/main' Lucia 2024-12-17 16:44:40 -05:00
  • c73f19e069 Add new o1-2024-12-17 model Lucia 2024-12-17 16:36:33 -05:00
  • f40be08a7a Add new o1-2024-12-17 model Lucia 2024-12-17 16:36:33 -05:00
  • b742a86f03 Merge pull request #122 from dqbd/changeset-release/main David Duong 2024-10-04 11:33:13 +02:00
  • 7e6cddc86d Version Packages github-actions[bot] 2024-10-03 23:25:52 +00:00
  • 503da217a6 Merge pull request #121 from dqbd/dqbd/o1 David Duong 2024-10-04 01:25:19 +02:00
  • 53bd14a713 Changeset Tat Dat Duong 2024-10-04 01:21:22 +02:00
  • 0ba7dbb000 Add missing o1 models Tat Dat Duong 2024-10-04 01:20:41 +02:00
  • f8aa4555da Merge pull request #118 from dqbd/changeset-release/main David Duong 2024-08-16 01:31:52 +02:00
  • 386acb8e64 Version Packages github-actions[bot] 2024-08-15 23:31:13 +00:00
  • 25f065610d Merge pull request #117 from dqbd/dqbd/js-tiktoken-missing-files David Duong 2024-08-16 01:30:34 +02:00
  • 74e7870a0a Changeset Tat Dat Duong 2024-08-16 01:27:20 +02:00
  • a825d5f253 fix(js): add missing rank files back to js-tiktoken Tat Dat Duong 2024-08-16 01:26:46 +02:00
  • 60ff9bb8aa Merge pull request #116 from dqbd/changeset-release/main David Duong 2024-08-16 01:05:33 +02:00
  • ed2e7857aa Version Packages github-actions[bot] 2024-08-15 23:04:34 +00:00
  • e77e339711 Merge pull request #112 from mbarretol/add-gpt4o-mini David Duong 2024-08-16 01:04:05 +02:00
  • 831a7e8693 Add changeset Tat Dat Duong 2024-08-16 00:59:18 +02:00
  • 9d385cb0e7 Add text-embedding-3-small and text-embedding-3-large Tat Dat Duong 2024-08-16 00:59:10 +02:00
  • 4796f27ec4 Add changeset Tat Dat Duong 2024-08-16 00:55:11 +02:00
  • bba4ed6f4b Fix unreachable code Tat Dat Duong 2024-08-16 00:53:13 +02:00
  • a32f0a4c53 Update wasm/src/lib.rs Marco Barreto 2024-08-10 11:33:19 +02:00
  • 26ec6cc78c Update wasm/src/lib.rs Marco Barreto 2024-08-10 11:33:12 +02:00
  • fb1ca7bf32 Update tiktoken/model_to_encoding.json Marco Barreto 2024-08-10 11:33:03 +02:00
  • de6a05200d Update js/src/core.ts Marco Barreto 2024-08-10 11:32:42 +02:00
  • f7e3df106f Update wasm/src/lib.rs Marco Barreto 2024-07-22 13:15:53 +02:00
  • be5db3488d Update wasm/src/lib.rs Marco Barreto 2024-07-22 13:15:46 +02:00
  • 396a8d0c5d Update tiktoken/model_to_encoding.json Marco Barreto 2024-07-22 13:15:37 +02:00
  • 25bb43aeda Update js/src/core.ts Marco Barreto 2024-07-22 13:15:29 +02:00
  • 28ae6b3d24 add support for gpt-4o-mini model mbarretol 2024-07-19 00:09:14 +02:00
  • a7cce9922b Merge pull request #107 from dqbd/changeset-release/main David Duong 2024-05-14 00:15:42 +02:00
  • 50f70ddb6c Version Packages github-actions[bot] 2024-05-13 22:13:22 +00:00
  • 791cf62151 Add changeset Tat Dat Duong 2024-05-14 00:12:43 +02:00
  • 5de6be521d Merge pull request #106 from dqbd/dqbd/o200k_base David Duong 2024-05-14 00:08:04 +02:00
  • e228b479ef Add entry to tsup Tat Dat Duong 2024-05-13 23:58:21 +02:00
  • ed9cc4f1ca fix(js): specify exports in js-tiktoken Tat Dat Duong 2024-05-13 23:57:04 +02:00
  • 3c118a6968 Merge pull request #104 from neonredwood/support-gpt4-omni David Duong 2024-05-13 23:56:11 +02:00
  • f2e1ac26a7 Add support for GPT-4-O, "Omni" model Phil Kallos 2024-05-13 11:23:37 -07:00
  • 045f0e431b Merge pull request #98 from dqbd/changeset-release/main David Duong 2024-04-13 01:04:37 +02:00
  • f6165e7c01 Version Packages github-actions[bot] 2024-04-12 22:58:38 +00:00
  • f386b281ca Add changelog Tat Dat Duong 2024-04-13 00:58:08 +02:00
  • 1d8a762a45 Merge pull request #97 from akynau/add-gpt-4-turbo David Duong 2024-04-12 15:29:15 +02:00
  • 37682318b5 Add GPT-4 Turbo Akyas Naushad 2024-04-10 17:53:32 +01:00
  • 110eef4f68 Update development README.md Tat Dat Duong 2024-01-28 00:02:00 -08:00
  • ffa82838d2 Merge pull request #89 from dqbd/changeset-release/main David Duong 2024-01-27 23:49:06 -08:00
  • f6b2819603 Version Packages github-actions[bot] 2024-01-28 07:48:23 +00:00
  • d54f04c46a Fix invalid model when requesting an instruct model Tat Dat Duong 2024-01-27 23:47:50 -08:00
  • f39912b9d9 Fix typo Tat Dat Duong 2024-01-27 23:42:42 -08:00
  • e3fcb126b2 Fix typings for wasm Tat Dat Duong 2024-01-27 23:38:39 -08:00
  • 4491997c6d Backport changes to @dqbd/tiktoken Tat Dat Duong 2024-01-27 23:35:35 -08:00
  • de6d1c772e Fix invalid model Tat Dat Duong 2024-01-27 23:25:58 -08:00
  • a020c6af42 Merge pull request #87 from dqbd/changeset-release/main David Duong 2024-01-27 23:11:20 -08:00
  • 708f77c0a5 Version Packages github-actions[bot] 2024-01-28 07:10:49 +00:00
  • 43e99b4c3c Add support for new models, instruct models Tat Dat Duong 2024-01-27 23:10:11 -08:00
  • 221a30ee3d Fix build Tat Dat Duong 2024-01-27 23:05:21 -08:00
  • 5414d83e03 Merge pull request #71 from Prince-Mendiratta/main David Duong 2024-01-27 23:01:04 -08:00
  • e1b24725c5 Merge pull request #86 from risu729/main David Duong 2024-01-27 22:58:52 -08:00
  • ff9c6377e8 Add new models risu729 2024-01-26 14:47:26 +09:00
  • 74c147e195 Merge pull request #81 from dqbd/changeset-release/main David Duong 2023-11-16 00:02:47 +01:00
  • 20d610f3a5 Version Packages github-actions[bot] 2023-11-15 23:01:58 +00:00
  • bd3a360f1e Add new changeset Tat Dat Duong 2023-11-16 00:01:21 +01:00
  • 10302a2d90 Update examples Tat Dat Duong 2023-11-15 23:57:20 +01:00
  • 32882f7ef2 Update WASM and JS to add new models Tat Dat Duong 2023-11-15 23:49:49 +01:00
  • 4cda379781 Add new encodings Tat Dat Duong 2023-11-15 23:44:20 +01:00
  • 4a91a815a3 Merge remote-tracking branch 'upstream/main' Tat Dat Duong 2023-10-02 00:33:09 +02:00
  • db9a80452e feat: add gpt3.5-turbo-instruct model Prince Mendiratta 2023-09-19 10:46:33 +05:30
  • 39f29cecdb Sync codebase Shantanu 2023-09-12 17:39:23 -07:00
  • 52fceb8fa1 Replace <|endoftext|> with constant (#186) Alvaro Bartolome 2023-09-12 06:18:00 +02:00
  • cc1848c08a Run only the most minimal test in emulated builds Shantanu 2023-09-11 18:51:34 -07:00
  • a7937793e7 Sync codebase Shantanu 2023-09-11 14:50:26 -07:00
  • 072dd12962 Merge pull request #66 from nikwen/electron-readme David Duong 2023-08-08 01:17:35 +02:00
  • 82d44e1629 Add Electron setup instructions to README Niklas Wenzel 2023-08-05 18:11:58 +02:00
  • c86963f522 Merge pull request #58 from dqbd/changeset-release/main David Duong 2023-06-25 00:19:05 +01:00
  • 41bb68a0a2 Version Packages github-actions[bot] 2023-06-24 23:18:00 +00:00
  • b1260d9d3c Merge pull request #57 from dqbd/prefix-fix David Duong 2023-06-25 00:17:23 +01:00
  • a691152a24 Add changeset Tat Dat Duong 2023-06-25 00:11:53 +01:00
  • 8e776d36dc Remove prefix from folder Tat Dat Duong 2023-06-25 00:06:03 +01:00
  • 71db4346ae Use NODE_AUTH_TOKEN Tat Dat Duong 2023-06-23 00:51:51 +01:00
  • 15b8a8bf47 Remove python CI steps for now, write .npmrc in actions Tat Dat Duong 2023-06-23 00:18:48 +01:00
  • 3310bfeb94 Bump tiktoken to 1.0.9 Tat Dat Duong 2023-06-22 23:55:43 +01:00