Mintplex-Labs/transformersjs-electron
1
0
Fork 0
mirror of https://github.com/Mintplex-Labs/transformersjs-electron.git synced 2026-07-19 21:26:04 -04:00
Code Issues Packages Projects Releases Wiki Activity

Commit Graph

  • a6d1a5cc0d Add support for masked language modelling Joshua Lochner 2023-02-22 21:32:32 +02:00
  • e9af80a449 Move getTopItems method to utils Joshua Lochner 2023-02-22 17:37:49 +02:00
  • 0226b9a406 Add escapeRegExp utility function Joshua Lochner 2023-02-22 17:33:50 +02:00
  • c911df3a88 Fix tokenization with special tokens Joshua Lochner 2023-02-22 17:32:58 +02:00
  • 4df6c76f10 Generalise getLastLogits method to allow any index to be specified Joshua Lochner 2023-02-22 17:32:33 +02:00
  • 16b608ef46 Set minimum progress bar height Joshua Lochner 2023-02-22 00:53:33 +02:00
  • 064f486116 Set wasm paths relative to worker file (instead of hardcoding) Joshua Lochner 2023-02-22 00:51:04 +02:00
  • a192f8104e Remove source mapping comment from ort.js Joshua Lochner 2023-02-22 00:35:47 +02:00
  • 1f4c394a26 Add logging statement for wasmpaths Joshua Lochner 2023-02-22 00:27:14 +02:00
  • 1623b5bb2c Add models/onnx folder Joshua Lochner 2023-02-22 00:25:47 +02:00
  • 718231eb0f Add models/pytorch folder Joshua Lochner 2023-02-22 00:25:14 +02:00
  • f9ac396cb9 Remove t5-small model from repo Joshua Lochner 2023-02-22 00:25:05 +02:00
  • f41b782dad Update model paths Joshua Lochner 2023-02-22 00:24:40 +02:00
  • 274c05e45f Create style.css Joshua Lochner 2023-02-22 00:18:36 +02:00
  • f11f2cf271 Include model sizes in dropdown Joshua Lochner 2023-02-22 00:10:19 +02:00
  • 70f03f6c3b Update model paths and comments Joshua Lochner 2023-02-21 23:57:24 +02:00
  • 47cda05881 Update demo website Joshua Lochner 2023-02-21 23:56:38 +02:00
  • e32aeef0b4 Require non-empty array for generation Joshua Lochner 2023-02-21 23:56:03 +02:00
  • 9eec801a4d Fix adding temperature Joshua Lochner 2023-02-21 23:55:16 +02:00
  • e3ec36b72c Fix BPE encode method Joshua Lochner 2023-02-21 23:54:48 +02:00
  • b290d9b233 Use quantized distilgpt for text generation Joshua Lochner 2023-02-21 23:54:21 +02:00
  • 2772cb209e Update README.md Joshua Lochner 2023-02-21 17:58:58 +02:00
  • a4541c46bb Update README.md Joshua Lochner 2023-02-21 17:57:48 +02:00
  • f7d3e48647 Allow top_k sampling with 0 if do_sample is True Joshua Lochner 2023-02-21 17:57:20 +02:00
  • 707face329 Update README.md Joshua Lochner 2023-02-21 17:02:27 +02:00
  • 445eaeaaf5 Update FUNDING.yml Joshua Lochner 2023-02-21 16:58:15 +02:00
  • 2410e610aa Create README.md Joshua Lochner 2023-02-21 16:56:36 +02:00
  • 1306e00f29 Update index.html Joshua Lochner 2023-02-21 16:56:28 +02:00
  • 9ec84754bb Use optimum for converting to onnx Joshua Lochner 2023-02-21 16:53:32 +02:00
  • 1fe83e0b67 Add temperature to base Sampler class Joshua Lochner 2023-02-21 16:52:03 +02:00
  • c7324f7f4e Set wasm path in transformer.js Joshua Lochner 2023-02-21 16:51:42 +02:00
  • 2041639a86 Update index.html Joshua Lochner 2023-02-21 16:51:19 +02:00
  • ba202698e1 Update prism Joshua Lochner 2023-02-21 15:29:59 +02:00
  • a453d8e46f Use getAttribute instead of dot notation Joshua Lochner 2023-02-21 15:29:44 +02:00
  • a04f03fa14 Add t5-small model Joshua Lochner 2023-02-20 19:34:38 +02:00
  • abf25ff1df Add generation parameters Joshua Lochner 2023-02-20 19:32:46 +02:00
  • 4920e3c708 Add JS to parse generation options Joshua Lochner 2023-02-20 19:32:29 +02:00
  • 59b90dfbb7 Pass generation options from UI to worker Joshua Lochner 2023-02-20 19:31:52 +02:00
  • 437f551110 Return original text for text-generation Joshua Lochner 2023-02-20 18:56:16 +02:00
  • cba017031d Add demo script Joshua Lochner 2023-02-20 17:14:29 +02:00
  • fa3d4d4ae1 Create worker.js for demo Joshua Lochner 2023-02-20 17:14:13 +02:00
  • 7f854467a9 Create FUNDING.yml Joshua Lochner 2023-02-20 16:02:05 +02:00
  • 98e659eaa7 Dispatch callbacks on certain events Joshua Lochner 2023-02-20 03:51:27 +02:00
  • 17ad585f66 Only add global variables to window if not in worker Joshua Lochner 2023-02-20 01:19:31 +02:00
  • 82968dba62 Add import for ort in model.js Joshua Lochner 2023-02-20 01:18:54 +02:00
  • 6721b57fd8 Add callback function Joshua Lochner 2023-02-20 01:18:35 +02:00
  • 2f16b4a595 Add temperate and discount factor parameters to generate function Joshua Lochner 2023-02-19 17:15:30 +02:00
  • 6a17ba43bf Fix beam search sampling Joshua Lochner 2023-02-19 15:32:10 +02:00
  • 9fbd742717 Abstract generate function Joshua Lochner 2023-02-19 11:57:18 +02:00
  • 6442932d53 Rename variable Joshua Lochner 2023-02-19 03:56:31 +02:00
  • 0b48767d1e Replace for loop with for of loop Joshua Lochner 2023-02-19 03:56:04 +02:00
  • 558ea62cc1 Clean up T5 generation code Joshua Lochner 2023-02-19 03:53:08 +02:00
  • 8e2fd3df5d Remove repeated code between softmax and log_softmax Joshua Lochner 2023-02-19 03:23:58 +02:00
  • fd7b7b17c3 Add log_softmax function Joshua Lochner 2023-02-19 03:09:31 +02:00
  • 11b1b7c2a0 Add GPT2Tokenizer Joshua Lochner 2023-02-19 03:09:06 +02:00
  • b29355f938 Remove old logging Joshua Lochner 2023-02-19 03:08:33 +02:00
  • c9b4b6feb3 Implement beam search Joshua Lochner 2023-02-19 03:06:54 +02:00
  • 8414b0f9d8 Support decoding of multiple lists of token ids Joshua Lochner 2023-02-19 01:37:59 +02:00
  • 807b9216fe Fix top-k sampling Joshua Lochner 2023-02-18 18:38:57 +02:00
  • a11b81111c Implement ByteLevel encoding and decoding (GPT2) Joshua Lochner 2023-02-18 15:48:23 +02:00
  • e285f3afa0 Export AutoModelForCausalLM Joshua Lochner 2023-02-18 15:43:31 +02:00
  • 7952d17feb Improve generate methods Joshua Lochner 2023-02-18 15:29:30 +02:00
  • 7d547b4928 Fix past key dimensions Joshua Lochner 2023-02-18 15:18:01 +02:00
  • 6f04da0d9b Fix GPT generation and use optimum export for T5 Joshua Lochner 2023-02-18 03:02:18 +02:00
  • 6e71ee125a Reorganize generate method Joshua Lochner 2023-02-16 20:20:17 +02:00
  • d2b4fadb8e Fix BertTokenizer by including token_type_ids Joshua Lochner 2023-02-16 04:54:37 +02:00
  • 917b457323 Add skip_special_tokens option to decoder Joshua Lochner 2023-02-16 04:54:13 +02:00
  • 1c962fa219 Add sequence classification model Joshua Lochner 2023-02-16 04:52:01 +02:00
  • 5d7e6fe417 Create t5 model helper methods Joshua Lochner 2023-02-16 00:21:45 +02:00
  • 8a09f503da Remove redundant variable Joshua Lochner 2023-02-16 00:20:26 +02:00
  • f5ad3059df Create .gitignore Joshua Lochner 2023-02-16 00:14:27 +02:00
  • 36ec1431f9 Add T5ForConditionalGeneration model Joshua Lochner 2023-02-16 00:14:20 +02:00
  • e0a88f9453 Add conversion script for models Joshua Lochner 2023-02-16 00:11:49 +02:00
  • 2ef0f00e8e Get basic model working Joshua Lochner 2023-02-15 02:40:32 +02:00
  • 8b7ab098bf Add ort wasm Joshua Lochner 2023-02-15 02:40:13 +02:00
  • fdef4896b2 Add from_pretrained method to PreTrainedTokenizer Joshua Lochner 2023-02-15 01:53:06 +02:00
  • 488b6829ea Update imports and exports Joshua Lochner 2023-02-15 01:52:47 +02:00
  • 57300873c2 Rename classes Joshua Lochner 2023-02-15 01:09:51 +02:00
  • 4be15f9555 Create LICENSE Joshua Lochner 2023-02-15 00:57:04 +02:00
  • 82c207985b Add v1 of scripts (tokenizers working) Joshua Lochner 2023-02-15 00:56:44 +02:00
  • 8c9281fc54 Add template Joshua Lochner 2023-02-15 00:54:29 +02:00
  • e1ba11924c Create model folder Joshua Lochner 2023-02-14 18:36:13 +02:00