Commit Graph

  • c0780804aa Add links to submodules in main module entry point Joshua Lochner 2023-05-08 05:55:13 +02:00
  • b25f19350f Update package.json Joshua Lochner 2023-05-08 05:44:25 +02:00
  • 4422adb928 Fix TypedArray typedef Joshua Lochner 2023-05-08 05:40:32 +02:00
  • 2b5073f73c Fix type issues Joshua Lochner 2023-05-08 05:37:48 +02:00
  • 2512693778 Implement preprocessing and postprocessing for SAM models Joshua Lochner 2023-05-08 04:05:02 +02:00
  • 267ea55e6c Export image utilities from transformers.js Joshua Lochner 2023-05-07 15:56:58 +02:00
  • 736573481f Add SamModel Joshua Lochner 2023-05-07 15:56:36 +02:00
  • 13b570ce97 Merge pull request #106 from chrislee973/fix-norm-calculation Joshua Lochner 2023-05-07 15:54:20 +02:00
  • d0e93c044b add initial value for reduce chrislee973 2023-05-06 21:39:18 -07:00
  • 9665c1e2f0 Update LICENSE Joshua Lochner 2023-05-06 18:03:41 +02:00
  • 403d175190 Reorganize project structure Joshua Lochner 2023-05-06 16:54:28 +02:00
  • aa910b4098 Update JSDocs Joshua Lochner 2023-05-06 04:15:12 +02:00
  • 91b91e1e22 Fix failing tests Joshua Lochner 2023-05-05 00:05:03 +02:00
  • 20b5fdab4a Refactor test suite to fix Jest memory leaks Joshua Lochner 2023-05-04 23:47:45 +02:00
  • 348398e4ff Update webpack.config.js Joshua Lochner 2023-05-04 18:55:15 +02:00
  • f6a6519a20 Improve unit testing framework Joshua Lochner 2023-05-04 18:54:38 +02:00
  • 0cbfaa4bba Remove node: prefix for stream/web import Joshua Lochner 2023-05-04 00:41:14 +02:00
  • 81793726e4 Temporarily remove mobilebert tokenizer test Joshua Lochner 2023-05-04 00:01:42 +02:00
  • 5e1395504b Update list of converted models Joshua Lochner 2023-05-03 23:41:47 +02:00
  • aabf5163fc Differentiate between local and remote testing Joshua Lochner 2023-05-03 02:37:08 +02:00
  • b7e21ff474 Replace default models with web-ready versions Joshua Lochner 2023-05-03 02:11:56 +02:00
  • 60f0e62a3c Update versions of Node.js to test on Joshua Lochner 2023-05-02 22:36:04 +02:00
  • abafbeec95 Allow remote models for testing Joshua Lochner 2023-05-02 22:27:02 +02:00
  • e37b9e5870 Move generate-tests to github workflow Joshua Lochner 2023-05-02 20:04:36 +02:00
  • ca96c7e6c8 Generate tests before running unit tests Joshua Lochner 2023-05-02 20:01:19 +02:00
  • 681d291dc9 Fix ReadableStream import for Node 16.x Joshua Lochner 2023-05-02 18:36:15 +02:00
  • 626168bffd Update tests.yml Joshua Lochner 2023-05-02 18:30:02 +02:00
  • c8c2b35892 Update tests.yml Joshua Lochner 2023-05-02 18:29:16 +02:00
  • aae36e5c1b Remove test for 14.x Joshua Lochner 2023-05-02 18:29:05 +02:00
  • 06db0fe7fd Update package-lock.json Joshua Lochner 2023-05-02 18:27:22 +02:00
  • f0cba36503 Allow ci from docs branch Joshua Lochner 2023-05-02 18:21:10 +02:00
  • 216d498ab4 Create basic github actions workflow Joshua Lochner 2023-05-02 18:14:47 +02:00
  • 508f0003b4 Temporarily disable pipeline tests Joshua Lochner 2023-05-02 17:59:34 +02:00
  • 54ab260945 Add type acquisition include for jest Joshua Lochner 2023-05-02 17:16:29 +02:00
  • 4a282bf632 Use interpolation method specified in processor's config Joshua Lochner 2023-05-02 06:49:54 +02:00
  • 8de18bc1d5 Create hub.test.js Joshua Lochner 2023-05-02 05:37:39 +02:00
  • 595efc631c Export PreTrainedModel from transformers Joshua Lochner 2023-05-02 05:36:26 +02:00
  • 27c9d8d570 Fix isDeepEqual function Joshua Lochner 2023-05-02 05:20:07 +02:00
  • f67d9642be Move tokenizers test to jest module Joshua Lochner 2023-05-02 05:19:23 +02:00
  • c29bd79085 Move pipelines test to jest module Joshua Lochner 2023-05-02 05:18:38 +02:00
  • 25993e7706 Create jest.config.mjs Joshua Lochner 2023-05-02 05:16:04 +02:00
  • 9a5e8a954b Do not track coverage reports Joshua Lochner 2023-05-02 05:13:20 +02:00
  • 2e9c789023 Add docs-preview script to package.json Joshua Lochner 2023-05-02 05:12:46 +02:00
  • a861785a10 Use jest for unit testing Joshua Lochner 2023-05-02 05:12:21 +02:00
  • 80912c0fb2 Reformat tests generator Joshua Lochner 2023-05-02 05:10:07 +02:00
  • 459ac7f4f9 Fix BertPreTokenizer regex pattern Joshua Lochner 2023-05-01 22:34:19 +02:00
  • 63ccc3dbac Use Map for tokens_to_ids Joshua Lochner 2023-05-01 22:33:51 +02:00
  • d0509e0916 Fix ByteLevel pretokenization Joshua Lochner 2023-05-01 17:27:28 +02:00
  • 82660943d6 Replace for...of with for loop Joshua Lochner 2023-05-01 02:00:33 +02:00
  • 926b279b7b Support loading of audio sources with 1 channel Joshua Lochner 2023-05-01 01:16:32 +02:00
  • 76e2a1f3c3 Allow different order for NllbTokenizer post processor config Joshua Lochner 2023-04-30 15:23:41 +02:00
  • 375fac56c6 Add descriptions for tasks Joshua Lochner 2023-04-29 02:26:29 +02:00
  • f85a7359ff Add listed support for NLLB models (Closes #101) Joshua Lochner 2023-04-29 02:04:08 +02:00
  • 019289e51a Allow source language to be optional (use tokenizer's default) Joshua Lochner 2023-04-29 01:55:46 +02:00
  • 8a783e8305 Use Object.create(null); when creating empty objects Joshua Lochner 2023-04-29 01:13:52 +02:00
  • 38b9d5fc5b Add warning/todo for MarianTokenizers Joshua Lochner 2023-04-29 00:53:15 +02:00
  • e5ad22719b Use byte_fallback option if present in config Joshua Lochner 2023-04-29 00:45:22 +02:00
  • 5ff0b86cee Add translation test for multilingual (nllb) models Joshua Lochner 2023-04-29 00:14:05 +02:00
  • 7ee3c969c7 Log test name and input text if the test fails Joshua Lochner 2023-04-29 00:12:02 +02:00
  • dbe6e85e12 Save results file as utf-8 Joshua Lochner 2023-04-29 00:11:32 +02:00
  • 142846f7d5 Add tokenizer tests for m2m_100 models Joshua Lochner 2023-04-29 00:11:18 +02:00
  • 517c281092 Allow user to specify source and target language in translation pipeline Joshua Lochner 2023-04-28 21:32:06 +02:00
  • 1a518da1be Add support for Nllb tokenizer Joshua Lochner 2023-04-28 21:29:32 +02:00
  • 3a7d3c0d22 Add support for M2M100 models Joshua Lochner 2023-04-28 21:28:49 +02:00
  • 6899153904 Add sample electron application Joshua Lochner 2023-04-28 15:57:26 +02:00
  • a6bb4b0eb5 Remove blenderbot-small from tokenizer test Joshua Lochner 2023-04-27 23:29:42 +02:00
  • 9c8963ab8f Ignore .json files generated by test_generator.py Joshua Lochner 2023-04-27 23:29:17 +02:00
  • 814f9f0023 Update tokenizer test function Joshua Lochner 2023-04-27 23:28:33 +02:00
  • 67419fc844 Also move .onnx_data files to the onnx folder Joshua Lochner 2023-04-27 21:52:05 +02:00
  • 357666800c Update README.md Joshua Lochner 2023-04-26 19:16:12 +02:00
  • c7697d0455 Add env.allowRemoteModels option Joshua Lochner 2023-04-26 03:38:08 +02:00
  • aa3286020e Fix typo Joshua Lochner 2023-04-25 21:39:19 +02:00
  • ca7a1012b5 Update .gitignore to only target build directories at root level Joshua Lochner 2023-04-25 20:48:12 +02:00
  • 6cb5f7266b Update example browser extension README Joshua Lochner 2023-04-25 20:42:35 +02:00
  • 2651a7b1a0 Fix typo Joshua Lochner 2023-04-25 20:38:47 +02:00
  • 07f04de441 Add example browser extension project Joshua Lochner 2023-04-25 20:34:09 +02:00
  • 86d3aa1d60 Catch errors that may occur when adding to cache Joshua Lochner 2023-04-25 14:51:40 +02:00
  • 727c0d30b4 Await result of cache.put (Fixes #99) Joshua Lochner 2023-04-25 14:37:50 +02:00
  • 2a1dc38a52 Remove experimental top-level await from webpack config Joshua Lochner 2023-04-25 01:50:59 +02:00
  • e1ea278024 Remove onnxruntime-node from webpack ignore plugin Joshua Lochner 2023-04-25 01:50:30 +02:00
  • 34db6d694c Add onnxruntime-node to browser ignore list Joshua Lochner 2023-04-25 01:40:07 +02:00
  • 1206827a3b Update dev dependency versions Joshua Lochner 2023-04-25 01:39:28 +02:00
  • 18c8d9fb27 Disable SIMD for WASM on iOS devices Joshua Lochner 2023-04-25 01:36:59 +02:00
  • 3eba196518 Fix demo when running remotely Joshua Lochner 2023-04-25 00:36:23 +02:00
  • 795174d5ba Remove unused imports Joshua Lochner 2023-04-25 00:09:33 +02:00
  • 55dac3e96c Update demo site imports Joshua Lochner 2023-04-25 00:08:44 +02:00
  • 0172cf85c1 Do not use top-level awaits when importing ONNX runtime Joshua Lochner 2023-04-25 00:02:51 +02:00
  • e2cbd70f33 Update __dirname in env.js Joshua Lochner 2023-04-24 23:59:01 +02:00
  • 0966debc26 Lazily construct canvas elements (for when OffscreenCanvas is not defined) Joshua Lochner 2023-04-24 17:02:48 +02:00
  • 0af5f5fdaf Only use url package when running locally Joshua Lochner 2023-04-24 06:09:31 +02:00
  • 29b7f9a6fd Convert webpack config to ES6 Joshua Lochner 2023-04-24 06:09:10 +02:00
  • 17349d18a2 Change global to globalThis Joshua Lochner 2023-04-24 06:08:22 +02:00
  • b5c9163533 Ignore url package from browser Joshua Lochner 2023-04-24 06:06:42 +02:00
  • 1a90c6e553 Fix ES6 imports Joshua Lochner 2023-04-24 05:28:24 +02:00
  • f25b17c91a Merge branch 'es6-rewrite' into docs Joshua Lochner 2023-04-24 04:57:38 +02:00
  • a0b53f6654 Move demo site to examples folder Joshua Lochner 2023-04-23 22:50:49 +02:00
  • 6073ba4b79 Add models folder to .gitignore Joshua Lochner 2023-04-23 20:18:30 +02:00
  • 8941a100fe Delete models folder Joshua Lochner 2023-04-23 20:16:36 +02:00
  • 20f4b1fc6a Fix demo progress bars Joshua Lochner 2023-04-23 01:55:02 +02:00
  • ad69f0a9ea Update package.json Joshua Lochner 2023-04-22 22:03:31 +02:00