mirror of
https://github.com/run-llama/create-llama.git
synced 2026-07-15 05:08:15 -04:00
Write Wikipedia tool in WASM #41
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @marcusschiesser on GitHub (Aug 26, 2024).
Originally assigned to: @thucpn on GitHub.
Context
WASM would be a great technology for writing the same LLM tool once and using it in Python and TS.
However, the problem is that even a simple HTTP fetch is not standardized among WASM runtimes. This would be the minimum requirement for a runtime running LLM tools (tools usually do API calls).
Status
LlamaIndexTS can already use WASM tools; see https://github.com/run-llama/LlamaIndexTS/blob/main/packages/wasm-tools/README.md
Options
How can we do an HTTP fetch?
Extism looks more mature. (August 2024)
Next step
Try extism to implement a Wikipedia tool
@thucpn commented on GitHub (Aug 29, 2024):
Extism is very cool for JS and Python. I can:
Just one problem, their python-sdk hasn't support using the http plugin. I submit an issue here to ask them:
https://github.com/extism/python-sdk/issues/25