Release 0.8.8 (#1457)

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: himself65 <himself65@users.noreply.github.com>

CONTRIBUTING.md

@@ -2,86 +2,58 @@
 
 ## Structure
 
-This is a monorepo built with Turborepo
+LlamaIndex.TS uses pnpm monorepo.
 
-Right now, for first-time contributors, these three packages are of the highest importance:
+We recommend you to understand the basics of Node.js, TypeScript, pnpm, and of course, LLM before contributing.
 
-- `packages/llamaindex` which is the main NPM library `llamaindex`
+There are some important folders in the repository:
-- `examples` is where the demo code lives
-- `apps/docs` is where the code for the documentation of https://ts.llamaindex.ai/ is located
 
-### Turborepo docs
+- `packages/*`: Contains the source code of the packages. Each package is a separate npm package.
-
+  - `llamaindex`: The starter package for LlamaIndex.TS, which contains the all sub-packages.
-You can checkout how Turborepo works using the default [README-turborepo.md](/README-turborepo.md)
+  - `core`: The core package of LlamaIndex.TS, which contains the abstract classes and interfaces. It is designed for
+    all JS runtime environments.
+  - `env`: The environment package of LlamaIndex.TS, which contains the environment-specific classes and interfaces. It
+    includes compatibility layers for Node.js, Deno, Vercel Edge Runtime, Cloudflare Workers...
+- `apps/*`: The applications based on LlamaIndex.TS.
+  - `next`: Our documentation website based on Next.js.
+- `examples`: The code examples of LlamaIndex.TS using Node.js.
 
 ## Getting Started
 
-Install NodeJS. Preferably v18 using nvm or n.
+Make sure you have Node.js LIS (Long-term Support) installed. You can check your Node.js version by running:
-
-Inside the LlamaIndexTS directory:
 
+```shell
+node -v
+# v20.x.x
 ```
-npm i -g pnpm ts-node
+
+### Use pnpm
+
+```shell
+corepack enable
+```
+
+### Install dependencies
+
+```shell
 pnpm install
 ```
 
-Note: we use pnpm in this repo, which has a lot of the same functionality and CLI options as npm but it does do some things better in a monorepo, like centralizing dependencies and caching.
+### Build the packages
 
-PNPM's has documentation on its [workspace feature](https://pnpm.io/workspaces) and Turborepo had some [useful documentation also](https://turbo.build/repo/docs/core-concepts/monorepos/running-tasks).
+```shell
-
+# Build all packages
-### Running Typescript
+turbo build --filter "./packages/*"
-
-When we publish to NPM we will have a tsc compiled version of the library in JS. For now, the easiest thing to do is use ts-node.
-
-### Test cases
-
-To run them, run
-
-```
-pnpm run test
-```
-
-To write new test cases write them in [packages/llamaindex/tests](/packages/llamaindex/tests)
-
-We use Vitest https://vitest.dev to write our test cases. Vitest comes with a bunch of built-in assertions using the expect function: https://vitest.dev/api/expect.html#expect
-
-### Demo applications
-
-There is an existing ["example"](/examples/README.md) demos folder with mainly NodeJS scripts. Feel free to add additional demos to that folder. If you would like to try out your changes in the `llamaindex` package with a new demo, you need to run the build command in the README.
-
-You can create new demo applications in the apps folder. Just run pnpm init in the folder after you create it to create its own package.json
-
-### Installing packages
-
-To install packages for a specific package or demo application, run
-
-```
-pnpm add [NPM Package] --filter [package or application i.e. llamaindex or docs]
-```
-
-To install packages for every package or application run
-
-```
-pnpm add -w [NPM Package]
 ```
 
 ### Docs
 
-To contribute to the docs, go to the docs website folder and run the Docusaurus instance.
+See the [docs](./apps/next/README.md) for more information.
-
-```bash
-cd apps/docs
-pnpm install
-pnpm start
-```
-
-That should start a webserver which will serve the docs on https://localhost:3000
-
-Any changes you make should be reflected in the browser. If you need to regenerate the API docs and find that your TSDoc isn't getting the updates, feel free to remove apps/docs/api. It will automatically regenerate itself when you run pnpm start again.
 
 ## Changeset
 
-We use [changesets](https://github.com/changesets/changesets) for managing versions and changelogs. To create a new changeset, run in the root folder:
+We use [changesets](https://github.com/changesets/changesets) for managing versions and changelogs. To create a new
+changeset, run in the root folder:
 
 ```
 pnpm changeset
@@ -95,6 +67,6 @@ The [Release Github Action](.github/workflows/release.yml) is automatically gene
 PR called "Release {version}".
 
 This PR will update the `package.json` and `CHANGELOG.md` files of each package according to
-the current changesets in the [.changeset](.changeset/) folder.
+the current changesets in the [.changeset](.changeset) folder.
 
 If this PR is merged it will automatically add version tags to the repository and publish the updated packages to NPM.

apps/docs/CHANGELOG.md

@@ -1,5 +1,13 @@
 # docs
 
+## 0.0.112
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+  - @llamaindex/examples@0.0.13
+
 ## 0.0.111
 
 ### Patch Changes

apps/docs/package.json

@@ -1,6 +1,6 @@
 {
   "name": "docs",
-  "version": "0.0.111",
+  "version": "0.0.112",
   "private": true,
   "scripts": {
     "docusaurus": "docusaurus",

apps/next/CHANGELOG.md

@@ -1,5 +1,18 @@
 # @llamaindex/doc
 
+## 0.0.10
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - llamaindex@0.8.8
+  - @llamaindex/node-parser@0.0.6
+  - @llamaindex/workflow@0.0.3
+  - @llamaindex/cloud@2.0.5
+  - @llamaindex/openai@0.1.30
+  - @llamaindex/readers@1.0.6
+
 ## 0.0.9
 
 ### Patch Changes

apps/next/README.md

@@ -1,4 +1,4 @@
-# next
+# Docs
 
 This is a Next.js application generated with
 [Create Fumadocs](https://github.com/fuma-nama/fumadocs).
@@ -6,15 +6,10 @@ This is a Next.js application generated with
 Run development server:
 
 ```bash
-npm run dev
+turbo run dev
-# or
+# turbo will build all required packages before running the dev server
-pnpm dev
-# or
-yarn dev
 ```
 
-Open http://localhost:3000 with your browser to see the result.
-
 ## Learn More
 
 To learn more about Next.js and Fumadocs, take a look at the following

apps/next/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/doc",
-  "version": "0.0.9",
+  "version": "0.0.10",
   "private": true,
   "scripts": {
     "build": "pnpm run build:docs && next build",

apps/next/src/content/docs/llamaindex/setup/typescript.mdx

@@ -93,6 +93,35 @@ See more about [moduleResolution](https://www.typescriptlang.org/docs/handbook/m
 	</Accordion>
 </Accordions>
 
+## Enable AsyncIterable for `Web Stream` API
+
+Some modules uses `Web Stream` API like `ReadableStream` and `WritableStream`, you need to enable `DOM.AsyncIterable` in your `tsconfig.json`.
+
+```json5
+{
+  compilerOptions: {
+    // ⬇️ add this lib to your tsconfig.json
+    lib: ["DOM.AsyncIterable"],
+  },
+}
+```
+
+```ts twoslash
+import { OpenAIAgent } from '@llamaindex/openai'
+
+const agent = new OpenAIAgent({
+  tools: []
+})
+
+const response = await agent.chat({
+  message: 'Hello, how are you?',
+  stream: true
+})
+for await (const _ of response) {
+                      //^?
+  // ...
+}
+```
 
 ## Run TypeScript Script in Node.js
 

apps/next/turbo.json

@@ -0,0 +1,8 @@
+{
+  "extends": ["//"],
+  "tasks": {
+    "dev": {
+      "dependsOn": ["^build"]
+    }
+  }
+}

e2e/examples/cloudflare-worker-agent/CHANGELOG.md

@@ -1,5 +1,12 @@
 # @llamaindex/cloudflare-worker-agent-test
 
+## 0.0.104
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+
 ## 0.0.103
 
 ### Patch Changes

e2e/examples/cloudflare-worker-agent/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/cloudflare-worker-agent-test",
-  "version": "0.0.103",
+  "version": "0.0.104",
   "type": "module",
   "private": true,
   "scripts": {

e2e/examples/llama-parse-browser/CHANGELOG.md

@@ -1,5 +1,11 @@
 # @llamaindex/llama-parse-browser-test
 
+## 0.0.25
+
+### Patch Changes
+
+- @llamaindex/cloud@2.0.5
+
 ## 0.0.24
 
 ### Patch Changes

e2e/examples/llama-parse-browser/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/llama-parse-browser-test",
   "private": true,
-  "version": "0.0.24",
+  "version": "0.0.25",
   "type": "module",
   "scripts": {
     "dev": "vite",

e2e/examples/nextjs-agent/CHANGELOG.md

@@ -1,5 +1,12 @@
 # @llamaindex/next-agent-test
 
+## 0.1.104
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+
 ## 0.1.103
 
 ### Patch Changes

e2e/examples/nextjs-agent/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/next-agent-test",
-  "version": "0.1.103",
+  "version": "0.1.104",
   "private": true,
   "scripts": {
     "dev": "next dev",

e2e/examples/nextjs-edge-runtime/CHANGELOG.md

@@ -1,5 +1,12 @@
 # test-edge-runtime
 
+## 0.1.103
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+
 ## 0.1.102
 
 ### Patch Changes

e2e/examples/nextjs-edge-runtime/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/nextjs-edge-runtime-test",
-  "version": "0.1.102",
+  "version": "0.1.103",
   "private": true,
   "scripts": {
     "dev": "next dev",

e2e/examples/nextjs-node-runtime/CHANGELOG.md

@@ -1,5 +1,12 @@
 # @llamaindex/next-node-runtime
 
+## 0.0.85
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+
 ## 0.0.84
 
 ### Patch Changes

e2e/examples/nextjs-node-runtime/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/next-node-runtime-test",
-  "version": "0.0.84",
+  "version": "0.0.85",
   "private": true,
   "scripts": {
     "dev": "next dev",

e2e/examples/nextjs-node-runtime/src/utils/tokenizer.ts

@@ -1,5 +1,5 @@
 // test runtime
-import { Tokenizers, tokenizers } from "@llamaindex/env";
+import { Tokenizers, tokenizers } from "@llamaindex/env/tokenizers";
 import "llamaindex";
 
 // @ts-expect-error EdgeRuntime is not defined in type

e2e/examples/waku-query-engine/CHANGELOG.md

@@ -1,5 +1,12 @@
 # @llamaindex/waku-query-engine-test
 
+## 0.0.104
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+
 ## 0.0.103
 
 ### Patch Changes

e2e/examples/waku-query-engine/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/waku-query-engine-test",
-  "version": "0.0.103",
+  "version": "0.0.104",
   "type": "module",
   "private": true,
   "scripts": {

e2e/node/issue.e2e.ts

@@ -1,6 +1,13 @@
-import { LLMSingleSelector, Settings } from "llamaindex";
+import type { TaskStep } from "@llamaindex/core/agent";
+import {
+  LLMSingleSelector,
+  OpenAIAgent,
+  Settings,
+  type ChatMessage,
+} from "llamaindex";
 import assert from "node:assert";
 import { test } from "node:test";
+import { divideNumbersTool, sumNumbersTool } from "./fixtures/tools.js";
 import { mockLLMEvent } from "./utils.js";
 
 await test("#1177", async (t) => {
@@ -65,3 +72,28 @@ await test("#1177", async (t) => {
     }
   });
 });
+
+await test("#1281", async (t) => {
+  await mockLLMEvent(t, "#1281");
+  await t.test(async () => {
+    const chatHistory: ChatMessage[] = [];
+    const agent = new OpenAIAgent({
+      chatHistory,
+      tools: [sumNumbersTool, divideNumbersTool],
+    });
+    {
+      const stream = agent.createTask(
+        "calculate 2 + 2",
+        true,
+        true,
+        chatHistory,
+      );
+      const steps: TaskStep[] = [];
+      for await (const task of stream) {
+        steps.push(task.taskStep);
+      }
+      const lastStep = steps.at(-1)!;
+      assert.equal(lastStep.context.store.messages.length, 4);
+    }
+  });
+});

e2e/node/snapshot/#1281.snap

@@ -0,0 +1,393 @@
+{
+  "llmEventStart": [
+    {
+      "id": "PRESERVE_0",
+      "messages": [
+        {
+          "role": "user",
+          "content": "calculate 2 + 2"
+        }
+      ]
+    },
+    {
+      "id": "PRESERVE_1",
+      "messages": [
+        {
+          "role": "user",
+          "content": "calculate 2 + 2"
+        },
+        {
+          "role": "assistant",
+          "content": "",
+          "options": {
+            "toolCall": [
+              {
+                "name": "sumNumbers",
+                "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+                "input": {
+                  "a": 2,
+                  "b": 2
+                }
+              }
+            ]
+          }
+        },
+        {
+          "role": "user",
+          "content": "4",
+          "options": {
+            "toolResult": {
+              "result": "4",
+              "isError": false,
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd"
+            }
+          }
+        }
+      ]
+    }
+  ],
+  "llmEventEnd": [
+    {
+      "id": "PRESERVE_0",
+      "response": {
+        "raw": null,
+        "message": {
+          "content": "",
+          "role": "assistant",
+          "options": {
+            "toolCall": [
+              {
+                "name": "sumNumbers",
+                "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+                "input": {
+                  "a": 2,
+                  "b": 2
+                }
+              }
+            ]
+          }
+        }
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "response": {
+        "raw": null,
+        "message": {
+          "content": "The result of \\(2 + 2\\) is \\(4\\).",
+          "role": "assistant",
+          "options": {}
+        }
+      }
+    }
+  ],
+  "llmEventStream": [
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": "{\"a\":2,\"b\":2}"
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_0",
+      "chunk": {
+        "raw": null,
+        "options": {
+          "toolCall": [
+            {
+              "name": "sumNumbers",
+              "id": "call_S2x0FUa475GVpNQJ796Rc9fd",
+              "input": {
+                "a": 2,
+                "b": 2
+              }
+            }
+          ]
+        },
+        "delta": ""
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": "The"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": " result"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": " of"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": " \\("
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": "2"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": " +"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": " "
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": "2"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": "\\"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": ")"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": " is"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": " \\("
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": "4"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": "\\"
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": ")."
+      }
+    },
+    {
+      "id": "PRESERVE_1",
+      "chunk": {
+        "raw": null,
+        "options": {},
+        "delta": ""
+      }
+    }
+  ]
+}

e2e/tsconfig.json

@@ -5,7 +5,6 @@
     "module": "node16",
     "moduleResolution": "node16",
     "target": "ESNext",
-    "lib": ["ES2022", "DOM.AsyncIterable"],
     "types": ["node"]
   },
   "include": ["./node", "./mock-module.js", "./mock-register.js", "./fixtures"],

examples/CHANGELOG.md

@@ -1,5 +1,15 @@
 # examples
 
+## 0.0.13
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - llamaindex@0.8.8
+  - @llamaindex/workflow@0.0.3
+  - @llamaindex/readers@1.0.6
+
 ## 0.0.12
 
 ### Patch Changes

examples/package.json

@@ -1,15 +1,15 @@
 {
   "name": "@llamaindex/examples",
   "private": true,
-  "version": "0.0.12",
+  "version": "0.0.13",
   "dependencies": {
     "@aws-crypto/sha256-js": "^5.2.0",
     "@azure/cosmos": "^4.1.1",
     "@azure/identity": "^4.4.1",
     "@datastax/astra-db-ts": "^1.4.1",
-    "@llamaindex/core": "^0.4.0",
+    "@llamaindex/core": "^0.4.5",
-    "@llamaindex/readers": "^1.0.0",
+    "@llamaindex/readers": "^1.0.6",
-    "@llamaindex/workflow": "^0.0.2",
+    "@llamaindex/workflow": "^0.0.3",
     "@notionhq/client": "^2.2.15",
     "@pinecone-database/pinecone": "^3.0.2",
     "@vercel/postgres": "^0.10.0",
@@ -18,7 +18,7 @@
     "commander": "^12.1.0",
     "dotenv": "^16.4.5",
     "js-tiktoken": "^1.0.14",
-    "llamaindex": "^0.8.0",
+    "llamaindex": "^0.8.8",
     "mongodb": "^6.7.0",
     "pathe": "^1.1.2",
     "postgres": "^3.4.4"

packages/autotool/CHANGELOG.md

@@ -1,5 +1,12 @@
 # @llamaindex/autotool
 
+## 5.0.8
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+
 ## 5.0.7
 
 ### Patch Changes

packages/autotool/examples/01_node/CHANGELOG.md

@@ -1,5 +1,13 @@
 # @llamaindex/autotool-01-node-example
 
+## 0.0.51
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+  - @llamaindex/autotool@5.0.8
+
 ## 0.0.50
 
 ### Patch Changes

packages/autotool/examples/01_node/package.json

@@ -13,5 +13,5 @@
   "scripts": {
     "start": "node --import tsx --import @llamaindex/autotool/node ./src/index.ts"
   },
-  "version": "0.0.50"
+  "version": "0.0.51"
 }

packages/autotool/examples/02_nextjs/CHANGELOG.md

@@ -1,5 +1,13 @@
 # @llamaindex/autotool-02-next-example
 
+## 0.1.95
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+  - @llamaindex/autotool@5.0.8
+
 ## 0.1.94
 
 ### Patch Changes

packages/autotool/examples/02_nextjs/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/autotool-02-next-example",
   "private": true,
-  "version": "0.1.94",
+  "version": "0.1.95",
   "scripts": {
     "dev": "next dev",
     "build": "next build",

packages/autotool/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/autotool",
   "type": "module",
-  "version": "5.0.7",
+  "version": "5.0.8",
   "description": "auto transpile your JS function to LLM Agent compatible",
   "files": [
     "dist",

packages/cloud/CHANGELOG.md

@@ -1,5 +1,13 @@
 # @llamaindex/cloud
 
+## 2.0.5
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+
 ## 2.0.4
 
 ### Patch Changes

packages/cloud/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/cloud",
-  "version": "2.0.4",
+  "version": "2.0.5",
   "type": "module",
   "license": "MIT",
   "scripts": {

packages/cloud/tsconfig.json

@@ -8,7 +8,6 @@
     "moduleResolution": "Bundler",
     "skipLibCheck": true,
     "strict": true,
-    "lib": ["DOM", "ESNext"],
     "types": []
   },
   "include": ["./src"],

packages/community/CHANGELOG.md

@@ -1,5 +1,13 @@
 # @llamaindex/community
 
+## 0.0.63
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+
 ## 0.0.62
 
 ### Patch Changes

packages/community/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/community",
   "description": "Community package for LlamaIndexTS",
-  "version": "0.0.62",
+  "version": "0.0.63",
   "type": "module",
   "types": "dist/type/index.d.ts",
   "main": "dist/cjs/index.js",

packages/core/CHANGELOG.md

@@ -1,5 +1,14 @@
 # @llamaindex/core
 
+## 0.4.5
+
+### Patch Changes
+
+- ad85bd0: - fix agent chat message not saved into the task context when streaming
+  - fix async local storage might use `node:async_hook` in edge-light/workerd condition
+- Updated dependencies [ad85bd0]
+  - @llamaindex/env@0.1.19
+
 ## 0.4.4
 
 ### Patch Changes

packages/core/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/core",
   "type": "module",
-  "version": "0.4.4",
+  "version": "0.4.5",
   "description": "LlamaIndex Core Module",
   "exports": {
     "./agent": {
@@ -392,7 +392,7 @@
     "@edge-runtime/vm": "^4.0.3",
     "ajv": "^8.17.1",
     "bunchee": "5.6.1",
-    "happy-dom": "^15.10.0",
+    "happy-dom": "^15.11.0",
     "natural": "^8.0.1"
   },
   "dependencies": {

packages/core/src/agent/base.ts

@@ -3,7 +3,7 @@ import {
   BaseChatEngine,
   type NonStreamingChatEngineParams,
   type StreamingChatEngineParams,
-} from "../chat-engine/base";
+} from "../chat-engine";
 import { wrapEventCaller } from "../decorator";
 import { Settings } from "../global";
 import type {
@@ -172,7 +172,6 @@ export abstract class AgentWorker<
       start: async (controller) => {
         for await (const stepOutput of taskOutputStream) {
           this.#taskSet.add(stepOutput.taskStep);
-          controller.enqueue(stepOutput);
           if (stepOutput.isLast) {
             let currentStep: TaskStep<
               AI,
@@ -183,7 +182,30 @@ export abstract class AgentWorker<
               this.#taskSet.delete(currentStep);
               currentStep = currentStep.prevStep;
             }
+            const { output, taskStep } = stepOutput;
+            if (output instanceof ReadableStream) {
+              const [pipStream, finalStream] = output.tee();
+              stepOutput.output = finalStream;
+              const reader = pipStream.getReader();
+              const { value } = await reader.read();
+              reader.releaseLock();
+              let content: string = value!.delta;
+              for await (const chunk of pipStream) {
+                content += chunk.delta;
+              }
+              taskStep.context.store.messages = [
+                ...taskStep.context.store.messages,
+                {
+                  role: "assistant",
+                  content,
+                  options: value!.options,
+                },
+              ];
+            }
+            controller.enqueue(stepOutput);
             controller.close();
+          } else {
+            controller.enqueue(stepOutput);
           }
         }
       },
@@ -373,8 +395,8 @@ export abstract class AgentRunner<
       if (stepOutput.isLast) {
         const { output } = stepOutput;
         if (output instanceof ReadableStream) {
-          return output.pipeThrough<EngineResponse>(
+          return output.pipeThrough(
-            new TransformStream({
+            new TransformStream<EngineResponse>({
               transform(chunk, controller) {
                 controller.enqueue(EngineResponse.fromChatResponseChunk(chunk));
               },

packages/core/src/agent/utils.ts

@@ -79,7 +79,7 @@ export async function stepToolsStreaming<Model extends LLM>({
     for await (const chunk of pipStream) {
       if (chunk.options && "toolCall" in chunk.options) {
         const toolCall = chunk.options.toolCall;
-        toolCall.forEach((toolCall) => {
+        toolCall.forEach((toolCall: ToolCall | PartialToolCall) => {
           toolCalls.set(toolCall.id, toolCall);
         });
       }

packages/core/src/embeddings/base.ts

@@ -1,4 +1,4 @@
-import { type Tokenizers } from "@llamaindex/env";
+import type { Tokenizers } from "@llamaindex/env/tokenizers";
 import type { MessageContentDetail } from "../llms";
 import { BaseNode, MetadataMode, TransformComponent } from "../schema";
 import { extractSingleText } from "../utils";

packages/core/src/embeddings/tokenizer.ts

@@ -1,4 +1,4 @@
-import { Tokenizers, tokenizers } from "@llamaindex/env";
+import { Tokenizers, tokenizers } from "@llamaindex/env/tokenizers";
 
 export function truncateMaxTokens(
   tokenizer: Tokenizers,

packages/core/src/global/settings.ts

@@ -1,4 +1,5 @@
-import { getEnv, type Tokenizer } from "@llamaindex/env";
+import { getEnv } from "@llamaindex/env";
+import type { Tokenizer } from "@llamaindex/env/tokenizers";
 import type { LLM } from "../llms";
 import {
   type CallbackManager,

packages/core/src/global/settings/tokenizer.ts

@@ -1,4 +1,5 @@
-import { AsyncLocalStorage, type Tokenizer, tokenizers } from "@llamaindex/env";
+import { AsyncLocalStorage } from "@llamaindex/env";
+import { type Tokenizer, tokenizers } from "@llamaindex/env/tokenizers";
 
 const chunkSizeAsyncLocalStorage = new AsyncLocalStorage<Tokenizer>();
 let globalTokenizer: Tokenizer = tokenizers.tokenizer();

packages/core/src/indices/prompt-helper.ts

@@ -1,4 +1,4 @@
-import { type Tokenizer, tokenizers } from "@llamaindex/env";
+import type { Tokenizer } from "@llamaindex/env/tokenizers";
 import {
   DEFAULT_CHUNK_OVERLAP_RATIO,
   DEFAULT_CONTEXT_WINDOW,
@@ -64,7 +64,7 @@ export class PromptHelper {
     this.numOutput = numOutput;
     this.chunkOverlapRatio = chunkOverlapRatio;
     this.chunkSizeLimit = chunkSizeLimit;
-    this.tokenizer = tokenizer ?? tokenizers.tokenizer();
+    this.tokenizer = tokenizer ?? Settings.tokenizer;
     this.separator = separator;
   }
 

packages/core/src/llms/type.ts

@@ -1,6 +1,6 @@
-import type { Tokenizers } from "@llamaindex/env";
+import type { Tokenizers } from "@llamaindex/env/tokenizers";
 import type { JSONSchemaType } from "ajv";
-import type { JSONObject, JSONValue } from "../global/type";
+import type { JSONObject, JSONValue } from "../global";
 
 /**
  * @internal

packages/core/src/memory/summary-memory.ts

@@ -1,4 +1,4 @@
-import { type Tokenizer, tokenizers } from "@llamaindex/env";
+import { type Tokenizer, tokenizers } from "@llamaindex/env/tokenizers";
 import { Settings } from "../global";
 import type { ChatMessage, LLM, MessageType } from "../llms";
 import { defaultSummaryPrompt, type SummaryPrompt } from "../prompts";

packages/core/src/node-parser/sentence-splitter.ts

@@ -1,4 +1,4 @@
-import type { Tokenizer } from "@llamaindex/env";
+import type { Tokenizer } from "@llamaindex/env/tokenizers";
 import { z } from "zod";
 import { Settings } from "../global";
 import { sentenceSplitterSchema } from "../schema";

packages/core/src/node-parser/token-text-splitter.ts

@@ -1,4 +1,4 @@
-import type { Tokenizer } from "@llamaindex/env";
+import type { Tokenizer } from "@llamaindex/env/tokenizers";
 import { z } from "zod";
 import { DEFAULT_CHUNK_OVERLAP, DEFAULT_CHUNK_SIZE, Settings } from "../global";
 import { MetadataAwareTextSplitter } from "./base";

packages/core/src/node-parser/type.ts

@@ -1,4 +1,4 @@
-import type { Tokenizer } from "@llamaindex/env";
+import type { Tokenizer } from "@llamaindex/env/tokenizers";
 
 export type SplitterParams = {
   tokenizer?: Tokenizer;

packages/core/tests/embeddings.test.ts

@@ -1,5 +1,5 @@
 import { truncateMaxTokens } from "@llamaindex/core/embeddings";
-import { Tokenizers, tokenizers } from "@llamaindex/env";
+import { Tokenizers, tokenizers } from "@llamaindex/env/tokenizers";
 import { describe, expect, test } from "vitest";
 
 describe("truncateMaxTokens", () => {

packages/core/tests/node-parser/sentence-spiller.test.ts

@@ -1,6 +1,6 @@
 import { SentenceSplitter } from "@llamaindex/core/node-parser";
 import { Document } from "@llamaindex/core/schema";
-import { tokenizers } from "@llamaindex/env";
+import { tokenizers } from "@llamaindex/env/tokenizers";
 import { beforeEach, describe, expect, test } from "vitest";
 
 describe("SentenceSplitter", () => {

packages/core/tsconfig.json

@@ -8,7 +8,6 @@
     "moduleResolution": "Bundler",
     "skipLibCheck": true,
     "strict": true,
-    "lib": ["ESNext", "DOM", "DOM.AsyncIterable"],
     "types": ["node"]
   },
   "include": ["./src"],

packages/env/CHANGELOG.md

@@ -1,5 +1,12 @@
 # @llamaindex/env
 
+## 0.1.19
+
+### Patch Changes
+
+- ad85bd0: - fix agent chat message not saved into the task context when streaming
+  - fix async local storage might use `node:async_hook` in edge-light/workerd condition
+
 ## 0.1.18
 
 ### Patch Changes

packages/env/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/env",
   "description": "environment wrapper, supports all JS environment including node, deno, bun, edge runtime, and cloudflare worker",
-  "version": "0.1.18",
+  "version": "0.1.19",
   "type": "module",
   "types": "dist/index.d.ts",
   "module": "dist/index.js",
@@ -51,6 +51,32 @@
         "default": "./dist/index.cjs"
       }
     },
+    "./tokenizers": {
+      "workerd": {
+        "types": "./tokenizers/dist/index.workerd.d.ts",
+        "default": "./tokenizers/dist/index.workerd.js"
+      },
+      "edge-light": {
+        "types": "./tokenizers/dist/index.edge-light.d.ts",
+        "default": "./tokenizers/dist/index.edge-light.js"
+      },
+      "browser": {
+        "types": "./tokenizers/dist/index.browser.d.ts",
+        "default": "./tokenizers/dist/index.browser.js"
+      },
+      "import": {
+        "types": "./tokenizers/dist/index.d.ts",
+        "default": "./tokenizers/dist/index.js"
+      },
+      "require": {
+        "types": "./tokenizers/dist/index.d.cts",
+        "default": "./tokenizers/dist/index.cjs"
+      },
+      "default": {
+        "types": "./tokenizers/dist/index.d.ts",
+        "default": "./tokenizers/dist/index.js"
+      }
+    },
     "./multi-model": {
       "workerd": {
         "types": "./multi-model/dist/index.workerd.d.ts",
@@ -79,6 +105,7 @@
     }
   },
   "files": [
+    "tokenizers",
     "multi-model",
     "dist",
     "CHANGELOG.md",

packages/env/src/als/index.node.ts

@@ -0,0 +1 @@
+export { AsyncLocalStorage } from "node:async_hooks";

packages/env/src/als/index.non-node.ts

@@ -0,0 +1,3 @@
+// Async Local Storage is available cross different JS runtimes
+// @ts-expect-error AsyncLocalStorage is not defined in Non Node.js environment
+export const AsyncLocalStorage = globalThis.AsyncLocalStorage;

packages/env/src/als/index.web.ts

@@ -0,0 +1,32 @@
+// Web doesn't have AsyncLocalStorage and there's no alternative way to implement it
+// Wait for https://github.com/tc39/proposal-async-context
+export class AsyncLocalStorage<T> {
+  #store: T = null!;
+
+  // eslint-disable-next-line @typescript-eslint/no-explicit-any
+  static bind<Func extends (...args: any[]) => any>(fn: Func): Func {
+    return fn;
+  }
+
+  // eslint-disable-next-line @typescript-eslint/no-explicit-any
+  static snapshot(): <R, TArgs extends any[]>(
+    fn: (...args: TArgs) => R,
+    ...args: TArgs
+  ) => R {
+    // eslint-disable-next-line @typescript-eslint/no-explicit-any
+    return (cb: any, ...args: any[]) => cb(...args);
+  }
+
+  getStore() {
+    return this.#store;
+  }
+
+  run<R>(store: T, cb: () => R): R {
+    this.#store = store;
+    if (cb.constructor.name === "AsyncFunction") {
+      console.warn("AsyncLocalStorage is not supported in the web environment");
+      console.warn("Please note that some features may not work as expected");
+    }
+    return cb();
+  }
+}

packages/env/src/index.browser.ts

@@ -5,11 +5,10 @@
  */
 import "./global-check.js";
 
+export * from "./als/index.web.js";
 export { consoleLogger, emptyLogger, type Logger } from "./logger/index.js";
-export { Tokenizers, tokenizers, type Tokenizer } from "./tokenizers/js.js";
 export { NotSupportCurrentRuntimeClass } from "./utils/shared.js";
 export * from "./web-polyfill.js";
-// @ts-expect-error no type
 if (typeof window === "undefined") {
   console.warn(
     "You are not in a browser environment. This module is not supposed to be used in a non-browser environment.",

packages/env/src/index.edge-light.ts

@@ -3,8 +3,8 @@
  *
  * @module
  */
-import "./global-check.js";
+
+export * from "./als/index.non-node.js";
 export { consoleLogger, emptyLogger, type Logger } from "./logger/index.js";
 export * from "./node-polyfill.js";
-export { Tokenizers, tokenizers, type Tokenizer } from "./tokenizers/js.js";
 export { NotSupportCurrentRuntimeClass } from "./utils/shared.js";

packages/env/src/index.ts

@@ -34,14 +34,9 @@ export function createSHA256(): SHA256 {
   };
 }
 
+export * from "./als/index.node.js";
 export { consoleLogger, emptyLogger, type Logger } from "./logger/index.js";
-export { Tokenizers, tokenizers, type Tokenizer } from "./tokenizers/node.js";
+export { CustomEvent, getEnv, setEnvs } from "./utils/index.js";
-export {
-  AsyncLocalStorage,
-  CustomEvent,
-  getEnv,
-  setEnvs,
-} from "./utils/index.js";
 export { NotSupportCurrentRuntimeClass } from "./utils/shared.js";
 export {
   EOL,

packages/env/src/index.workerd.ts

@@ -7,6 +7,7 @@
  */
 import { INTERNAL_ENV } from "./utils/index.js";
 
+export * from "./als/index.non-node.js";
 export { NotSupportCurrentRuntimeClass } from "./utils/shared.js";
 
 export * from "./node-polyfill.js";
@@ -16,4 +17,3 @@ export function getEnv(name: string): string | undefined {
 }
 
 export { consoleLogger, emptyLogger, type Logger } from "./logger/index.js";
-export { Tokenizers, tokenizers, type Tokenizer } from "./tokenizers/js.js";

packages/env/src/internal/tokenizers/js.ts

@@ -1,4 +1,4 @@
-// Note: js-tiktoken it's 60x slower than the WASM implementation - use it only for unsupported environments
+// Note: js-tiktoken it's 60x slower than gpt-tokenizer
 import { getEncoding } from "js-tiktoken";
 import type { Tokenizer } from "./types.js";
 import { Tokenizers } from "./types.js";

packages/env/src/internal/tokenizers/node.ts

@@ -1,4 +1,3 @@
-// Note: This is using th WASM implementation of tiktoken which is 60x faster
 import type { Tokenizer } from "./types.js";
 import { Tokenizers } from "./types.js";
 

packages/env/src/node-polyfill.ts

@@ -56,9 +56,4 @@ export const process: NodeJS.Process = globalThis.process ?? {
   versions: {},
 };
 
-export {
+export { CustomEvent, getEnv, setEnvs } from "./utils/index.js";
-  AsyncLocalStorage,
-  CustomEvent,
-  getEnv,
-  setEnvs,
-} from "./utils/index.js";

packages/env/src/tokenizers.browser.ts

@@ -0,0 +1,5 @@
+export {
+  Tokenizers,
+  tokenizers,
+  type Tokenizer,
+} from "./internal/tokenizers/js.js";

packages/env/src/tokenizers.edge-light.ts

@@ -0,0 +1,5 @@
+export {
+  Tokenizers,
+  tokenizers,
+  type Tokenizer,
+} from "./internal/tokenizers/js.js";

packages/env/src/tokenizers.ts

@@ -0,0 +1,5 @@
+export {
+  Tokenizers,
+  tokenizers,
+  type Tokenizer,
+} from "./internal/tokenizers/node.js";

packages/env/src/tokenizers.workerd.ts

@@ -0,0 +1,5 @@
+export {
+  Tokenizers,
+  tokenizers,
+  type Tokenizer,
+} from "./internal/tokenizers/js.js";

packages/env/src/utils/index.ts

@@ -56,9 +56,6 @@ interface CustomEventInit<T = any> extends EventInit {
   detail?: T;
 }
 
-// Async Local Storage is available cross different JS runtimes
-export { AsyncLocalStorage } from "node:async_hooks";
-
 // Node.js 18 doesn't have CustomEvent by default
 // Refs: https://github.com/nodejs/node/issues/40678
 // eslint-disable-next-line @typescript-eslint/no-explicit-any

packages/env/src/utils/index.web.ts

@@ -13,38 +13,6 @@ export function getEnv(name: string): string | undefined {
   }
 }
 
-// Web doesn't have AsyncLocalStorage and there's no alternative way to implement it
-// Wait for https://github.com/tc39/proposal-async-context
-export class AsyncLocalStorage<T> {
-  #store: T = null!;
-  // eslint-disable-next-line @typescript-eslint/no-explicit-any
-  static bind<Func extends (...args: any[]) => any>(fn: Func): Func {
-    return fn;
-  }
-
-  // eslint-disable-next-line @typescript-eslint/no-explicit-any
-  static snapshot(): <R, TArgs extends any[]>(
-    fn: (...args: TArgs) => R,
-    ...args: TArgs
-  ) => R {
-    // eslint-disable-next-line @typescript-eslint/no-explicit-any
-    return (cb: any, ...args: any[]) => cb(...args);
-  }
-
-  getStore() {
-    return this.#store;
-  }
-
-  run<R>(store: T, cb: () => R): R {
-    this.#store = store;
-    if (cb.constructor.name === "AsyncFunction") {
-      console.warn("AsyncLocalStorage is not supported in the web environment");
-      console.warn("Please note that some features may not work as expected");
-    }
-    return cb();
-  }
-}
-
 // eslint-disable-next-line @typescript-eslint/no-explicit-any
 const defaultCustomEvent = (globalThis as any).CustomEvent;
 

packages/env/src/utils/shared.ts

@@ -18,10 +18,8 @@ export class NotSupportCurrentRuntimeClass {
 export const glo: any =
   typeof globalThis !== "undefined"
     ? globalThis
-    : // @ts-expect-error globalThis is not defined
+    : typeof window !== "undefined"
-      typeof window !== "undefined"
+      ? window
-      ? // @ts-expect-error window is not defined
-        window
       : typeof global !== "undefined"
         ? global
         : {};

packages/env/src/web-polyfill.ts

@@ -49,10 +49,4 @@ export function randomUUID(): string {
   return crypto.randomUUID();
 }
 
-export {
+export { CustomEvent, getEnv, process, setEnvs } from "./utils/index.web.js";
-  AsyncLocalStorage,
-  CustomEvent,
-  getEnv,
-  process,
-  setEnvs,
-} from "./utils/index.web.js";

packages/env/tests/tokenizer.test.ts

@@ -1,11 +1,21 @@
 import { describe, expect, it } from "vitest";
-import { tokenizers } from "../src/tokenizers/node.js";
+import { tokenizers as fallbackTokenizers } from "../src/internal/tokenizers/js.js";
+import { tokenizers as nodeTokenizers } from "../src/internal/tokenizers/node.js";
 
-describe("tokenizer", () => {
+describe("node tokenizer", () => {
   it("should tokenize text", () => {
-    const tokenizer = tokenizers.tokenizer();
+    const tokenizer = nodeTokenizers.tokenizer();
     expect(tokenizer.decode(tokenizer.encode("hello world"))).toBe(
       "hello world",
     );
   });
+
+  it("should have same result as fallback tokenizer", () => {
+    const nodeTokenizer = nodeTokenizers.tokenizer();
+    const fallbackTokenizer = fallbackTokenizers.tokenizer();
+    const text = "hello world";
+    expect(nodeTokenizer.decode(nodeTokenizer.encode(text))).toBe(
+      fallbackTokenizer.decode(fallbackTokenizer.encode(text)),
+    );
+  });
 });

packages/experimental/CHANGELOG.md

@@ -1,5 +1,12 @@
 # @llamaindex/experimental
 
+## 0.0.120
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - llamaindex@0.8.8
+
 ## 0.0.119
 
 ### Patch Changes

packages/experimental/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/experimental",
   "description": "Experimental package for LlamaIndexTS",
-  "version": "0.0.119",
+  "version": "0.0.120",
   "type": "module",
   "types": "dist/type/index.d.ts",
   "main": "dist/cjs/index.js",

packages/llamaindex/CHANGELOG.md

@@ -1,5 +1,27 @@
 # llamaindex
 
+## 0.8.8
+
+### Patch Changes
+
+- ad85bd0: - fix agent chat message not saved into the task context when streaming
+  - fix async local storage might use `node:async_hook` in edge-light/workerd condition
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+  - @llamaindex/node-parser@0.0.6
+  - @llamaindex/cloud@2.0.5
+  - @llamaindex/anthropic@0.0.14
+  - @llamaindex/clip@0.0.14
+  - @llamaindex/deepinfra@0.0.14
+  - @llamaindex/huggingface@0.0.14
+  - @llamaindex/ollama@0.0.21
+  - @llamaindex/openai@0.1.30
+  - @llamaindex/portkey-ai@0.0.14
+  - @llamaindex/replicate@0.0.14
+  - @llamaindex/readers@1.0.6
+  - @llamaindex/groq@0.0.29
+
 ## 0.8.7
 
 ### Patch Changes

packages/llamaindex/package.json

@@ -1,6 +1,6 @@
 {
   "name": "llamaindex",
-  "version": "0.8.7",
+  "version": "0.8.8",
   "license": "MIT",
   "type": "module",
   "keywords": [

packages/llamaindex/src/tools/AzureDynamicSessionTool.node.ts

@@ -12,6 +12,7 @@ import {
   path,
   randomUUID,
 } from "@llamaindex/env";
+
 export type InterpreterParameter = {
   code: string;
 };
@@ -266,7 +267,9 @@ export class AzureDynamicSessionTool
         if (params.localFilename) {
           const writer = createWriteStream(path.resolve(params.localFilename));
           const blob = await response.blob();
-          Readable.from(blob.stream()).pipe(writer);
+          Readable.from(
+            blob.stream() as unknown as AsyncIterable<unknown>,
+          ).pipe(writer);
           return;
         }
 

packages/node-parser/CHANGELOG.md

@@ -1,5 +1,15 @@
 # @llamaindex/node-parser
 
+## 0.0.6
+
+### Patch Changes
+
+- ad85bd0: - fix agent chat message not saved into the task context when streaming
+  - fix async local storage might use `node:async_hook` in edge-light/workerd condition
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+
 ## 0.0.5
 
 ### Patch Changes

packages/node-parser/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@llamaindex/node-parser",
-  "version": "0.0.5",
+  "version": "0.0.6",
   "description": "Node parser for LlamaIndex",
   "type": "module",
   "exports": {

packages/node-parser/tsconfig.json

@@ -8,7 +8,6 @@
     "moduleResolution": "Bundler",
     "skipLibCheck": true,
     "strict": true,
-    "lib": ["ESNext", "DOM", "DOM.Iterable", "DOM.AsyncIterable"],
     "types": ["node"]
   },
   "include": ["./src"],

packages/providers/anthropic/CHANGELOG.md

@@ -1,5 +1,13 @@
 # @llamaindex/anthropic
 
+## 0.0.14
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+
 ## 0.0.13
 
 ### Patch Changes

packages/providers/anthropic/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/anthropic",
   "description": "Anthropic Adapter for LlamaIndex",
-  "version": "0.0.13",
+  "version": "0.0.14",
   "type": "module",
   "main": "./dist/index.cjs",
   "module": "./dist/index.js",

packages/providers/anthropic/tsconfig.json

@@ -5,8 +5,7 @@
     "module": "ESNext",
     "moduleResolution": "bundler",
     "outDir": "./lib",
-    "tsBuildInfoFile": "./lib/.tsbuildinfo",
+    "tsBuildInfoFile": "./lib/.tsbuildinfo"
-    "lib": ["DOM", "ES2022"]
   },
   "include": ["./src"],
   "references": [

packages/providers/clip/CHANGELOG.md

@@ -1,5 +1,14 @@
 # @llamaindex/clip
 
+## 0.0.14
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+  - @llamaindex/openai@0.1.30
+
 ## 0.0.13
 
 ### Patch Changes

packages/providers/clip/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/clip",
   "description": "Clip Embedding Adapter for LlamaIndex",
-  "version": "0.0.13",
+  "version": "0.0.14",
   "type": "module",
   "types": "dist/index.d.ts",
   "main": "dist/index.cjs",

packages/providers/clip/tsconfig.json

@@ -5,8 +5,7 @@
     "module": "ESNext",
     "moduleResolution": "bundler",
     "outDir": "./lib",
-    "tsBuildInfoFile": "./lib/.tsbuildinfo",
+    "tsBuildInfoFile": "./lib/.tsbuildinfo"
-    "lib": ["DOM", "ES2022"]
   },
   "include": ["./src"],
   "references": [

packages/providers/deepinfra/CHANGELOG.md

@@ -1,5 +1,14 @@
 # @llamaindex/deepinfra
 
+## 0.0.14
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+  - @llamaindex/openai@0.1.30
+
 ## 0.0.13
 
 ### Patch Changes

packages/providers/deepinfra/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/deepinfra",
   "description": "Deepinfra Adapter for LlamaIndex",
-  "version": "0.0.13",
+  "version": "0.0.14",
   "type": "module",
   "main": "./dist/index.cjs",
   "module": "./dist/index.js",

packages/providers/deepinfra/tsconfig.json

@@ -5,8 +5,7 @@
     "module": "ESNext",
     "moduleResolution": "bundler",
     "outDir": "./lib",
-    "tsBuildInfoFile": "./lib/.tsbuildinfo",
+    "tsBuildInfoFile": "./lib/.tsbuildinfo"
-    "lib": ["DOM", "ES2022"]
   },
   "include": ["./src"],
   "references": [

packages/providers/groq/CHANGELOG.md

@@ -1,5 +1,13 @@
 # @llamaindex/groq
 
+## 0.0.29
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/env@0.1.19
+  - @llamaindex/openai@0.1.30
+
 ## 0.0.28
 
 ### Patch Changes

packages/providers/groq/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/groq",
   "description": "Groq Adapter for LlamaIndex",
-  "version": "0.0.28",
+  "version": "0.0.29",
   "type": "module",
   "main": "./dist/index.cjs",
   "module": "./dist/index.js",

packages/providers/huggingface/CHANGELOG.md

@@ -1,5 +1,14 @@
 # @llamaindex/huggingface
 
+## 0.0.14
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+  - @llamaindex/openai@0.1.30
+
 ## 0.0.13
 
 ### Patch Changes

packages/providers/huggingface/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/huggingface",
   "description": "Huggingface Adapter for LlamaIndex",
-  "version": "0.0.13",
+  "version": "0.0.14",
   "type": "module",
   "types": "dist/index.d.ts",
   "main": "dist/index.cjs",

packages/providers/huggingface/tsconfig.json

@@ -5,8 +5,7 @@
     "module": "ESNext",
     "moduleResolution": "bundler",
     "outDir": "./lib",
-    "tsBuildInfoFile": "./lib/.tsbuildinfo",
+    "tsBuildInfoFile": "./lib/.tsbuildinfo"
-    "lib": ["DOM", "ES2022"]
   },
   "include": ["./src"],
   "references": [

packages/providers/ollama/CHANGELOG.md

@@ -1,5 +1,13 @@
 # @llamaindex/ollama
 
+## 0.0.21
+
+### Patch Changes
+
+- Updated dependencies [ad85bd0]
+  - @llamaindex/core@0.4.5
+  - @llamaindex/env@0.1.19
+
 ## 0.0.20
 
 ### Patch Changes

packages/providers/ollama/package.json

@@ -1,7 +1,7 @@
 {
   "name": "@llamaindex/ollama",
   "description": "Ollama Adapter for LlamaIndex",
-  "version": "0.0.20",
+  "version": "0.0.21",
   "type": "module",
   "main": "./dist/index.cjs",
   "module": "./dist/index.js",