CF-Incidents Agents, Workers - @cloudflare/codemode v0.1.0: a new runtime agnostic modular architecture

[ENF News Bot]

The @cloudflare/codemode ↗︎ package has been rewritten into a modular, runtime-agnostic SDK.

Code Mode ↗︎ enables LLMs to write and execute code that orchestrates your tools, instead of calling them one at a time. This can (and does) yield significant token savings, reduces context window pressure and improves overall model performance on a task.

The new Executor interface is runtime agnostic and comes with a prebuilt DynamicWorkerExecutor to run generated code in a Dynamic Worker Loader.

Breaking changes​

https://developers.cloudflare.com/changelog/rss/#breaking-changes

• Removed experimental_codemode() and CodeModeProxy — the package no longer owns an LLM call or model choice
• New import path: createCodeTool() is now exported from @cloudflare/codemode/ai

New features​

https://developers.cloudflare.com/changelog/rss/#new-features

• createCodeTool() — Returns a standard AI SDK Tool to use in your AI agents.
• Executor interface — Minimal execute(code, fns) contract. Implement for any code sandboxing primitive or runtime.

DynamicWorkerExecutor​

https://developers.cloudflare.com/changelog/rss/#dynamicworkerexecutor

Runs code in a Dynamic Worker. It comes with the following features:

• Network isolation — fetch() and connect() blocked by default (globalOutbound: null) when using DynamicWorkerExecutor
• Console capture — console.log/warn/error captured and returned in ExecuteResult.logs
• Execution timeout — Configurable via timeout option (default 30s)

Usage​

https://developers.cloudflare.com/changelog/rss/#usage

import { createCodeTool } from "@cloudflare/codemode/ai";
import { DynamicWorkerExecutor } from "@cloudflare/codemode";
import { streamText } from "ai";

const executor = new DynamicWorkerExecutor({ loader: env.LOADER });
const codemode = createCodeTool({ tools: myTools, executor });

const result = streamText({
	model,
	tools: { codemode },
	messages,
});

import { createCodeTool } from "@cloudflare/codemode/ai";
import { DynamicWorkerExecutor } from "@cloudflare/codemode";
import { streamText } from "ai";

const executor = new DynamicWorkerExecutor({ loader: env.LOADER });
const codemode = createCodeTool({ tools: myTools, executor });

const result = streamText({
	model,
	tools: { codemode },
	messages,
});

Wrangler configuration​

https://developers.cloudflare.com/changelog/rss/#wrangler-configuration

{
	"worker_loaders": [{ "binding": "LOADER" }],
}

[[worker_loaders]]
binding = "LOADER"

See the Code Mode documentation for full API reference and examples.

Upgrade​

https://developers.cloudflare.com/changelog/rss/#upgrade

npm i @cloudflare/codemode@latest

Continue reading...