Node.js client for the unofficial ChatGPT API.
Go to file
Travis Fischer df70e0c840 fix: turbo CI 2024-08-08 00:32:37 -05:00
.changeset feat: bump version to 7.0.0 for new major release 2024-08-04 06:50:05 -05:00
.github fix: turbo CI 2024-08-08 00:32:37 -05:00
.husky 2024-06-07 02:14:33 -05:00
examples feat: relax chatFn types 2024-08-07 05:53:39 -05:00
media 2024-06-04 06:30:36 -05:00
packages 🦌 2024-08-07 23:43:04 -05:00
.editorconfig init 2024-05-16 18:22:07 -07:00
.env.example 🏡 2024-06-01 19:34:25 -05:00
.eslintignore feat: add WikidataClient 2024-08-01 03:49:50 -05:00
.eslintrc.json feat: add hunter.io client 2024-06-30 00:31:07 -07:00
.gitignore feat: add EchoAITool and turbo build pipeline 2024-08-03 22:54:04 -05:00
.npmrc init 2024-05-16 18:22:07 -07:00
.prettierignore feat: add WikidataClient 2024-08-01 03:49:50 -05:00
.prettierrc init 2024-05-16 18:22:07 -07:00
license 2024-06-04 06:30:36 -05:00
package.json fix: turbo CI 2024-08-08 00:32:37 -05:00
pnpm-lock.yaml 🖌 2024-08-07 23:44:46 -05:00
pnpm-workspace.yaml feat: WIP closer to completing monorepo transition 2024-08-04 01:32:30 -05:00
readme.md 🤠 2024-08-04 08:51:37 -05:00
tsup.config.ts feat: WIP refactor to monorepo and separate packages 2024-08-03 21:36:44 -05:00
turbo.json fix: turbo CI 2024-08-08 00:32:37 -05:00
vite.config.ts 🏡 2024-06-01 19:34:25 -05:00

readme.md

Agentic

AI agent stdlib that works with any LLM and TypeScript AI SDK.

Build Status NPM MIT License Prettier Code Formatting

Agentic

Intro

Agentic is a standard library of AI functions / tools which are optimized for both normal TS-usage as well as LLM-based usage. Agentic works with all of the major TS AI SDKs (LangChain, LlamaIndex, Vercel AI SDK, OpenAI SDK, etc).

Agentic clients like WeatherClient can be used as normal TS classes:

import { WeatherClient } from '@agentic/stdlib'

// Requires `process.env.WEATHER_API_KEY` (from weatherapi.com)
const weather = new WeatherClient()

const result = await weather.getCurrentWeather({
  q: 'San Francisco'
})
console.log(result)

Or you can use these clients as LLM-based tools where the LLM decides when and how to invoke the underlying functions for you.

This works across all of the major AI SDKs via adapters. Here's an example using Vercel's AI SDK:

// sdk-specific imports
import { openai } from '@ai-sdk/openai'
import { generateText } from 'ai'
import { createAISDKTools } from '@agentic/ai-sdk'

// sdk-agnostic imports
import { WeatherClient } from '@agentic/stdlib'

const weather = new WeatherClient()

const result = await generateText({
  model: openai('gpt-4o-mini'),
  // this is the key line which uses the `@agentic/ai-sdk` adapter
  tools: createAISDKTools(weather),
  toolChoice: 'required',
  prompt: 'What is the weather in San Francisco?'
})

console.log(result.toolResults[0])

You can use our standard library of thoroughly tested AI functions with your favorite AI SDK – without having to write any glue code!

Here's a slightly more complex example which uses multiple clients and selects a subset of their functions using the AIFunctionSet.pick method:

// sdk-specific imports
import { ChatModel, createAIRunner } from '@dexaai/dexter'
import { createDexterFunctions } from '@agentic/dexter'

// sdk-agnostic imports
import { PerigonClient, SerperClient } from '@agentic/stdlib'

async function main() {
  // Perigon is a news API and Serper is a Google search API
  const perigon = new PerigonClient()
  const serper = new SerperClient()

  const runner = createAIRunner({
    chatModel: new ChatModel({
      params: { model: 'gpt-4o-mini', temperature: 0 }
    }),
    functions: createDexterFunctions(
      perigon.functions.pick('search_news_stories'),
      serper
    ),
    systemMessage: 'You are a helpful assistant. Be as concise as possible.'
  })

  const result = await runner(
    'Summarize the latest news stories about the upcoming US election.'
  )
  console.log(result)
}

Here we've exposed 2 functions to the LLM, search_news_stories (which comes from the PerigonClient.searchStories method) and serper_google_search (which implicitly comes from the SerperClient.search method).

All of the SDK adapters like createDexterFunctions accept very flexible AIFunctionLike objects, which include:

  • AIFunctionSet - Sets of AI functions (like perigon.functions.pick('search_news_stories') or perigon.functions or serper.functions)
  • AIFunctionsProvider - Client classes which expose an AIFunctionSet via the .functions property (like perigon or serper)
  • AIFunction - Individual functions (like perigon.functions.get('search_news_stories') or serper.functions.get('serper_google_search') or AI functions created directly via the createAIFunction utility function)

You can pass as many of these AIFunctionLike objects as you'd like and you can manipulate them as AIFunctionSet sets via .pick, .omit, .get, .map, etc.

Install

npm install @agentic/stdlib @agentic/core zod
  • @agentic/core - exports core AI utils and @aiFunction decorator
  • @agentic/stdlib - exports all of the built-in AI tools (convenience wrapper around the individual tool packages; see Optimized Imports if you'd rather import the individual packages directly)
  • zod - used for schema validation

[!NOTE] This package is ESM only and requires Node.js >= 18 or an equivalent environment (bun, deno, CF workers, etc).

Optimized Imports

@agentic/stdlib is just a convenience package which re-exports all of the built-in AI tool packages. If you want to optimize your imports, you can replace @agentic/stdlib with the specific AI tools you want. For example:

npm install @agentic/weather @agentic/core zod
import { WeatherClient } from '@agentic/weather'

[!NOTE] There is no functional difference between using @agentic/stdlib versus using the individual packages directly. The only difference is if you want to optimize your install size (when running on serverless functions, for instance), in which case installing and using the individual packages directly will be more efficient. The default examples use @agentic/stdlib because it provides a simpler DX.

AI SDKs

To use Agentic with one of the supported AI SDKs, you'll also need to install its (really lightweight) adapter package.

Vercel AI SDk

Install
npm install @agentic/ai-sdk ai
import { createAISDKTools } from '@agentic/ai-sdk'

See examples/ai-sdk for a full example.

LangChain

Install
npm install @agentic/langchain @langchain/core langchain
import { createLangChainTools } from '@agentic/langchain'

See examples/langchain for a full example.

LlamaIndex

Install
npm install @agentic/llamaindex llamaindex
import { createLlamaIndexTools } from '@agentic/llamaindex'

See examples/llamaindex for a full example.

Firebase Genkit

Install
npm install @agentic/genkit @genkit-ai/ai @genkit-ai/core
import { createGenkitTools } from '@agentic/genkit'

See examples/genkit for a full example.

Dexa Dexter

Install
npm install @agentic/dexter @dexaai/dexter
import { createDexterFunctions } from '@agentic/dexter'

See examples/dexter for a full example.

OpenAI SDK

Install
npm install openai

There's no need for an adapter with the OpenAI SDK since all agentic tools are compatible with OpenAI by default. You can use AIFunctionSet.specs for function calling or AIFunctionSet.toolSpecs for parallel tool calling.

import { WeatherClient } from '@agentic/stdlib'
import OpenAI from 'openai'

const weather = new WeatherClient()
const openai = new OpenAI()

const messages: OpenAI.ChatCompletionMessageParam[] = [
  {
    role: 'system',
    content: 'You are a helpful assistant. Be as concise as possible.'
  },
  { role: 'user', content: 'What is the weather in San Francisco?' }
]

const res = await openai.chat.completions.create({
  messages,
  model: 'gpt-4o-mini',
  temperature: 0,
  tools: weather.functions.toolSpecs,
  tool_choice: 'required'
})
const message = res.choices[0]?.message!
console.log(JSON.stringify(message, null, 2))
assert(message.tool_calls?.[0]?.function?.name === 'get_current_weather')

const fn = weather.functions.get('get_current_weather')!

const toolParams = message.tool_calls[0].function.arguments
const toolResult = await fn(toolParams)
console.log(JSON.stringify(toolResult, null, 2))

See examples/openai for a full example.

Services

Service Package Named export Description
Bing @agentic/bing BingClient Bing web search.
Calculator @agentic/calculator calculator Basic calculator for simple mathematical expressions.
Clearbit @agentic/clearbit ClearbitClient Resolving and enriching people and company datae.
Dexa @agentic/dexa DexaClient Answers questions from the world's best podcasters.
Diffbot @agentic/diffbot DiffbotClient Web page classification and scraping; person and company data enrichment.
E2B @agentic/e2b e2b Hosted Python code intrepreter sandbox which is really useful for data analysis, flexible code execution, and advanced reasoning on-the-fly. (peer dep @e2b/code-interpreter)
Exa @agentic/exa ExaClient Web search tailored for LLMs.
Firecrawl @agentic/firecrawl FirecrawlClient Website scraping and sanitization.
HackerNews @agentic/hacker-news HackerNewsClient Official HackerNews API.
Hunter @agentic/hunter HunterClient Email finder, verifier, and enrichment.
Jina @agentic/jina JinaClient Clean URL reader and web search + URL top result reading with a generous free tier.
Midjourney @agentic/midjourney MidjourneyClient Unofficial Midjourney client for generative images.
Novu @agentic/novu NovuClient Sending notifications (email, SMS, in-app, push, etc).
People Data Labs @agentic/people-data-labs PeopleDataLabsClient People & company data (WIP).
Perigon @agentic/perigon PerigonClient Real-time news API and web content data from 140,000+ sources. Structured and enriched by AI, primed for LLMs.
Polygon @agentic/polygon PolygonClient Stock market and company financial data.
PredictLeads @agentic/predict-leads PredictLeadsClient In-depth company data including signals like fundraising events, hiring news, product launches, technologies used, etc.
Proxycurl @agentic/proxycurl ProxycurlClient People and company data from LinkedIn & Crunchbase.
Searxng @agentic/searxng SearxngClient OSS meta search engine capable of searching across many providers like Reddit, Google, Brave, Arxiv, Genius, IMDB, Rotten Tomatoes, Wikidata, Wolfram Alpha, YouTube, GitHub, etc.
SerpAPI @agentic/serpapi SerpAPIClient Lightweight wrapper around SerpAPI for Google search.
Serper @agentic/serper SerperClient Lightweight wrapper around Serper for Google search.
Slack @agentic/slack SlackClient Send and receive Slack messages.
SocialData @agentic/social-data SocialDataClient Unofficial Twitter / X client (readonly) which is much cheaper than the official Twitter API.
Tavily @agentic/tavily TavilyClient Web search API tailored for LLMs.
Twilio @agentic/twilio TwilioClient Twilio conversation API to send and receive SMS messages.
Twitter @agentic/twitter TwitterClient Basic Twitter API methods for fetching users, tweets, and searching recent tweets. Includes support for plan-aware rate-limiting. Uses Nango for OAuth support.
Weather @agentic/weather WeatherClient Basic access to current weather data based on location.
Wikidata @agentic/wikidata WikidataClient Basic Wikidata client.
Wikipedia @agentic/wikipedia WikipediaClient Wikipedia page search and summaries.
Wolfram Alpha @agentic/wolfram-alpha WolframAlphaClient Wolfram Alpha LLM API client for answering computational, mathematical, and scientific questions.

Note that you can import any of these AI tools from @agentic/stdlib OR from their individual packages. Installing and importing from their individual packages is more efficient, but it's less convenient so it isn't the default.

Client Design Philosophy

  • clients should be as minimal as possible
  • clients should use ky and zod where possible
  • clients should have a strongly-typed TS DX
  • clients should expose select methods via the @aiFunction(...) decorator
    • inputSchema zod schemas should be as minimal as possible with descriptions prompt engineered specifically for use with LLMs
  • clients and AIFunctions should be composable via AIFunctionSet
  • clients should work with all major TS AI SDKs

TODO

Contributors

License

MIT © Travis Fischer

To stay up to date or learn more, follow @transitive_bs on Twitter.