How to get binding for AI Gateway to use with ai-gateway-provider SDK?

[raress96]

Describe the bug
Seems like there is no way to get a binding directly to the AI Gateway so I can use other models outside of Cloudflare with the ai-gateway-provider when using AI SDK v5.

workers-ai-provider works:

const workersAI = createWorkersAI({
    binding: hubAI(),
    gateway: {
      id: process.env.CLOUDFLARE_AI_GATEWAY_ID!,
    },
  });

However ai-gateway-provider I see no way to get just the gateway binding:

const aiGateway = createAiGateway({
    binding: hubAI().gateway(process.env.CLOUDFLARE_AI_GATEWAY_ID!), // TODO: How to get this binding?
    options: {
      skipCache: true, // Optional request-level settings
    },
  });
  const anthropic = createAnthropic({ apiKey: process.env.ANTHROPIC_API_KEY! });
  const model = aiGateway([
    anthropic('claude-3-7-sonnet-latest'),
  ]);

[RihanArfan]

Your usage is correct, however, this will only work when deployed. We've excluded gateway from the types since it isn't currently implemented within the remote proxy. As hubAI() returns process.env.AI, gateway is still available through the binding (hubAI().gateway('gateway-id')), just untyped.

core/src/runtime/ai/server/utils/ai.ts

Line 25 in 714c67e

export function hubAI(): Omit<Ai, 'autorag' | 'gateway'> {

[raress96]

Your usage is correct, however, this will only work when deployed. We've excluded gateway from the types since it isn't currently implemented within the remote proxy. As hubAI() returns process.env.AI, gateway is still available through the binding (hubAI().gateway('gateway-id')), just untyped.

core/src/runtime/ai/server/utils/ai.ts

Line 25 in 714c67e

export function hubAI(): Omit<Ai, 'autorag' | 'gateway'> {

Would it be possible for it to work locally with remote binding?

I am running nuxt dev --remote=production on my app to test things locally, and if that doesn't work I guess I need to check if it is running on local and then use the model directly without going through the gateway, which is not ideal.