---
title: Stream OpenAI API Responses
description: Use the OpenAI v4 SDK to stream responses from OpenAI.
image: https://developers.cloudflare.com/dev-products-preview.png
---

> Documentation Index  
> Fetch the complete documentation index at: https://developers.cloudflare.com/workers/llms.txt  
> Use this file to discover all available pages before exploring further.

[Skip to content](#%5Ftop) 

### Tags

[ AI ](https://developers.cloudflare.com/search/?tags=AI)[ JavaScript ](https://developers.cloudflare.com/search/?tags=JavaScript)[ TypeScript ](https://developers.cloudflare.com/search/?tags=TypeScript) 

# Stream OpenAI API Responses

**Last reviewed:**  over 2 years ago 

Use the OpenAI v4 SDK to stream responses from OpenAI.

If you want to get started quickly, click on the button below.

[![Deploy to Cloudflare](https://deploy.workers.cloudflare.com/button)](https://deploy.workers.cloudflare.com/?url=https://github.com/cloudflare/docs-examples/tree/main/workers/openai-sdk-streaming)

This creates a repository in your GitHub account and deploys the application to Cloudflare Workers.

In order to run this code, you must install the OpenAI SDK by running `npm i openai`.

Note

For analytics, caching, rate limiting, and more, you can also send requests like this through Cloudflare's [AI Gateway](https://developers.cloudflare.com/ai-gateway/usage/providers/openai/).

* [  TypeScript ](#tab-panel-9332)
* [  Hono ](#tab-panel-9333)

TypeScript

```

import OpenAI from "openai";


export default {

  async fetch(request, env, ctx): Promise<Response> {

    const openai = new OpenAI({

      apiKey: env.OPENAI_API_KEY,

    });


    // Create a TransformStream to handle streaming data

    let { readable, writable } = new TransformStream();

    let writer = writable.getWriter();

    const textEncoder = new TextEncoder();


    ctx.waitUntil(

      (async () => {

        const stream = await openai.chat.completions.create({

          model: "gpt-4o-mini",

          messages: [{ role: "user", content: "Tell me a story" }],

          stream: true,

        });


        // loop over the data as it is streamed and write to the writeable

        for await (const part of stream) {

          writer.write(

            textEncoder.encode(part.choices[0]?.delta?.content || ""),

          );

        }

        writer.close();

      })(),

    );


    // Send the readable back to the browser

    return new Response(readable);

  },

} satisfies ExportedHandler<Env>;


```

TypeScript

```

import { Hono } from "hono";

import { streamText } from "hono/streaming";

import OpenAI from "openai";


interface Env {

  OPENAI_API_KEY: string;

}


const app = new Hono<{ Bindings: Env }>();


app.get("*", async (c) => {

  const openai = new OpenAI({

    apiKey: c.env.OPENAI_API_KEY,

  });


  const chatStream = await openai.chat.completions.create({

    model: "gpt-4o-mini",

    messages: [{ role: "user", content: "Tell me a story" }],

    stream: true,

  });


  return streamText(c, async (stream) => {

    for await (const message of chatStream) {

      await stream.write(message.choices[0].delta.content || "");

    }

    stream.close();

  });

});


export default app;


```

```json
{"@context":"https://schema.org","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"item":{"@id":"/directory/","name":"Directory"}},{"@type":"ListItem","position":2,"item":{"@id":"/workers/","name":"Workers"}},{"@type":"ListItem","position":3,"item":{"@id":"/workers/examples/","name":"Examples"}},{"@type":"ListItem","position":4,"item":{"@id":"/workers/examples/openai-sdk-streaming/","name":"Stream OpenAI API Responses"}}]}
```