Last updated
Last updated
You can retrieve the
In this recipe, we will build a simple version of ChatGPT using the framework and their ChatOpenAI model.
To keep it simple, we won't add memory to this Chat Model. However, you will be able to find a full example with a basic memory in our .
Here's the final result:
First, we'll init the AgentLabs SDK, our agent and to open the connection with the server.
Don't forget your OPENAI_API_KEY
environment variable if you want everything to work.
Now we have imported our dependencies, let's init our model by adding the following line.
What we want is to process every incoming stream and forward it to the client.
This handler is pretty straightforward:
On LLM start, we create a stream for our agent
When we receive a token, we stream it using our agent
On LLM end, we close the stream for our agent
To do so, we'll use the on_chat_message
method provided by AgentLabs.
This method takes a handler function as an argument. Let's define it.
In this function, we handle the incoming message from the user and them we pass it to the LLM.
We also pass it a first message to give it some context so it knows how to handle the user's input.
As a second argument, you can see we give it an instance of our callback class that we previously created.
Now, every time a user sends a message, the LLM will receive it, and we'll stream the LLM responses back to the user.
Looking at the , you will see we created a parse_env_or_raise()
method. But you can handle the configuration variable the way you want.
Then, we'll init and the ChatOpenAI model. Let's import every dependency we need:
Setting streaming to True allows us to get fragments of the response as they arrive and not wait for the entire response to be available. You can find more info about streaming in the .
Now, we'll create a class that extends the BaseCallbackHandler
of to handle the stream fragments as they arrive.
We're mostly done! We initiated AgentLabs and configured , now we need to handle the incoming messages.
Congrats, you created your own version of ChatGPT! You can retrieve the