Managing Multiple Chat Sessions with OpenAI

Welcome to the next step in your journey of creating a chatbot with OpenAI! In the previous lessons, you learned how to send messages to OpenAI's language model, explored model parameters, maintained conversation history, and personalized AI behavior with system prompts. Now, we will focus on managing multiple chat sessions. This is crucial for applications where you need to handle several conversations simultaneously, such as customer service chatbots. By the end of this lesson, you will be able to create and manage multiple chat sessions using OpenAI's API, setting the stage for more complex interactions.

In a chatbot application, each conversation should be treated as a separate session. To achieve this, we use unique identifiers for each chat session. This ensures that messages and responses are correctly associated with their respective sessions. In our code example, we use the github.com/google/uuid package to generate a unique identifier for each chat session. When a new chat session is created, a unique chatID is generated, and an empty conversation history is initialized.

// Store all active chat sessions
var chatSessions = make(map[string][]openai.ChatCompletionMessageParamUnion)

// Define a common system prompt for all conversations
var systemPrompt = openai.SystemMessage("You are a friendly and efficient customer service attendant eager to assist customers with their inquiries and concerns.")

// Create a new chat session with a unique identifier
func createChat() string {
    chatID := uuid.New().String() // Create unique session identifier
    chatSessions[chatID] = []openai.ChatCompletionMessageParamUnion{systemPrompt} // Initialize conversation history with system prompt
    return chatID
}

In our example, we store conversation history in a map called chatSessions, where each key is a unique chatID. When a user sends a message, it is added to the conversation history, ensuring that the AI has access to the full context when generating a response. This approach helps create a seamless and coherent interaction between the user and the AI.

Once a chat session is established, you can send messages and receive responses from the OpenAI model. It's important to maintain the context by sending the full conversation history to the model. In our code example, we use the sendMessage function to handle this process. The function takes a chatID and a userMessage as inputs, adds the message to the conversation history, and requests a response from the AI. The response is then processed and added to the conversation history, ensuring continuity in the interaction.

// Initialize the OpenAI client
var client = openai.NewClient(
    option.WithAPIKey(os.Getenv("OPENAI_API_KEY")),
    option.WithBaseURL(os.Getenv("OPENAI_BASE_URL")),
)

func sendMessage(chatID, userMessage string) (string, error) {
    // Verify chat session exists
    if _, exists := chatSessions[chatID]; !exists {
        return "", fmt.Errorf("chat session not found")
    }
    // Add user's message to history
    chatSessions[chatID] = append(chatSessions[chatID], openai.UserMessage(userMessage))
    // Get AI response using conversation history
    req := openai.ChatCompletionNewParams{
        Messages: chatSessions[chatID],
        Model:    openai.ChatModel("gpt-6-luna"),
    }
    response, err := client.Chat.Completions.New(context.TODO(), req)
    if err != nil {
        return "", err
    }
    if len(response.Choices) == 0 {
        return "", fmt.Errorf("no response choices were returned by the OpenAI API")
    }
    // Extract and clean AI's response
    answer := response.Choices[0].Message.Content
    // Add AI's response to history
    chatSessions[chatID] = append(chatSessions[chatID], openai.AssistantMessage(answer))
    // Return AI's response
    return answer, nil
}

Managing multiple chat sessions simultaneously is a crucial feature for advanced chatbot applications. By using unique identifiers, you can create and interact with different chat sessions independently, ensuring that each conversation remains distinct and contextually accurate. Below, we demonstrate this by initiating a first session and sending messages to it.

func main() {
    // Create the first chat and send messages
    chatID1 := createChat()
    response1, err := sendMessage(chatID1, "I'm having trouble with my recent order. Can you help me track it?")
    if err != nil {
        log.Fatal(err)
    }
    fmt.Println("Chat 1, First Message:", response1)

    response2, err := sendMessage(chatID1, "It was supposed to arrive yesterday but hasn't. What should I do next?")
    if err != nil {
        log.Fatal(err)
    }
    fmt.Println("Chat 1, Follow-up Message:", response2)

    // Create the second chat and send messages
    chatID2 := createChat()
    response3, err := sendMessage(chatID2, "I'm interested in upgrading my membership. What are the benefits?")
    if err != nil {
        log.Fatal(err)
    }
    fmt.Println("Chat 2, First Message:", response3)

    response4, err := sendMessage(chatID2, "Could you guide me through the upgrade process?")
    if err != nil {
        log.Fatal(err)
    }
    fmt.Println("Chat 2, Follow-up Message:", response4)
}

This approach not only maintains the integrity of each conversation but also enhances scalability, making it ideal for applications like customer support where multiple interactions occur simultaneously. By keeping conversations separate, you can provide a more efficient and effective service to each user.

In this lesson, you learned how to manage multiple chat sessions using OpenAI's API. We covered creating unique chat sessions, maintaining conversation history, and handling multiple interactions simultaneously. These skills are essential for building scalable chatbot applications that can handle numerous conversations at once. As you move on to the practice exercises, I encourage you to apply what you've learned by creating and managing chat sessions independently. This hands-on practice will reinforce your understanding and prepare you for more advanced chatbot development. Keep up the great work, and enjoy the journey of creating your chatbot with OpenAI!