How to Maintain and Send Chat History with Orq.ai Deployments

pip install orq-ai-sdk

npm install @orq-ai/node --save

import os

from orq_ai_sdk import Orq

client = Orq(
  api_key=os.environ.get("ORQ_API_KEY", "__API_KEY__"),
  environment="production"
)

conv_memory = []

# Call orq.ai Deployment with conversation history
def chat_with_deployment(message, conv_memory):
    conv_memory.append({"role": "user", "content": message})
    
    generation = client.deployments.invoke(
            key="cookbook-history",
            context={
                "environments": []
                },
            metadata={
                "custom-field-name": "custom-metadata-value"
                },
        messages=conv_memory
    )
    
    response = generation.choices[0].message.content
    conv_memory.append({"role": "assistant", "content": response})
    
    return response

# Handle terminal input
print("\nYou can now start chatting! Type 'exit' or 'quit' to end the chat.\n")
while True:
    user_input = input("You: ")
    if user_input.lower() in ["exit", "quit"]:
        print("Ending chat.")
        break
    response = chat_with_deployment(user_input, conv_memory)
    print(f"Assistant: {response}")

import { Orq } from '@orq-ai/node';
import readline from 'readline';

const client = new Orq({
  apiKey: process.env.ORQ_API_KEY || "__API_KEY__",
  environment: "production"
});

let convMemory = [];

// Calling orq.ai with conversation history
async function chatWithDeployment(message, convMemory) {
  convMemory.push({ role: "user", content: message });
  
  const generation = await client.deployments.invoke({
    key: "cookbook-history",
    context: {
      environments: []
    },
    metadata: {
      "custom-field-name": "custom-metadata-value"
    },
    messages: convMemory
  });
  
  const response = generation.choices[0].message.content;
  convMemory.push({ role: "assistant", content: response });
  
  return response;
}

const rl = readline.createInterface({
  input: process.stdin,
  output: process.stdout
});

console.log("\nYou can now start chatting! Type 'exit' or 'quit' to end the chat.\n");

// Handle Terminal Input
function promptUser() {
  rl.question("You: ", async (userInput) => {
    if (userInput.toLowerCase() === "exit" || userInput.toLowerCase() === "quit") {
      console.log("Ending chat.");
      rl.close();
      return;
    }
    
    try {
      const response = await chatWithDeployment(userInput, convMemory);
      console.log(`Assistant: ${response}`);
    } catch (error) {
      console.error("Error:", error.message);
    }
    
    promptUser();
  });
}

promptUser();

❯ python3 history.py

You can now start chatting! Type 'exit' or 'quit' to end the chat.

You: What is the distance between Paris and Lyon ?

Assistant: The distance between Paris and Lyon is approximately:

    - **By road**: 465 kilometers (289 miles)
    - **Straight-line distance**: 390 kilometers (242 miles)

    The driving time is typically around 4.5-5 hours depending on traffic and route taken. There's also a high-speed TGV train connection that takes about 2 hours between the two cities.

You: How long would it take while flying ?
    
Assistant: A direct flight between Paris and Lyon would take approximately **1 hour and 15 minutes** of actual flight time.

    However, it's worth noting that:

    - **Direct flights between Paris and Lyon are quite rare** since the TGV train is so efficient and convenient
    - When you factor in airport procedures (arriving early, check-in, security, boarding, baggage claim), the **total travel time would be around 3-4 hours**
    - Most travelers choose the **TGV train instead**, which takes only 2 hours city center to city center and is more convenient

    So while the flight itself is short, the TGV high-speed train is typically the preferred option for travel between these two French cities due to its speed and convenience.