From 59ab0f2bb2cb71d6a67e759549bb9367daee627a Mon Sep 17 00:00:00 2001 From: gagb Date: Fri, 26 Apr 2024 14:47:18 -0700 Subject: [PATCH] Update try_orc readme --- samples/apps/try_orc/OAI_CONFIG_LIST_sample | 21 +++++++++++++++++++++ samples/apps/try_orc/README.md | 9 +++++++++ 2 files changed, 30 insertions(+) create mode 100644 samples/apps/try_orc/OAI_CONFIG_LIST_sample diff --git a/samples/apps/try_orc/OAI_CONFIG_LIST_sample b/samples/apps/try_orc/OAI_CONFIG_LIST_sample new file mode 100644 index 000000000..e21b8637f --- /dev/null +++ b/samples/apps/try_orc/OAI_CONFIG_LIST_sample @@ -0,0 +1,21 @@ +[ + { + "model": "gpt-4", + "api_key": "", + "tags": ["gpt-4", "tool"] + }, + { + "model": "", + "api_key": "", + "base_url": "", + "api_type": "azure", + "api_version": "2024-02-15-preview" + }, + { + "model": "", + "api_key": "", + "base_url": "", + "api_type": "azure", + "api_version": "2024-02-15-preview" + } +] diff --git a/samples/apps/try_orc/README.md b/samples/apps/try_orc/README.md index c951da19f..8dae57293 100644 --- a/samples/apps/try_orc/README.md +++ b/samples/apps/try_orc/README.md @@ -25,6 +25,15 @@ The application should be run in a virtual environment to ensure that its depend ### Running the Application +First you need to set up your LLM keys and configuration. You can do this by +creating a file called `OAI_CONFIG_LIST` or export an environment variable +with the same name and content. Its basically a JSON string that defines +various properties like model names, api keys, base urls, etc. + +Please see the contents of `OAI_CONFIG_LIST_sample` in this directory for an example. +Modify it with your keys and configuration and rename it to `OAI_CONFIG_LIST`. + + Once you've installed the required packages, you can run the application with the following command: ```bash