Changes between Version 6 and Version 7 of Public/DjAiAdmin

Timestamp:

Jul 9, 2023, 12:03:00 PM (2 years ago)

Author:

Boris Horner

Comment:

—

Public/DjAiAdmin

@@ -89 +89 @@
 
 
-=== Configuring available AI models
+=== Configuration of available AI models
+//dj//**AI** is not, and does not contain, a Large Language Model (LLM) by itself. Instead, it's a flexible interface to standardize and simplify AI briefing and use. The actual AI functionality is provided by external services.
+
+Currently, //dj//**AI** supports these models:
+* openAI: GPT3.5 turbo. We are still on the waitlist for GPT4 and will integrate it as soon as we can access it.
+* AlephAlpha: base, extended and supreme levels.
+
+Model support is done by simple plugins that must implement an interface with very few methods. We'll implement more models as needed (integration of RedPajama running on a local video board is on the way). We'll provide the interface definition with some documentation, so anyone can write their own plugins.
+
+In //djAI//, AI models are configured in the file {{{Models.json}}} in the main program folder. The default file looks like this:
+{{{
+{
+  "Models": {
+    "GPT35": {
+      "Description": "GPT3.5 - 4k tokens",
+      "Assembly": "djAIModels",
+      "Type": "AiModels.Gpt35",
+      "ApiKey": "<your openAI API key>",
+      "Url": "https://api.openai.com/v1/chat/completions",
+      "ChatSummaryTransform": "TBD",
+      "ChatMaxMessagesChars": 1000,
+      "ChatMaxPrefixChars": 1000,
+      "Custom": {
+        "Temperature": 0.9
+      }
+    },
+    "AlephAlphaCompletion": {
+      "Description": "AlephAlpha Completion Base",
+      "Assembly": "djAIModels",
+      "Type": "AiModels.AlephAlphaCompletion",
+      "ApiKey": "<your AlephAlpha API key>",
+      "Url": "https://api.aleph-alpha.com/complete",
+      "ChatSummaryTransform": "AlephAlpha - Summarize chat",
+      "ChatMaxMessagesChars": 1000,
+      "ChatMaxPrefixChars": 1000,
+      "Custom": {
+        "Temperature": 0.9,
+        "ModelVariant": "luminous-base"
+      }
+    },
+    "AlephAlphaCompletionExtended": {
+      "Description": "AlephAlpha Completion Extended",
+      "Assembly": "djAIModels",
+      "Type": "AiModels.AlephAlphaCompletion",
+      "ApiKey": "<your AlephAlpha API key>",
+      "Url": "https://api.aleph-alpha.com/complete",
+      "ChatSummaryTransform": "AlephAlpha - Summarize chat",
+      "ChatMaxMessagesChars": 1000,
+      "ChatMaxPrefixChars": 1000,
+      "Custom": {
+        "Temperature": 0.9,
+        "ModelVariant": "luminous-extended"
+      }
+    },
+    "AlephAlphaCompletionSupreme": {
+      "Description": "AlephAlpha Completion Supreme",
+      "Assembly": "djAIModels",
+      "Type": "AiModels.AlephAlphaCompletion",
+      "ApiKey": "<your AlephAlpha API key>",
+      "Url": "https://api.aleph-alpha.com/complete",
+      "ChatSummaryTransform": "AlephAlpha - Summarize chat",
+      "ChatMaxMessagesChars": 1000,
+      "ChatMaxPrefixChars": 1000,
+      "Custom": {
+        "Temperature": 0.9,
+        "ModelVariant": "luminous-supreme"
+      }
+    }
+  }
+}}}}