Changes between Version 7 and Version 8 of Public/DjAiAdmin


Ignore:
Timestamp:
Jul 9, 2023, 12:19:29 PM (16 months ago)
Author:
Boris Horner
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Public/DjAiAdmin

    v7 v8  
    3030dotnet djAI.dll --urls http://127.0.0.1:5000
    3131}}}
    32 * Configure the service to start on system reboot:
    33  * **Linux:** Run {{{crontab -e}}} and add the following line:
    34   {{{
    35 @reboot /path/to/djAI/run_djAI.cmd
    36 }}}
    37  * **Windows:** Use //Scheduled tasks// to configure automatic start.
    3832
    3933
     
    9286//dj//**AI** is not, and does not contain, a Large Language Model (LLM) by itself. Instead, it's a flexible interface to standardize and simplify AI briefing and use. The actual AI functionality is provided by external services.
    9387
     88Model support is done by simple plugins that must implement an interface with very few methods. We'll implement more models as needed (integration of RedPajama running on a local video board is on the way). We'll provide the interface definition with some documentation, so anyone can write their own plugins.
     89
    9490Currently, //dj//**AI** supports these models:
    9591* openAI: GPT3.5 turbo. We are still on the waitlist for GPT4 and will integrate it as soon as we can access it.
    96 * AlephAlpha: base, extended and supreme levels.
     92* !AlephAlpha: base, extended and supreme levels.
    9793
    98 Model support is done by simple plugins that must implement an interface with very few methods. We'll implement more models as needed (integration of RedPajama running on a local video board is on the way). We'll provide the interface definition with some documentation, so anyone can write their own plugins.
     94To use any of these services, you must have an account with openAI and/or !AlephAlpha, and you must obtain an API secret for each of the services you want to use.
    9995
    10096In //djAI//, AI models are configured in the file {{{Models.json}}} in the main program folder. The default file looks like this:
     
    158154    }
    159155  }
    160 }}}}
     156}
     157}}}
     158
     159If you have an API secret for a model, insert it in the {{{ApiKey}}} field. If you do not have a secret for a model, remove it from the configuration by deleting its configuration (JSON does not allow commenting it out).
     160
     161Please note that the {{{Temperature}}} parameter is currently not read, instead, the default value is used. In the future, it will be possible to configure other values for this and other parameters of the model. Please do not modify any parameters than the {{{ApiKey}}} one.
     162
     163=== Running the djAI service
     164To run the djAI web service on your client machine, execute {{{run_djAI.cmd}}} by double-clicking it, before you start the client.
     165
     166=== Configuration of the djAI service to start on reboot
     167* **Windows Server:** Using //Scheduled Tasks//, configure {{{run_djAI.cmd}}} to start at server start.
     168* **Linux Server:**
     169 * In the {{{djAI}}} program folder, copy {{{run_djAI.cmd}}} to {{{run_djAI.sh}}}.
     170 * Set the execute permission of {{{run_djAI.sh}}} to the user in whose context you want to run it.
     171 * Add the following line to {{{crontab -e}}}:
     172  {{{
     173@reboot /path/to/run_djAI.sh
     174}}}
     175
     176> **NOTE:** Optionally, you might want to run //dj//**AI** behind a proxy. Follow the documentation of the proxy's web server.