For any configuration you want to set up, you will always have to follow the same steps with slight differences. While in Janitor:
- Start a chat with any character
- Click on the purple button above saying "
using janitor" or "using [something]" and a new tab will pop up
- Select "
Proxy"
- Scroll down to Proxy Configurations and click in "
+ New", and it will ask for a few settings:
- Name: you can put whatever you want in here
- Model: model ID (for example: "deepseek-free")
- Proxy URL: endpoint for the router you are using (for example: https://openrouter.ai/api/v1/chat/completions)
- API Key: the API Key that you will create in a specific provider
(for all of these I am going to present more information in the provider guides)
There are also two sections for prompts, that are important to lead the LLM to behave as you wish:
-
Global Prompt: I mostly use this for setting up the prompt, and I like the prompt from this guide. Since some people asked, you can also copy my custom prompt here:
Custom Prompt
-
Custom Prompt (for each model): I only use this when I notice that a certain model needs some fine tuning in the instructions, or for models like Gemini that can flag jailbreaks or NSFW content
At last, click on "Save", refresh the page, and it's done!
Generation Settings
The range in brackets represents the usual range for that setting across most models.
- Temperature [0.6 - 1.2]: How "creative" your model will be — higher values means it's more creative. Turning this up too high will make the AI say incoherent stuff. This varies a lot depending on the model you are using.
- Max Tokens [0 - 2k]: How many tokens the AI can generate as output (response). You can set it to 0 and it will be unlimited, and this is not that important, I leave mine at 1.5k just to avoid some glitches.
Note: If you are using "thinking" or "reasoning" models, set this to 0, or it will limit the amount of tokens it can use to generate it's thought process.
- Context Size [32k / 64k / 128k]: How many tokens the AI can take as input (context). For this one you will usually want to set it to the max that the model you are using can take. Most good models are in the range of 32k or 64k contexts, some even 128k and 256k. Always check the limit of the model you are using, and set the context size to be inside that limit.
Advanced:
If you don't want to mess too much with this, you can just set everything to 0 and Janitor will use the model's default. But here's a summary of what each setting is for:
- Top K [30 - 50]: The amount of words the AI has to pick from — the higher, the more words it will gain access to use.
- Top P [0.9 - 0.99]: The probability of the AI picking a more unique word, basically how much of the vocabulary from Top K it can really access.
- Repetition Penalty [0.8 - 1.3]: Higher = Makes the AI repeats less words in a message.
*Note: ***If you are using "thinking" or "reasoning" models, set this to 0, or it will limit the repetition of words in the model's reasoning.