I found out about NVIDIA NIM through somebody's comment on the original Janitor AI post, and the models are pretty good, with the only hard limit being 40 RPM (Requests Per Minute).

Setup

• Enter https://developer.nvidia.com/nim
• Click on "Try APIs"
• Click on "Login" (even if you are signing up) and enter your email

Proxy URL

For some reason, you cannot use their Proxy URL directly in Janitor or you will get a network error, so for this you will need to set it up with Sophia's Lorebary.

For that, check: Sophia’s Lorebary Guide, and set it up with this URL: https://integrate.api.nvidia.com/v1/chat/completions

API Key

Note: I believe you will need to verify your phone number to get access to your API Key.

Paste it in the "API Key" field on Janitor (mentioned in the Janitor Guide):

• Click on your avatar (usually top right)
• Click on "API Keys”
• Click on "Generate API Key"
• Give it a name of your choosing and select "Never Expire" for Expiration
• Copy the key and paste it on Janitor

Models

You can search for the available models on your own and test them, but here are my recommendations:

• z-ai/glm-5.2 ⚠️ This model is often overloaded, which will result in a “Network Error”
• minimaxai/minimax-m3