So far, running LLMs has required a large amount of computing resources, mainly GPUs. Running locally, a simple prompt with a typical LLM takes on an average Mac ...
First you'll need to put your MongoDB connection string in config.json. If you don't know how to get it here's a quick tutorial: https://imgur.com/a/oXI34dA ...