# Running Pinegrow AI with Locally Installed LLM Ai assistants **URL:** \ **Category:** Questions\ **Created:** [November 28, 2024, 8:14am UTC](https://forum.pinegrow.com/t/running-pinegrow-ai-with-locally-installed-llm-ai-assistants/10042 "2024-11-28T08:14:35Z")\ **Posts on this page:** 1\ **Showing post:** 16
**Author:** ![schpengle](https://yyz2.discourse-cdn.com/flex036/user_avatar/forum.pinegrow.com/schpengle/32/238_2.png) [@schpengle](https://forum.pinegrow.com/u/schpengle)\ **Post date:** [December 14, 2024, 4:17pm UTC](https://forum.pinegrow.com/t/running-pinegrow-ai-with-locally-installed-llm-ai-assistants/10042/16 "2024-12-14T16:17:52Z")
RABBIT HOLE!!! RABBIT HOLE ALert!! A LLM ert… ![Screenshot 2024-12-14 at 15.28.51](https://canada1.discourse-cdn.com/flex036/uploads/pinegrow/original/2X/4/433fe425323a26747317ba225e618aec98630677.jpeg) Easy > **[Ollama](https://ollama.com/)** > > Get up and running with large language models. Not so easy to set up , config didnt work for a while but then you have a local chatty, code assistant in VSCode. > **[Overview | Continue](https://docs.continue.dev/getting-started/overview)** > > Getting started with Continue Mind bending unless your a developer. it took me 2 days… after a few days repeating the video I posted previously. Awesome, Cheers Alex! > **[GitHub - open-webui/open-webui: User-friendly AI Interface (Supports Ollama,...](https://github.com/open-webui/open-webui)** > > User-friendly AI Interface (Supports Ollama, OpenAI API, ...) Incredibly easy once you’ve set up Ollama. Having said that I had a problem where I had to un and re install twice… sigh. > **[AnythingLLM | The all-in-one AI application for everyone](https://anythingllm.com/)** > > AnythingLLM is the AI application you've been seeking. Use any LLM to chat with your documents, enhance your productivity, and run the latest state-of-the-art LLMs completely privately with no technical setup. You can use it for RAG (feeding it your own documents… so its your very own specialised LLM. with your own documentation to peruse… the same as the Open WebUI above) And of course… Pinegrow, with AI … Mr PineCone.but… this page needs updating… seriously! > **[How to Set Up Your API Key for Mr. Pine Cone the Pinegrow AI Assistant - A...](https://pinegrow.com/blog/how-to-set-up-your-api-key-for-pinegrow-ai-assistant-a-simple-guide/)** > > To use AI features with the Mr Pinecone assistant, a subscription to OpenAI or Anthropic is required. Integration is done simply through a personal API key, giving you access to powerful models like… it doesnt contain how to do it with your own Local LLM instance. as it omits the custom setup process ![Screenshot 2024-12-14 at 15.51.50](https://canada1.discourse-cdn.com/flex036/uploads/pinegrow/original/2X/f/f5d099df6f53b31c83682765d01272fab706d305.jpeg) ![Screenshot 2024-12-14 at 15.52.12](https://canada1.discourse-cdn.com/flex036/uploads/pinegrow/original/2X/d/d80dec127a3faec0349335d3559c3d6508d39b55.png) So without that one…ONE…custom setting in Pinegrow, I would have had zero interest and NEVER gone down this… Rabbit hole. Have I mentioned Rabbit holes enough. SO seriously, I am running an m1 Mac, silicon, on an outdated OS (im on 12… macs may be on 15-16 by now I dont know) and had various warnings, I had to learn about Node… Python… NVM (for various different Node version environmen ts) and Anaconda (settled for MiniForge for maintaining a sane Python versions environment) to follow along with the Awesome Video By ALex about setting all this up, the developer way… And… then I found the anythingLLM app… from this video. > **[How to Set Up Your API Key for Mr. Pine Cone the Pinegrow AI Assistant - A...](https://pinegrow.com/blog/how-to-set-up-your-api-key-for-pinegrow-ai-assistant-a-simple-guide/)** > > To use AI features with the Mr Pinecone assistant, a subscription to OpenAI or Anthropic is required. Integration is done simply through a personal API key, giving you access to powerful models like… and am now also exploring uncensored LLM’s. So that App and Ollama. its running. It all starts with Ollama (or LMStudio) > **[LM Studio - Discover, download, and run local LLMs](https://lmstudio.ai/)** > > Run Llama, Mistral, Phi-3 locally on your computer. and you can fire up pinegrow with your very own, no fees/payments/internet/security madness. It really should be in the PG Docs. Cheers at @matjaz , this has actuallly piqued my interest and got me tinkering again for the first time in Years if Im honest and now… Ive got a coding assistant and PG to get me back into it. BRILLIANT! ive not enthused about something for a very…very … long time. now like I said, Ive got an m1 mac,16inch version, 2021 16gb ram, 1TB harddrive (SSD) and about a GAZILLION tabs open (hundreds) in about…jesus, just counted them, 68 windows! PG Running…AnythingLLM… bean editor, zed editor > **[Zed - The editor for what's next](https://zed.dev/)** > > Zed is a high-performance, multiplayer code editor from the creators of Atom and Tree-sitter. , vscode (running the openweb ui instance) piles of text editor pages open…new shiny warp text editor (experimenting with -as also interfaces with local AI) > **[Warp, the reimagined terminal with a modern UX and text editor | Warp](https://www.warp.dev/modern-terminal)** > > Warp is the terminal with a modern UX for easier code editing and faster navigation. Boost productivity with built-in command completions and terminal Blocks. (yeah i forgot to add that in my picture-ran out of screen real estate) several other things, Activity monitor and… ![Screenshot 2024-12-14 at 16.11.42](https://canada1.discourse-cdn.com/flex036/uploads/pinegrow/original/2X/1/150af703479d3e12cb00d7f17540904990e369b9.jpeg) Its smashing it. yes, its a bit laggy but, totally useable (I used to use windows 3.1 so yeah!) everything works and its not rebooted for I dont know how long…weeks. SO try it, its a whole new way of getting info (Yeah, looking at your, condescending stack overflow nerds…) and it really comes alive in coding apps like PG and the others above, so come on PG Team, update your docs and get people to actually fire up and use your AI assitant! And… thanks for actually creating it and then not jailing it to online paid providers. like you say, just part of your toolset, no lock in. Not with code and now not with Online LLM AI providers with prohibitive, ongoing charges which necessitate a permanent Internet connection. This and money, not always available. So, i now have a new found respect for the PG app and its development. AI aint gimmicky after all. Cheers. OH Yes, and I have to say, all these different _LLM PORTALS_ seem to have different lags and latencies with regard response. Terminal I found to be the quickest, But then, the open-WebUI … which suprised me as the backend setup was immense ( there is also a one line docker install! I didnt go that route. that will be next. Never used docker before) So when the dust settles I’ll reboot with just these relevant apps open and see how PG compares to the others for speed etc. PS… I last posted about all this node, python, package managing stuff back in 2021 > [@What is the Best, better Way to Install Node.js, NPM on a mac?](https://forum.pinegrow.com/t/what-is-the-best-better-way-to-install-node-js-npm-on-a-mac/4960): > > Hello! as it says above. I’m pretty sure this could either be ignored, or start a flame war. …or I’ll be totally blown away by everyone agreeing on one way! But Macports… [https://www.macports.org/](https://www.macports.org/) Homebrew… … the stand alone Installer, made by the devs themselves? Dis/Advantages of these 3 methods (are there more? heaven forbid!) I’m Concerned about Privilege/damage escalation with regards installing packages etc that I dont really understand or know little about but are deemed necess… Well, I think Ive finally done it sanely on this machine. Its been bugging me for years. Right, now to go to the horses! TTFN --- _[View the full topic](https://forum.pinegrow.com/t/running-pinegrow-ai-with-locally-installed-llm-ai-assistants/10042)._