Can I set up my own local hosted AI to run for the AI system?
1 Like
If it’s of any value, you can find a posting I made a few months ago here. However – as will so many technical topics – the thread expanded and it’s probably out of date already.
The short version is I found what you’re trying to do possible, and even satisfactory, but you need to have a decent model running on a decent machine (32GB memory, and probably 100GB of spare drive space).
Lately I’ve been experimenting with commercial subscription models (using Claude) and found these so far ahead of models able to be run locally. In fact, providing a detailed description of what I wanted, Pinegrow (using Claude) created the bulk of my (fully self hosted) current website in about 10 minutes at a cost of around US$5, I spent the rest of the weekend customising the wording (the contact page took another week as I created a backend server to handle the form interactions).
However, I think the outlook is bright for local models as I suspect before long local models achieve a certain minimum ‘smartness’ that will be satisfactory for web design.
I have 128 gigabytes of RAM on my Mac, so I’m running 50 gigabyte models even some larger for other things. I do in a program app called Goose. It works great on Mac for doing all these types of things for coding.
Goose was made by the people who used to own Twitter. And they owned Square. They basically designed Goose to replace most of their employees. And then open sourced it. It runs all kinds of AI models and does things.
Yeah, that machine should suffice then. 
I think I installed Goose when I was checking out the hype around OpenClaw (or whatever iteration it morphed into on the particular day). Never actually went further though. Sounded too scary for security.
If you do have your models running already, feel free to PM me when you hit sticking points. It’s not too difficult to get them working with Pinegrow. Perhaps you’ll be able to post something of what worked best for you back on the forum when done? That way we can keep the threads cleaner while sharing the learned knowledge.
Here’s a screenshot of what I currently have working. Three different models. Fast, the better higher end one, and then a search one.
Seems a bit slow to run some of them though. I’m going to probably add some API keys into something as well to try.
I would like to try Kimi 2.6 I think it is new version.
I’m still stuck on learning a lot of things in Pine Grow, comparing it to possibly going with Greenlight, Greenshift. But I really like Pine Grow, the interface, building things local. And being able to see the cell version side by side. And the live updates on my second monitor.
Maybe you could help me with this question.
If I build things local, push blocks into a current WordPress site, replacing some pages, and then the customer goes in and edits some of that text on a block or changes a photo, how does that work? Because then if I push a new updated version of the block at some point, it’s going to overwrite everything that the customer has changed, right?
Is there some way that Pine Grow Local would be able to grab any changes from the live WordPress site so everything’s matching all the time So there’s no problems updating the design ever.?
This is the one main reason I’m thinking about going with using Greenlight because it’s all edited right within WordPress. So any changes are always there. But I would rather do this with PineGrow if there’s a solution to this.
Here’s a screenshot of the settings area. For the API key, you can just put anything you want in there, since you’re not using one. It just has to have something.
It’s loading them all in from… Ollama.
I first had them all loaded in LM Studio, but I couldn’t figure out how to make them work in Pine Grow from LM Studio, so I had to remove them, re-download them all into Ollama.
The Wordpress side is something I know nothing of – even normal Wordpress eludes me. However, reading that other thread (about colours) you were involved with seems to be the answer. It sounds like you do the design locally, while Wordpress holds the content.
IIUC, that means someone can independently modify the text of the page while you control the layout.
Or I could have misunderstood totally. 