CoMakingSpace AI #388
Description
In the Telegram group, the idea was raised to deploy an AI which is trained on wiki data.
The current proposal is to use a server hosted by hetzner to deploy a LLM and train it with wiki data.
@kaplan2539 volunteered to experiment on the technical part.
I have setup a server (aitest.comaking.space), which can be used for testing purposes. Some details regarding the setup:
- SSH is enabled, password login is prohibited
- External Port 443 is forwarded to internal port 8080
-
- For any container, please bind to port 8080
- podman is installed and can be used to run containers
@kaplan2539 feel free to play around and let me know your results. If you need anything (e.g. data dumps from the wiki), let me know :-)
As an alternative, you can also try and see, whether some of the available Cloud AI Services fit our needs even better. Being EU based is a requirement for us though. There are some companys (scaleway, ionos as examples) which provide AI services and are european. If you want me to setup an account there, just let me know.