65 lines
2.4 KiB
Markdown
65 lines
2.4 KiB
Markdown
# Kischdle setup for microservices
|
|
|
|
## Motivation
|
|
|
|
This introduces the product "Kischdle" and the basic Kischdle server setup
|
|
to you so that you can store the information to the corresponding files in
|
|
the Claude environment. This empowers you to generate content for Kischdle
|
|
in the future when Kischdle topics come up.
|
|
|
|
## Product "Kischdle"
|
|
|
|
The product "Kischdle" is in the early proof-of-concept implementation phase.
|
|
|
|
A Kischdle is an on-premise system with server hardware
|
|
including a local AI GPU and a suite of software apps optimized for
|
|
small and medium sized enterprises.
|
|
|
|
## Basic server setup
|
|
|
|
### Hardware
|
|
|
|
The server hardware used for the proof-of-concept implementation:
|
|
- GPU: NVIDIA RTX5070Ti 16GB VRAM
|
|
- CPU: AMD Ryzen 9 9900X (12x 4.4GHz / 5.6GHz Turbo)
|
|
- Mainboard: MSI PRO X870-P Wifi, PCIe 5.0 x16
|
|
- System RAM: 64GB (2x32GB) DDR5 AMD/Intel 6000MHz Kingston Fury Beast CL30
|
|
- NVMEs: Two devices in Software RAID-1, 2TB SAMSUNG 990 PRO 2TB M.2 PCIe 4.0 x4 NVME (Read 7450MB/s ; Write 6900MB/s)
|
|
|
|
### OS
|
|
|
|
The OS is Debian Linux version 12 (Bookworm).
|
|
|
|
### Microservices
|
|
|
|
The software apps are running separated from each other and from the system
|
|
level. Software apps of each area is running in a rootless Podman Pod by
|
|
a dedicated user. The currently existing users, area and apps are:
|
|
- 'trf': Routes ingress and egress traffic; Traefik
|
|
- 'wbg': Provides a Web GUI for AI; Open WebUI
|
|
- 'llm': Provides AI LLM services internally; PyTorch and custom app
|
|
- 'pln': Provides planning services; AFFiNE
|
|
|
|
Some others exist but are not relevant. Others will be added as
|
|
implementation proceeds; e.g., crm for CRM and dms for DMS.
|
|
|
|
Each microservice is started by executing shell scripts which generate
|
|
the Podman Pod and start a systemd service.
|
|
|
|
It is important that you know how the shell scripts are structured
|
|
and which naming is used - creating shell scripts for coming microservices
|
|
will be one of your future tasks.
|
|
|
|
Please examine these three examples of such shell scripts:
|
|
@~/tmp/create_pod_openwebui.sh
|
|
@~/tmp/create_pod_affine.sh
|
|
@~/tmp/create_pod_traefik.sh
|
|
|
|
## Your tasks
|
|
|
|
1. Use your your ask user questions tool to completely understand the
|
|
situation, the basic server setup and the shell script structure.
|
|
2. Ask me before proceeding with task 3.
|
|
3. Store the knowledge which you gained in this session to the
|
|
appropriate Claude files.
|