docs: document external site parser

This commit is contained in:
Your Name
2026-08-10 23:28:47 +05:00
parent f866a13a8a
commit 01eea99c88
3 changed files with 142 additions and 3 deletions
+29 -1
View File
@@ -1,6 +1,6 @@
# RAA deployment
Last updated: 2026-08-04.
Last updated: 2026-08-10.
RAA is not a separate code project anymore. The source of truth for code and
documentation is:
@@ -26,6 +26,7 @@ continue feature work there.
- Destination: `raa-fn8`, CTID `105`, IP `192.168.1.105`
- Edge proxy: Caddy in CTID `110` proxies `raa.panel.f-n8.ru` to Coolify Traefik at `192.168.1.105:80`
- Health check: `https://raa.panel.f-n8.ru/health`
- Current verified deploy: `f866a13a8a83598e26a7a6a3406b8bc1c01c9a80`
## Per-Project Settings
@@ -55,6 +56,10 @@ Database settings:
- `vk_poster_access_token` is the RAA community token
- `site_poster_enabled=false`
- `site_poster_provider=""` until a website adapter is configured
- Site parser settings are stored here as well:
`site_parser_url`, `site_parser_token`, `site_parser_rucaptcha_token`,
`site_parser_timeout_sec`, `site_parser_interval_minutes`, and
`site_parser_min_text_length`.
- Optional social text headers/footers:
- `tg_poster_header_text` / `tg_poster_footer_text`
- `vk_poster_header_text` / `vk_poster_footer_text`
@@ -83,6 +88,29 @@ AI qualifier/writer are configured with user-provided token, models, and prompts
but both the worker controls and double-safety settings were still off. Turning
them on will spend LLM tokens and process the pending RAA raw posts.
## Website Sources
Website sources use the existing `vk-parser` scheduling loop but are sent one
at a time to a stateless external worker in LXC `108` (`192.168.1.113:8080`).
All source records, JSON configs, schedules, errors, raw posts, and media state
remain in the RAA database. The worker is managed by Docker Compose from
`/opt/site-parser` and should be healthy as `site-parser-worker`.
PopularAirsoft source id `72`:
- URL: `https://popularairsoft.com/rss.xml`
- Config: `{"format":"rss","access":"cloudflare","max_items":10,"min_text_length":50}`
- `access='cloudflare'` deliberately starts the browser/RuCaptcha flow before
fetching the RSS.
- Keep `follow_links` disabled for this feed. Nine current entries have no
body, only title/video, and are intentionally filtered before media upload.
- Cloudflare cookies and browser User-Agent are reused by `media-uploader` for
protected images.
- Admin image previews use authenticated Telegram-backed
`/raw/media/{media_id}` URLs.
- Verified 2026-08-10: source `ok`; raw post `102` is `storage_ready`; four
images are `uploaded`. The AI later rejected the content as non-target.
## RAA Categories
RAA categories live in the RAA `content_categories` table. The UI has only