docs: document external site parser
This commit is contained in:
@@ -1,6 +1,6 @@
|
||||
# RAA deployment
|
||||
|
||||
Last updated: 2026-08-04.
|
||||
Last updated: 2026-08-10.
|
||||
|
||||
RAA is not a separate code project anymore. The source of truth for code and
|
||||
documentation is:
|
||||
@@ -26,6 +26,7 @@ continue feature work there.
|
||||
- Destination: `raa-fn8`, CTID `105`, IP `192.168.1.105`
|
||||
- Edge proxy: Caddy in CTID `110` proxies `raa.panel.f-n8.ru` to Coolify Traefik at `192.168.1.105:80`
|
||||
- Health check: `https://raa.panel.f-n8.ru/health`
|
||||
- Current verified deploy: `f866a13a8a83598e26a7a6a3406b8bc1c01c9a80`
|
||||
|
||||
## Per-Project Settings
|
||||
|
||||
@@ -55,6 +56,10 @@ Database settings:
|
||||
- `vk_poster_access_token` is the RAA community token
|
||||
- `site_poster_enabled=false`
|
||||
- `site_poster_provider=""` until a website adapter is configured
|
||||
- Site parser settings are stored here as well:
|
||||
`site_parser_url`, `site_parser_token`, `site_parser_rucaptcha_token`,
|
||||
`site_parser_timeout_sec`, `site_parser_interval_minutes`, and
|
||||
`site_parser_min_text_length`.
|
||||
- Optional social text headers/footers:
|
||||
- `tg_poster_header_text` / `tg_poster_footer_text`
|
||||
- `vk_poster_header_text` / `vk_poster_footer_text`
|
||||
@@ -83,6 +88,29 @@ AI qualifier/writer are configured with user-provided token, models, and prompts
|
||||
but both the worker controls and double-safety settings were still off. Turning
|
||||
them on will spend LLM tokens and process the pending RAA raw posts.
|
||||
|
||||
## Website Sources
|
||||
|
||||
Website sources use the existing `vk-parser` scheduling loop but are sent one
|
||||
at a time to a stateless external worker in LXC `108` (`192.168.1.113:8080`).
|
||||
All source records, JSON configs, schedules, errors, raw posts, and media state
|
||||
remain in the RAA database. The worker is managed by Docker Compose from
|
||||
`/opt/site-parser` and should be healthy as `site-parser-worker`.
|
||||
|
||||
PopularAirsoft source id `72`:
|
||||
|
||||
- URL: `https://popularairsoft.com/rss.xml`
|
||||
- Config: `{"format":"rss","access":"cloudflare","max_items":10,"min_text_length":50}`
|
||||
- `access='cloudflare'` deliberately starts the browser/RuCaptcha flow before
|
||||
fetching the RSS.
|
||||
- Keep `follow_links` disabled for this feed. Nine current entries have no
|
||||
body, only title/video, and are intentionally filtered before media upload.
|
||||
- Cloudflare cookies and browser User-Agent are reused by `media-uploader` for
|
||||
protected images.
|
||||
- Admin image previews use authenticated Telegram-backed
|
||||
`/raw/media/{media_id}` URLs.
|
||||
- Verified 2026-08-10: source `ok`; raw post `102` is `storage_ready`; four
|
||||
images are `uploaded`. The AI later rejected the content as non-target.
|
||||
|
||||
## RAA Categories
|
||||
|
||||
RAA categories live in the RAA `content_categories` table. The UI has only
|
||||
|
||||
Reference in New Issue
Block a user