feat: data lifecycle rewrite, download clients, wanted list, and central catalog index

Ships the fresh-start schema cleanup: rebuilt explore catalog index pipeline (dump import, artifact fetch/build, incremental listen-count refresh), a new download subsystem (Lidarr/Prowlarr/qBittorrent/SABnzbd/ slskd/yt-dlp providers, staging, reconciliation, wanted list), and the supporting schema/query/store changes across backend and frontend. Also includes two smaller follow-ups: bump the central index's rebuild-after cadence from 90 to 180 days, and remove the Explore "library only" online/offline toggle entirely (frontend-only, no backend counterpart) rather than carry unused UI/state. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Y2Agd9af5hE7qzti2ackiS
2026-08-06 17:12:01 -04:00
parent d0d86f85d5
commit e190fd75b9
165 changed files with 31088 additions and 5192 deletions
@@ -0,0 +1,49 @@
+-- One row per grab attempt against one candidate.  A request can have
+-- several: the first pick stalls, the user picks another, or a
+-- search-only provider's candidate is fetched by a separate transport
+-- (in which case provider_id is the searcher and transport_id is the
+-- fetcher).
+--
+-- `candidate` is the full ranked Candidate as JSON.  It is stored
+-- rather than re-derived because the provider's result set is
+-- ephemeral — a Soulseek peer that had the files an hour ago may be
+-- offline now, and the item still has to render in the UI and explain
+-- why it was chosen.
+--
+-- external_id holds a delegating manager's own identifier (a Lidarr
+-- queue id), which is how polling finds the record again after a
+-- restart.
+
+
+CREATE TABLE IF NOT EXISTS download_items (
+    id           TEXT PRIMARY KEY,
+    request_id   TEXT    NOT NULL,
+    provider_id  INTEGER NOT NULL,
+    transport_id INTEGER,
+    external_id  TEXT    NOT NULL DEFAULT '',
+    candidate    TEXT    NOT NULL DEFAULT '{}',
+    state        TEXT    NOT NULL DEFAULT 'queued'
+        CHECK(state IN ('searching', 'found', 'queued', 'grabbing',
+                        'verifying', 'tagging', 'importing',
+                        'complete', 'cancelled', 'failed')),
+    staging_dir  TEXT    NOT NULL DEFAULT '',
+    bytes_done   INTEGER NOT NULL DEFAULT 0,
+    bytes_total  INTEGER NOT NULL DEFAULT 0,
+    -- imported_paths is a JSON array of the library paths the files
+    -- ended up at, so an import can be undone without guessing.
+    imported_paths TEXT  NOT NULL DEFAULT '[]',
+    error        TEXT    NOT NULL DEFAULT '',
+    created_at   DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
+    updated_at   DATETIME NOT NULL DEFAULT CURRENT_TIMESTAMP,
+    FOREIGN KEY(request_id) REFERENCES download_requests(id) ON DELETE CASCADE
+);
+
+CREATE INDEX IF NOT EXISTS idx_download_items_live
+    ON download_items(state)
+    WHERE state NOT IN ('complete', 'cancelled', 'failed');
+
+CREATE INDEX IF NOT EXISTS idx_download_items_request
+    ON download_items(request_id);
+
+CREATE INDEX IF NOT EXISTS idx_download_items_state
+    ON download_items(state);