import form #16

New issue

Closed

opened 2026-02-07 15:11:55 +00:00 by despiegk · 1 comment

despiegk commented

2026-02-07 15:11:55 +00:00

Owner

allow people to specify a git url for scanning

books
collections

we have to put marker .book in books
like we have marker .collection in collections

then we scan, so we can automatically import collections & books

need to make sure this can survive a server restart
also we need to be able to delete books

we should have reporting while we are scanning so people see what happens, so it something goes wrong they can see

we can also import 1 book (or re-import), this is good for development purposes

check carefully for errors and have a good way how to show the errors, so it becomes more like a dev tool

use

there is a new RPC endpoint for hero_embedder its a key/value store per namespace, we can use this to remember info we don't want to forget (in stead of a default redis), and this is per namespace, use this for checking if we need to process a page again or for other config

to remember info we need to remember

allow people to specify a git url for scanning - books - collections we have to put marker .book in books like we have marker .collection in collections then we scan, so we can automatically import collections & books need to make sure this can survive a server restart also we need to be able to delete books we should have reporting while we are scanning so people see what happens, so it something goes wrong they can see we can also import 1 book (or re-import), this is good for development purposes check carefully for errors and have a good way how to show the errors, so it becomes more like a dev tool use > there is a new RPC endpoint for hero_embedder its a key/value store per namespace, we can use this to remember info we don't want to forget (in stead of a default redis), and this is per namespace, use this for checking if we need to process a page again or for other config to remember info we need to remember

despiegk added this to the now milestone

2026-02-07 15:12:04 +00:00

mik-tf was assigned by despiegk

2026-02-07 15:12:11 +00:00

mik-tf was unassigned by despiegk

2026-02-07 15:13:21 +00:00

despiegk added this to the ACTIVE project

2026-02-07 15:13:31 +00:00

mik-tf referenced this issue from a commit

2026-02-08 01:39:17 +00:00

Phase 6: Web features #16 import, #8 library routing, #9 tags

mik-tf referenced this issue

2026-02-08 01:39:51 +00:00

Issues sweep: 13 issues addressed (development-fixes-feb) #24

mik-tf commented

2026-02-08 01:40:58 +00:00

Owner

Addressed in PR #24 (branch development-fixes-feb).

Commits: c98cf72, dcbdad5

Import form at /import with git URL input, namespace selector, pull/reset options
Full pipeline: clone via scan_collections() → process_collection() for Q&A → push_ai_metadata() to remote → upload_collection_embeddings_and_build()
Push checkbox: optionally push .ai/ metadata back to the source repo
State persisted in KVS (survives restart when hero_embedder KVS is available)
Import status reporting via response page

Addressed in PR #24 (branch `development-fixes-feb`). **Commits:** `c98cf72`, `dcbdad5` - Import form at `/import` with git URL input, namespace selector, pull/reset options - Full pipeline: clone via `scan_collections()` → `process_collection()` for Q&A → `push_ai_metadata()` to remote → `upload_collection_embeddings_and_build()` - Push checkbox: optionally push `.ai/` metadata back to the source repo - State persisted in KVS (survives restart when hero_embedder KVS is available) - Import status reporting via response page

despiegk closed this issue

2026-02-08 08:35:35 +00:00