# Live Database Ingest

Capture semantic-layer and knowledge updates from a live database schema snapshot.

- Repository: https://github.com/Kaelio/ktx (1627 stars)
- Category: Data and ML
- License: Apache-2.0
- Last updated: 2026-10-22
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add Kaelio/ktx --skill live_database_ingest -g -a claude-code -y`
Codex: `npx skills add Kaelio/ktx --skill live_database_ingest -g -a codex -y`
Cursor: `npx skills add Kaelio/ktx --skill live_database_ingest -g -a cursor -y`
Gemini CLI: `npx skills add Kaelio/ktx --skill live_database_ingest -g -a gemini-cli -y`

## Description

Capture semantic-layer and knowledge updates from a live database schema snapshot.

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Live Database Ingest

Use this skill when the ingest work unit contains raw files under
`raw-sources/<connectionId>/live-database/<syncId>/`.

## Workflow

1. Read the table JSON file listed in the work unit.
2. Read `connection.json` to understand the snapshot metadata.
3. Read `foreign-keys.json` when the table has a foreign key or when joins are
   needed for the semantic-layer source.
4. Create or update one semantic-layer source for the table with
   `sl_write_source`.
5. Use the physical table name from the raw JSON as the source `table` field.
6. Preserve database comments as `descriptions.db` on tables and columns.
7. Add joins only when the foreign key index names both sides.
8. Write wiki pages only for durable business meaning that is present in table
   or column comments.
9. Run `sl_validate` for the table source before the work unit completes.

Sample values come from the scan record; do not invent values not present in
relationship-profile.json.

## Identifier Verification Protocol

Before writing a wiki page or SL source on any topic:

1. `discover_data({query: "<topic>"})` - see what wikis, SL sources, and raw
   tables already exist. Prefer updating existing pages over creating new ones.

Before emitting any `schema.table` or `schema.table.column` into a wiki body,
SL source, `tables:` frontmatter, `sl_refs`, or `emit_unmapped_fallback`:

The rest: https://github.com/Kaelio/ktx/blob/HEAD/packages/cli/src/skills/live_database_ingest/SKILL.md
