Files
ThothII/harness/.pi/skills/tht-sessione/sql-generation.md
T
marcopanandClaude Opus 4.8 c4d130828f fix(harness): remediation difetti review — gate↔CLI, D15, D7/D6, D14, robustezza
Implementazione del piano di remediation progressiva sui difetti emersi
dall'analisi dell'harness. Tutto verificato: 214 test Python (incl. L0 su
Postgres reale), 14 test JS del gate, ruff pulito.

Blocco 1 (CRITICA, integrazione gate↔CLI):
- phase advance: gate usa --auto + exit 6; reviewer_confirm kind:phase fa
  advance esplicito che applica i prerequisiti (prima non avanzava per le
  fasi a conferma umana).
- cte plan riceve i --name dal gate (param names); set-question con id
  posizionale; skill `tht search find`; nuovo comando `tht memory save-one`
  con dedup hash client-side in save_one_memory.

Blocco 2 (D15, stato post-rollback):
- campo `phase` su DecisionRecord + effective_decisions phase-aware per i
  subject "a nome" (cte_approved ecc.); _compute_promotions e finalize sulla
  vista effective; finalize confronta col piano CTE effettivo, non glob;
  `decision add --retracts` + comando `decision retract`.

Blocco 3 (D7 read-only + D6 manifest):
- assert_read_only su tutti e quattro i codepath (direct + REST);
- manifest author/summary/updated_at/updated_by/schema_version popolati +
  helper touch_manifest sulle mutazioni.

Blocco 4-5 (D14a/D14b):
- decision_min_phase data-driven via `emits:` in workflow.yaml;
- formula evidence: status auto, search_formulas, gruppo CLI `tht formula`,
  `search find --kind formula`, load_evidence_dir salta i .sql.md.

Blocco 6 (robustezza):
- taskdoc slice promoted_tables + bound enforced; report escaping/bound +
  rsplit note; filtro kind reader REST/direct; conteggio upserted robusto;
  guard REST run_query non-list; LSH disallineato -> LshIndexError.

Blocco 7 (pulizia):
- dead code gate e KIND_TO_TABLE morto rimossi; doc Postgres-only
  (README + connection.py).

Blocco 0 (parziale): test di compatibilità firma gate↔CLI
(tests/integration). Rinviati: fake-Pi runtime completo, artifact-gate da
disco (#23), parità eligibility REST/direct (#28), unificazione
reserved-labels (#30), memory_rejected da deselezione (#33).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-27 17:16:51 +02:00

2.8 KiB

Final SQL generation technique

Adapted from the "query generation" step of AV-SQL (recursive divide-and-conquer) and its review checklist.

Generation (divide-and-conquer)

  1. Divide: decompose the rewritten question into sub-questions, each aimed at a piece of information or logic (a population, a filter, an aggregate).
  2. Conquer: for each sub-question formulate a pseudo-SQL, with placeholders for sub-questions not yet resolved. The CTEs already tested in Phase 6 are the preferred building blocks: reuse them by name, with their known outcome.
  3. Recombine: replace placeholders bottom-up until the full SQL. The final SQL may include the CTEs in its own WITH.
  4. Dialect: PostgreSQL. Copy table and column names EXACTLY from the schema context; never invent objects.

The file sessions/<id>/sql_final.sql must contain ONLY the SQL, clean and copy-pasteable: no rationale comments (that lives in the audit artifacts).

Time dimension (analysis by year/month/quarter)

Fact tables have data_time_key (integer, format YYYYMMDD): it is the FK to dim_time.day_key. This FK is NOT declared in the DWH (facts have foreign_keys: []), so it will NOT appear in schema_linking.json: you must add it by hand to the join.

  • To extract year, month, quarter, semester etc. do JOIN dim_time dt ON dt.day_key = <fact>.data_time_key and use the dimension's columns: dt.year, dt.month, dt.quarter, dt.semester, dt.full_date, dt.month_name_it, dt.year_month.
  • Do NOT do arithmetic on the key (e.g. data_time_key / 10000 for the year): it works by accident but is fragile and breaks as soon as you need to format a date or do a cast. Always use dim_time.
  • "Last N years from the most recent year": dt.year >= (SELECT MAX(year) FROM dim_time WHERE day_key IN (SELECT data_time_key FROM <fact>)) - (N-1), or compute the max year on the rows actually present in the fact.

Review checklist (on errors or suspicious results)

  • Do the returned columns answer the question exactly?
  • Do the filters (WHERE/HAVING) reflect ALL the conditions of the rewritten question?
  • Are aggregations, groupings and orderings the required ones?
  • Empty or zero result: almost always indicates a problem in conditions or joins. Verify the filter values with tht search find "<value>" (match on real values).
  • Do the joins follow those promoted in schema_linking.json? (exception: the FK data_time_key → dim_time.day_key is not declared, see the time section.)
  • Time analyses: are you using JOIN dim_time and not key arithmetic?

Every substantive revision is recorded with: reviewer_decide(options:[{label:"Register revision", type:"sql_revised", subject:"sql_final", detail:"<what changed>", rationale:"<why>"}], allow_other:false).