feat(sidecar): JSON-family storage backend — plain / JSON-LD / NDJSON (V-L2-F3, #146)

[hyperpolymath]

V-L2-F3: JSON-family sidecar storage backend (#146)

Implements a real json sidecar store covering plain JSON, JSON-LD, and NDJSON, with full parity to the runtime operations the SQLite path implements today. Re-opens the capability that #112/#144 dropped — at the maintainer's request — now deliberately scoped and built rather than aspirational.

Manifest

• [sidecar].storage = "json" is accepted again; new [sidecar].format = plain (default) | ld | ndjson.
• New sidecar::StorageKind::resolve(storage, format) is the single source of truth (Sqlite | Postgres | Json(JsonFormat)); the old SqlDialect::from_storage is folded into it. validate/doctor, generate, drift, and gc all defer to it, so they agree on the accepted set and reject typos / bad formats consistently.

Store (src/sidecar/json.rs)

• One SidecarData model mirrors the verisimdb_* tables; the format is purely a codec, so every octad operation is written once and is format-independent:
  • plain — the model as a keyed object;
  • ld — @context + @graph of typed (@type/@id) nodes (genuine linked data);
  • ndjson — one {"_table": …} record per line.
• Provenance: linear append, append_fork, verify_chain, fork_points — reusing abi::ProvenanceEntry::compute_hash, so hashing is byte-identical to the SQLite backend.
• Temporal: append_version (monotonic, exactly-one-current enforced in code), read_current, read_at, rollback_to.
• Drift: reuses the storage-agnostic tier1::drift::temporal_drift_score.
• GC: purges provenance / superseded-temporal / lineage by age (keeps the current version).
• Crash-safe writes (temp file + atomic rename); logical append-only, single-writer model (the one documented difference from SQLite's lock-based serialization).

Commands

• generate emits a format-appropriate scaffold sidecar_schema.{json,jsonld,ndjson} (DDL-parity for SQL); drift and gc dispatch to the JSON store; postgres drift/gc remain explicit "not yet implemented".

Verification

• 141 lib unit tests (incl. 22 new sidecar tests exercising provenance/temporal/drift/gc + codec round-trips across all three formats) + all integration tests pass.
• cargo clippy --all-targets -- -D warnings and cargo fmt --check clean.
• Manual CLI smoke test confirmed validate (new sidecar-storage-supported check), generate (plain/ld/ndjson scaffolds incl. JSON-LD @context/@graph), gc, and drift all work against a json manifest, and that a bad format is rejected with a clear message.

Acceptance (#146)

• storage = "json" + format = plain|ld|ndjson parse, validate, round-trip; bad format rejected clearly.
• StorageKind::resolve is the single resolver; validate/doctor accept json, reject typos.
• JSON store passes provenance (incl. fork + tamper), temporal (monotonic + one-current + rollback), drift, and gc tests across all three formats.
• generate emits a format-appropriate scaffold; drift and gc honour the json store.
• SidecarConfig docs + manifest template document json and format.

Closes #146.

https://claude.ai/code/session_01S2xDQQU5o85N3xTpeFUSfN

---

Generated by Claude Code

[github-actions]

🔍 Hypatia Security Scan

Findings: 81 issues detected

Severity	Count
🔴 Critical	2
🟠 High	7
🟡 Medium	72

⚠️ Action Required: Critical security issues found!

View findings

[
  {
    "reason": "Action perpolymath/standards/.github/workflows/governance-reusable.yml@main\n needs attention",
    "type": "unpinned_action",
    "file": "governance.yml",
    "action": "pin_sha",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Action actions/checkout@v4 needs attention",
    "type": "unpinned_action",
    "file": "rust-ci.yml",
    "action": "pin_sha",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Action dtolnay/rust-toolchain@stable needs attention",
    "type": "unpinned_action",
    "file": "rust-ci.yml",
    "action": "pin_sha",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Action Swatinem/rust-cache@v2 needs attention",
    "type": "unpinned_action",
    "file": "rust-ci.yml",
    "action": "pin_sha",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Action actions/checkout@v4 needs attention",
    "type": "unpinned_action",
    "file": "rust-ci.yml",
    "action": "pin_sha",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Action dtolnay/rust-toolchain@master needs attention",
    "type": "unpinned_action",
    "file": "rust-ci.yml",
    "action": "pin_sha",
    "rule_module": "workflow_audit",
    "severity": "high"
  },
  {
    "reason": "Action Swatinem/rust-cache@v2 needs attention",
    "type": "unpinned_action",
    "file": "rust-ci.yml",
    "action": "pin_sha",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Issue in boj-build.yml",
    "type": "missing_timeout_minutes",
    "file": "boj-build.yml",
    "action": "flag",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Issue in casket-pages.yml",
    "type": "missing_timeout_minutes",
    "file": "casket-pages.yml",
    "action": "flag",
    "rule_module": "workflow_audit",
    "severity": "medium"
  },
  {
    "reason": "Issue in casket-pages.yml",
    "type": "missing_timeout_minutes",
    "file": "casket-pages.yml",
    "action": "flag",
    "rule_module": "workflow_audit",
    "severity": "medium"
  }
]

Powered by Hypatia Neurosymbolic CI/CD Intelligence