Files
anonymizer/CHANGELOG.md
Mobiletic 2584bd8c95 feat: prompt rules for lossless round-trips (0.3.1)
Two coherence rules added to DEFAULT_SYSTEM_PROMPT:
- different values of the same type get distinct placeholders (context),
  e.g. old/new IBAN -> [PER_1.IBAN:Ancien] / [PER_1.IBAN:Nouveau]
- never absorb adjacent punctuation/separators into a placeholder

Took the live Gemma-4 (Infomaniak) e-learning demo from 4/5 to 5/5 exact
round-trips. 36 tests passing.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-07-01 09:58:56 +01:00

4.1 KiB

Changelog

All notable changes to this project are documented here. The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[0.3.1] - Unreleased

Changed

  • Default prompt hardening for lossless round-trips: (1) two different values of the same type never share a placeholder — they must be distinguished by context (e.g. [PER_1.IBAN:Ancien] vs [PER_1.IBAN:Nouveau]), preventing a within-message collision (old/new IBAN); (2) the model must not absorb adjacent punctuation/separators (commas, spaces, parentheses) into a placeholder. Together these took the live Gemma-4 e-learning demo from 4/5 to 5/5 exact round-trips.

[0.3.0] - Unreleased

Changed

  • openAICompatibleProvider now works with Infomaniak (and other open-model endpoints) out of the box. response_format is omitted by default instead of hard-coding { type: 'json_object' }, which current Infomaniak rejects (HTTP 422). Pass the new responseFormat option (e.g. { type: 'json_object' } or a json_schema object) for endpoints that support/require it. Breaking for endpoints that relied on the previous forced json_object.
  • JSON responses are now parsed leniently — a fenced JSON code block or surrounding prose is tolerated (the outermost { … } is extracted), so models without an enforced response_format don't cause spurious parse failures.
  • The default prompt gained a COHÉRENCE block (exact placeholder↔mapping-key identity, values are the original data never another placeholder, strict [TYPE_N…] format, mask the value not the adjacent label) to improve reliability across models.

[0.2.0] - Unreleased

Added

  • legend on every result — abbreviation → French meaning (PERPersonne, MMasculin), safe to forward to a downstream LLM so it understands the placeholder tokens. Backed by a built-in DEFAULT_LEGEND so coverage is guaranteed even if the model omits entries.
  • The default prompt now lets the model coin new uppercase abbreviations for entities/attributes/ context it discovers and return their meanings in legende.
  • PatternDef.meaning — optional human label for a tag, surfaced in the legend. presets.swiss/ presets.generic ship French meanings.
  • AnonymizationError (exported) — thrown when anonymization can't complete and no fallback exists; carries the originating error in .cause.

Changed (breaking)

  • Regex fallback is now opt-in. patterns no longer defaults to presets.swiss. With no fallback, an LLM failure throws AnonymizationError (fail-closed) and the pre-filter is bypassed. At least one of llm or patterns is required, or the constructor throws.
  • AnonymizationResult gained a required legend field; LlmProvider.anonymizeBatch returns legend.
  • anonymizeChunks(chunks, seed)seed is now { mapping, legend? } (was the bare mapping) and the return includes legend.

[0.1.0] - Unreleased

Added

  • Initial public release.
  • Anonymizer — pre-filter → LLM → regex fallback, bidirectional validation, deterministic coreference, and de-collision across question and retrieved chunks (anonymize, anonymizeChunks, deanonymize).
  • makeStreamDeanonymizer — streaming-safe de-anonymization that never leaks a split placeholder.
  • openAICompatibleProvider — pluggable LLM detection over any OpenAI-compatible Chat Completions API.
  • presets.swiss and presets.generic regex pattern sets; fully configurable custom patterns.
  • Regex-only mode (no LLM provider required).
  • PatternDef.validate — optional second-stage predicate to cut false positives; presets.generic uses it for a Luhn check on credit-card candidates, and de-overlaps its phone/date/IP patterns.
  • openAICompatibleProvider retries transient failures (network/timeout/429/5xx) via retries and retryDelayMs options; non-transient 4xx and malformed responses are not retried.
  • Hardened the nameHint heuristic: g/y flags are stripped internally so .test() is stateless.