Define speech lowering handoff
This commit is contained in:
parent
559c8e4cee
commit
e1f3226219
10 changed files with 603 additions and 0 deletions
|
|
@ -18,6 +18,11 @@ steer the machine, describe its authority here.
|
|||
contract between clients, authoring tools, and language projects.
|
||||
- [english-lowering-packet.md](./english-lowering-packet.md): packet contract
|
||||
for projecting interlingua through agent state into flavored English.
|
||||
- [english-pronunciation-plan.md](./english-pronunciation-plan.md): plan for
|
||||
stringing flavored English into IPA/phoneme sequences before downstream speech.
|
||||
- [line-expression-vector.md](./line-expression-vector.md): learned vector
|
||||
contract for handing prosody, emphasis, and character pressure to downstream
|
||||
synth control.
|
||||
|
||||
## Source Of Truth
|
||||
|
||||
|
|
|
|||
37
schemas/english-pronunciation-plan.md
Normal file
37
schemas/english-pronunciation-plan.md
Normal file
|
|
@ -0,0 +1,37 @@
|
|||
# English Pronunciation Plan Contract
|
||||
|
||||
This is the human-facing schema receipt for English pronunciation plans.
|
||||
|
||||
The plan sits after flavored-English lowering and before downstream speech
|
||||
systems such as AquaSynth.
|
||||
|
||||
## Required Fields
|
||||
|
||||
- `schema_version`: currently `weksa.english_pronunciation_plan.v0`.
|
||||
- `source_output_ref`: file or packet reference for the lowered English output.
|
||||
- `dialect`: pronunciation target such as `en-US-general`.
|
||||
- `orthographic_text`: final English text being pronounced.
|
||||
- `tokens`: token-level pronunciation records.
|
||||
- `ipa`: broad IPA output.
|
||||
- `trace`: decisions and uncertainties.
|
||||
|
||||
## Token Records
|
||||
|
||||
Each token should include:
|
||||
|
||||
- `id`
|
||||
- `text`
|
||||
- `kind`: `word`, `punctuation`, `boundary`, or `symbol`
|
||||
- `pronunciation_source`
|
||||
- `arpabet`
|
||||
- `ipa`
|
||||
- `stress`
|
||||
- `notes`
|
||||
|
||||
`arpabet` may be omitted for punctuation and non-CMUdict sources.
|
||||
|
||||
## Boundary
|
||||
|
||||
This contract does not define phonetic features, articulatory gestures, tract
|
||||
morphology, or audio. It only defines the pronunciation string and the trace that
|
||||
explains where it came from.
|
||||
32
schemas/line-expression-vector.md
Normal file
32
schemas/line-expression-vector.md
Normal file
|
|
@ -0,0 +1,32 @@
|
|||
# Line Expression Vector Contract
|
||||
|
||||
This is the human-facing schema receipt for Weksa line-expression vectors.
|
||||
|
||||
The vector sits after flavored-English lowering and before AquaSynth synth
|
||||
control. It is the learned representation of a character's line: meaning,
|
||||
emphasis, prosody, and delivery pressure in one compact artifact.
|
||||
|
||||
## Required Fields
|
||||
|
||||
- `schema_version`: currently `weksa.line_expression_vector.v0`.
|
||||
- `source_output_ref`: lowered English output reference.
|
||||
- `speaker_agent_id`: speaker identity.
|
||||
- `encoder`: model ID and version metadata.
|
||||
- `text`: spoken and normalized text.
|
||||
- `vector`: dimensionality and either inline values or `values_ref`.
|
||||
- `audit_projection`: human-readable probe of what the vector is intended to
|
||||
preserve.
|
||||
- `trace`: notes and uncertainties.
|
||||
|
||||
## Boundary
|
||||
|
||||
The vector is not canonical character state. It is a derived runtime/training
|
||||
artifact.
|
||||
|
||||
The audit projection is not the true latent space. It is a review surface for
|
||||
humans, tests, and training data.
|
||||
|
||||
## Downstream
|
||||
|
||||
AquaSynth may consume the vector through its own decoder. Weksa does not define
|
||||
the synth-control schema here.
|
||||
Loading…
Reference in a new issue