fluffychat/.github/instructions
wcjord f6a048ca3e
feat: embed STT transcription in audio event content (#5731)
* feat: embed STT transcription in audio event content

Before sending the audio event, the client now fetches the STT
transcript first, then embeds it under 'user_stt' in the event
content. This mirrors the 'original_sent' pattern for text messages
and lets the bot read the transcript immediately without downloading
audio or calling choreo.

- Add ModelKey.userStt constant
- Rewrite onVoiceMessageSend to get transcript before sending audio
- Update getSpeechToTextLocal() to check userStt before botTranscription

* chore: replace inaccurate comment with TODO referencing #5730

* formatting

* fix pangea comments

* feat: make stt translations relate to pangea message events instead of stt representation events

* clean up pangea event types

---------

Co-authored-by: ggurdin <ggurdin@gmail.com>
2026-02-18 12:39:38 -05:00
..
analytics-system.instructions.md docs: add instruction docs for analytics, practice, activities, toolbar; adjust content-word scoring ratio (10:7) 2026-02-15 15:49:26 -05:00
choreographer.instructions.md Add score field to LLMFeedbackModel for human audit integration (#5684) 2026-02-12 14:52:22 -05:00
conversation-activities.instructions.md docs: add instruction docs for analytics, practice, activities, toolbar; adjust content-word scoring ratio (10:7) 2026-02-15 15:49:26 -05:00
events-and-tokens.instructions.md feat: embed STT transcription in audio event content (#5731) 2026-02-18 12:39:38 -05:00
modules.instructions.md Writing assistance (#5598) 2026-02-09 15:55:18 -05:00
phonetic-transcription-v2-design.instructions.md feat: phonetic transcription v2 migration (#5640) 2026-02-10 16:29:26 -05:00
practice-exercises.instructions.md docs: add instruction docs for analytics, practice, activities, toolbar; adjust content-word scoring ratio (10:7) 2026-02-15 15:49:26 -05:00
profile.instructions.md fix: prioritize bot DM in updateBotOptions, handle DM outside _targetBotChats (#5698) 2026-02-14 14:47:05 -05:00
token-info-feedback-v2.instructions.md feat: phonetic transcription v2 migration (#5640) 2026-02-10 16:29:26 -05:00
toolbar-reading-assistance.instructions.md docs: add instruction docs for analytics, practice, activities, toolbar; adjust content-word scoring ratio (10:7) 2026-02-15 15:49:26 -05:00