fluffychat/lib/pangea
wcjord f6a048ca3e
feat: embed STT transcription in audio event content (#5731)
* feat: embed STT transcription in audio event content

Before sending the audio event, the client now fetches the STT
transcript first, then embeds it under 'user_stt' in the event
content. This mirrors the 'original_sent' pattern for text messages
and lets the bot read the transcript immediately without downloading
audio or calling choreo.

- Add ModelKey.userStt constant
- Rewrite onVoiceMessageSend to get transcript before sending audio
- Update getSpeechToTextLocal() to check userStt before botTranscription

* chore: replace inaccurate comment with TODO referencing #5730

* formatting

* fix pangea comments

* feat: make stt translations relate to pangea message events instead of stt representation events

* clean up pangea event types

---------

Co-authored-by: ggurdin <ggurdin@gmail.com>
2026-02-18 12:39:38 -05:00
..
activity_feedback Merge main into production (#4437) 2025-10-30 11:21:19 -04:00
activity_generator Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
activity_planner Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
activity_sessions chore: fix text overflow in ping participants button on small screen with large text in Spanish (#5734) 2026-02-18 09:33:54 -05:00
activity_suggestions Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
activity_summary Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
analytics_data feat: add language indicators to analytics database entries (#5692) 2026-02-13 15:06:21 -05:00
analytics_details_popup fix: always pass pos and morph when available on request TTS (#5716) 2026-02-16 16:00:28 -05:00
analytics_downloads feat: add language indicators to analytics database entries (#5692) 2026-02-13 15:06:21 -05:00
analytics_misc fix: always pass pos and morph when available on request TTS (#5716) 2026-02-16 16:00:28 -05:00
analytics_page chore: better link color for saved activities tooltip (#5647) 2026-02-10 15:20:51 -05:00
analytics_practice fix: clear last result on start new file search (#5739) 2026-02-18 10:43:06 -05:00
analytics_settings Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
analytics_summary feat: add language indicators to analytics database entries (#5692) 2026-02-13 15:06:21 -05:00
authentication Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
bot chore: prevent users from setting their l1 to their l2 2026-02-12 10:14:47 -05:00
chat feat: embed STT transcription in audio event content (#5731) 2026-02-18 12:39:38 -05:00
chat_list Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
chat_settings fix: add missing dependency (#5707) 2026-02-16 11:56:39 -05:00
choreographer chore: brighten igc underlines (#5736) 2026-02-18 09:45:34 -05:00
common feat: embed STT transcription in audio event content (#5731) 2026-02-18 12:39:38 -05:00
constructs feat: unified use-type-aware practice scoring (#5703) 2026-02-16 12:13:46 -05:00
course_chats fix: add guard to not update space hierarchy info if space ID changes while fetching (#5723) 2026-02-17 14:34:59 -05:00
course_creation Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
course_plans Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
course_settings Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
download Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
events feat: embed STT transcription in audio event content (#5731) 2026-02-18 12:39:38 -05:00
extensions Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
instructions chore: add course description tooltip to find a course page (#5628) 2026-02-10 12:02:07 -05:00
join_codes Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
languages Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
learning_settings chore: prevent users from setting their l1 to their l2 2026-02-12 10:14:47 -05:00
lemmas Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
login chore: autofocus email field in login with email page (#5733) 2026-02-18 09:28:37 -05:00
morphs chore: add ttl to morph cache and new parts of speech to default morph mapping (#5629) 2026-02-10 12:16:40 -05:00
navigation Merge main into prod (#5167) 2026-01-12 09:59:12 -05:00
payload_client Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
phonetic_transcription 5702 audio practice tweaks (#5724) 2026-02-18 09:52:15 -05:00
practice_activities feat: unified use-type-aware practice scoring (#5703) 2026-02-16 12:13:46 -05:00
space_analytics Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
spaces Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
speech_to_text Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
subscription fix: prevent subscription management launch from being blocked, show snackbar with button to try launch again (#5685) 2026-02-12 15:58:07 -05:00
text_to_speech feat: phonetic transcription v2 migration (#5640) 2026-02-10 16:29:26 -05:00
token_info_feedback chore: on token feedback response, replace all tokens when available (#5715) 2026-02-16 15:37:35 -05:00
toolbar feat: embed STT transcription in audio event content (#5731) 2026-02-18 12:39:38 -05:00
translation Fluffychat merge 2 (#5590) 2026-02-10 08:01:12 -05:00
user feat: add language indicators to analytics database entries (#5692) 2026-02-13 15:06:21 -05:00