mirror of
https://github.com/memohai/Memoh.git
synced 2026-04-27 07:16:19 +09:00
7d7d0e4b51
* refactor: introduce multi-session chat support (#session)
Replace the single-context-per-bot model with multiple chat sessions.
Database:
- Add bot_sessions table (route_id, channel_type, title, metadata, soft delete)
- Migrate bot_history_messages from (route_id, channel_type) to session_id
- Add active_session_id to bot_channel_routes
- Migration 0036 handles data migration from existing messages
Backend:
- New internal/session service for session CRUD
- Update message service/types to use session_id instead of route_id
- Update conversation flow (resolver, history, store) for session context
- Channel inbound auto-creates/retrieves active session via SessionEnsurer
- New REST endpoints: /bots/:bot_id/sessions (CRUD)
- WebSocket and message handlers accept optional session_id
- Wire session service into FX dependency graph (agent + memoh)
Frontend:
- Refactor chat store: sessions replaces chats, sessionId replaces chatId
- Session-aware message loading, sending, and pagination
- WebSocket sends include session_id
- New session sidebar component with select/delete
- Chat area header shows active session title + new session button
- API layer updated: fetchSessions, createSession, deleteSession
- i18n strings for session management (en + zh)
SDK:
- Regenerated TypeScript SDK and Swagger docs with session endpoints
* fix: update tests for session refactoring (RouteID → SessionID)
Remove references to removed RouteID and Platform fields from
PersistInput/Message in channel_test.go and service_integration_test.go.
* fix: restore accidentally deleted SDK files and guard migration 0032
- Restore packages/sdk/src/container-stream.ts and extra/index.ts that
were accidentally removed during SDK regeneration
- Wrap migration 0032 route_id index creation in a column existence check
to avoid failure on fresh databases where 0001_init.up.sql no longer
has route_id
* fix: guard migration 0036 data steps for fresh databases
Wrap steps 3-7 (which reference route_id/channel_type on
bot_history_messages) in a column existence check so the migration
is safe on fresh databases where 0001_init.up.sql already reflects
the final schema without those columns.
* feat: add title model setting and auto-generate session titles on user input
- Add title_model_id to bots table (migration 0037) and bot settings API
- Implement async title generation triggered at user message time (not after
assistant response) for faster title availability
- Publish session_title_updated events via SSE event hub for real-time
frontend updates without page refresh
- Fix SSE message event parsing: use direct JSON.parse instead of
normalizeStreamEvent which silently dropped non-chat-stream event types
- Add title model selector in bot settings UI with i18n support
* fix: session-scoped message filtering and URL-based chat routing
- Filter realtime SSE messages by session_id to prevent cross-session
message leakage after page refresh
- Add /chat/:sessionId? route with bidirectional URL ↔ store sync
- Visiting /chat shows a clean state with no bot or session pre-selected
- Visiting /chat/:sessionId loads the specific session directly
- Session switches from sidebar automatically update the URL
- Fix stale RouteID field in dedupe test (removed during session refactor)
* fix: skip cross-channel stream events to prevent session leakage
The bot-level web stream pushes events from all channels (Telegram,
Discord, etc.) without session_id context. Previously these were
rendered inline in the current chat view regardless of session.
Now cross-channel events are ignored in handleLocalStreamEvent;
persisted messages arrive via the SSE message events stream with
proper session_id filtering through appendRealtimeMessage.
* feat: show IM avatars and platform badges on session sidebar
- Add sender_avatar_url to route metadata from identity resolution
- Resolve group avatar and handle via directory adapter for group chats
- JOIN bot_channel_routes in ListSessionsByBot to return route metadata
- Display avatar with ChannelBadge on IM session items (group avatar
for groups, sender avatar for private chats)
- Show @groupname or @username as session sub-label
* fix: clean up RunConfig unused fields, fix skill system and copy bug
- Remove unused RunConfig fields: Tools, Channels, CurrentChannel,
ActiveContextTime
- Remove unused SessionContext fields: DisplayName, ConversationType
- Fix EnabledSkillNames copy bug: make([]string, 0, n) + copy copies
zero elements; changed to make([]string, n)
- Fix prepareRunConfig dead code: remove no-op loop over
CurrentPlatform runes; compute supportsImageInput from model's
InputModalities
- Fix EnabledSkills always nil in system prompt: resolve enabled skill
entries from EnabledSkillNames + Skills
- Fix use_skill tool returning empty response: now returns full skill
content (description + instructions) so LLM gets it in the same turn
- Skip use_skill tool registration when no skills are available
- Conditionally render Skills section in system prompt (hidden when
no skills exist)
* feat: add session type field and bind sessions to heartbeat/schedule executions
- Add `type` column to `bot_sessions` (chat | heartbeat | schedule)
- Add `session_id` to `bot_heartbeat_logs` for per-execution session tracking
- Create `schedule_logs` table binding schedule_id + session_id
- Heartbeat and schedule runs now create independent sessions and persist
agent messages via storeRound, enabling full conversation replay
- Add schedule logs API endpoints (list by bot, list by schedule, delete)
- Update Triggerer interfaces to return TriggerResult with status/usage/model
* refactor: modular system prompts per session type (chat/heartbeat/schedule)
Split the monolithic system.md into three type-specific system prompts
with shared fragments via {{include:_xxx}} syntax, so each session type
gets a focused prompt without irrelevant instructions.
* fix: prevent message duplication after task completion
message_created events from Persist() had an empty platform field because
toMessageFromCreate() didn't extract it from the session. This caused
appendRealtimeMessage to fail the platform === 'web' guard, and
hasMessageWithId to fail because local IDs differ from server UUIDs,
resulting in all messages being appended as duplicates.
- Extract platform from metadata in toMessageFromCreate so published events
carry the correct value
- Pass channel_type: 'web' when creating sessions from the web frontend so
List queries return the correct platform via the session JOIN
* fix: use per-message usage from SDK instead of misaligned step-level usages
Previously, token usage was stored via a separate per-step usages array
that didn't align with messages (off-by-one from prepending user message,
step count != message count). This caused:
- User messages incorrectly receiving usage data
- Usage values shifted across messages in multi-step rounds
- Last assistant message getting the accumulated total instead of its own step usage
- InputTokenDetails/OutputTokenDetails lost during manual accumulation
Now each sdk.Message carries its own per-step Usage (set by the SDK in
buildStepMessages), which is extracted in sdkMessagesToModelMessages and
stored directly via ModelMessage.Usage. The storeRound/storeMessages path
no longer needs external usage/usages parameters.
Also fixes the totalUsage accumulation in runStream to include all detail
fields (InputTokenDetails, OutputTokenDetails).
* feat: add /new slash command to create a new active session from IM channels
Users in Telegram/Discord/Feishu can now send /new to start a fresh
conversation, resetting the session context for the current chat thread.
The command resolves the channel route, creates a new session, sets it as
the active session on the route, and replies with a confirmation message.
* feat: distinguish heartbeat and schedule sessions with dedicated icons in sidebar
Heartbeat sessions show a heart-pulse icon (rose), schedule sessions
show a clock icon (amber), and both display a type label beneath the
session title.
* refactor: remove enabledSkills system prompt injection, keep sorted skill listing
use_skill now returns skill content directly as tool output, so there is
no need to inject enabled skill body text into the system prompt. Remove
the entire enabledSkills tracking chain (RunConfig.EnabledSkillNames,
StreamEvent.Skills, GenerateResult.Skills, ChatRequest/Response.Skills,
enableSkill closures in runStream/runGenerate, prepareRunConfig matching).
Keep a lightweight skills listing (name + description only) in the system
prompt so the model knows which skills are available. Sort entries by name
to guarantee deterministic ordering and maximize KV cache reuse.
* refactor: remove inbox system, persist passive messages directly to history
Replace the bot_inbox table and service with direct writes to
bot_history_messages for group conversations where the bot is not
@mentioned. Trigger-path messages continue to be persisted after the
agent responds (unchanged).
- Drop bot_inbox table and max_inbox_items column (migration 0039)
- Delete internal/inbox/, handlers/inbox.go, command/inbox.go,
agent/tools/inbox.go and the MCP message provider
- Add persistPassiveMessage() in channel inbound to write user
messages into the active session immediately
- Rewrite ListObservedConversationsByChannelIdentity to query
bot_history_messages + bot_sessions instead of bot_inbox
- Extract shared send/react logic into internal/messaging/executor.go;
agent/tools/message.go is now a thin SDK adapter
- Clean up all inbox references from agent prompts, flow resolver,
email trigger, settings, commands, DI wiring, and frontend
- Regenerate sqlc, swagger, and SDK
* feat: add list_sessions and search_messages agent tools
Provide agents with the ability to query session metadata and search
message history across all sessions. search_messages supports filtering
by time range, keyword (JSONB-aware ILIKE), session, contact, and role,
with a default 7-day lookback when no start_time is given.
* feat: inject last_heartbeat time and improve heartbeat search guidance
Query the previous heartbeat's started_at timestamp and pass it through
TriggerPayload into the heartbeat prompt template. Update system prompt
and HEARTBEAT.md checklist to guide agents to use search_messages with
start_time=last_heartbeat for efficient cross-session message review.
* fix: pass BridgeProvider to FSClient and store full heartbeat prompt
FSClient was always created with nil provider, causing all container
file reads (IDENTITY.md, SOUL.md, MEMORY.md, HEARTBEAT.md, etc.) to
silently return empty strings. Expose Agent.BridgeProvider() and wire
it into Resolver. Also fix heartbeat trigger to store the full prompt
template as the user message instead of the literal "heartbeat" string.
* feat: add line numbers to container file read output
Move line-number formatting from the bridge gRPC server to the agent
tool layer so that the raw content stored and transmitted via gRPC
remains clean, while the read_file tool output includes numbered lines
for easier reference by the agent.
* chore(deps): update twilight-ai to v0.3.2
* fix: lint, test
854 lines
22 KiB
Go
854 lines
22 KiB
Go
package message
|
|
|
|
import (
|
|
"context"
|
|
"encoding/json"
|
|
"fmt"
|
|
"log/slog"
|
|
"math"
|
|
"strings"
|
|
"time"
|
|
|
|
"github.com/jackc/pgx/v5/pgtype"
|
|
|
|
dbpkg "github.com/memohai/memoh/internal/db"
|
|
"github.com/memohai/memoh/internal/db/sqlc"
|
|
"github.com/memohai/memoh/internal/message/event"
|
|
)
|
|
|
|
// DBService persists and reads bot history messages.
|
|
type DBService struct {
|
|
queries *sqlc.Queries
|
|
logger *slog.Logger
|
|
publisher event.Publisher
|
|
}
|
|
|
|
// NewService creates a message service.
|
|
func NewService(log *slog.Logger, queries *sqlc.Queries, publishers ...event.Publisher) *DBService {
|
|
if log == nil {
|
|
log = slog.Default()
|
|
}
|
|
var publisher event.Publisher
|
|
if len(publishers) > 0 {
|
|
publisher = publishers[0]
|
|
}
|
|
return &DBService{
|
|
queries: queries,
|
|
logger: log.With(slog.String("service", "message")),
|
|
publisher: publisher,
|
|
}
|
|
}
|
|
|
|
// Persist writes a single message to bot_history_messages.
|
|
func (s *DBService) Persist(ctx context.Context, input PersistInput) (Message, error) {
|
|
pgBotID, err := dbpkg.ParseUUID(input.BotID)
|
|
if err != nil {
|
|
return Message{}, fmt.Errorf("invalid bot id: %w", err)
|
|
}
|
|
|
|
pgSessionID, err := parseOptionalUUID(input.SessionID)
|
|
if err != nil {
|
|
return Message{}, fmt.Errorf("invalid session id: %w", err)
|
|
}
|
|
pgSenderChannelIdentityID, err := parseOptionalUUID(input.SenderChannelIdentityID)
|
|
if err != nil {
|
|
return Message{}, fmt.Errorf("invalid sender channel identity id: %w", err)
|
|
}
|
|
pgSenderUserID, err := parseOptionalUUID(input.SenderUserID)
|
|
if err != nil {
|
|
return Message{}, fmt.Errorf("invalid sender user id: %w", err)
|
|
}
|
|
pgModelID, err := parseOptionalUUID(input.ModelID)
|
|
if err != nil {
|
|
return Message{}, fmt.Errorf("invalid model id: %w", err)
|
|
}
|
|
|
|
metaBytes, err := json.Marshal(nonNilMap(input.Metadata))
|
|
if err != nil {
|
|
return Message{}, fmt.Errorf("marshal message metadata: %w", err)
|
|
}
|
|
|
|
content := input.Content
|
|
if len(content) == 0 {
|
|
content = []byte("{}")
|
|
}
|
|
|
|
row, err := s.queries.CreateMessage(ctx, sqlc.CreateMessageParams{
|
|
BotID: pgBotID,
|
|
SessionID: pgSessionID,
|
|
SenderChannelIdentityID: pgSenderChannelIdentityID,
|
|
SenderUserID: pgSenderUserID,
|
|
ExternalMessageID: toPgText(input.ExternalMessageID),
|
|
SourceReplyToMessageID: toPgText(input.SourceReplyToMessageID),
|
|
Role: input.Role,
|
|
Content: content,
|
|
Metadata: metaBytes,
|
|
Usage: input.Usage,
|
|
ModelID: pgModelID,
|
|
})
|
|
if err != nil {
|
|
return Message{}, err
|
|
}
|
|
|
|
result := toMessageFromCreate(row)
|
|
|
|
for _, ref := range input.Assets {
|
|
pgMsgID := row.ID
|
|
role := ref.Role
|
|
if strings.TrimSpace(role) == "" {
|
|
role = "attachment"
|
|
}
|
|
contentHash := strings.TrimSpace(ref.ContentHash)
|
|
if contentHash == "" {
|
|
s.logger.Warn("skip asset ref without content_hash")
|
|
continue
|
|
}
|
|
if ref.Ordinal < math.MinInt32 || ref.Ordinal > math.MaxInt32 {
|
|
return Message{}, fmt.Errorf("asset ordinal out of range: %d", ref.Ordinal)
|
|
}
|
|
if _, assetErr := s.queries.CreateMessageAsset(ctx, sqlc.CreateMessageAssetParams{
|
|
MessageID: pgMsgID,
|
|
Role: role,
|
|
Ordinal: int32(ref.Ordinal),
|
|
ContentHash: contentHash,
|
|
Name: ref.Name,
|
|
Metadata: marshalMetadata(ref.Metadata),
|
|
}); assetErr != nil {
|
|
s.logger.Warn("create message asset link failed", slog.String("message_id", result.ID), slog.Any("error", assetErr))
|
|
}
|
|
}
|
|
|
|
if len(input.Assets) > 0 {
|
|
assets := make([]MessageAsset, 0, len(input.Assets))
|
|
for _, ref := range input.Assets {
|
|
ch := strings.TrimSpace(ref.ContentHash)
|
|
if ch == "" {
|
|
continue
|
|
}
|
|
assets = append(assets, MessageAsset{
|
|
ContentHash: ch,
|
|
Role: coalesce(ref.Role, "attachment"),
|
|
Ordinal: ref.Ordinal,
|
|
Mime: ref.Mime,
|
|
SizeBytes: ref.SizeBytes,
|
|
StorageKey: ref.StorageKey,
|
|
Name: ref.Name,
|
|
Metadata: ref.Metadata,
|
|
})
|
|
}
|
|
result.Assets = assets
|
|
}
|
|
|
|
s.publishMessageCreated(result)
|
|
return result, nil
|
|
}
|
|
|
|
// List returns all messages for a bot.
|
|
func (s *DBService) List(ctx context.Context, botID string) ([]Message, error) {
|
|
pgBotID, err := dbpkg.ParseUUID(botID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessages(ctx, pgBotID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromList(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListSince returns bot messages since a given time.
|
|
func (s *DBService) ListSince(ctx context.Context, botID string, since time.Time) ([]Message, error) {
|
|
pgBotID, err := dbpkg.ParseUUID(botID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessagesSince(ctx, sqlc.ListMessagesSinceParams{
|
|
BotID: pgBotID,
|
|
CreatedAt: pgtype.Timestamptz{Time: since, Valid: true},
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromSince(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListActiveSince returns bot messages since a given time, excluding passive_sync messages.
|
|
func (s *DBService) ListActiveSince(ctx context.Context, botID string, since time.Time) ([]Message, error) {
|
|
pgBotID, err := dbpkg.ParseUUID(botID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListActiveMessagesSince(ctx, sqlc.ListActiveMessagesSinceParams{
|
|
BotID: pgBotID,
|
|
CreatedAt: pgtype.Timestamptz{Time: since, Valid: true},
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromActiveSince(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListLatest returns the latest N bot messages (newest first in DB; caller may reverse for ASC).
|
|
func (s *DBService) ListLatest(ctx context.Context, botID string, limit int32) ([]Message, error) {
|
|
pgBotID, err := dbpkg.ParseUUID(botID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessagesLatest(ctx, sqlc.ListMessagesLatestParams{
|
|
BotID: pgBotID,
|
|
MaxCount: limit,
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromLatest(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListBefore returns up to limit messages older than before (created_at < before), ordered oldest-first.
|
|
func (s *DBService) ListBefore(ctx context.Context, botID string, before time.Time, limit int32) ([]Message, error) {
|
|
pgBotID, err := dbpkg.ParseUUID(botID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessagesBefore(ctx, sqlc.ListMessagesBeforeParams{
|
|
BotID: pgBotID,
|
|
CreatedAt: pgtype.Timestamptz{Time: before, Valid: true},
|
|
MaxCount: limit,
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromBefore(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// --- Session-scoped queries ---
|
|
|
|
// ListBySession returns all messages for a session.
|
|
func (s *DBService) ListBySession(ctx context.Context, sessionID string) ([]Message, error) {
|
|
pgSessionID, err := dbpkg.ParseUUID(sessionID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessagesBySession(ctx, pgSessionID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromSessionList(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListSinceBySession returns session messages since a given time.
|
|
func (s *DBService) ListSinceBySession(ctx context.Context, sessionID string, since time.Time) ([]Message, error) {
|
|
pgSessionID, err := dbpkg.ParseUUID(sessionID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessagesSinceBySession(ctx, sqlc.ListMessagesSinceBySessionParams{
|
|
SessionID: pgSessionID,
|
|
CreatedAt: pgtype.Timestamptz{Time: since, Valid: true},
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromSinceBySession(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListActiveSinceBySession returns session messages since a given time, excluding passive_sync messages.
|
|
func (s *DBService) ListActiveSinceBySession(ctx context.Context, sessionID string, since time.Time) ([]Message, error) {
|
|
pgSessionID, err := dbpkg.ParseUUID(sessionID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListActiveMessagesSinceBySession(ctx, sqlc.ListActiveMessagesSinceBySessionParams{
|
|
SessionID: pgSessionID,
|
|
CreatedAt: pgtype.Timestamptz{Time: since, Valid: true},
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromActiveSinceBySession(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListLatestBySession returns the latest N session messages.
|
|
func (s *DBService) ListLatestBySession(ctx context.Context, sessionID string, limit int32) ([]Message, error) {
|
|
pgSessionID, err := dbpkg.ParseUUID(sessionID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessagesLatestBySession(ctx, sqlc.ListMessagesLatestBySessionParams{
|
|
SessionID: pgSessionID,
|
|
MaxCount: limit,
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromLatestBySession(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// ListBeforeBySession returns up to limit session messages older than before.
|
|
func (s *DBService) ListBeforeBySession(ctx context.Context, sessionID string, before time.Time, limit int32) ([]Message, error) {
|
|
pgSessionID, err := dbpkg.ParseUUID(sessionID)
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
rows, err := s.queries.ListMessagesBeforeBySession(ctx, sqlc.ListMessagesBeforeBySessionParams{
|
|
SessionID: pgSessionID,
|
|
CreatedAt: pgtype.Timestamptz{Time: before, Valid: true},
|
|
MaxCount: limit,
|
|
})
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
msgs := toMessagesFromBeforeBySession(rows)
|
|
s.enrichAssets(ctx, msgs)
|
|
return msgs, nil
|
|
}
|
|
|
|
// LinkAssets links asset refs to an existing persisted message.
|
|
func (s *DBService) LinkAssets(ctx context.Context, messageID string, assets []AssetRef) error {
|
|
pgMsgID, err := dbpkg.ParseUUID(messageID)
|
|
if err != nil {
|
|
return fmt.Errorf("invalid message id: %w", err)
|
|
}
|
|
for _, ref := range assets {
|
|
contentHash := strings.TrimSpace(ref.ContentHash)
|
|
if contentHash == "" {
|
|
continue
|
|
}
|
|
role := ref.Role
|
|
if strings.TrimSpace(role) == "" {
|
|
role = "attachment"
|
|
}
|
|
if ref.Ordinal < math.MinInt32 || ref.Ordinal > math.MaxInt32 {
|
|
return fmt.Errorf("asset ordinal out of range: %d", ref.Ordinal)
|
|
}
|
|
if _, assetErr := s.queries.CreateMessageAsset(ctx, sqlc.CreateMessageAssetParams{
|
|
MessageID: pgMsgID,
|
|
Role: role,
|
|
Ordinal: int32(ref.Ordinal),
|
|
ContentHash: contentHash,
|
|
Name: ref.Name,
|
|
Metadata: marshalMetadata(ref.Metadata),
|
|
}); assetErr != nil {
|
|
s.logger.Warn("link asset failed", slog.String("message_id", messageID), slog.Any("error", assetErr))
|
|
}
|
|
}
|
|
return nil
|
|
}
|
|
|
|
// DeleteByBot deletes all messages for a bot.
|
|
func (s *DBService) DeleteByBot(ctx context.Context, botID string) error {
|
|
pgBotID, err := dbpkg.ParseUUID(botID)
|
|
if err != nil {
|
|
return err
|
|
}
|
|
return s.queries.DeleteMessagesByBot(ctx, pgBotID)
|
|
}
|
|
|
|
// DeleteBySession deletes all messages for a session.
|
|
func (s *DBService) DeleteBySession(ctx context.Context, sessionID string) error {
|
|
pgSessionID, err := dbpkg.ParseUUID(sessionID)
|
|
if err != nil {
|
|
return err
|
|
}
|
|
return s.queries.DeleteMessagesBySession(ctx, pgSessionID)
|
|
}
|
|
|
|
// --- Conversion helpers ---
|
|
|
|
func toMessageFromCreate(row sqlc.CreateMessageRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
pgtype.Text{},
|
|
pgtype.Text{},
|
|
extractPlatformFromMetadata(row.Metadata),
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func extractPlatformFromMetadata(metadata []byte) pgtype.Text {
|
|
m := parseJSONMap(metadata)
|
|
if v, ok := m["platform"].(string); ok && strings.TrimSpace(v) != "" {
|
|
return pgtype.Text{String: strings.TrimSpace(v), Valid: true}
|
|
}
|
|
return pgtype.Text{}
|
|
}
|
|
|
|
func toMessageFromListRow(row sqlc.ListMessagesRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromSessionListRow(row sqlc.ListMessagesBySessionRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromSinceRow(row sqlc.ListMessagesSinceRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromSinceBySessionRow(row sqlc.ListMessagesSinceBySessionRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromActiveSinceRow(row sqlc.ListActiveMessagesSinceRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromActiveSinceBySessionRow(row sqlc.ListActiveMessagesSinceBySessionRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromLatestRow(row sqlc.ListMessagesLatestRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromLatestBySessionRow(row sqlc.ListMessagesLatestBySessionRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromBeforeRow(row sqlc.ListMessagesBeforeRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFromBeforeBySessionRow(row sqlc.ListMessagesBeforeBySessionRow) Message {
|
|
return toMessageFields(
|
|
row.ID,
|
|
row.BotID,
|
|
row.SessionID,
|
|
row.SenderChannelIdentityID,
|
|
row.SenderUserID,
|
|
row.SenderDisplayName,
|
|
row.SenderAvatarUrl,
|
|
row.Platform,
|
|
row.ExternalMessageID,
|
|
row.SourceReplyToMessageID,
|
|
row.Role,
|
|
row.Content,
|
|
row.Metadata,
|
|
row.Usage,
|
|
row.CreatedAt,
|
|
)
|
|
}
|
|
|
|
func toMessageFields(
|
|
id pgtype.UUID,
|
|
botID pgtype.UUID,
|
|
sessionID pgtype.UUID,
|
|
senderChannelIdentityID pgtype.UUID,
|
|
senderUserID pgtype.UUID,
|
|
senderDisplayName pgtype.Text,
|
|
senderAvatarURL pgtype.Text,
|
|
platform pgtype.Text,
|
|
externalMessageID pgtype.Text,
|
|
sourceReplyToMessageID pgtype.Text,
|
|
role string,
|
|
content []byte,
|
|
metadata []byte,
|
|
usage []byte,
|
|
createdAt pgtype.Timestamptz,
|
|
) Message {
|
|
return Message{
|
|
ID: id.String(),
|
|
BotID: botID.String(),
|
|
SessionID: sessionID.String(),
|
|
SenderChannelIdentityID: senderChannelIdentityID.String(),
|
|
SenderUserID: senderUserID.String(),
|
|
SenderDisplayName: dbpkg.TextToString(senderDisplayName),
|
|
SenderAvatarURL: dbpkg.TextToString(senderAvatarURL),
|
|
Platform: dbpkg.TextToString(platform),
|
|
ExternalMessageID: dbpkg.TextToString(externalMessageID),
|
|
SourceReplyToMessageID: dbpkg.TextToString(sourceReplyToMessageID),
|
|
Role: role,
|
|
Content: json.RawMessage(content),
|
|
Metadata: parseJSONMap(metadata),
|
|
Usage: json.RawMessage(usage),
|
|
CreatedAt: createdAt.Time,
|
|
}
|
|
}
|
|
|
|
func toMessagesFromList(rows []sqlc.ListMessagesRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromListRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromSessionList(rows []sqlc.ListMessagesBySessionRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromSessionListRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromSince(rows []sqlc.ListMessagesSinceRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromSinceRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromSinceBySession(rows []sqlc.ListMessagesSinceBySessionRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromSinceBySessionRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromActiveSince(rows []sqlc.ListActiveMessagesSinceRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromActiveSinceRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromActiveSinceBySession(rows []sqlc.ListActiveMessagesSinceBySessionRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromActiveSinceBySessionRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromLatest(rows []sqlc.ListMessagesLatestRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromLatestRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromLatestBySession(rows []sqlc.ListMessagesLatestBySessionRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for _, row := range rows {
|
|
messages = append(messages, toMessageFromLatestBySessionRow(row))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
// toMessagesFromBefore returns messages in oldest-first order (ListMessagesBefore returns DESC; we reverse).
|
|
func toMessagesFromBefore(rows []sqlc.ListMessagesBeforeRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for i := len(rows) - 1; i >= 0; i-- {
|
|
messages = append(messages, toMessageFromBeforeRow(rows[i]))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func toMessagesFromBeforeBySession(rows []sqlc.ListMessagesBeforeBySessionRow) []Message {
|
|
messages := make([]Message, 0, len(rows))
|
|
for i := len(rows) - 1; i >= 0; i-- {
|
|
messages = append(messages, toMessageFromBeforeBySessionRow(rows[i]))
|
|
}
|
|
return messages
|
|
}
|
|
|
|
func parseOptionalUUID(id string) (pgtype.UUID, error) {
|
|
if strings.TrimSpace(id) == "" {
|
|
return pgtype.UUID{}, nil
|
|
}
|
|
return dbpkg.ParseUUID(id)
|
|
}
|
|
|
|
func toPgText(value string) pgtype.Text {
|
|
value = strings.TrimSpace(value)
|
|
if value == "" {
|
|
return pgtype.Text{}
|
|
}
|
|
return pgtype.Text{String: value, Valid: true}
|
|
}
|
|
|
|
func nonNilMap(m map[string]any) map[string]any {
|
|
if m == nil {
|
|
return map[string]any{}
|
|
}
|
|
return m
|
|
}
|
|
|
|
func coalesce(values ...string) string {
|
|
for _, v := range values {
|
|
if strings.TrimSpace(v) != "" {
|
|
return v
|
|
}
|
|
}
|
|
return ""
|
|
}
|
|
|
|
func parseJSONMap(data []byte) map[string]any {
|
|
if len(data) == 0 {
|
|
return nil
|
|
}
|
|
var m map[string]any
|
|
_ = json.Unmarshal(data, &m)
|
|
return m
|
|
}
|
|
|
|
func (s *DBService) publishMessageCreated(message Message) {
|
|
if s.publisher == nil {
|
|
return
|
|
}
|
|
payload, err := json.Marshal(message)
|
|
if err != nil {
|
|
if s.logger != nil {
|
|
s.logger.Warn("marshal message event failed", slog.Any("error", err))
|
|
}
|
|
return
|
|
}
|
|
s.publisher.Publish(event.Event{
|
|
Type: event.EventTypeMessageCreated,
|
|
BotID: strings.TrimSpace(message.BotID),
|
|
Data: payload,
|
|
})
|
|
}
|
|
|
|
// enrichAssets batch-loads asset links for a list of messages (single-table query).
|
|
func (s *DBService) enrichAssets(ctx context.Context, messages []Message) {
|
|
if len(messages) == 0 {
|
|
return
|
|
}
|
|
ids := make([]pgtype.UUID, 0, len(messages))
|
|
for _, m := range messages {
|
|
pgID, err := dbpkg.ParseUUID(m.ID)
|
|
if err != nil {
|
|
continue
|
|
}
|
|
ids = append(ids, pgID)
|
|
}
|
|
if len(ids) == 0 {
|
|
return
|
|
}
|
|
rows, err := s.queries.ListMessageAssetsBatch(ctx, ids)
|
|
if err != nil {
|
|
s.logger.Warn("enrich assets failed, returning messages without assets", slog.Any("error", err))
|
|
ensureAssetsSlice(messages)
|
|
return
|
|
}
|
|
assetMap := map[string][]MessageAsset{}
|
|
for _, row := range rows {
|
|
msgID := row.MessageID.String()
|
|
contentHash := strings.TrimSpace(row.ContentHash)
|
|
if contentHash == "" {
|
|
continue
|
|
}
|
|
assetMap[msgID] = append(assetMap[msgID], MessageAsset{
|
|
ContentHash: contentHash,
|
|
Role: row.Role,
|
|
Ordinal: int(row.Ordinal),
|
|
Name: row.Name,
|
|
Metadata: unmarshalMetadata(row.Metadata),
|
|
})
|
|
}
|
|
for i := range messages {
|
|
if assets, ok := assetMap[messages[i].ID]; ok {
|
|
messages[i].Assets = assets
|
|
} else {
|
|
messages[i].Assets = []MessageAsset{}
|
|
}
|
|
}
|
|
}
|
|
|
|
func ensureAssetsSlice(messages []Message) {
|
|
for i := range messages {
|
|
if messages[i].Assets == nil {
|
|
messages[i].Assets = []MessageAsset{}
|
|
}
|
|
}
|
|
}
|
|
|
|
func marshalMetadata(m map[string]any) []byte {
|
|
if len(m) == 0 {
|
|
return []byte("{}")
|
|
}
|
|
b, err := json.Marshal(m)
|
|
if err != nil {
|
|
return []byte("{}")
|
|
}
|
|
return b
|
|
}
|
|
|
|
func unmarshalMetadata(b []byte) map[string]any {
|
|
if len(b) == 0 {
|
|
return nil
|
|
}
|
|
var m map[string]any
|
|
if err := json.Unmarshal(b, &m); err != nil || len(m) == 0 {
|
|
return nil
|
|
}
|
|
return m
|
|
}
|