stream-chat-android-ai-ondevice/io.getstream.chat.android.ai.ondevice

Package-level declarations

Types

data class AIConversationTurn(val role: AIConversationTurn.Role, val text: String)

One turn of a conversation, for a local model.

A language model on the device, for answering when your AI agent can't: the person is offline, or the agent reached its usage limit.

AIOnDeviceModel

class AIOnDeviceModel(context: Context, val maximumResponseTokens: Int = DEFAULT_RESPONSE_TOKENS) : AILocalModel, AutoCloseable

Gemini Nano, the model in Android's AICore, through ML Kit's GenAI Prompt API. It answers without a network connection, and the conversation never leaves the device.