This plugin provides Google Gemini LLM support for LiveKit Node Agents using the new unified @google/genai SDK.
npm install @livekit/agents-plugin-googleimport { LLM } from '@livekit/agents-plugin-google';
// Using Google AI Studio (API Key)
const llm = new LLM({
model: 'gemini-1.5-flash',
apiKey: 'your-api-key', // or set GOOGLE_API_KEY env var
});
// Using Vertex AI
const llm = new LLM({
model: 'gemini-1.5-pro',
vertexai: true,
project: 'your-project-id', // or set GOOGLE_CLOUD_PROJECT env var
location: 'us-central1', // or set GOOGLE_CLOUD_LOCATION env var
});To use the Gemini realtime model or TTS (Beta)
import * as google from '@livekit/agents-plugin-google';
const realtimeModel = new google.beta.realtime.RealtimeModel({
model: 'gemini-2.5-flash-native-audio-preview-12-2025',
})
const geminiTTS = new google.beta.TTS(),-
GOOGLE_API_KEYorGOOGLE_GENAI_API_KEY: Your Google AI Studio API key -
GOOGLE_GENAI_USE_VERTEXAI: Set totrueor1to enable Vertex AI -
GOOGLE_CLOUD_PROJECT: Your Google Cloud project ID (for Vertex AI) -
GOOGLE_CLOUD_LOCATION: Your preferred location (default:us-central1)
-
gemini-1.5-pro- Most capable model -
gemini-1.5-flash- Fast and efficient -
gemini-1.5-flash-8b- Ultra-fast lightweight model -
gemini-2.0-flash-exp- Latest experimental model - And more (see models.ts for full list)
-
gemini-3.1-flash-live-previewis supported as a realtime model, butgenerateReply()is not currently compatible with it. - This matters for
voice.AgentSessionflows that rely on programmatic reply generation, such as explicit post-tool continuation, greetings, reconnect replies, and other server-triggered follow-up turns. - If your voice-agent flow depends on
generateReply(), prefer a Gemini 2.5 native-audio live model for now.
-
thinkingConfigis model-specific. - Gemini 3.1 live models use
thinkingLevelsuch asminimal,low,medium, andhigh. - Gemini 2.5 live models use
thinkingBudget.
const llm = new LLM({
model: 'gemini-1.5-pro',
temperature: 0.7,
maxOutputTokens: 2048,
topP: 0.8,
topK: 40,
toolChoice: 'auto',
});Set your API key via environment variable or constructor option:
export GOOGLE_API_KEY=your-api-keyFor Vertex AI, ensure you have:
- Google Cloud CLI installed and authenticated
- Vertex AI API enabled in your project
- Proper authentication configured (Application Default Credentials)
gcloud auth application-default login
export GOOGLE_CLOUD_PROJECT=your-project-id
export GOOGLE_GENAI_USE_VERTEXAI=trueApache 2.0