Ml Kit Genai Prompt API

This skill provides step-by-step guidance for integrating and optimizing the ML Kit GenAI Prompt API in Android apps.

Prerequisites

• Android API level must be 26 or higher. If minSdk is below 26, update it to 26.
• Add the ML Kit GenAI Prompt API dependency (com.google.mlkit:genai-prompt) to the app-level build.gradle file, with version at least 1.0.0-beta4.
• If com.google.mlkit:genai-schema-compiler dependency is used and KSP plugin version is below 2.3.6, update it to 2.3.6.

Detailed steps

1. Prompt optimization

To optimize prompts for use with the ML Kit Prompt API, follow the prompt optimization guide.

2. Prefix caching optimization

If the prompt is more than 200 words, implement the prefix caching API.

3. Lifecycle and best practices

• The model must be fully downloaded and available before calling the first inference. Follow the guide on implementing a generative model to check that the FeatureStatus of a model is AVAILABLE before making an inference.

• Release ML Kit instances by calling close() when an Activity, Fragment, or ViewModel is destroyed. Example:

  // Instantiating model in activity, fragment, or ViewModel
      val generativeModel = Generation.getClient()
  
  // When activity, fragment, or ViewModel is destroyed
      generativeModel.close()
  

  <br />

4. Structured output

When implementing or refactoring a prompt to use structured output, follow these rules: