Docs
Docs

Generating

You can generate responses using MLC models with the Vercel AI SDK's generateText or streamText functions.

Requirements

  • Models must be downloaded and prepared before use
  • Sufficient device storage for model files (1-4GB per model)

Text Generation

import { mlc } from '@react-native-ai/mlc';
import { generateText } from 'ai';

// Create and prepare model
const model = mlc.languageModel('Llama-3.2-3B-Instruct');
await model.prepare();

const result = await generateText({
  model,
  prompt: 'Explain quantum computing in simple terms'
});

console.log(result.text);

Streaming

Stream responses for real-time output:

import { mlc } from '@react-native-ai/mlc';
import { streamText } from 'ai';

// Create and prepare model
const model = mlc.languageModel('Llama-3.2-3B-Instruct');
await model.prepare();

const { textStream } = await streamText({
  model,
  prompt: 'Write a short story about a robot learning to paint'
});

for await (const delta of textStream) {
  console.log(delta);
}

Available Options

Configure model behavior with generation options:

  • temperature (0-1): Controls randomness. Higher values = more creative, lower = more focused
  • maxTokens: Maximum number of tokens to generate
  • topP (0-1): Nucleus sampling threshold
  • topK: Top-K sampling parameter

You can pass selected options with either generateText or streamText as follows:

import { mlc } from '@react-native-ai/mlc';
import { generateText } from 'ai';

// Create and prepare model
const model = mlc.languageModel('Llama-3.2-3B-Instruct');
await model.prepare();

const result = await generateText({
  model,
  prompt: 'Write a creative story',
  temperature: 0.8,
  maxTokens: 500,
  topP: 0.9,
});
Need to boost your app's performance?
We help React Native teams enhance speed, responsiveness, and efficiency.