Introduction: GenAI Product Designs

Now You Build the Products

Modules 4 and 5 introduced inference costs, serving optimizations, model adaptation, evaluation, and retrieval from your own data.

Now it is time to use that toolkit.

This module covers four common GenAI products: a ChatGPT-style assistant, a code assistant, AI-powered search, and a text-to-image service.

Four Products, Four Extremes

Each product highlights a different system design problem.

The assistant manages conversation history outside the model. Each inference call needs the relevant history or a reference to state managed by the service.