Supabase Edge Functions now support AI inference with the ability to run AI models, generate embeddings using models like 'gte-small', and use Large Language Models like 'llama2' and 'mistral' for GenAI workloads. The release introduces improvements to remove cold starts using Ort and adds LLM support using Ollama.
Table of contents
Generating Text Embeddings in Edge Functions #Large Language Models in Supabase Edge Functions #Extending model support #Getting started #18 Impressions