Blog posts tagged "LLMs"

Realtime transaction fraud detection – with an LLM?

Realtime transaction fraud detection – with an LLM?

Conversational AI with a chatbot is great for drafting emails or debugging code,  but it’s less ideal for real-time application middleware. If you’re trying...

AI
Understanding disaggregated GenAI model serving with llm-d

Understanding disaggregated GenAI model serving with llm-d

What is llm-d? llm-d is an open source solution for managing high-scale, high-performance Large Language Model (LLM) deployments. LLMs are at the heart of...

AI
Why we brought hardware-optimized GenAI inference to Ubuntu

Why we brought hardware-optimized GenAI inference to Ubuntu 

On October 23rd, we announced the beta availability of silicon-optimized AI models in Ubuntu. Developers can locally install DeepSeek R1 and Qwen 2.5 VL with...

AI