Building AI Features in ASP.NET Core Using Small Language Models Instead of Large LLMs

Microsoft's introduction of Small Language Models (SLMs) as an alternative to Large Language Models (LLMs) in ASP.NET Core marks a significant shift in AI feature development, highlighting the benefits of lower costs, faster responses, and better privacy. This development means that website owners using ASP.NET Core can now leverage SLMs to build AI-powered features without incurring the high costs associated with LLMs, while also improving response times and protecting user data. By using SLMs, website owners can create more efficient and secure AI-driven experiences for their users, which can lead to increased engagement and loyalty. To take advantage of this development, website owners should consider the following actionable tips: review their current AI feature implementations to identify areas where SLMs can be integrated, update their llms.txt files to reflect the use of SLMs and ensure proper tracking of AI bot traffic, and explore ASP.NET Core's built-in support for SLMs to streamline the development process and optimize AI feature performance.