Ash AI: A comprehensive LLM toolbox for Ash Framework
![]()
Ash AI is a new package for the Elixir-based Ash Framework that facilitates the integration of Large Language Models (LLMs) into applications. It seeks to help developers rapidly and securely deploy LLM features, such as chatbots or other agentic tools, by building on the foundational Ash principles of structuring application logic as data. This approach allows for powerful integrations, structured outputs, and leverages tools like LangChain for efficient and safe AI functionality. Key features include structured output actions, tool definitions, vectorisation, a chat generation tool, and MCP server support for exposing application behaviors to external agents. The article also highlights the secure design principles employed, which ensure that AI integrations do not compromise user data privacy.
Was this useful?