We are delighted to introduce our latest features and fixes from the recent period, enhancing your experience with improved functionality and performance.
Protect your LLM from excessive requests! Our new DOS policy detects and blocks potential overloads by limiting the number of requests per minute from each user. Customize the request threshold to match your security needs and keep your system running smoothly.
Manage your LLM’s cost efficiently with the new Cost Harvesting policy. The policy detects and prevents excessive token use, helping avoid unexpected cost spikes. Set a custom token threshold and control costs without impacting user experience.
Secure your data with role-based access! The new RAG Access Control API limits document access based on user roles, ensuring only authorized users view sensitive information. Initial integration supports Google Drive, with more knowledge bases on the way.
Our revamped Custom Policy Builder now empowers users with “Simple” and “Advanced” configuration modes, offering both ease of use and in-depth customization to suit diverse policy needs.