The DOS Policy prevents system degradation or shutdown caused by a flood of requests from a single user or IP address. It helps protect LLM services from being overwhelmed by excessive traffic.This policy monitors and limits the number of requests a user can make in a one-minute window. Once the limit is exceeded, the user is blocked from making further requests until the following minute.
To ensure this policy functions correctly, the user should provide a unique User ID to activate the policy. Without the User ID, the policy will not function.
The User ID parameter should be passed in the request body as user:.