Resource groups
A resource group is a set of servers allocated for running ML services for specific accounts. Each service is launched in a single resource group. They can be public or private.
Public resource groups
Public resource groups are accessible to multiple accounts at the same time. Each account can only be assigned one public resource group.
The resources of public resource groups are limited by account limits. Services within a public resource group may be subject to eviction — forced stoppage in the event that:
- The service has been inactive for two days.
- The system lacks resources to run other services, including those of other accounts.
Private resource groups
Private resource groups are allocated to a specific account. If an account has private resource groups, public ones are not available to it.
The resources of private resource groups are limited only by the physical capacity of dedicated or cloud servers. The use of GPUs is also only possible in private resource groups.