[Feature]: Allow configuring Nginx file and connection limits #3984

Problem

The Nginx server on dstack gateways uses the default distro-provided config, which can have low file and connection limits (worker_rlimit_nofile, worker_connections) insufficient for production use cases. For example, the limits may default to 1024 files and 768 connections, which would cause Nginx to fail handling more concurrent requests.

Solution

Either allow configuring in the gateway configuration, or hardcode higher limits.

Workaround

SSH to the gateway instance, set new limits by hand.

Would you like to help us implement this feature by sending a PR?

Yes