[service] [request] support parallel invocations on a single instance #97

One of our highly used Node.js lambdas is mostly IO-bound, waiting for a HTTP request to complete. It would be nice if a single lambda instance can handle multiple invocations in parallel, so we can save on start-up cost, have some shared cache and not run into our quota limit as fast (we're capped at 2500 at the moment, but it's not enough).

We'd use a regular Node.js service for this, but in this case we're using Lambda@edge so we're in a bind.

The specific lambda as a auth/acl check in cloudfront before we hit a S3 origin.

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Tell us about your request
What do you want us to build?

Which service(s) is this request for?
This could be AWS Lambda itself, or integrations with other services.

Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?
What outcome are you trying to achieve, ultimately, and why is it hard/impossible to do right now? What is the impact of not having this problem solved? The more details you can provide, the better we'll be able to understand and solve the problem.

Are you currently working around this issue?
How are you currently solving this problem?

Additional context
Anything else we should know?

Attachments
If you think you might have additional information that you'd like to include via an attachment, please do - we'll take a look. (Remember to remove any personally-identifiable information.)