One connection per app, how to support large scale applications?



I have a web api that uses the streaming api for processing user requests and analyze the data, what is the preferred approach to support large scale api when the user request can last for a very long time, can we use more than one app to service the users on server per stream basis?