There are quite a few routing and gateway tools now, such as Magpie. Once deployed, they can bring the connected providers together and supply them to different Agents. You can also set routing rules: for example, have a model judge the request, send simple requests to cheaper models, and send complex requests to more advanced models.
