Is anyone using an LLM gateway?

Hey everyone. Those of you who are building a GenAi based service- are you using any gateway? Facing some issues currently as I am trying to integrate different LLMs. It’s a hustle learning and integrating the different api’s also maintaining costs and looking at performance is quite inefficient (I am building a customer support solution). So was wondering how those of you who are also building overcome these?