VS Code: Connecting to a python interpreter in docker container without using remote containers

I know it is generally possible to connect to a container's python interpreter with:

• remote containers
• remote ssh

The problems I have with these solutions:

• it opens a new window where I need to install/specify all extensions again
• it opens a new window per container. I am working in a monorepo where each services's folder is mounted in a different container (connected via docker compose)

Is there a solution that allows me to specify a remote container to connect to simply for the python interpreter (and not for an entirely new workspace)?