Can't access server with local IP when VPN enabled and SSH configured on other than port 22

My YunoHost server

Hardware: Odroid hc4
YunoHost version: 11.1
I have access to my server : Through SSH | through the webadmin

Description of my issue

When having the vpnclient app enabled, I can’t any more access to my server through the local network.

When the app is disabled, I can without problem connect through ssh to my server with local ip.
For example when I enable the VPN app with a cube file from FDN service, I can’t any more reach any host on the local network when entering the IP.

When starting the VPN app, I have the following lines displaying in yunohost admin page :

Reading config panel description and current configuration...
Extracting TLS keys from .ovpn file
Checking what changed in the new configuration...
Validating the new configuration...
Applying the new configuration...
Stopping vpnclient in order to edit files
Configuration key 'service_enabled' edited in app settings
Starting vpnclient service if needed
Failed to start ntp.service: Unit ntp.service is masked.
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists
RTNETLINK answers: File exists

Trying to connect to my servers is not possible without the domain name:

ssh quiwy@86.178.129.11 -p 54785 -vvvvv
OpenSSH_8.2p1 Ubuntu-4ubuntu0.5, OpenSSL 1.1.1f  31 Mar 2020
debug1: Reading configuration data /home/quiwy/.ssh/config
debug1: Reading configuration data /etc/ssh/ssh_config
debug1: /etc/ssh/ssh_config line 19: include /etc/ssh/ssh_config.d/*.conf matched no files
debug1: /etc/ssh/ssh_config line 21: Applying options for *
debug2: resolve_canonicalize: hostname my_local_ip_server is address
debug2: ssh_connect_direct
debug1: Connecting to 86.178.129.11 [86.178.129.11] port 54785.
debug1: connect to address 86.178.129.11 port 54785: Connection timed out
ssh: connect to host 86.178.129.11 port 54785: Connection timed out

I have to do ssh quiwy@quiwy.ninja -p 54785

When the VPn is not enabled I have no problem.

I find it quite strange.

Yes I think it’s probably not a bug but a feature, any outgoing traffic is expected to go through the VPN

Ahaha, thank you for your answer.
I miss clicked on “create topic” so as I was still writing when you answered :confused:

I did some more test, when changing SSH to port 22 I have no problem to access my server on my local network. I don’t understand whether the issue comes from my router or from my server.

I would say that I need to investigate further on the router because I don’t see anything in logs when trying to log in with my local IP the port is set to 54785.