Remote dongle setup via REMSERIAL

Hello
My home server is sitting in the basement.
Almost all devices are on base floor.
So I have a raspberry PI with zwave dongle and remserial to expose the serial via ip in the server.
Working fine since more then 2 years

I recently switched from consumer zigbee gateways to zigbee2mqtt.

In the beginning I have been using the application colocated on the PI to test it.

Now I would like to replicate the remote port also for the zigbee part as all the rest of the automations is located on the server (homeassistant, nodered, mqtt , docker etc).

However when I start zigbee2mqtt on the server it is not connecting to the remote port
> zigbee2mqtt@1.12.0 start /opt/zigbee2mqtt

node index.js

zigbee2mqtt:info 2020-03-28 22:45:10: Logging to console and directory: ‘/opt/zigbee2mqtt/data/log/2020-03-28.22-45-10’ filename: log.txt
zigbee2mqtt:info 2020-03-28 22:45:10: Starting zigbee2mqtt version 1.12.0 (commit #840b9d9)
zigbee2mqtt:info 2020-03-28 22:45:10: Starting zigbee-herdsman…
zigbee2mqtt:error 2020-03-28 22:45:17: Error while starting zigbee-herdsman
zigbee2mqtt:error 2020-03-28 22:45:17: Failed to start zigbee
zigbee2mqtt:error 2020-03-28 22:45:17: Exiting…
zigbee2mqtt:error 2020-03-28 22:45:17: Error: Failed to connect to the adapter (Error: SRSP - SYS - ping after 6000ms)
at ZStackAdapter. (/opt/zigbee2mqtt/node_modules/zigbee-herdsman/dist/adapter/z-stack/adapter/zStackAdapter.js:71:23)
at Generator.throw ()
at rejected (/opt/zigbee2mqtt/node_modules/zigbee-herdsman/dist/adapter/z-stack/adapter/zStackAdapter.js:6:65)
npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! zigbee2mqtt@1.12.0 start: node index.js
npm ERR! Exit status 1
npm ERR!
npm ERR! Failed at the zigbee2mqtt@1.12.0 start script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR! /home/reinan/.npm/_logs/2020-03-28T21_45_17_992Z-debug.log

0 info it worked if it ends with ok

1 verbose cli [ ‘/usr/bin/node’, ‘/usr/bin/npm’, ‘start’ ]
2 info using npm@6.13.4
3 info using node@v12.16.1
4 verbose run-script [ ‘prestart’, ‘start’, ‘poststart’ ]
5 info lifecycle zigbee2mqtt@1.12.0~prestart: zigbee2mqtt@1.12.0
6 info lifecycle zigbee2mqtt@1.12.0~start: zigbee2mqtt@1.12.0
7 verbose lifecycle zigbee2mqtt@1.12.0~start: unsafe-perm in lifecycle true
8 verbose lifecycle zigbee2mqtt@1.12.0~start: PATH: /usr/lib/node_modules/npm/node_modules/npm-lifecycle/node-gyp-bin:/opt/zigbee2mqtt/node_modules/.bin:/home/reinan/.local/bin:/opt/intel/openvino_2020.1.023/deployment_tools/model_optimizer:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
9 verbose lifecycle zigbee2mqtt@1.12.0~start: CWD: /opt/zigbee2mqtt
10 silly lifecycle zigbee2mqtt@1.12.0~start: Args: [ ‘-c’, ‘node index.js’ ]
11 silly lifecycle zigbee2mqtt@1.12.0~start: Returned: code: 1 signal: null
12 info lifecycle zigbee2mqtt@1.12.0~start: Failed to exec start script
13 verbose stack Error: zigbee2mqtt@1.12.0 start: node index.js
13 verbose stack Exit status 1
13 verbose stack at EventEmitter. (/usr/lib/node_modules/npm/node_modules/npm-lifecycle/index.js:332:16)
13 verbose stack at EventEmitter.emit (events.js:311:20)
13 verbose stack at ChildProcess. (/usr/lib/node_modules/npm/node_modules/npm-lifecycle/lib/spawn.js:55:14)
13 verbose stack at ChildProcess.emit (events.js:311:20)
13 verbose stack at maybeClose (internal/child_process.js:1021:16)
13 verbose stack at Process.ChildProcess._handle.onexit (internal/child_process.js:286:5)
14 verbose pkgid zigbee2mqtt@1.12.0
15 verbose cwd /opt/zigbee2mqtt
16 verbose Linux 4.19.0-8-amd64
17 verbose argv “/usr/bin/node” “/usr/bin/npm” “start”
18 verbose node v12.16.1
19 verbose npm v6.13.4

Any clue?
I checked
The two remote ports are setup identically and the peers are connected