[Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

classic Classic list List threaded Threaded
5 messages Options
Reply | Threaded
Open this post in threaded view
|

[Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

Chris Calbreath

Has anyone experienced this before? I have 2 Kea v1.79 servers running in a load balancing pair but I get the following errors when running kea-ctrl:

 

{ "command": "ha-heartbeat", "service": [ "dhcp6" ] }

INFO  COMMAND_RECEIVED Received command 'ha-heartbeat'

DEBUG CTRL_AGENT_COMMAND_FORWARD_BEGIN begin forwarding command ha-heartbeat to service dhcp6

DEBUG CTRL_AGENT_COMMAND_FORWARD_FAILED failed forwarding command ha-heartbeat: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

DEBUG HTTP_SERVER_RESPONSE_SEND sending HTTP response HTTP/1.1 200 OK to XXX.XXX.223.245

DEBUG HTTP_SERVER_RESPONSE_SEND_DETAILS detailed information about response sent to XXX.XXX.223.245:

HTTP/1.1 200 OK

Content-Length: 140

Content-Type: application/json

Date: Tue, 28 Jul 2020 20:06:35 GMT

 

[ { "result": 1, "text": "unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline" } ]


_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.

To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.

Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users
Reply | Threaded
Open this post in threaded view
|

Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

Wlodek Wencel

Hello,

thank you for using Kea :)

This is problem of communication between kea-ctrl-agent and kea-dhcp6, two most common issues in this case are:

 - kea-dhcp6 is not running / failed to open socket

 - there is misconfiguration of sockets (configuration in kea-ctrl-agent has to point to the socket that kea-dhcp6 is opening)

Regards

Wlodek Wencel

ISC QA

On 28/07/2020 22:15, Chris Calbreath wrote:

Has anyone experienced this before? I have 2 Kea v1.79 servers running in a load balancing pair but I get the following errors when running kea-ctrl:

 

{ "command": "ha-heartbeat", "service": [ "dhcp6" ] }

INFO  COMMAND_RECEIVED Received command 'ha-heartbeat'

DEBUG CTRL_AGENT_COMMAND_FORWARD_BEGIN begin forwarding command ha-heartbeat to service dhcp6

DEBUG CTRL_AGENT_COMMAND_FORWARD_FAILED failed forwarding command ha-heartbeat: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

DEBUG HTTP_SERVER_RESPONSE_SEND sending HTTP response HTTP/1.1 200 OK to XXX.XXX.223.245

DEBUG HTTP_SERVER_RESPONSE_SEND_DETAILS detailed information about response sent to XXX.XXX.223.245:

HTTP/1.1 200 OK

Content-Length: 140

Content-Type: application/json

Date: Tue, 28 Jul 2020 20:06:35 GMT

 

[ { "result": 1, "text": "unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline" } ]


_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.

To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.

Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.

To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.

Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users
Reply | Threaded
Open this post in threaded view
|

Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

Chris Calbreath

So a bit more investigation and it appears the socket is the cause of the issue. running strace against the PID of kea-ctrl-agent produces this message:

connect(17, {sa_family=AF_UNIX, sun_path="/tmp/dhcp6.sock"}, 17) = -1 ENOENT (No such file or directory)

 

What would cause the socket to not be created in the path specified?

 

 

Here is my config.

 

Server 1:

dhcpv6.conf

"control-socket": {

                        "socket-type": "unix",

                        "socket-name": "/tmp/dhcp6.sock "

 

ctrl-agent.conf

"dhcp6": {

            "socket-type": "unix",

            "socket-name": "/tmp/dhcp6.sock"

 

Server 2

dhcpv6.conf

"control-socket": {

                        "socket-type": "unix",

                        "socket-name": "/tmp/dhcp6.sock "

 

ctrl-agent.conf

"dhcp6": {

            "socket-type": "unix",

            "socket-name": "/tmp/dhcp6.sock "

 

 

Chris

 

 

 

 

From: Kea-users <[hidden email]> On Behalf Of Wlodek Wencel
Sent: Tuesday, July 28, 2020 3:24 PM
To: [hidden email]
Subject: Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

 

Hello,

thank you for using Kea :)

This is problem of communication between kea-ctrl-agent and kea-dhcp6, two most common issues in this case are:

 - kea-dhcp6 is not running / failed to open socket

 - there is misconfiguration of sockets (configuration in kea-ctrl-agent has to point to the socket that kea-dhcp6 is opening)

Regards

Wlodek Wencel

ISC QA

On 28/07/2020 22:15, Chris Calbreath wrote:

Has anyone experienced this before? I have 2 Kea v1.79 servers running in a load balancing pair but I get the following errors when running kea-ctrl:

 

{ "command": "ha-heartbeat", "service": [ "dhcp6" ] }

INFO  COMMAND_RECEIVED Received command 'ha-heartbeat'

DEBUG CTRL_AGENT_COMMAND_FORWARD_BEGIN begin forwarding command ha-heartbeat to service dhcp6

DEBUG CTRL_AGENT_COMMAND_FORWARD_FAILED failed forwarding command ha-heartbeat: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

DEBUG HTTP_SERVER_RESPONSE_SEND sending HTTP response HTTP/1.1 200 OK to XXX.XXX.223.245

DEBUG HTTP_SERVER_RESPONSE_SEND_DETAILS detailed information about response sent to XXX.XXX.223.245:

HTTP/1.1 200 OK

Content-Length: 140

Content-Type: application/json

Date: Tue, 28 Jul 2020 20:06:35 GMT

 

[ { "result": 1, "text": "unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline" } ]

 

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.
 
To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.
 
Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.

To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.

Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users
Reply | Threaded
Open this post in threaded view
|

Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

Wlodek Wencel

Hello,

it can be privileges or path issue, it's weird with /tmp though.

Make sure that socket can be created, second option is to try configure it in different directories.

Regards

Wlodek

On 31/07/2020 15:06, Chris Calbreath wrote:

So a bit more investigation and it appears the socket is the cause of the issue. running strace against the PID of kea-ctrl-agent produces this message:

connect(17, {sa_family=AF_UNIX, sun_path="/tmp/dhcp6.sock"}, 17) = -1 ENOENT (No such file or directory)

 

What would cause the socket to not be created in the path specified?

 

 

Here is my config.

 

Server 1:

dhcpv6.conf

"control-socket": {

                        "socket-type": "unix",

                        "socket-name": "/tmp/dhcp6.sock "

 

ctrl-agent.conf

"dhcp6": {

            "socket-type": "unix",

            "socket-name": "/tmp/dhcp6.sock"

 

Server 2

dhcpv6.conf

"control-socket": {

                        "socket-type": "unix",

                        "socket-name": "/tmp/dhcp6.sock "

 

ctrl-agent.conf

"dhcp6": {

            "socket-type": "unix",

            "socket-name": "/tmp/dhcp6.sock "

 

 

Chris

 

 

 

 

From: Kea-users <[hidden email]> On Behalf Of Wlodek Wencel
Sent: Tuesday, July 28, 2020 3:24 PM
To: [hidden email]
Subject: Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

 

Hello,

thank you for using Kea :)

This is problem of communication between kea-ctrl-agent and kea-dhcp6, two most common issues in this case are:

 - kea-dhcp6 is not running / failed to open socket

 - there is misconfiguration of sockets (configuration in kea-ctrl-agent has to point to the socket that kea-dhcp6 is opening)

Regards

Wlodek Wencel

ISC QA

On 28/07/2020 22:15, Chris Calbreath wrote:

Has anyone experienced this before? I have 2 Kea v1.79 servers running in a load balancing pair but I get the following errors when running kea-ctrl:

 

{ "command": "ha-heartbeat", "service": [ "dhcp6" ] }

INFO  COMMAND_RECEIVED Received command 'ha-heartbeat'

DEBUG CTRL_AGENT_COMMAND_FORWARD_BEGIN begin forwarding command ha-heartbeat to service dhcp6

DEBUG CTRL_AGENT_COMMAND_FORWARD_FAILED failed forwarding command ha-heartbeat: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

DEBUG HTTP_SERVER_RESPONSE_SEND sending HTTP response HTTP/1.1 200 OK to XXX.XXX.223.245

DEBUG HTTP_SERVER_RESPONSE_SEND_DETAILS detailed information about response sent to XXX.XXX.223.245:

HTTP/1.1 200 OK

Content-Length: 140

Content-Type: application/json

Date: Tue, 28 Jul 2020 20:06:35 GMT

 

[ { "result": 1, "text": "unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline" } ]

 

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.
 
To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.
 
Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.

To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.

Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.

To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.

Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users
Reply | Threaded
Open this post in threaded view
|

Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

Chris Calbreath

I resolved this issue. It turned out to be when I was creating the control socket in the config. I moved the control socket statement to the first line of the config under the service and the control socket was created. It appears if you declare interfaces before the control socket – the control socket is not created.

 

I’ve add the HA Pair to stork – but am not able to retrieve any subnet stats from them – I just get a no stats yet message. I’ve messaged the stork users list for guidance on that.

 

Chris

 

From: Kea-users <[hidden email]> On Behalf Of Wlodek Wencel
Sent: Wednesday, August 5, 2020 2:35 AM
To: [hidden email]
Subject: Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

 

Hello,

it can be privileges or path issue, it's weird with /tmp though.

Make sure that socket can be created, second option is to try configure it in different directories.

Regards

Wlodek

On 31/07/2020 15:06, Chris Calbreath wrote:

So a bit more investigation and it appears the socket is the cause of the issue. running strace against the PID of kea-ctrl-agent produces this message:

connect(17, {sa_family=AF_UNIX, sun_path="/tmp/dhcp6.sock"}, 17) = -1 ENOENT (No such file or directory)

 

What would cause the socket to not be created in the path specified?

 

 

Here is my config.

 

Server 1:

dhcpv6.conf

"control-socket": {

                        "socket-type": "unix",

                        "socket-name": "/tmp/dhcp6.sock "

 

ctrl-agent.conf

"dhcp6": {

            "socket-type": "unix",

            "socket-name": "/tmp/dhcp6.sock"

 

Server 2

dhcpv6.conf

"control-socket": {

                        "socket-type": "unix",

                        "socket-name": "/tmp/dhcp6.sock "

 

ctrl-agent.conf

"dhcp6": {

            "socket-type": "unix",

            "socket-name": "/tmp/dhcp6.sock "

 

 

Chris

 

 

 

 

From: Kea-users <[hidden email]> On Behalf Of Wlodek Wencel
Sent: Tuesday, July 28, 2020 3:24 PM
To: [hidden email]
Subject: Re: [Kea-users] ha heartbeat error: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

 

Hello,

thank you for using Kea :)

This is problem of communication between kea-ctrl-agent and kea-dhcp6, two most common issues in this case are:

 - kea-dhcp6 is not running / failed to open socket

 - there is misconfiguration of sockets (configuration in kea-ctrl-agent has to point to the socket that kea-dhcp6 is opening)

Regards

Wlodek Wencel

ISC QA

On 28/07/2020 22:15, Chris Calbreath wrote:

Has anyone experienced this before? I have 2 Kea v1.79 servers running in a load balancing pair but I get the following errors when running kea-ctrl:

 

{ "command": "ha-heartbeat", "service": [ "dhcp6" ] }

INFO  COMMAND_RECEIVED Received command 'ha-heartbeat'

DEBUG CTRL_AGENT_COMMAND_FORWARD_BEGIN begin forwarding command ha-heartbeat to service dhcp6

DEBUG CTRL_AGENT_COMMAND_FORWARD_FAILED failed forwarding command ha-heartbeat: unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline

DEBUG HTTP_SERVER_RESPONSE_SEND sending HTTP response HTTP/1.1 200 OK to XXX.XXX.223.245

DEBUG HTTP_SERVER_RESPONSE_SEND_DETAILS detailed information about response sent to XXX.XXX.223.245:

HTTP/1.1 200 OK

Content-Length: 140

Content-Type: application/json

Date: Tue, 28 Jul 2020 20:06:35 GMT

 

[ { "result": 1, "text": "unable to forward command to the dhcp6 service: No such file or directory. The server is likely to be offline" } ]

 

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.
 
To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.
 
Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users



_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.
 
To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.
 
Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users

_______________________________________________
ISC funds the development of this software with paid support subscriptions. Contact us at https://www.isc.org/contact/ for more information.

To unsubscribe visit https://lists.isc.org/mailman/listinfo/kea-users.

Kea-users mailing list
[hidden email]
https://lists.isc.org/mailman/listinfo/kea-users