| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-05-11 | |||
| 15:31:07 | ignaziocassano | ralonsoh I tried to apply this patch https://review.opendev.org/c/openstack/neutron/+/766277/10/neutron/conf/common.py#177 and I configured thhe section nova in neutron.conf with live_migration_events=True but when I migrate a vm on a provider network it stops to respond to ping requests. It starts to respond only when it initiate some traffic for | |
| 15:31:07 | ignaziocassano | ralonsoh I tried to apply this patch https://review.opendev.org/c/openstack/neutron/+/766277/10/neutron/conf/common.py#177 and I configured thhe section nova in neutron.conf with live_migration_events=True but when I migrate a vm on a provider network it stops to respond to ping requests. It starts to respond only when it initiate some traffic for | |
| 15:31:08 | ignaziocassano | example when it search the ntp server | |
| 15:31:08 | ignaziocassano | example when it search the ntp server | |
| 15:32:00 | ignaziocassano | If I logon using the console (becuse network is unreacheable) and I ping the router, it starts to respond | |
| 15:32:00 | ignaziocassano | If I logon using the console (becuse network is unreacheable) and I ping the router, it starts to respond | |
| 15:33:16 | ralonsoh | ignaziocassano, please open a LP bug for this | |
| 15:33:16 | ralonsoh | ignaziocassano, please open a LP bug for this | |
| 15:33:27 | ralonsoh | maybe we need to force a GARP to refresh the APR tables | |
| 15:33:27 | ralonsoh | maybe we need to force a GARP to refresh the APR tables | |
| 15:33:57 | ignaziocassano | ralonsoh, How can open a bug ? | |
| 15:33:57 | ignaziocassano | ralonsoh, How can open a bug ? | |
| 15:34:47 | ralonsoh | https://bugs.launchpad.net/neutron | |
| 15:34:47 | ralonsoh | https://bugs.launchpad.net/neutron | |
| 15:34:52 | ralonsoh | --> report a bug | |
| 15:34:52 | ralonsoh | --> report a bug | |
| 15:36:00 | ignaziocassano | thanks | |
| 15:36:00 | ignaziocassano | thanks | |
| 15:36:44 | sean-k-mooney | ralonsoh: qemu should be sendign GARP packet or thecnically RARP packets | |
| 15:36:44 | sean-k-mooney | ralonsoh: qemu should be sendign GARP packet or thecnically RARP packets | |
| 15:37:01 | ralonsoh | right | |
| 15:37:17 | ralonsoh | so the arp table should be updated when the VM is migrated | |
| 15:37:17 | ralonsoh | so the arp table should be updated when the VM is migrated | |
| 15:37:28 | sean-k-mooney | and for hybrid plug nova added a veth pair to ovs so the l2 agent shoudl have wired that up before we migrated | |
| 15:37:28 | sean-k-mooney | and for hybrid plug nova added a veth pair to ovs so the l2 agent shoudl have wired that up before we migrated | |
| 15:37:30 | ralonsoh | arp tables, in all hosts | |
| 15:37:30 | ralonsoh | arp tables, in all hosts | |
| 15:37:35 | ralonsoh | right | |
| 15:37:35 | ralonsoh | right | |
| 15:37:38 | sean-k-mooney | yep | |
| 15:38:09 | sean-k-mooney | when qemu start on the dest it will send the RARP packets | |
| 15:38:09 | sean-k-mooney | when qemu start on the dest it will send the RARP packets | |
| 15:38:47 | sean-k-mooney | so i dont really know how ignaziocassano is having issue unless that happend after the dhcp server responded but before the l2 agent finsihed wiring up the ports | |
| 15:38:47 | sean-k-mooney | so i dont really know how ignaziocassano is having issue unless that happend after the dhcp server responded but before the l2 agent finsihed wiring up the ports | |
| 15:39:26 | sean-k-mooney | on a system with a lot of port that could happen but with your patch it should not and it shoudl be rare without it | |
| 15:39:27 | sean-k-mooney | on a system with a lot of port that could happen but with your patch it should not and it shoudl be rare without it | |
| 15:39:51 | sean-k-mooney | unless the l2 agent is consitntly slow for some reason on the host | |
| 15:39:51 | sean-k-mooney | unless the l2 agent is consitntly slow for some reason on the host | |
| 15:41:13 | ignaziocassano | I have few virtual machines on this two kvm nodes | |
| 15:41:13 | ignaziocassano | I have few virtual machines on this two kvm nodes | |
| 15:42:05 | ralonsoh | kvm? | |
| 15:42:06 | ralonsoh | kvm? | |
| 15:42:20 | sean-k-mooney | ralonsoh: as in libvirt/kvm | |
| 15:42:20 | sean-k-mooney | ralonsoh: as in libvirt/kvm | |
| 15:42:34 | sean-k-mooney | them mean compute nodes | |
| 15:42:34 | sean-k-mooney | them mean compute nodes | |
| 15:42:35 | ignaziocassano | yes | |
| 15:42:44 | ignaziocassano | kvm nodes | |
| 15:42:44 | ignaziocassano | kvm nodes | |
| 15:42:51 | ignaziocassano | libvirt kvm | |
| 15:42:51 | ignaziocassano | libvirt kvm | |
| 15:42:55 | ignaziocassano | centos 7 | |
| 15:42:55 | ignaziocassano | centos 7 | |
| 15:47:19 | ignaziocassano | I have just tryed again now. Startded I new vm. It responds to pings. Migrated it on new node. It stops to respond. I logged into vm using the console and I pinged the default router. It started immediately to respond to ping requests | |
| 15:47:19 | ignaziocassano | I have just tryed again now. Startded I new vm. It responds to pings. Migrated it on new node. It stops to respond. I logged into vm using the console and I pinged the default router. It started immediately to respond to ping requests | |
| 15:49:17 | sean-k-mooney | ignaziocassano: can you do that again but this time use tcpdump or tshark to dump the traffic | |
| 15:49:17 | sean-k-mooney | ignaziocassano: can you do that again but this time use tcpdump or tshark to dump the traffic | |
| 15:50:10 | ignaziocassano | on the vm ? | |
| 15:50:10 | ignaziocassano | on the vm ? | |
| 15:50:34 | sean-k-mooney | on the destination host | |
| 15:50:34 | sean-k-mooney | on the destination host | |
| 15:51:30 | ignaziocassano | ummh.... How can I do that ? On which interface ? | |
| 15:51:30 | ignaziocassano | ummh.... How can I do that ? On which interface ? | |
| 15:52:32 | sean-k-mooney | if you log into the souce node and check the name of the tap device you can set up a watch command that will try do start dumping the packets | |
| 15:52:32 | sean-k-mooney | if you log into the souce node and check the name of the tap device you can set up a watch command that will try do start dumping the packets | |
| 15:52:50 | ignaziocassano | ok | |
| 15:52:50 | ignaziocassano | ok | |
| 15:52:57 | sean-k-mooney | e.g. watch -n1 " tcpudump -i tap..." | |
| 15:52:58 | sean-k-mooney | e.g. watch -n1 " tcpudump -i tap..." | |
| 15:53:40 | sean-k-mooney | basicaly what im wondering is will you see the RARP packets form qemu and will they be recived before ovs is configured | |
| 15:53:40 | sean-k-mooney | basicaly what im wondering is will you see the RARP packets form qemu and will they be recived before ovs is configured | |
| 15:54:04 | sean-k-mooney | you coudl similarly check on teh br-ex/phsyical interface connected to ovs | |
| 15:54:04 | sean-k-mooney | you coudl similarly check on teh br-ex/phsyical interface connected to ovs | |
| 15:54:19 | sean-k-mooney | to see if they are sent onto the physical network | |
| 15:54:19 | sean-k-mooney | to see if they are sent onto the physical network | |
| 15:57:09 | ignaziocassano | on the source node the interfcace is tap11fdfb84-4a | |
| 15:57:09 | ignaziocassano | on the source node the interfcace is tap11fdfb84-4a | |
| 15:58:28 | ignaziocassano | so I must run watch -n1 " tcpudump -i tap11fdfb84-4a" on the destination node ? | |
| 15:58:28 | ignaziocassano | so I must run watch -n1 " tcpudump -i tap11fdfb84-4a" on the destination node ? | |
| 16:01:31 | ignaziocassano | tcpdump: verbose output suppressed, use -v or -vv for full protocol decode | |
| 16:01:31 | ignaziocassano | tcpdump: verbose output suppressed, use -v or -vv for full protocol decode | |
| 16:01:32 | ignaziocassano | listening on tap11fdfb84-4a, link-type EN10MB (Ethernet), capture size 262144 bytes | |
| 16:01:32 | ignaziocassano | 18:00:49.552314 ARP, Request who-has 10.138.209.47 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:32 | ignaziocassano | listening on tap11fdfb84-4a, link-type EN10MB (Ethernet), capture size 262144 bytes | |
| 16:01:32 | ignaziocassano | 18:00:49.552314 ARP, Request who-has 10.138.209.47 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:33 | ignaziocassano | 18:00:49.552325 ARP, Request who-has 10.138.209.47 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:33 | ignaziocassano | 18:00:49.556221 ARP, Request who-has 10.138.209.48 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:33 | ignaziocassano | 18:00:49.552325 ARP, Request who-has 10.138.209.47 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:33 | ignaziocassano | 18:00:49.556221 ARP, Request who-has 10.138.209.48 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:34 | ignaziocassano | 18:00:49.556230 ARP, Request who-has 10.138.209.48 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:34 | ignaziocassano | 18:00:49.855902 IP6 :: > ff02::16: HBH ICMP6, multicast listener report v2, 1 group record(s), length 28 | |
| 16:01:34 | ignaziocassano | 18:00:49.556230 ARP, Request who-has 10.138.209.48 (Broadcast) tell 10.138.209.1, length 46 | |
| 16:01:34 | ignaziocassano | 18:00:49.855902 IP6 :: > ff02::16: HBH ICMP6, multicast listener report v2, 1 group record(s), length 28 | |
| 16:01:35 | ignaziocassano | 18:00:50.009075 IP6 fe80::fc16:3eff:fe6b:8bee > ff02::16: HBH ICMP6, multicast listener report v2, 1 group record(s), length 28 | |
| 16:01:35 | ignaziocassano | 18:00:50.009117 IP6 fe80::fc16:3eff:fe6b:8bee > ff02::2: ICMP6, router solicitation, length 16 | |
| 16:01:35 | ignaziocassano | 18:00:50.009075 IP6 fe80::fc16:3eff:fe6b:8bee > ff02::16: HBH ICMP6, multicast listener report v2, 1 group record(s), length 28 | |
| 16:01:35 | ignaziocassano | 18:00:50.009117 IP6 fe80::fc16:3eff:fe6b:8bee > ff02::2: ICMP6, router solicitation, length 16 | |
| 16:01:36 | ignaziocassano | 18:00:50.265259 ARP, Reverse Request who-is fa:16:3e:6b:8b:ee (oui Unknown) tell fa:16:3e:6b:8b:ee (oui Unknown), length 46 | |
| 16:01:36 | ignaziocassano | 18:00:50.285607 ARP, Reverse Request who-is fa:16:3e:6b:8b:ee (oui Unknown) tell fa:16:3e:6b:8b:ee (oui Unknown), length 46 | |
| 16:01:36 | ignaziocassano | 18:00:50.265259 ARP, Reverse Request who-is fa:16:3e:6b:8b:ee (oui Unknown) tell fa:16:3e:6b:8b:ee (oui Unknown), length 46 | |