Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-02-20
21:38:03 mriedem i think we *are* registered to wait for the event
21:38:05 mriedem and neutron isn't sending it
21:38:34 sean-k-mooney mriedem: in the down stream bug neutron is sending it before we register to recive it
21:38:48 mriedem need to figure out what is triggering the event then
21:38:50 mriedem because for evacuate,
21:38:54 artom mriedem, and that's what you describe in your bug as well
21:39:00 mriedem the driver.spawn() is registering the callback
21:39:14 mriedem what might be sending the event is the port binding change
21:39:36 mriedem does that happen before driver.spawn (evacuate) and driver.finish_revert_migration?
21:40:16 sean-k-mooney mriedem: this is the downstream bug by the way https://bugzilla.redhat.com/show_bug.cgi?id=1678681
21:40:18 openstack bugzilla.redhat.com bug 1678681 in openstack-nova "REVERT_RESIZE stuck for 300s: "VirtualInterfaceCreateException: Virtual Interface creation failed" [Medium,Assigned] - Assigned to alifshit
21:40:23 artom mriedem, so, would it make sense to start listening immediately after calling Neutron?
21:40:41 sean-k-mooney artom: i would do it just before
21:40:53 artom sean-k-mooney, heh, right, that makes more sense
21:40:56 mriedem you have to register the callback before
21:41:24 artom Hrmm, and we might not have the callback until we get to spawn()?
21:41:29 mriedem sec
21:42:28 mriedem artom: so for evacuate, this is what updates the port binding to point at the dest host https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3212
21:42:42 mriedem the driver spawn then happens here https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L3276
21:43:06 mriedem so neutron likely doesn't send a 2nd network-vif-plugged event because it's already sending one for the port binding change
21:43:08 mriedem that's my guess anyway
21:43:31 artom (mriedem, btw, I sill never stop being impressed by the speed at which you walk through code and paste the relevant bits in here)
21:43:41 mriedem as for the revert resize,
21:43:46 mriedem port binding changes back to the source here https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L4089
21:43:59 mriedem and the guest is re-spawned (and vifs are plugged) here: https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L4108
21:44:10 mriedem i'm fast on *this* because i've been in the bowels of it for 6 months
21:45:02 artom Superbowels
21:45:10 artom OK, my eyes are glazing over.
21:45:17 artom Will pick up tomorrow.
21:45:17 sean-k-mooney os with ml2 ovs. the network-vif-plugged events are sent by the nova ovs agent when it finishes wiring up the port
21:45:36 sean-k-mooney if we had not got to the point of cleaning up the ports on the souce node
21:45:42 artom mriedem's link will be in my IRC log for future consultation.
21:46:11 sean-k-mooney when we rebind to the source node it might send the network-vif-plugged event imiddately
21:46:38 mriedem artom: no need https://bugs.launchpad.net/nova/+bug/1813789/comments/2
21:46:40 openstack Launchpad bug 1813789 in OpenStack Compute (nova) "Evacuate test intermittently fails with network-vif-plugged timeout exception" [Medium,Confirmed]
21:46:52 mriedem i put the notes in the bug
21:47:29 artom mriedem, cheers!
21:50:08 mriedem we also have the same issue in unshelve https://github.com/openstack/nova/blob/a4e6340bdcc2fda8fed41abc64ea554d9a8ab713/nova/compute/manager.py#L5087
21:51:51 openstackgerrit Matt Riedemann proposed openstack/nova master: Add cross-cell resize policy rule and enable in API https://review.openstack.org/638269
23:58:18 mriedem mdbooth_: for your morrow https://bugs.launchpad.net/nova/+bug/1816938
23:58:19 openstack Launchpad bug 1816938 in OpenStack Compute (nova) "Misleading log message "Booting with blank volume" in nova-compute when booting from real volume" [Medium,Confirmed]
23:58:23 aspiers mriedem: yes, I was planning to add SEV as a capabillity rather than a trait, since that's what efried_pto suggested: http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2019-02-08.log.html#t2019-02-08T19:58:54 Are you saying that the caps-to-traits patch can't be merged without changing the bp pointers?
23:58:45 mriedem aspiers: not necessarily
23:58:57 mriedem if it's part of an existing approved blueprint then i would probably say it's related to that
#openstack-nova - 2019-02-21
00:02:15 openstackgerrit Merged openstack/nova master: libvirt: Bump MIN_{LIBVIRT,QEMU}_VERSION for "Stein" https://review.openstack.org/632507
00:25:08 aspiers mriedem: just to be clear, my only currently submitted SEV patch https://review.openstack.org/#/c/633855/ shouldn't need rebasing since it's just extending the domain XML model
00:26:18 aspiers mriedem: but the next one I submit will auto-detect the SEV feature and most likely take advantage of the driver's capabilities to provide that trait
00:28:51 openstackgerrit Merged openstack/nova master: Fix typo in initial_disk_allocation_ratio release note https://review.openstack.org/638245
00:29:04 openstackgerrit Merged openstack/nova master: API microversion 2.69: Handles Down Cells Documentation https://review.openstack.org/635147
00:29:14 openstackgerrit Merged openstack/nova master: doc: fix and clarify --block-device usage in user docs https://review.openstack.org/607589
01:31:49 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Fix the leak in the cross-cell revert resize code https://review.openstack.org/638314
01:45:21 openstackgerrit Zhenyu Zheng proposed openstack/nova master: Add method to allow reset fields for root bdm in BDM obj https://review.openstack.org/614672
01:58:30 openstackgerrit Zhenyu Zheng proposed openstack/nova master: Bump compute service to indicate attach/detach root volume is supported https://review.openstack.org/614750
02:14:46 openstackgerrit Sundar Nadathur proposed openstack/nova master: ksa auth conf and client for cyborg access https://review.openstack.org/631242
02:14:47 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Create and bind Cyborg ARQs. https://review.openstack.org/631244
02:14:47 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Add Cyborg device profile groups to spec obj. https://review.openstack.org/631243
02:14:48 openstackgerrit Sundar Nadathur proposed openstack/nova master: WIP: Get resolved Cyborg ARQs and add PCI BDFs to VM's domain XML. https://review.openstack.org/631245
02:16:20 openstackgerrit Yongli He proposed openstack/nova master: Adds the server group info into show server detail API. https://review.openstack.org/621474
02:59:40 openstackgerrit Yongli He proposed openstack/nova master: Add server subresouce topology API https://review.openstack.org/621476
03:27:35 openstackgerrit melanie witt proposed openstack/nova master: WIP Add get_counts() to InstanceMappingList https://review.openstack.org/638072
03:27:35 openstackgerrit melanie witt proposed openstack/nova master: WIP Add online data migration for populating user_id https://review.openstack.org/633351
03:27:36 openstackgerrit melanie witt proposed openstack/nova master: Use instance mappings to count server group members https://review.openstack.org/638324
03:27:36 openstackgerrit melanie witt proposed openstack/nova master: WIP Count instances from mappings and cores/ram from placement https://review.openstack.org/638073
05:18:57 openstackgerrit Yongli He proposed openstack/nova master: Adds the server group info into show server detail API. https://review.openstack.org/621474
05:21:28 openstackgerrit Yongli He proposed openstack/nova master: Adds the server group info into show server detail API. https://review.openstack.org/621474
05:25:22 openstackgerrit Yongli He proposed openstack/nova master: Adds the server group info into show server detail API. https://review.openstack.org/621474
06:19:17 openstackgerrit Zhenyu Zheng proposed openstack/nova master: WIP detach root volume API changes https://review.openstack.org/623981
07:42:58 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove wrong description for auto resize confirm https://review.openstack.org/638357
08:17:47 openstackgerrit Lee Yarwood proposed openstack/nova master: rbd: flatten images when creating/unshelving an instance https://review.openstack.org/457886
08:42:24 openstackgerrit Silvan Kaiser proposed openstack/nova master: Added mount fstype based validation of Quobyte mounts https://review.openstack.org/522245
08:48:27 openstackgerrit zhaixiaojun proposed openstack/nova master: When the flavor id is invalid, the message does not match the regular expression, missing the numbers from 0-9. https://review.openstack.org/638150
08:49:20 openstackgerrit zhaixiaojun proposed openstack/nova master: When the flavor id is invalid, the message does not match the regular expression, missing the numbers from 0-9. https://review.openstack.org/638150
09:22:59 openstackgerrit Balazs Gibizer proposed openstack/nova master: FUP for Id7827fe8dc27112e342dc25c902c8dbc25f63b94 https://review.openstack.org/638370
09:38:58 gibi efried, jaypipes: I've added a fup ^^ for https://review.openstack.org/#/c/616239 I think https://review.openstack.org/#/c/616239 only needs a +A now :)
09:39:23 ygk_12345 hi all
09:39:49 ygk_12345 i have a songle node packstack. but the hypervisor list is empty eventhough the nova-compute is up and running
09:40:32 ygk_12345 *single
09:40:42 ygk_12345 can someone help me please
09:51:09 ygk_12345 can someone help me please with my issue
09:51:30 ygk_12345 the hypervisor list is empty and also no entries in the compute_nodes tables in nova database
09:52:33 bauzas which release ?
09:52:41 ygk_12345 bauzas: latest one
09:52:59 bauzas Rocky ?
09:53:13 bauzas I thought packstack was no longer supported
09:53:17 ygk_12345 bauzas: how to check that info ?
09:53:44 bauzas it's more a classic #openstack usage question, tbh
09:53:54 bauzas but just look at the RDO packages
09:54:03 bauzas they have versions
09:54:15 bauzas and then look at the n-cpu logs
09:55:04 ygk_12345 bauzas: where exactly n-cpu logs r located ?
09:56:59 tosky (packstack should still work, at least for rocky)
09:57:24 ygk_12345 bauzas: tosky yes it is rocky
09:57:42 ygk_12345 bauzas: tosky but the hypervisor list is empty. i cant understand why
09:58:15 bauzas ygk_12345: I'm not a packstack expert, so I don't know where those are located
09:58:20 bauzas /var/log/nova ?
09:58:25 tosky my nova knowledge does not go too depth in that, but I would start with the usual debug operations: enable debug=True, check all the logs
09:58:33 ygk_12345 bauzas: i see this in nova-compute log
09:59:57 ygk_12345 bauzas: tosky ""Can\'t connect to MySQL server on \'10.129.146.156\' "
10:00:56 ygk_12345 bauzas: but the mysql is running fine on that node
10:01:24 ygk_12345 bauzas: i see this in the mariadb "ERROR] WSREP: rsync SST method requires wsrep_...tartup"

Earlier   Later