Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2018-03-15
15:27:29 hrw mriedem: bug raport is more to signal issue as I will dig into it to find out what is going on
15:28:25 openstackgerrit Merged openstack/os-traits master: Add HW_NIC_SRIOV_TRUSTED trait https://review.openstack.org/550873
15:28:42 hrw mriedem: have to find out where get_connection().CompareCPU() is defined
15:29:03 hrw mriedem: as it looks like suspicious place ;d
15:29:23 mriedem my guess would be nova.virt.libvirt.host
15:31:03 hrw mriedem: nova.virt.libvirt.host.compare_cpu() calls self.get_connection.compareCPU()
15:32:09 mriedem mdbooth: dansmith: i think we'd just say you can't rebuild a volume-backed server with a new image using a multiattach volume if that volume has >1 attachment
15:32:19 dansmith right,
15:32:22 dansmith at least for the moment
15:32:43 mriedem and if it's a leap year because that's a lot of conditionals
15:42:02 mriedem would like to see another core review the flavor extra specs in GET /flavors/detail spec https://review.openstack.org/#/c/544158/ - discussed at the ptg and it's pretty straight forward
15:42:54 dansmith oooh
15:43:01 dansmith I found a typo I could use to crush your stats
15:46:39 dansmith penick: all while making this face: https://cheappopculture.files.wordpress.com/2015/02/revolting-blob.png?w=825
15:46:52 artom_ As a non-core observer, I feel like singing Sweet Dreams, but with Sweet changed to Crushed, would be appropriate
15:46:54 openstackgerrit Mathieu Gagné proposed openstack/nova-specs master: Multiple Fixed-IPs support in network information https://review.openstack.org/312626
15:47:08 penick hahaha, that got a real laugh outta me
15:47:49 mriedem we changed to "extra_spces" in a microversion in queens
15:47:54 mriedem you must have missed that
15:48:16 dansmith oh mah bad
15:48:21 penick Crushed dreams are made of theeeese, who am I to disagree?, travel the world, to the p-t-g, everybody's like minus two
15:48:54 artom_ penick, noice
15:49:12 penick *fistpump*
15:49:49 artom_ Are... are we bros now? Is this what being a bro is like?
15:51:31 openstackgerrit Merged openstack/nova-specs master: Add extra-specs to the flavor show and detail API calls https://review.openstack.org/544158
15:53:24 cfriesen_ I've got a question about service delete and placement...currently when we delete a service we don't delete the resource provider(s) for that compute node. If someone adds that compute node back later, this causes accounting issues because it has the same name but a different UUID.
15:53:45 cfriesen_ Should we be calling delete_resource_provider() when deleting the service?
15:54:32 cdent cfriesen_: I _think_ there's a bug for that.
15:56:23 openstack Launchpad bug 1708958 in OpenStack Compute (nova) "disabling a compute service does not disable the resource provider" [Wishlist,Confirmed]
15:56:23 cfriesen_ https://bugs.launchpad.net/nova/+bug/1708958 is that the one you were thinking of?
15:56:52 mriedem disable != delete
15:57:00 cfriesen_ yeah
15:57:07 mriedem you can delete a service record via the api,
15:57:13 mriedem but not the compute node record
15:57:17 mriedem deleting the compute node record is the issue
15:57:22 cfriesen_ yes
15:57:24 mriedem and no we don't have anything in place to clean that stuff up
15:57:33 mriedem we don't have any interfaces for deleting compute node records either
15:57:39 mriedem we've talked about adding that to nova-manage in the past
15:58:23 penick artom_ almost. Before becoming bros you have to go through the ceremony of course.
15:58:54 mriedem we have another issue with cleaning up stuff in placement mentioned here https://review.openstack.org/#/c/502306/17/specs/rocky/approved/bandwidth-resource-provider.rst@228
15:59:13 cfriesen_ mriedem: we've got a reported bug that deleting then re-adding a compute node with the same name results in not being able to schedule due to this placement issue
15:59:21 mriedem if you disable a compute or it's down, and delete instances from it and then purge them from the db, the allocations for those instances against that compute are never removed from placement
16:00:01 cfriesen_ ew
16:00:02 mriedem cfriesen_: well, how did they delete the compute node record? directly in the DB?
16:00:13 mriedem if you're monkeying with the db, then you are also going to need to deal with cleaning up placement as a result
16:00:20 mriedem at least for now, until we have some interface for this
16:00:34 cfriesen_ mriedem: I don't think they did delete the comptue node record, just the service
16:01:04 mriedem then i don't see how the compute node uuid would change unless the hostname changed or something
16:01:26 mriedem if the hostname changes, you have other problems
16:02:03 mriedem i think this also might tie into something tssurya was looking at which is having a way to delete host mappings and also make that recursive to delete compute nodes
16:02:08 mriedem and placement entries for those compute nodes
16:03:23 mriedem anyway, there is enough here that we should (1) have a way to cleanup compute nodes and their associated records and (2) that is complicated enough that it probably deserves at least a short spec
16:03:42 mriedem if it were easy it would have been done by now
16:03:59 tssurya I am cleaning up compute node and rp records in my patch
16:04:07 tssurya when we delete a cell or a host
16:04:26 dansmith tssurya: s/host/host mapping/ right?
16:04:55 tssurya yes
16:05:37 mriedem cfriesen_: in the meantime, they can use osc-placement 1.0 to delete the old compute node RP in placement
16:06:44 cfriesen_ okay, thanks for the info. tssurya, can you invite me to review that patch?
16:07:10 mriedem https://review.openstack.org/#/c/542964/ ?
16:07:19 cfriesen_ mriedem: I think that's basically what they were planning on doing for now
16:07:25 tssurya https://review.openstack.org/#/c/546660/
16:08:10 tssurya mriedem: its the one I posted, same one needing the functional test
16:08:13 tssurya for the placement side
16:08:32 tssurya for deleting the RP record
16:09:27 tssurya cfriesen_ : done, I hope I got the name right
16:09:31 tssurya for the review invite
16:10:18 cfriesen_ on a totally different issue, I opened https://bugs.launchpad.net/nova/+bug/1755981 Basically there seems to be a race due to the fact that we remove serial ports from ALLOCATED_PORTS but leave them in the guest definition.
16:10:19 openstack Launchpad bug 1755981 in OpenStack Compute (nova) "powering off and on an instance can result in instance boot failure due to serial port handling race" [Undecided,New]
16:10:22 cfriesen_ tssurya: yes, thanks
16:10:51 mriedem cfriesen_: probably ask sahid_ about that bug
16:10:59 mriedem markus_z would have been good too but he's no longer around
16:14:11 cfriesen sahid_: (or anyone else) regarding the above bug, why do we remove the port from ALLOCATED_PORTS when powering off? wouldn't it make more sense to remove them when undefining or changing the libvirt domain? The alternative seems to be to detach the serial ports from the libvirt domain when doing a power off, which is kind of icky.
16:17:03 sahid_ cfriesen: no comment or todo to explain why? I can't really remember
16:18:00 openstackgerrit Andrey Volkov proposed openstack/osc-placement master: Resource provider examples https://review.openstack.org/553461
16:18:46 sahid_ cfriesen: i just looked at the code, furing power_on we are doing a hard-reboot (don't ask me why)
16:19:03 sahid_ it seems that during hard reboot we redefine the domain xml
16:34:35 artom_ jaypipes, wanna talk about https://review.openstack.org/#/c/552722/1/specs/rocky/approved/live-migration-with-cpu-pinning.rst@16?
16:37:06 openstackgerrit Chris Dent proposed openstack/nova-specs master: Spec for isolating configuration of placement database https://review.openstack.org/552927
16:37:39 cdent stephenfin: addressed your suggestions on ^
16:41:07 openstackgerrit Matt Riedemann proposed openstack/nova master: Unmap compute nodes when deleting host mappings in delete cell operation https://review.openstack.org/542964
16:42:08 mriedem tssurya: would you like to propose a backport to stable/queens for ^ ?
16:43:14 tssurya mriedem: yes I will do it
16:45:24 openstackgerrit Alvaro Lopez Garcia proposed openstack/nova master: Ensure that periodic reclaim cleans DB deleted instances https://review.openstack.org/323250
16:46:13 cfriesen sahid_: I'm back. So on power_off() we _destroy() the instance (but leave it defined) and remove the serial ports from ALLOCATED_PORTS. Then on power_on() we hard reboot the instance, which calls _destroy() again, which removes the ports from ALLOCATED_PORTS again, which might result in removing ports currently in use by another instance.
16:46:42 jaypipes artom_: sure, what's up?
16:47:16 openstackgerrit sahid proposed openstack/nova master: libvirt: slow live-migration to ensure network is ready https://review.openstack.org/497457
16:47:24 cfriesen sahid: I assume we call _hard_reboot() to clean up as many things as possible about the instance (given the comment by mdbooth in _hard_reboot())
16:47:27 openstackgerrit Eric Fried proposed openstack/nova master: ProviderTree.{add|remove}_{traits|aggregates} https://review.openstack.org/553475
16:48:05 efried dansmith, jaypipes, cdent, edleafe: One half of the result of the "need to be able to merge traits/aggs" discussion ^
16:48:55 cfriesen sahid_: I'm wondering whether we should do the serial port removal from ALLOCATED_PORTS in _undefine_domain() instead.
16:49:16 openstackgerrit Eric Fried proposed openstack/nova master: update_provider_tree devref and docstring updates https://review.openstack.org/553476
16:49:31 efried dansmith, jaypipes, cdent, edleafe, mriedem: The other half ^
16:49:52 efried ...and now to send out that dev ML note, so I don't get in trouble with mriedem...
16:51:15 tssurya mriedem: there is a small problem with the backport, I guess the above patch sits on this one -> https://review.openstack.org/#/c/540073/ , so will backport both
16:51:30 artom jaypipes, so, what I think I failed in communicating is that getting NUMA resources modelled in placement and claimed by the scheduler (Sylvain's spec) is a dependency of my spec
16:51:53 artom jaypipes, and what I *think* you're saying is that, we can continue using the current compute-node-claims-the-resources way for now
16:53:10 openstackgerrit Surya Seetharaman proposed openstack/nova stable/queens: Extending delete_cell --force to delete instance_mappings https://review.openstack.org/553478
16:53:18 sahid_ cfriesen: i think you also have to look at the method where we define domain xml

Earlier   Later