| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-08-27 | |||
| 19:20:10 | artom | Choices were made, I'm sure at the time with the available info they were optimal | |
| 19:20:14 | artom | dansmith, ack | |
| 19:20:43 | dansmith | artom: this is the problem with bolting on incremental "okay we'll justsupport live migration with pci if they're like this" kind of features | |
| 19:20:48 | dansmith | after you do that a couple times, you end up here | |
| 19:20:51 | donnyd | melwitt: well I am really just guessing because I don't understand how the http.store option works... I was hopeful that I could configure the filestore to save images in a particular location, and then have that exposed directly by apache (or something of the like) https://opendev.org/openstack/glance_store/src/branch/master/glance_store/_drivers/http.py | |
| 19:21:58 | sean-k-mooney | well we evenually wanted to use the multiple port binding workflow for could migration and then move the sriov port claiming to always use the live migration flow when we did that | |
| 19:22:05 | artom | dansmith, isn't there a "law" about that? | |
| 19:22:15 | mriedem | ooo i'm scheduled for that tomorrow | |
| 19:22:19 | mriedem | we're sympatico | |
| 19:22:37 | artom | Products reproduce the communication structures of their organisations, or something like that? | |
| 19:22:53 | donnyd | melwitt: but i honestly don't know because I have never had to get that far into glance... in my normal uses cases... it just works | |
| 19:22:55 | artom | So us, being distributed, loose and non-cohesive, will produce features that are the same? | |
| 19:23:48 | artom | Aha, https://en.wikipedia.org/wiki/Conway%27s_law | |
| 19:24:10 | mriedem | "organizations that are a clusterfuck will produce software that is a clusterfuck" | |
| 19:24:11 | mriedem | got it | |
| 19:24:32 | artom | I mean, yes. :P | |
| 19:25:28 | sean-k-mooney | fyi i just migrated an instace with a numa toployg and an sriov macvtap port | |
| 19:25:33 | melwitt | donnyd: understood. I'm grepping around and also can't find the config option in glance about how to disable checksum verification for the image_cache. I'll need to chat with penick and get back to you. I'll ask him if he knows anything about http.store while I'm at it | |
| 19:25:38 | sean-k-mooney | i need to now look at the xml and see what happend | |
| 19:25:44 | sean-k-mooney | but it succeded | |
| 19:26:08 | donnyd | melwitt: much appreciate... or just any possible way to make it faster would be a massive help | |
| 19:26:14 | mriedem | melwitt: that stuff should be disabled by default in nova | |
| 19:26:15 | mriedem | https://docs.openstack.org/nova/latest/configuration/config.html#glance.verify_glance_signatures | |
| 19:26:32 | melwitt | mriedem: yeah, he said it's different than the signature verify | |
| 19:26:48 | melwitt | and I just can't find it anywhere | |
| 19:26:57 | mriedem | is this based on his ocata cloud? | |
| 19:27:10 | melwitt | it might be | |
| 19:27:14 | mriedem | https://docs.openstack.org/nova/pike/configuration/config.html#libvirt.checksum_base_images | |
| 19:27:21 | mriedem | that stuff has been removed | |
| 19:27:30 | melwitt | oh, dangit | |
| 19:27:38 | mriedem | dagnabbit even | |
| 19:28:03 | melwitt | yeah, for sure | |
| 19:28:40 | melwitt | there goes that lead :( | |
| 19:28:41 | sean-k-mooney | artom: the xml looks correct and it was updated | |
| 19:29:16 | donnyd | what would be real slick is to just mount the same share for glance filestore backend and nova image cache | |
| 19:29:23 | mriedem | make way | |
| 19:29:35 | donnyd | that way once the image is uploaded the hypervisor would have immediate access | |
| 19:30:37 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add nova.compute.utils.delete_image https://review.opendev.org/637605 | |
| 19:30:38 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Refactor ComputeManager.remove_volume_connection https://review.opendev.org/642183 | |
| 19:30:38 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add power_on kwarg to ComputeDriver.spawn() method https://review.opendev.org/642590 | |
| 19:30:39 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add Destination.allow_cross_cell_move field https://review.opendev.org/614035 | |
| 19:30:39 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Change HostManager to allow scheduling to other cells https://review.opendev.org/614037 | |
| 19:30:40 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_dest compute method https://review.opendev.org/633293 | |
| 19:30:41 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add PrepResizeAtDestTask https://review.opendev.org/627890 | |
| 19:30:41 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add prep_snapshot_based_resize_at_source compute method https://review.opendev.org/634832 | |
| 19:30:42 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add PrepResizeAtSourceTask https://review.opendev.org/627891 | |
| 19:30:42 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add finish_snapshot_based_resize_at_dest compute method https://review.opendev.org/635080 | |
| 19:30:43 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add FinishResizeAtDestTask https://review.opendev.org/635646 | |
| 19:30:43 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Execute CrossCellMigrationTask from MigrationTask https://review.opendev.org/635668 | |
| 19:30:44 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Plumb allow_cross_cell_resize into compute API resize() https://review.opendev.org/635684 | |
| 19:30:44 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Filter duplicates from compute API get_migrations_sorted() https://review.opendev.org/636224 | |
| 19:30:45 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Start functional testing for cross-cell resize https://review.opendev.org/636253 | |
| 19:30:45 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Handle target host cross-cell cold migration in conductor https://review.opendev.org/642591 | |
| 19:30:45 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Validate image/create during cross-cell resize functional testing https://review.opendev.org/642592 | |
| 19:30:46 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add zones wrinkle to TestMultiCellMigrate https://review.opendev.org/643450 | |
| 19:31:12 | mriedem | gibi: stephenfin: dansmith: ^ i've rebased and moved the already +2'ed and less controversial things to the bottom to help move those through | |
| 19:32:24 | sean-k-mooney | artom: http://paste.openstack.org/show/765671/ | |
| 19:32:30 | donnyd | mriedem: you are supposed to wait for Friday afternoons for that kind of action.. so my CI has something to do... it gets lonely and bored | |
| 19:32:37 | sean-k-mooney | that the xml before and after the migration | |
| 19:33:14 | mriedem | donnyd: i wanted to test your CI's image download capabilities | |
| 19:33:29 | donnyd | LOL - thanks | |
| 19:35:05 | artom | sean-k-mooney, I think the best thing would be to write up a comprehensive test report | |
| 19:35:30 | artom | I'm fairly confident that the XML part works, that's been there since Stein | |
| 19:35:49 | artom | It's more the new surprises - pci_requests from the migration_context, etc | |
| 19:36:04 | artom | It doesn't help that the path series keeps changing under you | |
| 19:36:05 | artom | But yeah | |
| 19:36:20 | artom | I think testing by a more or less independent third party would be awesome :) | |
| 19:36:35 | artom | I need to drop for a bit while I reconnect to phone's hotspot | |
| 19:36:39 | artom | brb | |
| 19:37:34 | sean-k-mooney | well im not sure i qualify in that regard but ill test it none the less | |
| 19:42:29 | sean-k-mooney | the migration context is here http://paste.openstack.org/show/765743/ | |
| 19:42:59 | sean-k-mooney | and the pci request in the instance extra table are empty | |
| 19:43:03 | sean-k-mooney | mysql> select pci_requests from instance_extra as ie where ie.instance_uuid='b304fedf-aa31-4990-9a74-29729eed336d'; | |
| 19:43:05 | sean-k-mooney | +--------------+ | |
| 19:43:07 | sean-k-mooney | | pci_requests | | |
| 19:43:09 | sean-k-mooney | +--------------+ | |
| 19:43:11 | sean-k-mooney | | [] | | |
| 19:43:13 | sean-k-mooney | +--------------+ | |
| 19:44:28 | artom | Yey :( | |
| 19:44:36 | artom | At least we know we weren't wrong to worry | |
| 19:45:11 | sean-k-mooney | the pci device will will be claimed with the instance uuid in the pci tracker | |
| 19:45:28 | sean-k-mooney | but its not correct. | |
| 19:45:31 | artom | Yeah, but won't that screw up future operations? | |
| 19:45:47 | artom | Suddenly you can evacuate to a host with no SRIOV, for example | |
| 19:46:07 | sean-k-mooney | i would have to do more testing but non nessiarally | |
| 19:47:15 | artom | Still seems dangerous | |
| 19:47:36 | artom | I mean, I want NUMA LM to land a *lot*, but there's a minimum level of quality here ;) | |
| 19:47:44 | artom | And that's not part of it | |
| 19:49:09 | sean-k-mooney | ya i know. the request_spec still has the orginal pci_request in it and we do not support pci hot attach | |
| 19:49:37 | sean-k-mooney | that is the request spec http://paste.openstack.org/show/765824/ | |
| 19:49:38 | openstackgerrit | Matt Riedemann proposed openstack/nova master: FUP for I66d8f06f19c5c631e33208580428aa843abb38d2 https://review.opendev.org/678951 | |
| 19:52:29 | sean-k-mooney | stephenfin: by the way i think we need to apply https://review.opendev.org/#/c/675776/ | |
| 19:52:40 | sean-k-mooney | i am seeing some other issue that that will likely fix | |
| 19:54:50 | sean-k-mooney | artom: with the same code if i use a non numa flavor the pci reuests are not removed | |
| 19:55:17 | sean-k-mooney | artom: we might be able to use the temporay mutation thing to ensure that the change is not saved | |
| 19:56:31 | artom | sean-k-mooney, errr... | |
| 19:56:37 | artom | We want to save the *other* stuff | |
| 19:59:05 | mriedem | sean-k-mooney: so definite -1 here right? https://review.opendev.org/#/c/635669/39/nova/compute/resource_tracker.py@307 | |
| 19:59:10 | mriedem | can someone do that? | |
| 19:59:42 | sean-k-mooney | mriedem: yes | |