| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-08-23 | |||
| 15:16:58 | dansmith | efried: it effectively restarts the whole process, which is good enough, just too heavy | |
| 15:17:15 | efried | dansmith: I thought we decided SIGHUP also breaks privsep | |
| 15:17:44 | dansmith | oh does it? | |
| 15:18:08 | efried | something about either restarting or not restarting the privsep daemon... | |
| 15:18:12 | efried | now I can't remember where I saw it. | |
| 15:18:12 | dougsz | https://github.com/openstack/kolla-ansible/blob/master/ansible/roles/nova/handlers/main.yml#L211 | |
| 15:18:25 | dougsz | dansmith efried ^ That's the issue afaik | |
| 15:18:26 | dansmith | not restarting is fine, as long as it doesn't lose a reference to the pipe, which I thought was global | |
| 15:19:10 | dansmith | dougsz: oh, right, right, ignore me | |
| 15:19:16 | dansmith | I forgot the rabbit hole went deeper | |
| 15:19:17 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: re-calculate provider mapping during migration https://review.opendev.org/655112 | |
| 15:19:22 | dougsz | np! | |
| 15:19:34 | dansmith | the simple case is that it does a full restart for no reason, but I forgot it also breaks some state as a result | |
| 15:20:41 | efried | someone stephenfin with oslo-core stephenfin should merge that patch | |
| 15:21:19 | stephenfin | whuh? | |
| 15:21:31 | efried | https://review.opendev.org/#/c/641907/ | |
| 15:21:40 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: update allocation in binding profile during migrate https://review.opendev.org/656422 | |
| 15:22:18 | stephenfin | I'm going to finish this cpu-resources reshuffle, but I can take a look after that | |
| 15:22:33 | efried | cool. No hurry, clearly. It's been open since like rocky. | |
| 15:22:49 | efried | sure would be nice to stop having to tell people SIGHUP is broken tho. | |
| 15:22:50 | beekneemech | If you figure it out you'll be ahead of the rest of us. :-) | |
| 15:23:19 | efried | (oh, did I trigger a keyword?) | |
| 15:23:26 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/stein: doc: remove confusing docs about aggregate allocation ratios https://review.opendev.org/678254 | |
| 15:23:48 | beekneemech | Yeah, I added an oslo highlight after the Denver PTL discussion. | |
| 15:24:05 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Extend NeutronFixture to handle migrations https://review.opendev.org/655114 | |
| 15:24:12 | dansmith | beekneemech: efried: I think it might be worth testing that with a real nova | |
| 15:24:13 | dansmith | before just firing it in | |
| 15:24:18 | dansmith | has anyone done that? | |
| 15:24:27 | mriedem | cpu-resources reshuffle is the worst dance move yet | |
| 15:24:37 | efried | dansmith: I ripped it in a devstack, does that count? | |
| 15:24:50 | dansmith | efried: does that mean "tested it" ? | |
| 15:25:09 | mriedem | it means he farted i think | |
| 15:25:27 | efried | I didn't try to hit the "stuff that actually breaks" paths cause I didn't understand them well enough | |
| 15:25:39 | dansmith | then...no | |
| 15:25:42 | efried | but I watched logs through SIGHUP before and after | |
| 15:25:57 | efried | that analysis is in the patch | |
| 15:26:30 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: prepare func test env for moving servers with bandwidth https://review.opendev.org/655109 | |
| 15:26:34 | dansmith | you should be able to validate that before the patch SIGHUP breaks booting instances, and after it doesn't right? | |
| 15:27:41 | efried | dansmith: I'm updating my devstack now, then will try that. | |
| 15:28:22 | mriedem | due to not processing the vif plug event right? you might be waiting 5 minutes if you don't tweak the config | |
| 15:28:37 | mriedem | https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.vif_plugging_timeout | |
| 15:28:40 | mriedem | i'd drop that to 60 seconds | |
| 15:28:48 | openstackgerrit | Eric Fried proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files https://review.opendev.org/639934 | |
| 15:28:48 | openstackgerrit | Eric Fried proposed openstack/nova master: Add emulated TPM support to Nova https://review.opendev.org/631363 | |
| 15:28:52 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Func test for migrate server with ports having resource request https://review.opendev.org/655113 | |
| 15:28:58 | CeeMac | afternoon | |
| 15:29:29 | CeeMac | is there a way to configure nova to use cinder volumes for ephemeral storage and root disks? | |
| 15:29:41 | mriedem | nope | |
| 15:29:55 | CeeMac | that answers that then | |
| 15:29:56 | mriedem | it's come up many a time | |
| 15:30:20 | CeeMac | so, the only option for shared storage backend is to mount the instance disk path to NFS? | |
| 15:30:48 | mriedem | you're talking about different things i think | |
| 15:30:56 | CeeMac | its entirely possible | |
| 15:31:12 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Make _rever_allocation nested allocation aware https://review.opendev.org/676138 | |
| 15:31:27 | mriedem | the instance path files are not the same as the root disk - you can have the root disks in rbd but have the instance files (console log, config drive, etc) be on local disk on the compute node | |
| 15:31:29 | mriedem | it gets confusing | |
| 15:31:43 | CeeMac | i don't use ceph, if that helps | |
| 15:31:48 | dansmith | artom: so, what do you think the timetable is for a respin of the numalm set? you said you've got unit tests fixed locally already, so can you do some swizzling of the top two patches and push that up today to get a run started? | |
| 15:31:50 | mriedem | or you could have the instance path files on local disk or shared NFS/rbd, but the root disk is actually a volume in cinder | |
| 15:32:13 | CeeMac | i was thinking in terms of when an instance is launched without specifying to use a cinder volume | |
| 15:32:19 | mriedem | CeeMac: sure, just saying that's a common shared storage backend | |
| 15:32:21 | artom | dansmith, working on updating the func test currently, since confidence seems to be the big thing | |
| 15:32:36 | CeeMac | mriedem: got you, yeah its all very confusing. | |
| 15:33:09 | mriedem | CeeMac: assuming you're using libvirt, the image backend for the root disk is defined with this config https://docs.openstack.org/nova/latest/configuration/config.html#libvirt.images_type | |
| 15:33:25 | mriedem | so you're probably using raw/flat/qcow2 yeah? | |
| 15:33:31 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support reverting migration / resize with bandwidth https://review.opendev.org/676140 | |
| 15:33:42 | CeeMac | qcow2 | |
| 15:33:55 | CeeMac | but i back images off onto volume, so it converts it raw iirc | |
| 15:34:51 | mriedem | https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.instances_path controls where the instance files are going to be then | |
| 15:35:14 | CeeMac | right | |
| 15:35:38 | CeeMac | thats what I was trying to get at i think | |
| 15:35:52 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Func test for migrate re-schedule with bandwidth https://review.opendev.org/676972 | |
| 15:36:10 | CeeMac | when an instance is launched without specifying to use volume backing for root disk, the root disk will go there too by default? | |
| 15:36:21 | CeeMac | i.e. not through horizon | |
| 15:36:53 | mriedem | horizon doesn't have anything to do with it (unless you mean horizon is somehow forcing you to use volume-backed servers) | |
| 15:36:55 | mriedem | but yeah | |
| 15:37:21 | mriedem | https://review.opendev.org/#/c/511965/ has some background details on the whole "configure nova to do volume-backed servers by default" thing which has had lots of discussion in the past like i said | |
| 15:37:26 | mriedem | many attempts, many failures | |
| 15:37:35 | sean-k-mooney | horizon default to createing a volume if cinder is enabled | |
| 15:37:43 | mriedem | sean-k-mooney: ok but it's not required | |
| 15:37:46 | mriedem | nor does everyone use horizon | |
| 15:37:51 | sean-k-mooney | im not really sure why but it does. its not require correct | |
| 15:38:10 | CeeMac | sean-k-mooney: thats my understanding too | |
| 15:38:14 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Support migrating SRIOV port with bandwidth https://review.opendev.org/676980 | |
| 15:38:15 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Allow migrating server with port resource request https://review.opendev.org/671497 | |
| 15:38:29 | sean-k-mooney | CeeMac: it defintly does not require it as i untick it all the time | |
| 15:38:44 | CeeMac | my issue comes when using rancher to deploy VMs, socker-volume isn't block-storage aware | |
| 15:39:02 | CeeMac | I'm happy with horizon defaulting to volume, as thats where I'd prefer for the instance to go | |
| 15:39:22 | CeeMac | trying to work out a way to force all instances to back off to block storage regardless of how they're requested | |
| 15:39:29 | CeeMac | was hoping there was an integrated cinder way | |
| 15:39:30 | sean-k-mooney | CeeMac: i kind of wish it default to delete the volume when you delete the vm too however | |
| 15:39:53 | CeeMac | but I'm guessing I'd need to go with mounting /var/lib/nova/instances to NFS on our SAN | |
| 15:40:15 | CeeMac | which is where instances_path points to right now | |
| 15:40:19 | CeeMac | in nova.config | |
| 15:40:20 | sean-k-mooney | CeeMac: i think we have a config option that will help | |
| 15:40:37 | sean-k-mooney | https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.max_local_block_devices | |
| 15:40:51 | sean-k-mooney | if you set that to 0 you have to use cinder volumes | |
| 15:40:58 | sean-k-mooney | not sure if tha tis what you want | |
| 15:41:39 | CeeMac | sean-k-mooney: that is a good start to prevent local disks being created and potentially filling up the (small) local disks on the compute | |
| 15:41:49 | sean-k-mooney | the other options open to you if you nova no/limnited local stoage and have ceph is to enable the RBD image backend | |