| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-06-08 | |||
| 13:06:35 | sean-k-mooney | have we talked about when we might deprecate that and swap over to the placment way of doing it by default | |
| 13:06:46 | gibi | sean-k-mooney: only aggregate info is in placeent but not AZ info | |
| 13:07:35 | kashyap | sean-k-mooney: libvirt doesn't do any automatic memory ballooning, does it? | |
| 13:07:45 | gibi | I mean the aggregate metadata is not in placement and the AZ name is in the aggregate metadata | |
| 13:07:48 | sean-k-mooney | right but what i ment is could we start enabling the prefilter by default and deprecate the filter for removal | |
| 13:08:06 | sean-k-mooney | gibi: specifclaly this prefilter https://github.com/openstack/nova/blob/8988316b8c132c9662dea6cf0345975e87ce7344/nova/scheduler/request_filter.py#L136-L163 | |
| 13:08:18 | sean-k-mooney | kashyap: no it does not | |
| 13:08:50 | kashyap | sean-k-mooney: Then what do you mean by: "i know that at least one user wants us to remove the automatic memory balloan that is added by livirt" | |
| 13:08:52 | sean-k-mooney | kashyap: you can makrk the domain to try an deflate on OOM but even then im not sure that it will work without something in the guest | |
| 13:09:24 | sean-k-mooney | kashyap: libvirt adds a virtio-ballon device even if you dont ask for one by default | |
| 13:09:30 | kashyap | That "deflate-on-OOM" (which is a QEMU feature) is only for the guest to reclaim its mem back - nothing related to host | |
| 13:09:37 | sean-k-mooney | kashyap: we had one user ask for a way to disable that | |
| 13:09:43 | kashyap | sean-k-mooney: Ah, merely the adding of the ballooning device | |
| 13:09:44 | gibi | sean-k-mooney: I see now. Yes it make sense. I think we can deprecate the Filter and user the perfilter + placement | |
| 13:09:55 | kashyap | sean-k-mooney: Yes, I know - the real-time usecase doesn't want it | |
| 13:10:06 | sean-k-mooney | kashyap: actrully it was not for realtime | |
| 13:10:36 | sean-k-mooney | kashyap: it was for a guest with 2TB of ram and the debian folk were wondering if that was causeing some qemu crashes | |
| 13:10:54 | sean-k-mooney | but i actully think it was related to the adress space not the memory ballaon | |
| 13:11:20 | sean-k-mooney | gibi: ok ill file a blueprint and submit a patch | |
| 13:11:41 | stephenfin | gibi: replied on https://review.opendev.org/#/c/733668/1 | |
| 13:11:54 | sean-k-mooney | gibi: i was just looking at my local.conf an noticed i was still enebling the retry filter which has notbeen needed for a few release and notice i was also enabling the az filter | |
| 13:13:45 | openstackgerrit | Merged openstack/nova master: [Nova] Add reference to Placement installation guide https://review.opendev.org/726936 | |
| 13:14:28 | sean-k-mooney | kashyap: the issue they were hiting is by default qemu was not allcating enough virtual adressspace to create a guest larger than 2TB | |
| 13:20:26 | kashyap | sean-k-mooney: I see | |
| 13:20:31 | kashyap | Thx for the context | |
| 13:21:35 | openstack | bugzilla.redhat.com bug 630975 in seabios "KVM guest limited to 40bit of physical address space" [Medium,Closed: errata] - Assigned to aarcange | |
| 13:21:35 | sean-k-mooney | kashyap: ya they just wanted to turn it off for debuging reasons they were hitting basically this bug https://bugzilla.redhat.com/show_bug.cgi?id=630975 or https://bugs.launchpad.net/ubuntu/+source/qemu/+bug/1769053 | |
| 13:21:36 | openstack | Launchpad bug 1769053 in libvirt (Ubuntu) "Ability to control phys-bits through libvirt" [High,Triaged] | |
| 13:21:57 | sean-k-mooney | i wonder if nova shoudl actully be setting the libvirt option | |
| 13:23:43 | sean-k-mooney | kashyap: they had to create a custom machine type to work around the issue | |
| 13:24:40 | openstack | bugzilla.redhat.com bug 1578278 in libvirt "Ability to control phys-bits through libvirt" [Unspecified,New] - Assigned to libvirt-maint | |
| 13:24:40 | sean-k-mooney | hum i guess this is still open https://bugzilla.redhat.com/show_bug.cgi?id=1578278 | |
| 13:24:52 | sean-k-mooney | so maybe this can only be done at the qemu level | |
| 13:28:21 | gibi | sean-k-mooney: cool thanks. | |
| 13:28:29 | gibi | stephenfin: looking... | |
| 13:34:22 | gibi | stephenfin: sorry. totally my bad I guess I wasn't paying enough attention. Sorry again. | |
| 13:34:38 | stephenfin | it's all good :) | |
| 13:35:12 | gibi | :) | |
| 13:39:01 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Use 'Exception.__traceback__' for versioned notifications https://review.opendev.org/733668 | |
| 13:39:10 | stephenfin | gibi: actually, looks like I had a pep8 failure on that ^ Trying to figure out why pre-commit didn't catch it | |
| 13:40:35 | sean-k-mooney | stephenfin: was it a hacking rule im not sure pre-commit runs those | |
| 13:40:49 | sean-k-mooney | it might i just have not checked | |
| 13:41:03 | stephenfin | not a hacking rule, no, but pre-commit does run hacking anyway | |
| 13:47:49 | gibi | stephenfin: ack, reapplied my +2 | |
| 13:47:55 | stephenfin | ta | |
| 13:50:46 | openstackgerrit | Merged openstack/os-resource-classes master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/731512 | |
| 14:43:26 | sean-k-mooney | frickler: so im not seeing any detach errors but i am seeing this http://paste.openstack.org/show/794474/ | |
| 14:45:38 | frickler | sean-k-mooney: yeah, that's related to eventlet and py>=3.7 it seems, see my note in the bug and the other bug linked. I'm not sure whether that's related or not, haven't been able to build an easier reproducer so far, either | |
| 14:45:58 | bauzas | frickler: we don't support yet py>=3.7 | |
| 14:46:36 | sean-k-mooney | bauzas: well we kindo of do. there is an non voting job we can enable and i think its planned for victoria | |
| 14:47:08 | sean-k-mooney | yep it is https://opendev.org/openstack/governance/src/branch/master/reference/runtimes/victoria.rst#user-content-python-runtimes-for-victoria | |
| 14:47:45 | sean-k-mooney | so 3.6 and 3.8 will be the required supported version once we swap form 18.04 | |
| 14:48:00 | sean-k-mooney | to 20.04 | |
| 14:48:57 | sean-k-mooney | frickler: the eventlet thing seams to be intermitent | |
| 14:49:08 | sean-k-mooney | i see the command are sometimes passing fine | |
| 14:52:05 | sean-k-mooney | frickler: given i deployed master i would apper that https://review.opendev.org/#/c/707474/ does not actully work | |
| 14:53:33 | frickler | sean-k-mooney: you might want to test with a revert, but I was assuming that it would be only incomplete and we would have much more issues without it | |
| 14:54:05 | sean-k-mooney | yes it likely incomplete but i can try that quickly. | |
| 14:54:18 | sean-k-mooney | me might need to do this in oslo as well | |
| 15:00:59 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: DNM: Test the state of VMware NSX 3pp CI https://review.opendev.org/734114 | |
| 19:19:45 | dansmith | sean-k-mooney: around? | |
| 19:28:08 | sean-k-mooney | dansmith: yes | |
| 19:28:18 | sean-k-mooney | just traging a networking issue how can i help | |
| 19:28:44 | dansmith | sean-k-mooney: I want to create a variant of the ceph job that has multiple glance stores, so some glance conf tweaking | |
| 19:28:56 | dansmith | sean-k-mooney: I think I need a devstack_local_conf section in the job def in .zuul.conf yeah? | |
| 19:29:18 | dansmith | I'm not quite sure what it needs to look like, can I pastebin something in a sec for you to look at? | |
| 19:29:38 | sean-k-mooney | so you likely need to set different values on the contoler/all-in-one node vs the compute only node | |
| 19:29:49 | sean-k-mooney | so you will need to set different value in different groups | |
| 19:30:07 | sean-k-mooney | dansmith: sure give me the linke and ill take a look | |
| 19:30:41 | dansmith | this can be single-node fwiw | |
| 19:30:58 | sean-k-mooney | with multiple stores? | |
| 19:31:01 | dansmith | yup | |
| 19:31:20 | sean-k-mooney | oh are you configuring mutile glance backends or something | |
| 19:32:02 | sean-k-mooney | i assume it cant advertises the single file store backend as multiple stores | |
| 19:32:20 | sean-k-mooney | or in this case ceph backends | |
| 19:32:52 | dansmith | one file and one ceph, but yeah you can have multiple file backends too AFAIK | |
| 19:33:25 | sean-k-mooney | ya im pretty sure you can have multipel file backedns | |
| 19:33:40 | sean-k-mooney | https://github.com/openstack/nova/blob/master/.zuul.yaml#L154-L161 | |
| 19:33:48 | sean-k-mooney | basically you are doing that | |
| 19:34:10 | sean-k-mooney | but replacen $NOVA_CPU_CONF with $GLANCE_CONF | |
| 19:34:32 | sean-k-mooney | then each "[section]" becomes "section:" | |
| 19:34:33 | dansmith | sean-k-mooney: https://pastebin.com/h8Z2hTQs | |
| 19:34:53 | dansmith | okay I thought so, but I saw some in that file that didn't look like section names I was expecting | |
| 19:35:02 | dansmith | so I thought maybe there was more to it | |
| 19:35:24 | sean-k-mooney | so the $WHATEVER | |
| 19:35:30 | sean-k-mooney | is being replaced by devstack | |
| 19:35:49 | sean-k-mooney | althoguh you are missing a bit | |
| 19:35:49 | dansmith | I figured | |
| 19:35:59 | sean-k-mooney | https://github.com/openstack/nova/blob/master/.zuul.yaml#L155 | |
| 19:36:08 | sean-k-mooney | you will notice its under post-config | |
| 19:36:24 | dansmith | ah okay thanks | |
| 19:36:39 | sean-k-mooney | so line 155 and 156 become [[post-config|$NOVA_CPU_CONF]] | |
| 19:37:48 | dansmith | ack | |
| 19:38:12 | sean-k-mooney | im sure you know this but the post-config section in devstack run after all the infrastucture serivces are start and after all the default config are generated but before any of the openstack services are started | |
| 19:38:28 | dansmith | yeah that's what I want | |
| 19:38:49 | sean-k-mooney | yep its both the latest point you can set it and in this casse the earlist that makes sense | |
| 19:39:01 | dansmith | sean-k-mooney: so what about the bit of parenting this from the existing job and replacing the existing thing under check to reference this... that look okay too? | |
| 19:39:50 | sean-k-mooney | yes although when im testing i normally disable the other check jobs untill i get it working | |
| 19:40:05 | dansmith | by just deleting them? | |
| 19:40:35 | sean-k-mooney | https://review.opendev.org/#/c/681771/2/.zuul.yaml | |