| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-05-28 | |||
| 13:30:50 | sean-k-mooney | stephenfin: so i suspect what is happening is sicne you only broke glance it the compute agent config we are trying to actully boot the instance and failing then hitting the retry limit and landing in cell0 with no host set | |
| 13:31:06 | sean-k-mooney | so its not wrong in that we failed to find a host where it can boot | |
| 13:31:17 | sean-k-mooney | stephenfin: and ya i was excpecting it to be in the api log | |
| 13:32:05 | sean-k-mooney | so your wondering if we we should drop the level form warning to info | |
| 13:32:36 | sean-k-mooney | sorry https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2400-L2401 is a different warning | |
| 13:32:56 | stephenfin | sean-k-mooney: not quite. More if we should log something special for the host=None case or not log at all for that case | |
| 13:33:13 | stephenfin | we should keep warning for host!=None | |
| 13:33:19 | sean-k-mooney | ah i was thinking if we log it should be at debug | |
| 13:33:29 | sean-k-mooney | i dont think it should be at warning | |
| 13:33:45 | sean-k-mooney | i dont think info is useful | |
| 13:34:09 | sean-k-mooney | i would be fine with LOG.debug("instance was not scheduled successfully, deleting from database") | |
| 13:34:25 | sean-k-mooney | for the host is None case | |
| 13:35:22 | sean-k-mooney | i think the intent behind the orginal warning stems form the fact the host is down | |
| 13:35:44 | sean-k-mooney | so you might need to check that the local delete actully works proably when you bring it back up | |
| 13:41:15 | stephenfin | gibi: https://bugs.launchpad.net/nova/+bug/1736920/comments/9 | |
| 13:41:15 | openstack | Launchpad bug 1736920 in OpenStack Security Advisory "Glance images are loaded into memory" [Undecided,Incomplete] | |
| 13:44:13 | sean-k-mooney | stephenfin: are you sure that has always been the case | |
| 13:44:32 | sean-k-mooney | e.g. the use of the decorator | |
| 13:45:19 | stephenfin | sean-k-mooney: A quick look at stable/ocata for glanceclient suggests yes | |
| 13:46:04 | sean-k-mooney | so if we are not loadign the entire image into memroy as a list then that means our imaage validation logic might be broken | |
| 13:46:04 | stephenfin | for v2, and for v1 the 'data' function is the only one that returns IterableWithLength too | |
| 13:50:53 | sean-k-mooney | ok so RequestIdProxy is its self an iterable which delegates to the IterableWithLength | |
| 13:53:55 | sean-k-mooney | and its internal iterable is initalised to the resopocne body | |
| 13:54:12 | sean-k-mooney | ok so ya it look like you are right | |
| 13:54:37 | sean-k-mooney | sincei it returns an iterable object not a generator it wont take that brnach. | |
| 13:56:17 | sean-k-mooney | "utils.serious_integrity_iter" they have some interesting names | |
| 13:56:52 | gibi | stephenfin: thanks. your comment make sense | |
| 14:17:20 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |
| 14:30:16 | stephenfin | gibi: bauzas: I meant to point this out last week. sean-k-mooney and I put it together. If you get a chance to take a look, let me know what you think/if there's anything to add https://that.guru/blog/the-numa-scheduling-story-in-nova/ | |
| 14:30:58 | stephenfin | We're trying to answers to commonly asked questions like that somewhere | |
| 14:31:00 | bauzas | stephenfin: gibi: I'm a bit on and off today due to a lot of stuff to do (French WC, bug issues, doc issues...) | |
| 14:31:09 | stephenfin | *to dump | |
| 14:31:11 | bauzas | but how can I help ? | |
| 14:31:28 | stephenfin | bauzas: No help needed. More of an FYI about that article | |
| 14:31:36 | bauzas | ahah lol | |
| 14:31:50 | stephenfin | bauzas: You've already seen it internally :) | |
| 14:32:21 | bauzas | seen what ? | |
| 14:32:28 | gibi | stephenfin, sean-k-mooney: nice blog, I've added that to my read queue | |
| 14:32:36 | stephenfin | bauzas: https://that.guru/blog/the-numa-scheduling-story-in-nova/ | |
| 14:32:39 | bauzas | that I helped french associates to get 120€ more ? :) | |
| 14:32:39 | bauzas | that I helped french associates to get 120€ more ? :) | |
| 14:33:27 | bauzas | weirdo, I haven't seen it in our chan :) | |
| 14:39:14 | openstackgerrit | Merged openstack/nova stable/rocky: Update scheduler instance info at confirm resize https://review.opendev.org/730344 | |
| 14:41:35 | openstackgerrit | Dan Smith proposed openstack/nova master: Make libvirt able to trigger a backend image copy when needed https://review.opendev.org/656998 | |
| 14:41:36 | openstackgerrit | Dan Smith proposed openstack/nova master: Plumb image import functionality through our glance module https://review.opendev.org/731550 | |
| 14:44:32 | dansmith | lyarwood: are you around? | |
| 14:45:56 | lyarwood | dansmith: yup | |
| 14:46:26 | dansmith | lyarwood: hey, surely we have some "so you want to configure rbd..." docs in nova, no? I can't seem to find them with half-assed grepping | |
| 14:47:28 | stephenfin | gibi: could I ask you to poke https://review.opendev.org/#/c/712766/ today/this week? | |
| 14:49:50 | lyarwood | dansmith: only https://docs.openstack.org/nova/latest/admin/configuration/hypervisor-kvm.html#configure-compute-backing-storage that I'm aware of | |
| 14:50:08 | lyarwood | dansmith: and that isn't specific to rbd | |
| 14:50:17 | dansmith | lyarwood: yeah that's unsatisfying | |
| 14:50:54 | dansmith | lyarwood: so, I was going to write up some docs about this multistore thing, but it would be weird to start a doc with "so you know everything about normal rbd, let's turn that up to 11" | |
| 14:51:24 | dansmith | lyarwood: are you capable of writing some basicy docs for rbd if I write the second half for multistore, or know anyone that would be good? | |
| 14:51:58 | lyarwood | dansmith: if you can wait a few weeks then yeah I can write that | |
| 14:52:54 | gibi | stephenfin: on it | |
| 14:53:23 | dansmith | lyarwood: okay, that'd be cool.. I'll write the multistore bit and can hang on for you to be around to fill in the first part | |
| 14:53:56 | dansmith | I guess I could try but I think it'd be pretty contrived | |
| 14:54:01 | lyarwood | dansmith: ack cool just remind me once I'm back :) | |
| 15:05:49 | openstackgerrit | Stephen Finucane proposed openstack/nova master: virt: Add 'context', drop 'network_info' parameters for 'unrescue' https://review.opendev.org/730382 | |
| 15:05:50 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add emulated TPM support to Nova https://review.opendev.org/631363 | |
| 15:05:50 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files https://review.opendev.org/639934 | |
| 15:18:15 | openstackgerrit | Balazs Gibizer proposed openstack/nova stable/queens: Reproduce bug 1869050 https://review.opendev.org/731563 | |
| 15:18:15 | openstack | bug 1869050 in OpenStack Compute (nova) queens "migration of anti-affinity server fails due to stale scheduler instance info" [Low,Triaged] https://launchpad.net/bugs/1869050 | |
| 15:19:27 | openstackgerrit | Balazs Gibizer proposed openstack/nova stable/queens: Update scheduler instance info at confirm resize https://review.opendev.org/731564 | |
| 15:54:51 | gibi | nova meeting will start in 5 miuntes on #openstack-meeting-3 | |
| 16:07:08 | openstackgerrit | Dan Smith proposed openstack/nova master: WIP: Add libvirt RBD configuration doc https://review.opendev.org/731577 | |
| 16:34:19 | openstackgerrit | Merged openstack/nova master: Handle flavor disk mismatches when resizing https://review.opendev.org/712766 | |
| 16:34:41 | sean-k-mooney | gibi: sorry was distracted did ye wrap up the team meeting early | |
| 16:35:08 | sean-k-mooney | i didnt actlly have anything for the adgenda | |
| 16:35:16 | sean-k-mooney | i just ment to join | |
| 16:36:06 | gibi | sean-k-mooney: yepp it was done early | |
| 16:36:13 | sean-k-mooney | cool | |
| 16:36:25 | openstackgerrit | Dan Smith proposed openstack/nova master: Remove deprecated nova.image.download hook https://review.opendev.org/725338 | |
| 16:37:11 | openstackgerrit | Dan Smith proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD https://review.opendev.org/574301 | |
| 16:38:34 | sean-k-mooney | gibi: im debating if i should remove one of my topics form the ptg. namely the topic around hardware profiles/stable abis/ changing and evolving our defaults | |
| 16:38:58 | sean-k-mooney | it think its a topic we should discuss but im debating if we should discuss it now | |
| 16:39:22 | sean-k-mooney | vs trying to finish out some of the other things that are on the list | |
| 16:41:40 | gibi | sean-k-mooney: up to you | |
| 16:41:48 | gibi | I don't have hard oppinion | |
| 16:43:19 | sean-k-mooney | ill think about it some more and let you know. | |
| 16:43:34 | sean-k-mooney | ill leae it for now and if we decide to skip over it fine | |
| 17:01:24 | gibi | sean-k-mooney: OK, that also works | |
| 17:47:17 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add emulated TPM support to Nova https://review.opendev.org/631363 | |
| 17:47:17 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add support for resize and cold migration of emulated TPM files https://review.opendev.org/639934 | |
| 18:11:01 | gmann | gibi: request from bnemec to schedule the oslo policy topic later than 15:00 on Monday ? | |
| #openstack-nova - 2020-05-29 | |||
| 03:06:06 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |
| 04:58:35 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |
| 07:09:48 | gibi | gmann: we have the whole 15:00 - 17:00 slot on Monday for oslo crossproject so within that timeframe any slot is OK | |
| 07:10:33 | gibi | gmann, bnemec: let me know if you have a more finegrained start time than somewhere between 15:00 - 17:00 | |
| 07:37:31 | bauzas | good morning Nova | |
| 07:41:23 | gibi | good morning bauzas! | |
| 08:12:48 | frickler | hello nova, I seem to be getting persistent tempest failures while detaching volumes when trying to run on focal (ubuntu 20.04), may this does ring a bell for someone? see e.g. https://zuul.opendev.org/t/openstack/build/a5aca94014224f1fa1acbb64e3f72f54/log/controller/logs/screen-n-cpu.txt?severity=4#39514 | |
| 08:13:14 | frickler | lyarwood: ^^ that also seems to affect your recent server_rescue tests | |
| 09:09:09 | lyarwood | frickler: morning, looking | |
| 09:20:26 | lyarwood | I'm seeing this logged alot in there, this isn't the issue but still something we should fix | |
| 09:20:29 | lyarwood | 50459 May 28 17:49:19.906197 ubuntu-focal-rax-ord-0016842009 nova-compute[139822]: Exception ignored in: <function _after_fork at 0x7f5217bc6b80> | |
| 09:20:31 | lyarwood | 50460 May 28 17:49:19.906197 ubuntu-focal-rax-ord-0016842009 nova-compute[139822]: Traceback (most recent call last): | |
| 09:20:33 | lyarwood | 50461 May 28 17:49:19.906197 ubuntu-focal-rax-ord-0016842009 nova-compute[139822]: File "/usr/lib/python3.8/threading.py", line 1454, in _after_fork | |
| 09:20:35 | lyarwood | 50462 May 28 17:49:19.906197 ubuntu-focal-rax-ord-0016842009 nova-compute[139822]: assert len(_active) == 1 | |