| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-09-06 | |||
| 11:05:29 | sean-k-mooney | but we should finish the sev seires as soon as we can i think | |
| 11:05:38 | aspiers | +1 for that ;-) | |
| 11:05:38 | sean-k-mooney | then push to land the cpu series | |
| 11:06:02 | aspiers | It's unfortunate that there was a Gerrit issue causing the current Zuul backlog | |
| 11:06:17 | aspiers | But hopefully it should catch up over the weekend | |
| 11:14:23 | bauzas | aspiers: gtk, then we should avoid asking for respins in case of nits | |
| 11:14:58 | aspiers | bauzas: yes, currently some jobs are in the check queue for >20 hours | |
| 11:16:51 | gibi | aspiers: I think those jobs stuck, as other, newly proposed patches went through | |
| 11:17:27 | aspiers | gibi: hrmm :-( I'll ask on #openstack-infra | |
| 11:19:00 | aspiers | gibi: Which ones do you see going through which are newer? I don't see them | |
| 11:19:07 | openstackgerrit | Brin Zhang proposed openstack/nova master: Add operator user_id/project_id to the migrations https://review.opendev.org/679413 | |
| 11:19:07 | openstackgerrit | Brin Zhang proposed openstack/nova master: Add user_id and project_id colume to Migration https://review.opendev.org/673990 | |
| 11:19:08 | openstackgerrit | Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243 | |
| 11:19:45 | gibi | aspiers: bauzas approved this couple of hours ago https://review.opendev.org/#/c/656422/ | |
| 11:20:06 | gibi | aspiers: and it went through the gate since | |
| 11:20:58 | bauzas | but the flakey network makes me crazy | |
| 11:21:01 | bauzas | dudes, move out my lawn ! | |
| 11:21:28 | bauzas | (and don't take all bandwith for crazy netflix thingies) | |
| 11:21:29 | aspiers | gibi: but the most recent patch set was uploaded yesterday afternoon | |
| 11:21:42 | aspiers | gibi: so I don't think it jumped the queue | |
| 11:22:00 | gibi | aspiers: true, so it can be that the check queue is owercrowded but the gate queue isny | |
| 11:22:03 | gibi | isnt | |
| 11:22:03 | bauzas | aspiers: gibi: I haven't paid attention to the status recently | |
| 11:22:13 | aspiers | gibi: yes exactly that is the case | |
| 11:22:25 | bauzas | aspiers: you know the difference between the gate and check pipelines, right? | |
| 11:22:26 | aspiers | I don't know why they are different resource pools | |
| 11:22:35 | aspiers | bauzas: yes of course | |
| 11:22:55 | gibi | could be that patches sitting in the check queue consuming resouce but now moving forward? | |
| 11:23:34 | bauzas | oh, freaky | |
| 11:23:38 | bauzas | http://zuul.openstack.org/status | |
| 11:23:54 | aspiers | bauzas: yes this is what we are talking about :) | |
| 11:24:33 | bauzas | hard to see with a flakey connection :) | |
| 11:25:06 | aspiers | The gate looks fine, but not check | |
| 11:25:24 | sean-k-mooney | gibi: infra were seeing quota issue causing nodepool failures | |
| 11:25:38 | sean-k-mooney | as a result the queue built up a bit | |
| 11:25:45 | gibi | sean-k-mooney: thanks, so we need to be patient | |
| 11:25:46 | sean-k-mooney | i think they were fixed yesterday evening | |
| 11:25:52 | sean-k-mooney | yes | |
| 11:25:59 | sean-k-mooney | it will just take a while | |
| 11:26:11 | aspiers | yup | |
| 11:26:16 | sean-k-mooney | although if it does not wew might need a zuul restart to clear the queue | |
| 12:02:18 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: DB API changes to get non-matching aggregates from metadata https://review.opendev.org/671074 | |
| 12:02:18 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Nova object changes for forbidden aggregates request filter https://review.opendev.org/671072 | |
| 12:02:19 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Docs for isolated aggregates request filter https://review.opendev.org/667952 | |
| 12:02:19 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Add a new request filter to isolate aggregates https://review.opendev.org/671075 | |
| 12:04:10 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Add min service level check for migrate with bandwidth https://review.opendev.org/680394 | |
| 12:06:06 | openstackgerrit | Dongcan Ye proposed openstack/nova master: Get pci_devices from _list_devices https://review.opendev.org/680674 | |
| 12:09:07 | dtantsur | efried, dustinc, update: the grenade failure in our CI probably is not caused by the instance_id problem.. | |
| 12:19:07 | gibi | bauzas: if you still have energy then this is the next patch in the bw series. I fixed up mriedem's comments https://review.opendev.org/#/c/680394 | |
| 12:49:07 | bauzas | gibi: heh, sure, I'm now waiting for my train | |
| 12:49:43 | gibi | bauzas: meanwhile I found that I left some debug print statement in that patch :/ so I will need to go back and remove them. | |
| 12:50:04 | bauzas | gibi: oh, which one ? did I miss it too ? | |
| 12:50:15 | bauzas | if so, Starbucks, I hate you | |
| 12:50:18 | gibi | bauzas: in https://review.opendev.org/680394 | |
| 12:50:24 | gibi | bauzas: not in the patch you approved | |
| 12:58:15 | mriedem | yonglihe: will you have time to address these comments in https://review.opendev.org/#/c/670790/ today or should someone else do those? | |
| 13:12:00 | mriedem | artom: let me know if you want to talk about any of my comments before you push changes | |
| 13:14:17 | mdbooth | mriedem dansmith: Looks like I've got another customer report affected by https://review.opendev.org/#/c/677736/ | |
| 13:14:24 | mdbooth | Any chance we could merge that? | |
| 13:15:04 | artom | mriedem, ack - you saw I noticed a thing we all missed until now? The -1 on the massive patch | |
| 13:15:23 | artom | Not that hard a fix, but kind of a bitch to only spot it now | |
| 13:15:33 | mriedem | i haven't looked back on responses yet | |
| 13:16:11 | artom | mriedem, https://review.opendev.org/#/c/635229/58/nova/virt/libvirt/driver.py@7345 for when you're ready to look | |
| 13:16:31 | mriedem | yonglihe: also, as i said on that novaclient change, i'd like to see what it actually looks like in the output | |
| 13:16:48 | mriedem | if it's just a bunch of json blobs dumped to the console that's not very useful | |
| 13:18:03 | mriedem | artom: is that because i was asking about guest_cpu_tune and guest_numa_tune being exclusive? | |
| 13:18:14 | openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Fix incorrect invocation of openstacksdk's baremetal.nodes() https://review.opendev.org/680684 | |
| 13:18:17 | dtantsur | efried, dustinc, mriedem, another issue ^^^ | |
| 13:18:30 | artom | mriedem, yeah, that's what lead me down that path | |
| 13:18:30 | dtantsur | this one probably affects ironic CI as well | |
| 13:18:35 | mriedem | \o/ | |
| 13:18:42 | artom | mriedem, indeed :) | |
| 13:18:43 | mriedem | mdbooth: i'll follow dansmith's lead on that one | |
| 13:20:13 | mriedem | dustinc: commented | |
| 13:23:00 | yonglihe | mriedem: do you mean put json to release notes? It is definitely json blob. | |
| 13:23:41 | yonglihe | https://review.opendev.org/#/c/621476/62/doc/api_samples/os-server-topology/v2.78/servers-topology-resp.json | |
| 13:23:57 | dtantsur | mriedem: I can try to reproduce my thoughts process in a bug, although it was a bit of guessing initially :) do you still use launchpad? | |
| 13:25:21 | yonglihe | mriedem: BTW, I'm afraid i don't have time to do it today, sorry. | |
| 13:26:21 | mdbooth | mriedem: Ack, thanks. | |
| 13:26:23 | mriedem | yonglihe: no i meant i'd like to see what the CLI output looks like | |
| 13:26:34 | mriedem | dtantsur: yeah | |
| 13:26:41 | dtantsur | so old school :) | |
| 13:26:45 | mriedem | best school | |
| 13:27:00 | mriedem | dtantsur: btw how is that we're not seeing issues in ironic CI? | |
| 13:27:10 | mriedem | or is it just because the job is non-voting in nova? | |
| 13:27:14 | dtantsur | mriedem: it has only one node at all. so picking a random node works. | |
| 13:27:27 | dtantsur | our multinode grenade uses several nodes, so it got hard broken on this. | |
| 13:27:38 | dtantsur | I'm writing a bug with explanation. | |
| 13:27:45 | mriedem | ok well just a link to a failed instance of one of those jobs with logs would be good in a bug report | |
| 13:27:47 | mriedem | thanks | |
| 13:28:14 | yonglihe | mriedem: then i need to running it after this weekend, sorry. | |
| 13:30:34 | dtantsur | mriedem: https://bugs.launchpad.net/nova/+bug/1843050 | |
| 13:30:34 | mriedem | ok, maybe sean-k-mooney or stephenfin or artom have a system with servers that have numa topology and they can pull this down and see what it looks like | |
| 13:30:35 | openstack | Launchpad bug 1843050 in OpenStack Compute (nova) "Regression in the ironic driver: wait_for_active checks a random node" [Undecided,New] | |
| 13:31:08 | yonglihe | mriedem: that's so nice. | |
| 13:31:12 | stephenfin | mriedem: This is the patch to expose NUMA topology API change in novaclient? | |
| 13:31:35 | openstackgerrit | Dmitry Tantsur proposed openstack/nova master: Fix incorrect invocation of openstacksdk's baremetal.nodes() https://review.opendev.org/680684 | |
| 13:31:45 | mriedem | stephenfin: yeah | |
| 13:31:50 | artom | mriedem, they could probably pile on to sean-k-mooney's new nfv job | |
| 13:31:58 | mriedem | artom: it's novaclient | |