| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-04-21 | |||
| 08:06:07 | bauzas | gosh, the tox target for relnotes takes a while recalculating all the relnotes... | |
| 08:38:49 | openstackgerrit | Sylvain Bauza proposed openstack/nova master: Ussuri 21.0.0 prelude section https://review.opendev.org/721548 | |
| 08:38:59 | bauzas | wow, it took a while but I'm done | |
| 08:39:42 | openstackgerrit | Merged openstack/nova master: Add new default roles in quota class policies https://review.opendev.org/719100 | |
| 08:39:48 | bauzas | gibi: stephenfin: dansmith: melwitt: alex_xu: gmann: others, the prelude section patch is up for reviews https://review.opendev.org/721548 | |
| 08:40:34 | bauzas | lyarwood: too ^ | |
| 08:41:51 | bauzas | gibi: can I hold the bugs lock ? | |
| 08:42:32 | openstack | Launchpad bug 1831315 in OpenStack Compute (nova) "nova-manage cell_v2 discover_hosts fails for IPv6 - ValueError: invalid literal for int() with base 10 - db connection URI gets its brackets eaten" [Undecided,New] - Assigned to Harald Jensås (harald-jensas) | |
| 08:42:32 | gibi | bauzas: I'm looking at https://bugs.launchpad.net/nova/+bug/1831315 right now but after that I have to jump to your prelude patch so you can have the lock | |
| 08:42:32 | openstack | Launchpad bug 1831315 in OpenStack Compute (nova) "nova-manage cell_v2 discover_hosts fails for IPv6 - ValueError: invalid literal for int() with base 10 - db connection URI gets its brackets eaten" [Undecided,New] - Assigned to Harald Jensås (harald-jensas) | |
| 08:43:19 | bauzas | gibi: you don't order bugs by Age, right? | |
| 08:47:02 | gibi | bauzas: I skip those that I cannot do anyithing with | |
| 08:47:27 | bauzas | ok, I'll try to look at them and ask for more if needed | |
| 08:47:50 | gibi | thanks | |
| 09:00:33 | openstack | Launchpad bug 1860312 in OpenStack Compute (nova) "compute service failed to delete" [Undecided,New] | |
| 09:00:33 | bauzas | gibi: for example, https://bugs.launchpad.net/nova/+bug/1860312 looks unrelated to Nova | |
| 09:00:54 | gibi | bauzas: is it so? | |
| 09:01:18 | gibi | bauzas: for me it seems like we somehow manage to allow a db corruption | |
| 09:01:41 | gibi | "When I try to delete the old compute service(status down), it failed." | |
| 09:02:30 | gibi | sure I don't know how the deployment ended up in "ComputeHostNotFound: Compute host mgt-slave03 could not be found " state | |
| 09:02:52 | gibi | but I feel that nova should support deleting old unused compute services | |
| 09:05:37 | gibi | my problem is that I have no way to try to recreate the bug without building a kubenetes + ironic env | |
| 09:11:48 | kashyap | lyarwood: So ... one test failure seems legit here: https://review.opendev.org/#/c/708701/4 | |
| 09:12:04 | kashyap | lyarwood: You know the reason once you see the failing test: test_stable_device_rescue_cdrom_ide() + Q35 :) | |
| 09:16:25 | lyarwood | I've not had a look yet no | |
| 09:16:38 | lyarwood | I assume with that test that q35 doesn't have an IDE bus? | |
| 09:16:47 | lyarwood | iirc that's the case right | |
| 09:17:10 | lyarwood | I can add a configurable in tempest for that | |
| 09:17:25 | lyarwood | the config drive issue is still there as well btw | |
| 09:18:32 | openstackgerrit | Lee Yarwood proposed openstack/nova master: docs: Add stable device rescue docs https://review.opendev.org/700837 | |
| 09:18:33 | kashyap | lyarwood: Yeah, the issue is indeed 'q35' has no IDE bus | |
| 09:18:55 | kashyap | lyarwood: Sorry, which config drive issue? | |
| 09:19:35 | lyarwood | kashyap: see test_server_basic_ops etc, blkid -L config-2 -o device', exit status: 2 | |
| 09:19:46 | lyarwood | ah wait | |
| 09:19:57 | lyarwood | that's because that's a cdrom | |
| 09:20:06 | lyarwood | over SCSI? | |
| 09:20:29 | kashyap | lyarwood: You mean over IDE, instead of SATA (or 'virtio')? | |
| 09:21:11 | lyarwood | kashyap: we don't have IDE, I can't recall if we default to SCSI in that case or SATA | |
| 09:21:13 | kashyap | I'm not sure yet ... I'll see what my non-configurable one-liner yields: https://review.opendev.org/#/c/721555/ | |
| 09:21:43 | lyarwood | kashyap: nack, IDE + cdrom is still a valid test case prior to q35 IMHO | |
| 09:21:44 | kashyap | lyarwood: Don't you recall the patch you made? :) We default to SATA with Q35: https://review.opendev.org/#/c/663011/ | |
| 09:22:07 | kashyap | lyarwood: Oh, sure; it still _is_ a valid test for PC | |
| 09:22:08 | lyarwood | ah right | |
| 09:22:41 | kashyap | (I'm just seeing what this not-to-be-merged yields. And a config tunable is perhaps the way) | |
| 09:23:27 | lyarwood | so are you pulling that in anywhere to test against 135? | |
| 09:24:17 | kashyap | lyarwood: Sorry, 135? | |
| 09:24:44 | lyarwood | q35 sorry | |
| 09:24:55 | bauzas | gibi: the problem is that ironic still sees some node | |
| 09:25:08 | bauzas | gibi: while nova doesn't | |
| 09:25:17 | kashyap | lyarwood: Err, I need to make that dependent against your 'q35' job, isn' it? | |
| 09:25:20 | kashyap | Let me go do that | |
| 09:26:01 | bauzas | gibi: at least we can ask the reporter to tell us whether nova still sees it => Incomplete | |
| 09:26:35 | lyarwood | kashyap: make my q35 change depend on your tempest change | |
| 09:27:02 | kashyap | lyarwood: Yeah. Not sure what I'm thinking | |
| 09:27:08 | kashyap | Doing ... | |
| 09:27:13 | gibi | bauzas: OK, I was not able to formulate any valid question to the reporter. I glad you could | |
| 09:27:23 | bauzas | gibi: I'm just doing it | |
| 09:30:13 | kashyap | lyarwood: Can I remove the Depends-On in your 'q35' CI change against the 'blkid -L' change? | |
| 09:31:30 | kashyap | lyarwood: I'll remove it for now, so as to test one thing at a time -- okay? | |
| 09:32:37 | lyarwood | kashyap: well it's seperate | |
| 09:32:50 | lyarwood | kashyap: ah wait no it isn't | |
| 09:32:57 | lyarwood | kashyap: it's in openstack/tempest so yeah feel free to | |
| 09:33:22 | lyarwood | kashyap: btw I'm planing on writing a spec for the q35 default change next week | |
| 09:33:25 | kashyap | Okido; I'll add a note in the commit with a link to tit. | |
| 09:33:53 | kashyap | lyarwood: FWIW, I already have it in place somewhere | |
| 09:34:01 | kashyap | One is this BP: https://blueprints.launchpad.net/nova/+spec/gracefully-handle-qemu-machine-types | |
| 09:34:06 | kashyap | And a spec should also be around ... | |
| 09:35:04 | kashyap | lyarwood: Here's the spec started 8 months ago: https://review.opendev.org/#/c/631154/ | |
| 09:35:27 | lyarwood | kk I'll repropose that for V | |
| 09:37:07 | kashyap | lyarwood: I was meaning to send a note to the upstream list as a heads-up. | |
| 09:37:45 | kashyap | (I have a draft e-mail, will send it sometime this week. Giving a heads-up to prepare ... as this is a virtual 'motherboard' change) | |
| 09:39:39 | openstackgerrit | Kashyap Chamarthy proposed openstack/nova master: WIP: nova-next: Start testing the 'q35' machine type https://review.opendev.org/708701 | |
| 09:41:38 | lyarwood | kashyap: lets get the spec reproposed, updated and on the agenda for PTG first | |
| 09:42:29 | lyarwood | kashyap: I'm not going to be around for PTG btw would you be okay leading any sessions/discussions on the ML? | |
| 09:42:53 | openstack | Launchpad bug 1860312 in OpenStack Compute (nova) "compute service failed to delete" [Undecided,Incomplete] | |
| 09:42:53 | bauzas | gibi: FYI I think I found the problem but before triaging it to Confirmed, I need to ask the reporter to tell us whether I'm right https://bugs.launchpad.net/nova/+bug/1860312/comments/1 | |
| 09:42:58 | kashyap | lyarwood: Yeah, I was intending to that. As I've been delaying this work for various reasons | |
| 09:43:56 | gibi | bauzas: cool | |
| 09:44:08 | gibi | bauzas: also I left some comments on the prelude. good job! | |
| 09:44:31 | bauzas | gibi: ack | |
| 09:45:05 | gibi | stephenfin: could you re-review stable device rescue doc patch? https://review.opendev.org/#/c/700837 | |
| 09:45:09 | openstack | bug 1860312 in OpenStack Compute (nova) "compute service failed to delete" [Undecided,Incomplete] https://launchpad.net/bugs/1860312 | |
| 09:45:09 | bauzas | I wish I could easily find bug duplicates with Launchpad, because I'm pretty sure that bug 1860312 is not the only one for the same issue | |
| 09:45:17 | stephenfin | sure, just finished gmann doc change | |
| 09:45:21 | stephenfin | *gmann's | |
| 09:45:32 | gibi | stephenfin: that would have been my other request :) | |
| 09:46:54 | openstack | Launchpad bug 1853009 in OpenStack Compute (nova) "Ironic node rebalance race can lead to missing compute nodes in DB" [Undecided,In progress] - Assigned to Mark Goddard (mgoddard) | |
| 09:46:54 | bauzas | gibi: bingo : https://bugs.launchpad.net/nova/+bug/1853009 | |
| 09:47:53 | mgoddard | bauzas, gibi: would love some reviews on those patches :) | |
| 09:48:10 | bauzas | mgoddard: absolutely, will do | |
| 09:48:13 | mgoddard | I think some were failing unit tests, I can tidy up if someone plans to look | |
| 09:48:28 | bauzas | mgoddard: how many times ironic can rebalance ? | |
| 09:48:46 | bauzas | because I think that can be a problem for a shit ton of deployers using ironic | |
| 09:48:55 | mgoddard | bauzas: advance warning: prepare a cup of coffee, or three. Nasty race conditions ahead | |
| 09:49:08 | mgoddard | bauzas: unlimited rebalancing | |
| 09:49:15 | bauzas | in particular when it goes on top on something abstract API like k8s... | |
| 09:49:15 | stephenfin | lyarwood, gibi: done https://review.opendev.org/#/c/700837/ | |
| 09:49:52 | mgoddard | bauzas: the hash ring just consists of the active nova computes | |
| 09:49:54 | bauzas | mgoddard: just tbc, ironic does rebalance if the things below it are shuffled ? | |
| 09:50:12 | gibi | bauzas: ack about the duplicates | |