| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-05-10 | |||
| 19:08:21 | sean-k-mooney | 2 hours? | |
| 19:08:22 | dansmith | just over two hours | |
| 19:08:48 | sean-k-mooney | we can bump it to 150 mins i guess | |
| 19:09:13 | sean-k-mooney | i like it when test fail and give you the requst id | |
| 19:09:41 | sean-k-mooney | im going to see why that failed on the neutron side and ill let you know if i find anyting | |
| 19:12:13 | opendevreview | Dan Smith proposed openstack/nova master: Bump nova-ceph-multstore timeout https://review.opendev.org/c/openstack/nova/+/882890 | |
| 19:13:27 | sean-k-mooney | oh that is in seconds https://zuul-ci.org/docs/zuul/latest/job-content.html#var-zuul.timeout | |
| 23:02:53 | dansmith | here we go | |
| 23:05:36 | opendevreview | Merged openstack/nova master: Use force=True for os-brick disconnect during delete https://review.opendev.org/c/openstack/nova/+/882847 | |
| 23:05:43 | opendevreview | Merged openstack/nova master: Enable use of service user token with admin context https://review.opendev.org/c/openstack/nova/+/882852 | |
| #openstack-nova - 2023-05-11 | |||
| 00:19:29 | dansmith | melwitt: oh jeez I didn't realize that wasn't +V from zuul, thanks | |
| 00:20:28 | melwitt | np. it's hard to see through all the fail | |
| 00:20:54 | dansmith | just too many patches really | |
| 00:23:21 | melwitt | huh.. it looks like it's already been running. it was already +W by you.. I didn't think of the +W kicking off the job again /facepalm | |
| 00:23:53 | dansmith | oh I swore it was | |
| 00:24:02 | dansmith | I see your recheck put it back in the arm queue, | |
| 00:24:16 | dansmith | which is only a few minutes old but the other one has been running in regular check for over an hour | |
| 00:24:32 | melwitt | yeah. it doesn't restart the normal jobs thankfully | |
| 00:24:32 | dansmith | I thought I must have been looking at the wrong on | |
| 00:24:49 | melwitt | no, I'm just le dumb | |
| 00:25:10 | dansmith | no, there are too many identical patches :) | |
| 00:33:57 | dansmith | crap, 2023.1 patch is going to fail | |
| 00:34:23 | dansmith | dhcp fail in the guest | |
| 00:34:24 | dansmith | le sigh | |
| 00:34:28 | melwitt | dangit | |
| 00:49:17 | dansmith | top patch is +V waiting for another trip to gateland | |
| 00:49:34 | dansmith | man cripes | |
| 00:49:44 | dansmith | my friggin timeout patch is gonna fail again | |
| 00:50:24 | melwitt | 😑 | |
| 00:50:24 | melwitt | 😑 | |
| 00:50:39 | dansmith | [ 10.258086] Buffer I/O error on dev vda1, logical block 20, lost async page write | |
| 00:50:39 | dansmith | clearly something ceph related: | |
| 00:50:44 | dansmith | vda is the root disk, which is on ceph | |
| 00:51:05 | dansmith | last time around cinder just stopped creating volumes halfway through (maybe for similar reasons) | |
| 00:52:25 | dansmith | Out of memory: Killed process 55722 (ceph-osd) | |
| 00:52:28 | dansmith | that'll do it like every time | |
| 00:52:32 | dansmith | cripes | |
| 00:53:03 | melwitt | ouch | |
| 00:54:42 | dansmith | ah, | |
| 00:54:59 | dansmith | we're lowering the swap on our fatter job than the ceph job I increased in their repo | |
| 00:56:25 | opendevreview | Dan Smith proposed openstack/nova master: Bump nova-ceph-multstore timeout https://review.opendev.org/c/openstack/nova/+/882890 | |
| 00:56:33 | dansmith | melwitt: ^ | |
| 00:59:06 | melwitt | I don't understand that sentence 😆 | |
| 00:59:06 | melwitt | I don't understand that sentence 😆 | |
| 00:59:52 | melwitt | ok nevermind | |
| 00:59:55 | dansmith | wait, in my commit message or | |
| 01:00:18 | melwitt | yeah you explained what I didn't understand in your commit message | |
| 01:00:25 | dansmith | I bumped the ceph job to 8G while jammifiying and cephadmifying it, but we inherit from that and set it down to 4G, which makes no sense because we run even more stuff than they do | |
| 01:00:30 | dansmith | ack | |
| 05:41:49 | opendevreview | Merged openstack/nova stable/2023.1: Use force=True for os-brick disconnect during delete https://review.opendev.org/c/openstack/nova/+/882858 | |
| 05:47:56 | opendevreview | Amit Uniyal proposed openstack/nova stable/2023.1: Have host look for CPU controller of cgroupsv2 location. https://review.opendev.org/c/openstack/nova/+/882913 | |
| 05:50:06 | opendevreview | Amit Uniyal proposed openstack/nova stable/zed: Have host look for CPU controller of cgroupsv2 location. https://review.opendev.org/c/openstack/nova/+/882914 | |
| 06:43:51 | gibi | rechecked https://review.opendev.org/c/openstack/nova/+/882890 as it failed nova-next in the gate with unrealted timeouts | |
| 06:46:37 | gibi | also rechecked https://review.opendev.org/c/openstack/nova/+/882859 | |
| 06:47:29 | gibi | both failed with http read timeout on various openstack APIs (cinder, neutron, nova) | |
| 06:48:05 | gibi | I think this is tracked here as a bug https://bugs.launchpad.net/tempest/+bug/1999893 | |
| 07:05:24 | bauzas | morning | |
| 07:05:45 | bauzas | gibi: catching up the world explosion after my yesterday PTO | |
| 07:29:12 | gibi | I don't have the full context as the CVE got public why I was away | |
| 07:29:20 | gibi | I see the fixes proposed so I'm trying to land them | |
| 07:29:25 | opendevreview | Amit Uniyal proposed openstack/nova stable/yoga: Have host look for CPU controller of cgroupsv2 location. https://review.opendev.org/c/openstack/nova/+/882920 | |
| 07:32:10 | gibi | s/why/while/ | |
| 07:32:16 | opendevreview | Sylvain Bauza proposed openstack/nova stable/2023.1: Revert "Debug Nova APIs call failures" https://review.opendev.org/c/openstack/nova/+/882783 | |
| 07:33:07 | bauzas | gibi: np, just looking at gerrit reviews | |
| 07:33:14 | bauzas | gibi: do you need some explanations ? | |
| 07:33:43 | gibi | I read the CVE it is well documented so thanks I'm OK about the fixes we are pushing | |
| 07:34:00 | opendevreview | Amit Uniyal proposed openstack/nova stable/xena: Have host look for CPU controller of cgroupsv2 location. https://review.opendev.org/c/openstack/nova/+/882921 | |
| 09:47:34 | sean-k-mooney | bauzas: can you take a look at some os-vif changes for me | |
| 09:48:08 | sean-k-mooney | this one is trivial https://review.opendev.org/c/openstack/os-vif/+/882755 and this one is the one i really want to merge https://review.opendev.org/c/openstack/os-vif/+/881751 | |
| 09:48:33 | sean-k-mooney | or gibi or anyone else who is about | |
| 10:11:50 | bauzas | sean-k-mooney: fyk see my comment on https://review.opendev.org/c/openstack/os-vif/+/882755 | |
| 10:12:09 | bauzas | the TC will add back py38 in the Bobcat PTI | |
| 10:12:37 | bauzas | (but that's just a FYK, since Focal won't be accepted again) | |
| 10:25:46 | sean-k-mooney | 38 i htink is still tested in os-vif | |
| 10:25:59 | sean-k-mooney | i havent got around to updating that so cool i can leave that | |
| 10:26:31 | sean-k-mooney | we just use openstack-python3-jobs to contol that | |
| 10:27:01 | sean-k-mooney | i might add 3.11 like we did in nova seperatly but ill keep 3.8 testable | |
| 10:27:30 | sean-k-mooney | thanks for the reminder | |
| 10:32:52 | opendevreview | Amit Uniyal proposed openstack/nova stable/wallaby: Have host look for CPU controller of cgroupsv2 location. https://review.opendev.org/c/openstack/nova/+/882939 | |
| 10:51:51 | opendevreview | Merged openstack/nova master: Bump nova-ceph-multstore timeout https://review.opendev.org/c/openstack/nova/+/882890 | |
| 12:01:48 | gibi | sean-k-mooney: approved the os-vif qdisc patch | |
| 12:02:23 | sean-k-mooney | gibi: thanks for reviewing | |
| 12:08:01 | opendevreview | Merged openstack/os-vif master: remove focal based jobs https://review.opendev.org/c/openstack/os-vif/+/882755 | |
| 12:15:16 | bauzas | stable cores are needed for 2023.1 https://review.opendev.org/c/openstack/nova/+/882783 | |
| 12:15:16 | opendevreview | Balazs Gibizer proposed openstack/nova stable/2023.1: Bump nova-ceph-multstore timeout https://review.opendev.org/c/openstack/nova/+/882784 | |
| 12:16:12 | gibi | bauzas, dansmith, melwitt: The nova-ceph-mutlistore timeout bump is merged to master so I cherry-picked it to 2023.1 ^^ | |
| 12:16:37 | bauzas | gibi: done | |
| 12:16:51 | bauzas | gibi: sean-k-mooney: could you please look at https://review.opendev.org/c/openstack/nova/+/882783 ? | |
| 12:17:44 | sean-k-mooney | yep | |
| 12:18:39 | sean-k-mooney | elodilles: :) | |
| 12:18:49 | elodilles | done :) | |
| 12:18:53 | sean-k-mooney | bauzas: they are both now +2w'd | |
| 12:18:59 | gibi | \o/ | |
| 12:20:54 | sean-k-mooney | by the way i dont care that w is a letter can cant be past tense but +2w'd is definelty a thing :) and the 'd gets that point across | |
| 12:21:46 | sean-k-mooney | english sometime allows you to convay info in a way that would make tech writers cry | |
| 12:22:40 | sean-k-mooney | and im ok with that, we all know i mainly comunicate in seanspeak anyway :) | |
| 12:22:41 | elodilles | yepp, i also use EOL'd +2'd +W'd o:) | |
| 12:25:52 | elodilles | i don't remember where i saw that 1st time, but it can be understood, so i started to use that myself too | |
| 12:27:46 | sean-k-mooney | i dont think any one has ever objected but from a grammer rules point of view english allows you to syntasies past tense verbs this way. i just know my english teach would have been unhappy | |
| 12:28:22 | sean-k-mooney | with makeing an acronym both be a verb and have tence | |