| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2022-02-23 | |||
| 10:35:44 | kashyap | gibi: (Sorry, was out for a run; weather is nice for a change) Hm, I'm feeling like we're 2 steps fwd, 1 step backward | |
| 10:44:16 | gibi | bauzas: Alban responded in review to update the versions so I'm still OK | |
| 10:44:29 | gibi | kashyap: I still in the | |
| 10:44:40 | gibi | kashyap: I'm still in the winter mode an only use the pool | |
| 10:44:48 | gibi | *and | |
| 10:45:55 | kashyap | I can't swim yet, I can do "controlled not drowning" in a calm pool if you know what I mean :D | |
| 10:46:07 | gibi | :) | |
| 10:46:24 | gibi | kashyap: about the bug, I'm not sure how to move forward | |
| 10:46:28 | kashyap | (No worries. I only began after 2 months...but keep walking 8-ish KM each day. But it's no substitue for running) | |
| 10:46:43 | kashyap | gibi: Back to the bug, it looks like it is not reproducible, right? | |
| 10:47:49 | kashyap | gibi: Did you look for this? | |
| 10:47:51 | kashyap | "libvirt.libvirtError: Unable to read from monitor: Connection reset by peer" | |
| 10:48:27 | gibi | I looked for the more specific raise libvirtError..virDomainGetBlockJobInfo.. failed.. regex | |
| 10:48:53 | gibi | but I can check the more generic one | |
| 10:50:31 | kashyap | gibi: Your search makes sense. | |
| 10:50:50 | kashyap | Yeah, what I'm wondering is, we don't see the _crash_ anymore: | |
| 10:50:51 | kashyap | "2022-01-25 13:13:35.058+0000: shutting down, reason=crashed" | |
| 10:51:14 | kashyap | Is that what you found based on your searches? That you can't find the crash anymore? | |
| 10:52:43 | gibi | I did not find the same nova symptom, the libvirtError, in any upstream logs, so I did not look deeper | |
| 10:53:27 | gibi | I can also try to find the same tempest test failure | |
| 10:53:32 | gibi | in upstream jobs | |
| 10:53:58 | gibi | and if I found one then I can refine from there | |
| 10:54:15 | kashyap | gibi: Nod. But you wanted a TripleO job result, right? | |
| 10:54:59 | kashyap | gibi: When you get a minute, can you please add your observation so far? Just so that it gives an insight that several folks are looking at it - https://bugs.launchpad.net/tripleo/+bug/1959014/ | |
| 10:55:37 | gibi | I can look at the original triploo run from ^^ bug but I'm new to tripleo that why I tried to find a repro in a nova run | |
| 10:56:28 | kashyap | Yeah, understood. I'm "perpetually new" to TripleO too. They're seeing this on TripleO, it looks like | |
| 10:56:43 | kashyap | gibi: Good that we (you) ruled it out w/ plain upstream jobs, at least. Thank you for the digging | |
| 10:57:15 | gibi | I will look at the original run, and then update the bug what I see | |
| 10:59:37 | sean-k-mooney | bauzas: i think https://blueprints.launchpad.net/nova/+spec/vmware-fcd is the blueprint for that by the way | |
| 10:59:53 | sean-k-mooney | its approved for the yoga cycle | |
| 11:00:09 | stephenfin | Is it just me, or is anyone else not getting emails from Gerrit at the moment. I haven't seen anything since midday yesterday | |
| 11:00:09 | sean-k-mooney | althouhg they are missing the commit message line for it | |
| 11:00:35 | sean-k-mooney | stephenfin: it know that you have abandoned us :P | |
| 11:01:06 | sean-k-mooney | stephenfin: last email was 12:04 yesterday | |
| 11:01:17 | sean-k-mooney | not sure if i should have got anything since then | |
| 11:01:48 | bauzas | sean-k-mooney: yup, we approved it as a specless BP during a meeting, see the whiteboard | |
| 11:02:20 | sean-k-mooney | bauzas: oh i know just wanted to highlight it to you incase you tought it was not approved | |
| 11:02:38 | sean-k-mooney | i noticed both you and gibi are +2 on it | |
| 11:02:47 | bauzas | sean-k-mooney: no, I'm tracking all the approved bps in https://etherpad.opendev.org/p/nova-yoga-blueprint-status | |
| 11:02:55 | sean-k-mooney | but ye have not +w so i was wondering if you were conceren that it was not approved | |
| 11:03:05 | bauzas | sean-k-mooney: and this one was in there so I was looking at it | |
| 11:03:06 | sean-k-mooney | ack | |
| 11:03:17 | bauzas | sean-k-mooney: I eventually +W it 1 min ago | |
| 11:03:21 | bauzas | as alban replied | |
| 11:03:37 | sean-k-mooney | stephenfin: so https://review.opendev.org/c/openstack/placement/+/826719 meged 14 hours ago | |
| 11:03:46 | sean-k-mooney | and i dont have a gerrit email from it | |
| 11:04:07 | sean-k-mooney | so ya i havent got anythin since just after noon yesterday so looks like its not just you | |
| 11:29:45 | stephenfin | sean-k-mooney: I emailed the list and mentioned it on #opendev | |
| 11:31:14 | sean-k-mooney | gibi by the way your placment any triats series is now merged in case you didnt get the gerrit email :) | |
| 11:31:47 | sean-k-mooney | stephenfin: was there anything in particalar you were looking for | |
| 11:31:57 | sean-k-mooney | or just noticed you got no emails form gerrit in a while | |
| 11:32:09 | stephenfin | No, just noticed the lack of emails | |
| 11:32:15 | sean-k-mooney | ack | |
| 11:32:17 | stephenfin | (Usually it's a firehose) | |
| 11:35:07 | sean-k-mooney | lyarwood: sorry to bother you but do you know what i should do with https://review.rdoproject.org/r/c/openstack/placement-distgit/+/39716 the build failed because it coudl not resovle the centos8-stream repos its not related to the patch that merged so do i just abandon that? | |
| 11:35:45 | lyarwood | sean-k-mooney: The RDO folks normally close these out once the outage is over | |
| 11:36:13 | sean-k-mooney | ok it showed up in my email so i was like do i need to do somehting with this | |
| 11:36:35 | sean-k-mooney | Errors during downloading metadata for repository 'Stream-BaseOS': | |
| 11:36:49 | sean-k-mooney | is clearly not related to placement | |
| 11:37:59 | lyarwood | Yeah it's infra 99% of the time | |
| 11:38:13 | sean-k-mooney | 2919c3f393bb2e897cead2e62c598acadeae3b8bd1603ef8e171e4274ff1b2e0-primary.xml.gz is missing form the mirrors | |
| 11:38:39 | sean-k-mooney | so proably a sync issue | |
| 11:38:56 | sean-k-mooney | lyarwood: how is life in openshift land | |
| 11:39:33 | lyarwood | Yeah good, I've somehow ended up helping with the introduction of flavors into KubeVirt ^_^ | |
| 11:40:12 | opendevreview | Rajat Dhasmana proposed openstack/nova master: Add support for volume backed server rebuild https://review.opendev.org/c/openstack/nova/+/820368 | |
| 11:40:42 | sean-k-mooney | ok so pod spec templates or something like that ya | |
| 11:43:21 | sean-k-mooney | the idea of flavors in a k8s env would be somewhat differnt then ours i expect since the intent with k8s is to be much more dynmic in terms of each pod spec is used for that one set of pods but not reused across unrelated pods | |
| 11:44:03 | sean-k-mooney | so unlike openstack if you udated the kubevirt flavor i would expect that to propagate to everything that used it | |
| 11:59:52 | gibi | kashyap: https://bugs.launchpad.net/tripleo/+bug/1959014/comments/15 tldr; I don't think the original problem was reproduced in later runs linked in the bug | |
| 12:00:34 | sean-k-mooney | stephenfin: by the way nova is nolonger installable with -e because pbr cannot figure out the version | |
| 12:00:49 | gibi | sean-k-mooney: thanks for pushing the any-traits through. I will get back to the series to do the small nit followup and the perf measurements / tuning | |
| 12:01:16 | sean-k-mooney | stephenfin: i know there is a bug with the current pbr due to metadata or somehting like that but do you know if the impact on nova is expected | |
| 12:01:30 | sean-k-mooney | gibi: ack | |
| 12:02:34 | stephenfin | sean-k-mooney: There is? I wasn't aware of anything | |
| 12:02:48 | sean-k-mooney | if you install with devstack | |
| 12:02:58 | sean-k-mooney | then clone nova and pip install -e the clone | |
| 12:03:08 | sean-k-mooney | then when you restart the nova compute agent | |
| 12:03:10 | sean-k-mooney | or any of the rest | |
| 12:03:13 | sean-k-mooney | it will fail to run | |
| 12:03:32 | sean-k-mooney | because pbr will not be able to figure out the version | |
| 12:03:47 | sean-k-mooney | so you ahve to do a non -e install currently | |
| 12:04:02 | sean-k-mooney | which is annoying since you have to redo it every time you make a change | |
| 12:06:59 | gibi | hm, I haven't hit that issue yet ^^ | |
| 12:07:10 | gibi | probably my pbr is older | |
| 12:09:29 | sean-k-mooney | https://paste.opendev.org/show/812529/ | |
| 12:09:56 | sean-k-mooney | stephenfin: gibi that is what it looks liek in the journal | |
| 12:10:40 | stephenfin | That's weird. I haven't seen that eithe | |
| 12:10:41 | stephenfin | *either | |
| 12:10:53 | sean-k-mooney | have you done sudo pip install -e | |
| 12:11:05 | sean-k-mooney | of the repo or a differnt copy of the repo | |
| 12:11:14 | stephenfin | I didn't need to. It does an editable install by default | |
| 12:11:19 | stephenfin | DevStack that is | |
| 12:11:27 | gibi | yeah I have the editable nova in devstack too | |
| 12:11:36 | gibi | so then that is the difference | |
| 12:11:55 | sean-k-mooney | so ye dont use a second repo for dev | |
| 12:12:06 | sean-k-mooney | with devstafck using reclone=ture i guess | |
| 12:12:21 | gibi | I tend to pull from my dev repo to the devstack nova repo with git | |
| 12:12:38 | stephenfin | Yeah, me too | |
| 12:12:47 | sean-k-mooney | ok you do it that way instead of installign the dev one after the fact | |
| 12:12:49 | stephenfin | Or I push from the local to devstack | |