| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-12-20 | |||
| 18:34:03 | opendevreview | sean mooney proposed openstack/nova master: pre-commit: Bump linter versions https://review.opendev.org/c/openstack/nova/+/903749 | |
| 18:34:03 | opendevreview | sean mooney proposed openstack/nova master: pre-commit: Add mypy https://review.opendev.org/c/openstack/nova/+/896228 | |
| 18:37:20 | sean-k-mooney | melwitt: ^ care to reapprove | |
| 18:40:57 | melwitt | done | |
| 18:41:41 | sean-k-mooney | by the way i thin kthe merge conflcit with yoru serise was in the patch that is already merged | |
| 18:41:59 | sean-k-mooney | so if that does not merged shortly you could just unparent again if you want too | |
| 18:42:17 | sean-k-mooney | melwitt: are you around tomorow/friday | |
| 18:42:36 | melwitt | sean-k-mooney: I'm around tomorrow | |
| 18:42:57 | sean-k-mooney | ok i might try and review your code tomorrow so if i can find time | |
| 18:43:16 | sean-k-mooney | are you taking much pto over the next few weeks | |
| 18:44:13 | melwitt | we have the year-end recharge Dec 22 until Jan 2 | |
| 18:44:38 | sean-k-mooney | ill be back on the 8th if you think its ready i think it woudl be great to try an land your seriese in early january | |
| 18:45:57 | melwitt | ++ yeah I'm pushing hard to get everything into finished shape by then. it's mostly adding unit tests and stuff like that | |
| 18:46:28 | melwitt | (i.e. the implementation won't change much if at all) | |
| 18:46:36 | sean-k-mooney | well to aid with athat i think it woudl be good to see if we can merge som of the eairler patches. | |
| 18:46:52 | sean-k-mooney | mainly so there is less to rebase/review | |
| 18:47:24 | melwitt | yeah, makes sense | |
| 20:26:49 | opendevreview | melanie witt proposed openstack/nova master: DNM test ephemeral encryption + resize: qcow2, raw, rbd https://review.opendev.org/c/openstack/nova/+/862416 | |
| 22:53:43 | opendevreview | melanie witt proposed openstack/nova master: Fix logging of exc_info in compute.utils.delete_image() https://review.opendev.org/c/openstack/nova/+/904155 | |
| 23:29:46 | opendevreview | Merged openstack/nova master: Allow best effort sending of notifications https://review.opendev.org/c/openstack/nova/+/903807 | |
| #openstack-nova - 2023-12-21 | |||
| 01:39:58 | opendevreview | Artom Lifshitz proposed openstack/nova master: weights debug log: stop using tuples as dict keys https://review.opendev.org/c/openstack/nova/+/904060 | |
| 05:00:33 | opendevreview | Merged openstack/nova master: pre-commit: Add mypy https://review.opendev.org/c/openstack/nova/+/896228 | |
| 05:33:04 | opendevreview | Merged openstack/nova master: pre-commit: Bump linter versions https://review.opendev.org/c/openstack/nova/+/903749 | |
| 10:39:31 | alisafari | Hi sean-k-mooney would you take a look at this backport. When you had the time ? https://review.opendev.org/c/openstack/nova/+/903444 | |
| 10:47:04 | kashyap | alisafari: That backport looks safe to me, but I can't +2 it, though. | |
| 10:57:29 | alisafari | kashyap Thank you. | |
| 10:59:24 | kashyap | alisafari: I just ACKed it, FWIW | |
| 11:14:14 | opendevreview | Sylvain Bauza proposed openstack/nova master: check both source and dest compute libvirt versions for mdev lv https://review.opendev.org/c/openstack/nova/+/904176 | |
| 11:14:14 | opendevreview | Sylvain Bauza proposed openstack/nova master: Augment the LibvirtLiveMigrateData object https://review.opendev.org/c/openstack/nova/+/904175 | |
| 11:14:15 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP: Check can destination can support mdev types https://review.opendev.org/c/openstack/nova/+/904177 | |
| 11:20:00 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP: Check can destination can support mdev types https://review.opendev.org/c/openstack/nova/+/904177 | |
| 11:41:08 | dvo-plv | Hello, All | |
| 11:41:13 | dvo-plv | Could you pelase help me zull | |
| 11:41:25 | dvo-plv | gate jobs failed https://review.opendev.org/c/openstack/glance/+/882133 | |
| 11:41:38 | dvo-plv | How I can rerun it, just with recheck comment ? | |
| 12:21:08 | bauzas | correct, please write 'recheck <something>' | |
| 12:21:30 | sean-k-mooney | dvo-plv: ya we dont allow reruning just gate any more so recheck and the reason why it failed | |
| 12:21:51 | sean-k-mooney | tempest.lib.exceptions.IdentityError: Got identity error | |
| 12:22:02 | sean-k-mooney | so it looks like keystone died | |
| 12:22:07 | sean-k-mooney | proably oom killed | |
| 12:24:29 | dvo-plv | I get it, as far as I understand, I just need some luck to avoid this issue, right ? | |
| 12:24:43 | sean-k-mooney | ya https://zuul.opendev.org/t/openstack/build/2874580c83d0484593f800d6d9c6fde2/log/controller/logs/screen-keystone.txt#89780 os the connection form keyston to the db was killed im guessign the db was killed | |
| 12:25:03 | sean-k-mooney | yep https://zuul.opendev.org/t/openstack/build/2874580c83d0484593f800d6d9c6fde2/log/controller/logs/syslog.txt#7394 | |
| 12:25:21 | sean-k-mooney | dvo-plv: ya unfortunetly | |
| 12:25:30 | sean-k-mooney | we try to optimise the jobs so that it wont happen | |
| 12:25:41 | sean-k-mooney | but sometimes it will still cause a failure | |
| 12:26:22 | sean-k-mooney | with that siad i need to fix the spellign mistaks in my devstack patch to improve this situration | |
| 12:26:52 | dvo-plv | I see, thank you | |
| 12:27:27 | sean-k-mooney | im hoping https://review.opendev.org/c/openstack/devstack/+/890693 will fix it or at least help | |
| 12:27:39 | sean-k-mooney | since you remineded me of that ill go fix the spelling issue now | |
| 12:28:05 | dvo-plv | you are welcome) | |
| 13:52:29 | opendevreview | alisafari proposed openstack/nova stable/2023.1: Fix traits to cpu flags mapping https://review.opendev.org/c/openstack/nova/+/903444 | |
| 13:56:57 | opendevreview | Sylvain Bauza proposed openstack/nova master: check both source and dest compute libvirt versions for mdev lv https://review.opendev.org/c/openstack/nova/+/904176 | |
| 13:56:58 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP returns mdevs https://review.opendev.org/c/openstack/nova/+/904209 | |
| 13:56:58 | opendevreview | Sylvain Bauza proposed openstack/nova master: Check if destination can support the src mdev types https://review.opendev.org/c/openstack/nova/+/904177 | |
| 15:25:27 | opendevreview | Sylvain Bauza proposed openstack/nova master: check both source and dest compute libvirt versions for mdev lv https://review.opendev.org/c/openstack/nova/+/904176 | |
| 15:25:28 | opendevreview | Sylvain Bauza proposed openstack/nova master: WIP returns mdevs https://review.opendev.org/c/openstack/nova/+/904209 | |
| 15:25:28 | opendevreview | Sylvain Bauza proposed openstack/nova master: Check if destination can support the src mdev types https://review.opendev.org/c/openstack/nova/+/904177 | |
| 16:19:15 | opendevreview | Alex Welsh proposed openstack/nova master: Add --update flag for map_cell0 https://review.opendev.org/c/openstack/nova/+/903140 | |
| 16:44:04 | opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.2: Call Neutron immediately upon _post_live_migration() start https://review.opendev.org/c/openstack/nova/+/904225 | |
| 16:44:05 | opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.2: Allow best effort sending of notifications https://review.opendev.org/c/openstack/nova/+/904226 | |
| 16:45:19 | opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.1: Call Neutron immediately upon _post_live_migration() start https://review.opendev.org/c/openstack/nova/+/904227 | |
| 16:45:20 | opendevreview | Artom Lifshitz proposed openstack/nova stable/2023.1: Allow best effort sending of notifications https://review.opendev.org/c/openstack/nova/+/904228 | |
| 16:47:15 | opendevreview | Artom Lifshitz proposed openstack/nova stable/zed: Call Neutron immediately upon _post_live_migration() start https://review.opendev.org/c/openstack/nova/+/904229 | |
| 16:47:16 | opendevreview | Artom Lifshitz proposed openstack/nova stable/zed: Allow best effort sending of notifications https://review.opendev.org/c/openstack/nova/+/904230 | |
| 16:54:14 | gksk | Hi Team | |
| 16:54:22 | gksk | Did any one face this error | |
| 16:54:24 | gksk | ERROR oslo.messaging._drivers.impl_rabbit [-] [2940a4d9-ce1c-4d6c-a51d-771c7c2e16a0] AMQP server on x.x.x.x is unreachable: Server unexpectedly closed connection. | |
| 16:54:51 | gksk | I am getting this error on nova-api log when I try to spin a vm on specific compute node | |
| 16:54:55 | sean-k-mooney | that generally just means that either the tcp connection dropped or the rabbitmq server was restarted | |
| 16:55:03 | sean-k-mooney | oh ok | |
| 16:55:13 | sean-k-mooney | that can be ignored entirly | |
| 16:55:43 | sean-k-mooney | well it depends so is it causing an error with booting the vm | |
| 16:56:13 | gksk | any solution for this issue? | |
| 16:56:37 | sean-k-mooney | gksk: ther eare two reason this happens oen is not an error the other means you had an infra probelm | |
| 16:56:53 | sean-k-mooney | are you runign nova api under a wsgi server like appche | |
| 16:57:25 | sean-k-mooney | if you are and its not causing the vm creation to fail | |
| 16:57:46 | gksk | No basically when I try to create another vm on the same host (compute node ) immediately the previous vm is coming to active state | |
| 16:58:01 | sean-k-mooney | then this is just because apache kills the wsgi application after the request suspendign the heatbeat and causing the connection to close | |
| 16:58:23 | gksk | do we have any fix for this | |
| 16:58:26 | gksk | ? | |
| 16:59:04 | sean-k-mooney | it depend on why the conenction was closed | |
| 16:59:23 | sean-k-mooney | we have once ase where this is prented that we do not consider a bug as it not fixable in nova | |
| 16:59:38 | sean-k-mooney | if it impacts the spawnign fo a vm and result in it going to error | |
| 16:59:51 | gksk | I am not sure why conenction was closed | |
| 16:59:51 | sean-k-mooney | it might be a diffent edgecase that might be a fixable bug | |
| 17:00:31 | sean-k-mooney | lets start by determing how your runing nova-api | |
| 17:00:43 | sean-k-mooney | are you using the nova-api binary or runing it as a wsgi applcition on a webserver | |
| 17:01:30 | gksk | no I am using nova-api binary | |
| 17:02:06 | sean-k-mooney | ok in that case that messge would indicate that the tcp connection to rabbit was closed likely due to a networkign issue | |
| 17:02:25 | sean-k-mooney | when using nova-api directly it runnign under the eventlet webserver | |
| 17:03:06 | sean-k-mooney | that webserver will not terminate the rabbitmq connect based on the time form the last request | |
| 17:03:18 | sean-k-mooney | it will keep it open wiht a heatbeat | |
| 17:03:42 | sean-k-mooney | can you confrim taht you have https://docs.openstack.org/nova/latest/configuration/config.html#oslo_messaging_rabbit.heartbeat_in_pthread set ot false | |
| 17:04:24 | gksk | Let me check | |
| 17:04:28 | gksk | give me 2 mins | |
| 17:06:31 | sean-k-mooney | heartbeat_in_pthread=true is only for runing under a wsgi server like apache mod_wsgi and is knwo to break running under eventlet | |
| 17:06:47 | sean-k-mooney | so in your config its imporant to set that to false | |
| 17:06:53 | sean-k-mooney | which is the default | |
| 17:07:22 | opendevreview | Sylvain Bauza proposed openstack/nova master: Check if destination can support the src mdev types https://review.opendev.org/c/openstack/nova/+/904177 | |