| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-12-10 | |||
| 13:35:30 | opendevreview | Pierre-Samuel Le Stang proposed openstack/nova-specs master: Implements: blueprint soft-delete-instance-actions https://review.opendev.org/c/openstack/nova-specs/+/821387 | |
| 13:40:41 | AlexShishebarov | Hello. I wanted to ask a question about the bug I reported. | |
| 13:41:19 | AlexShishebarov | https://bugs.launchpad.net/nova/+bug/1951623 This bug is that during live migration of a VM with a disabled port (to a neutron), the migration stopes with the error Timed out waiting for events “network-vif-plugged” (for disabled port). Will the change https://review.opendev.org/c/openstack/nova/+/767368 fix this problem? | |
| 14:06:06 | sean-k-mooney | AlexShishebarov: this is currently being fixed | |
| 14:06:27 | sean-k-mooney | AlexShishebarov: https://review.opendev.org/c/openstack/nova/+/819494 shoudl correct the issue | |
| 14:08:28 | sean-k-mooney | https://review.opendev.org/c/openstack/nova/+/767368 will not | |
| 14:38:31 | AlexShishebarov | sean-k-mooney: According to the code does not resolve this bug (in my opinion). Nova will continue to wait for events from the neutron. But events from a neutron will not come for disabled port. https://review.opendev.org/c/openstack/nova/+/819494 nova/network/model.py(line 556) method get_live_migration_plug_time_events | |
| 14:43:50 | sean-k-mooney | we shoudl be waiting for events for live migration | |
| 14:43:58 | sean-k-mooney | for cold migration the even moved | |
| 14:44:15 | sean-k-mooney | it went form bind time to plug tiem on revert | |
| 14:45:49 | sean-k-mooney | you are correct that we shoudl skip disabeld ports | |
| 14:46:02 | sean-k-mooney | well kind of | |
| 14:46:23 | sean-k-mooney | it shoudl not actully be required as neuton shoudl be sending the event but they dont currntly | |
| 14:46:55 | sean-k-mooney | we can skip them to work around the neutron bug but neutron shold be send network-vif-plugged event even for disabled ports | |
| 14:48:07 | sean-k-mooney | for now we shoudl be checking the vif status here https://review.opendev.org/c/openstack/nova/+/819494/5/nova/network/model.py#494 | |
| 14:53:20 | AlexShishebarov | I tried to solve the problem this way, but the nova saves the port state as "active" even if it is turned off to a neutron. https://github.com/openstack/nova/blob/master/nova/network/neutron.py#L3183-L3185 | |
| 14:55:39 | AlexShishebarov | in neutron | |
| 15:33:27 | opendevreview | Balazs Gibizer proposed openstack/nova master: functional: Add reproducer for #1907775 https://review.opendev.org/c/openstack/nova/+/766771 | |
| 15:33:43 | gibi | stephenfin: I hope you are OK that I refreshed ^^ | |
| 15:33:59 | gibi | I would like to add the rejection to the aggregate API to fix the bug | |
| 15:34:07 | gibi | but I figured out that we have more cases to handle | |
| 15:34:11 | gibi | so I added extra tests | |
| 15:51:51 | opendevreview | sean mooney proposed openstack/nova-specs master: Add spec for external cpu power managment https://review.opendev.org/c/openstack/nova-specs/+/821419 | |
| 17:06:31 | sean-k-mooney | gibi: it looks like https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/821396/ works | |
| 17:06:44 | gibi | sean-k-mooney: awesome | |
| 17:07:10 | sean-k-mooney | there are some test failerues in the non voting jobs but they are unrelated | |
| 17:07:23 | sean-k-mooney | who normally reivews that repo? do you know? | |
| 17:08:14 | sean-k-mooney | i might check on the qa channel | |
| 17:10:36 | gibi | I don't. lyarwood might know but he is already on PTO | |
| 17:13:52 | sean-k-mooney | ya i just left a message on #openstack-qa | |
| 17:14:07 | sean-k-mooney | honestly it proably wont be seen until moday at this point | |
| 17:14:14 | gibi | gmann: ^^ | |
| 17:14:28 | gibi | gmann: I think you have +2 rights in devstack-plugin-ceph | |
| 17:14:29 | opendevreview | Balazs Gibizer proposed openstack/nova master: functional: Add reproducer for #1907775 https://review.opendev.org/c/openstack/nova/+/766771 | |
| 17:14:30 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject AZ changes during aggregate add / remove host https://review.opendev.org/c/openstack/nova/+/821423 | |
| 17:17:21 | sean-k-mooney | ya anyone in devstack-core or qa-release or cinder-core | |
| 17:17:23 | sean-k-mooney | https://review.opendev.org/admin/groups/8e51d8f39e33d932a40f03060b861db57a3d25d4,members | |
| 17:19:30 | sean-k-mooney | on one hand its a gate blocker on the ohter hand its friday evening and its not near a milestone so it can proably wait till monday without it being a major problem | |
| 17:20:09 | sean-k-mooney | i can send a mail to the list just to keep everyone in the loop | |
| 17:21:21 | opendevreview | Artom Lifshitz proposed openstack/nova master: DNM: Debug whitebox RBD direct download test failures https://review.opendev.org/c/openstack/nova/+/821424 | |
| 17:22:15 | gmann | sean-k-mooney: gibi checking | |
| 17:22:21 | gibi | thanks! | |
| 17:32:53 | gibi | sean-k-mooney: left initial feedback on the healtcheck spec | |
| 17:32:59 | gibi | and that I will end my week | |
| 17:33:07 | gibi | see you next week o/ | |
| 17:35:32 | gmann | gibi: sean-k-mooney did not get why it started failing now? is there any recent change triggered this? | |
| 17:43:10 | opendevreview | Ghanshyam proposed openstack/nova master: DNM: testing nova-ceph-multistore fix https://review.opendev.org/c/openstack/nova/+/821435 | |
| 17:47:51 | sean-k-mooney | gmann: not that i know if i suspect either neutron started requrieing a new version of python3-logging or there was a cpeh package update upstream | |
| 17:54:26 | gmann | i can see only in l-c requirements which should not be installed by devstack | |
| 17:56:46 | sean-k-mooney | ya i was checking on codeasearch | |
| 17:56:52 | sean-k-mooney | not sure what is pulling it in to be honest | |
| 17:59:30 | sean-k-mooney | sean@cloud:~$ apt-cache rdepends python3-logutils | |
| 17:59:32 | sean-k-mooney | python3-logutils | |
| 17:59:34 | sean-k-mooney | Reverse Depends: | |
| 17:59:36 | sean-k-mooney | python3-pecan | |
| 17:59:38 | sean-k-mooney | changeme | |
| 17:59:47 | sean-k-mooney | so its comiy for either python3-pecan or changeme | |
| 17:59:56 | sean-k-mooney | likely python3-pecan | |
| 18:02:10 | sean-k-mooney | ya so thye had a release 2 days ago | |
| 18:02:12 | sean-k-mooney | https://pypi.org/project/pecan/ | |
| 18:02:17 | sean-k-mooney | and its used by neturon | |
| 18:02:57 | sean-k-mooney | gmann: and we udpated the upper constratints this morning https://github.com/openstack/requirements/commit/e74f91e250d127ff825dad5219527d62efaeb740 | |
| 18:03:00 | gmann | humm, it was there in pecan 1.4.1 which constraints updated in requirement yesterday https://github.com/pecan/pecan/blob/1.4.1/requirements.txt | |
| 18:03:10 | sean-k-mooney | yep | |
| 18:03:16 | sean-k-mooney | so that is likely what broke it | |
| 18:03:22 | gmann | yeah but there is no change in previous version of pecan on logutils | |
| 18:03:35 | sean-k-mooney | https://github.com/pecan/pecan/blob/master/requirements.txt#L6 | |
| 18:03:43 | sean-k-mooney | the require logutile >=3 | |
| 18:03:58 | gmann | yeah that is there in old version too https://github.com/pecan/pecan/blob/1.3.3/requirements.txt | |
| 18:04:07 | sean-k-mooney | ya 8 years | |
| 18:04:47 | sean-k-mooney | im not sure but that is the best i can come up with the version that is shipped in ubuntu is 0.3.4 i think | |
| 18:05:09 | sean-k-mooney | 0.3.3-7 | |
| 18:05:23 | sean-k-mooney | so ghatt should work | |
| 18:05:33 | gmann | I am trying to check the passing nova-ceph-multistore job and it was not pulled there somwhoe https://zuul.openstack.org/build/590c5996ca1b402486bfe1c7e1d08535/log/job-output.txt | |
| 18:07:29 | sean-k-mooney | its likely a ubuntu or cpeh packageing change | |
| 18:07:39 | sean-k-mooney | to we use the disto ceph or ceph form ceph.com | |
| 18:08:32 | sean-k-mooney | oh | |
| 18:08:38 | sean-k-mooney | the ceph pcakages changed | |
| 18:08:40 | sean-k-mooney | CEPH_PACKAGES='ceph libnss3-tools python3-rados python3-rbd' | |
| 18:08:43 | sean-k-mooney | on passin g | |
| 18:10:34 | sean-k-mooney | actully they end up being the same | |
| 18:10:36 | sean-k-mooney | CEPH_PACKAGES='ceph libnss3-tools python3-rados python3-rbd' | |
| 18:10:51 | gmann | yeah its same | |
| 18:12:05 | sean-k-mooney | et:20 https://download.ceph.com/debian-pacific focal/main amd64 python3-rbd amd64 16.2.7-1focal [386 kB] | |
| 18:12:08 | sean-k-mooney | vs | |
| 18:12:23 | sean-k-mooney | 021-12-10 10:37:05.265864 | controller | Get:48 https://download.ceph.com/debian-pacific focal/main amd64 python3-rbd amd64 16.2.7-1focal [386 kB] | |
| 18:12:33 | sean-k-mooney | so i guess the same version of ceph too | |
| 18:21:58 | gmann | sean-k-mooney: commented about commit msg to add these info and then i am +2 as it is gate blocker https://review.opendev.org/c/openstack/devstack-plugin-ceph/+/821396/comment/a2721f12_ea844e6b/ | |
| 18:22:28 | gmann | i cannot find root cause but it is clear it is pulling it recently so removing it is no issue | |
| 18:23:04 | gmann | I can try to ping other core if they are around | |
| 18:32:32 | sean-k-mooney | gibi: thanks yes ill spellcheck it with gramerly on monday | |
| 18:33:39 | sean-k-mooney | gmann: am if tis ok with you ill update teh commit on monday i was just about to leave for the day | |
| 18:34:40 | gmann | sean-k-mooney: ok, or i can update for you if it is ok? and try to get other core if they are around gouthamr or so. so that we can get gate unblocked | |
| 18:37:52 | opendevreview | Dmitriy Rabotyagov proposed openstack/nova stable/wallaby: Ensure MAC addresses characters are in the same case https://review.opendev.org/c/openstack/nova/+/816883 | |
| 20:06:49 | jamesbenson | Can anyone help with refstack tests failing due to additional-properties? | |
| 20:10:53 | jamesbenson | These are, for example this test: tempest.api.compute.servers.test_instance_actions.InstanceActionsTestJSON.test_get_instance_action | |
| 20:11:01 | jamesbenson | Gives me a: jsonschema.exceptions.ValidationError: Additional properties are not allowed ('updated_at' was unexpected) | |
| 20:12:38 | gmann | jamesbenson: hi | |
| 20:13:05 | gmann | jamesbenson: is it with upstream code or modified API? | |
| 20:13:48 | gmann | In tempest, we have strict validation on API response on additional-properties and t will fail if any API return any additional field in response without microversion or in downstream | |