| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-08-03 | |||
| 13:03:11 | lyarwood | gibi: ^ but even then I had to update lower-contraints.txt for it to even build that env for me locally | |
| 13:03:29 | lyarwood | gibi: to use MarkupSafe==1.1.0 | |
| 13:03:55 | lyarwood | gibi: as somthing here is pulling in the latest version of setuptools | |
| 13:05:14 | gibi | I do not promise to get to it but it sounds juicy | |
| 13:07:10 | lyarwood | gibi: yup cool no issues, I'll work on it this evening either way | |
| 13:37:24 | openstackgerrit | Kevin Zhao proposed openstack/nova master: [WIP] CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439 | |
| 14:01:32 | smcginnis | lyarwood: Responded on the ML, but I'd hold off on playing whack a mole with packages. The job itself appears to be broken somehow. | |
| 14:02:14 | smcginnis | lyarwood: Would be interesting to know what version you have locally if you are able to reproduce this (.tox/lower-constraints/bin/pip --version) | |
| 14:08:07 | smcginnis | Unable to repro on f32. Tried upgrading to latest pip in my env, but it still installs the correctly constrained versions. | |
| 14:35:08 | openstackgerrit | Bence Romsics proposed openstack/nova master: doc: Add IPv6 metadata address https://review.opendev.org/744492 | |
| 15:09:48 | openstackgerrit | Sean McGinnis proposed openstack/nova master: Fix lower-constraints conflicts https://review.opendev.org/744506 | |
| 15:11:30 | openstack | Launchpad bug 1890057 in OpenStack Compute (nova) "EC2 instance_id_mappings are never deleted" [Undecided,New] | |
| 15:11:30 | mnaser | dansmith: i'd appreciate your feedback when you're free on this fun one -- https://bugs.launchpad.net/nova/+bug/1890057 | |
| 15:17:31 | openstack | bugzilla.redhat.com bug 1726256 in openstack-nova "nova-manage archive_deleted_rows doesn't cleanup nova_cell0.instance_id_mappings, nova_api.request_specs, nova_api.consumers, nova_api.instance_mappings, nova.instance_id_mappings and nova.task_log" [High,Closed: errata] - Assigned to mwitt | |
| 15:17:31 | melwitt | mnaser: that should have been fixed in stein https://bugzilla.redhat.com/show_bug.cgi?id=1726256#c22 | |
| 15:18:49 | mnaser | melwitt: oooou | |
| 15:19:25 | mnaser | i will mark as duplicate in that case | |
| 15:19:37 | mnaser | i wonder how i miss that | |
| 15:19:55 | mnaser | i tried to search but didn't see much matches for `InstanceIdMapping` but i think i was trying to look for an ec2_* function | |
| 15:20:24 | openstack | Launchpad bug 1786298 in OpenStack Compute (nova) rocky "nova-manage db archive_deleted_rows does not cleanup table instance_id_mappings" [Medium,Fix committed] - Assigned to Matt Riedemann (mriedem) | |
| 15:20:24 | melwitt | I dunno, you commented on the duplicate too heh https://bugs.launchpad.net/nova/+bug/1786298 | |
| 15:20:40 | mnaser | wtf, really | |
| 15:20:54 | mnaser | wow | |
| 15:20:55 | mnaser | i did | |
| 15:21:08 | mnaser | old me did a good thing | |
| 15:21:22 | melwitt | haha | |
| 15:22:02 | mnaser | melwitt: marked as duplicate, that's my bad. i did a whole bunch of db trimming for an upcoming upgrade | |
| 15:22:22 | mnaser | went from 70G database down to 6GB.. we have very bad reasons why our shadow tables are still big that i won't admit yet | |
| 15:22:23 | melwitt | thanks! | |
| 16:23:53 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Move equality check into LibvirtConfigGuestInterface https://review.opendev.org/744524 | |
| 16:23:53 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: [WIP] Support SRIOV interface attach and detach https://review.opendev.org/740995 | |
| 16:52:53 | elod | lyarwood smcginnis : maybe this is related to the lower-constraints issue you are investigating: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-08-03.log.html#t2020-08-03T16:34:00 | |
| 16:57:07 | smcginnis | elod: Yeah, I'm seeing that on a Cinder failure too. | |
| 16:57:24 | smcginnis | That may be it. Like mentioned in that log, might need to add a --no-deps to that step. | |
| 17:11:24 | elod | smcginnis: probably yes. however I'm still trying to reproduce that locally, but locally I have just one phase (?) | |
| 18:09:13 | smcginnis | elod: Yeah, I'm not sure where that multiple phase things comes from. | |
| 18:09:32 | smcginnis | elod: The main log makes it look like it's just called tox --notest to set up the venv, then running the tests. | |
| 18:09:48 | smcginnis | elod: So it must be somewhere in the zuul job configuration that it does some extra steps. | |
| 18:12:56 | openstackgerrit | Sean McGinnis proposed openstack/nova master: Fix lower-constraints conflicts https://review.opendev.org/744506 | |
| 19:41:45 | openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: Don't delete the original attachment during pre LM rollback https://review.opendev.org/743319 | |
| 19:41:46 | openstackgerrit | Lee Yarwood proposed openstack/nova master: func: Introduce a server_expected_state kwarg to InstanceHelperMixin._live_migrate https://review.opendev.org/743710 | |
| 19:41:46 | openstackgerrit | Lee Yarwood proposed openstack/nova master: func: Add CinderFixture to _IntegratedTestBase https://review.opendev.org/743535 | |
| 19:41:49 | openstackgerrit | Lee Yarwood proposed openstack/nova master: Handle Neutron errors in _post_live_migration() https://review.opendev.org/729763 | |
| 19:41:49 | openstack | bug 1879787 in OpenStack Compute (nova) "post_live_migration does not handle Neutron errors" [Medium,In progress] https://launchpad.net/bugs/1879787 - Assigned to Artom Lifshitz (notartom) | |
| 19:41:49 | openstackgerrit | Lee Yarwood proposed openstack/nova master: Add regression test for bug 1879787 https://review.opendev.org/741230 | |
| 20:08:31 | openstack | Launchpad bug 1890193 in Glance "nova-ceph-multistore fails with rbd.OSError: [errno 116] error removing image" [Undecided,New] | |
| 20:08:31 | lyarwood | dansmith: https://bugs.launchpad.net/glance/+bug/1890193 - btw I've just seen nova-ceph-multistore fail again with this, it's the same issue as stephenfin pointed out last week. | |
| 20:31:37 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/ussuri: compute: Validate a BDMs disk_bus when provided https://review.opendev.org/744550 | |
| 20:47:23 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/train: compute: Validate a BDMs disk_bus when provided https://review.opendev.org/744552 | |
| 20:56:57 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/stein: compute: Validate a BDMs disk_bus when provided https://review.opendev.org/744554 | |
| 20:56:57 | openstackgerrit | Lee Yarwood proposed openstack/nova stable/stein: Should not skip volume_size check for bdm.image_id == image_ref case https://review.opendev.org/744553 | |
| 23:55:04 | openstackgerrit | Merged openstack/nova stable/queens: zuul: remove legacy-tempest-dsvm-neutron-dvr-multinode-full https://review.opendev.org/742668 | |
| 23:55:11 | openstackgerrit | Merged openstack/nova stable/pike: Fix false ERROR message at compute restart https://review.opendev.org/699496 | |
| #openstack-nova - 2020-08-04 | |||
| 00:49:56 | openstackgerrit | Tony Su proposed openstack/nova master: Provider Config File: Enable loading and merging of provider configs https://review.opendev.org/693460 | |
| 00:49:56 | openstackgerrit | Tony Su proposed openstack/nova master: Provider Config File: Functions to merge provider configs to provider tree https://review.opendev.org/676522 | |
| 02:49:23 | tony_su | stephenfin: gibi: the last 3 patches for provider-config-file are ready for a new round of review with comments answered. Thanks. | |
| 02:50:50 | tony_su | I checked zuul failure and found no relation to us. | |
| 03:28:23 | openstackgerrit | renminmin proposed openstack/nova master: SRIOV: Fix instance with macvtap port live migration failed https://review.opendev.org/738432 | |
| 06:26:45 | openstack | Launchpad bug 1298509 in OpenStack Compute (nova) ""nova server-group-delete" allows deleting server group with members" [Wishlist,Opinion] | |
| 06:26:45 | devfaz_ | hi, just run into an issue with no longer existing server groups. I had to evacuate some instances, but they failed, because the server group no longer exists. Just googled a bit and found https://bugs.launchpad.net/nova/+bug/1298509. I understand, that it should be possible to delete a server group with instances, but there should be also a way to update / remove the entry from the instances - | |
| 06:26:50 | devfaz_ | else the makes the instances unbootable. | |
| 06:50:08 | gibi | devfaz: do you have a stack trace from the log with the failure? I've quickly tried with resize and that worked with deleted server group | |
| 06:51:20 | devfaz | gibi: one moment | |
| 06:55:04 | devfaz | gibi: no stack-trace, just Filtering removed all hosts for the request with instance ID 'adddf2c9-0252-4463-a97c-f1ec209d9f49'. Filter results: ['AvailabilityZoneFilter: (start: 2, end: 2)', 'ComputeFilter: (start: 2, end: 2)', 'ComputeCapabilitiesFilter: (start: 2, end: 2)', 'ImagePropertiesFilter: (start: 2, end: 2)', 'ServerGroupAntiAffinityFilter: (start: 2, end: 2)', | |
| 06:55:10 | devfaz | 'ServerGroupAffinityFilter: (start: 2, end: 0)'] | |
| 06:56:48 | gibi | devfaz: I think it worth a bug report. I think nova needs to ignore delete server groups during scheduling | |
| 06:56:52 | devfaz | and in the "server show", i get as fault-value. Instance group 4b9a2cc5-cc44-470e-9ad0-68dcc9f8c60e could not be found. | |
| 06:57:28 | devfaz | gibi: ok, i will create a new one | |
| 06:57:32 | devfaz | thx a lot! | |
| 07:05:14 | openstack | Launchpad bug 1890244 in OpenStack Compute (nova) "nova scheduler should ignore removed groups" [Undecided,New] | |
| 07:05:14 | devfaz | https://bugs.launchpad.net/nova/+bug/1890244 | |
| 07:05:18 | devfaz | gibi: fyi | |
| 07:10:49 | openstackgerrit | Bence Romsics proposed openstack/nova master: doc: Add IPv6 metadata address https://review.opendev.org/744492 | |
| 08:09:47 | openstackgerrit | Xinran WANG proposed openstack/os-resource-classes master: Add new resource class for QAT card. https://review.opendev.org/726314 | |
| 09:38:28 | lyarwood | gibi: https://review.opendev.org/#/c/744506/ - morning, when you have time this should fix the lower-constraints job on master at least for now | |
| 09:39:37 | lyarwood | https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-lower-constraints&project=openstack%2Fnova for context | |
| 10:03:14 | elod | lyarwood: it seems every job have some *constraint related issue now (but some are not visible as does not cause failure), see discussion from infra channel yesterday: http://eavesdrop.openstack.org/irclogs/%23openstack-infra/%23openstack-infra.2020-08-03.log.html#t2020-08-03T16:22:05 | |
| 10:03:54 | elod | lyarwood: the interesting thing is that I cannot reproduce that locally :/ | |
| 10:13:11 | lyarwood | elod: ack thanks | |
| 10:13:29 | lyarwood | elod: I was eventually able to reproduce the master issue yesterday on a 18.04 vm but yeah it wasn't easy at all | |
| 10:15:04 | elod | elod: oh, sounds good! \o/ | |
| 10:15:12 | elod | lyarwood: ^^^ :] | |
| 10:16:12 | elod | lyarwood: also there's a new release of pip, there's an interesting change: "Correctly find already-installed distributions with dot (.) in the name and uninstall them when needed. " ( https://pip.pypa.io/en/stable/news/#id1 ) | |
| 10:16:41 | elod | especially as the failure came when already installed packages were reinstalled (without constraints) | |
| 10:26:10 | lyarwood | elod: ah that is interesting | |
| 10:35:34 | elod | lyarwood: well, it seems something changed, but I still see the issue in zuul jobs :S | |
| 10:36:45 | elod | lyarwood: do you have somewhere the steps, how the failure can be reproduced locally? | |
| 10:40:20 | lyarwood | elod: I didn't write them down sorry, I just built an env using virt-builder and installed tox directly from pypy instead of packages | |
| 10:40:38 | lyarwood | elod: iirc I had to bump MarkupSafe to workaround another issue | |
| 10:49:07 | elod | lyarwood: ok, no problem. actually I did the same, installed latest pip and tox from pypi. worth to mention that once it worked for me as in zuul, but then I couldn't reproduce it again with the steps I thought it should be reproducable :S | |
| 11:03:43 | gibi | devfaz: thanks | |
| 11:05:55 | sean-k-mooney | gibi: stephenfin alex_xu could ye take a lok at https://review.opendev.org/#/c/739131/ im trying to move on to numa in placment work so if i can close that out it would make me happy | |
| 11:06:06 | gibi | lyarwood: thanks. I've approved https://review.opendev.org/#/c/744506/ | |
| 11:07:01 | sean-k-mooney | that said gibi i just booted my sriov servers so ill be deploying your sriov detach patches while i rebase some os-vif patches. ill let you know what i find in my testing | |
| 11:08:26 | gibi | sean-k-mooney: thanks a lot for those tests | |
| 11:08:34 | gibi | sean-k-mooney: I'm looking at https://review.opendev.org/#/c/739131/ now | |
| 11:32:32 | openstackgerrit | Harshavardhan Metla proposed openstack/nova stable/rocky: [stable-only] Moved the quoted section https://review.opendev.org/744681 | |
| 11:50:52 | gibi | sean-k-mooney: I have left comments in https://review.opendev.org/#/c/744506/ | |
| 11:53:33 | sean-k-mooney | gibi: did you? that is the lower constrits fix :) | |
| 11:54:02 | sean-k-mooney | you mean https://review.opendev.org/#/c/739131 | |