| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-05-27 | |||
| 21:04:24 | openstackgerrit | Merged openstack/nova master: Remove compatibility check from migrate_data https://review.opendev.org/729949 | |
| 21:04:30 | openstackgerrit | Merged openstack/nova master: Fix pygments_style https://review.opendev.org/729747 | |
| 21:04:37 | openstackgerrit | Merged openstack/nova master: Cleanup libvirt test_mount unit tests https://review.opendev.org/692173 | |
| 22:38:54 | openstackgerrit | Merged openstack/nova stable/train: Reserve DISK_GB resource for the image cache https://review.opendev.org/730324 | |
| 22:39:00 | openstackgerrit | Merged openstack/nova master: Poison netifaces.interfaces() in tests https://review.opendev.org/671773 | |
| 23:45:24 | openstackgerrit | melanie witt proposed openstack/nova stable/queens: Reset the cell cache for database access in Service https://review.opendev.org/720596 | |
| #openstack-nova - 2020-05-28 | |||
| 00:03:13 | openstackgerrit | Merged openstack/nova master: Add packages required for pdf-docs run to bindep.txt https://review.opendev.org/727898 | |
| 00:27:19 | openstackgerrit | Merged openstack/nova stable/stein: fix scsi disk unit number of the attaching volume when cdrom bus is scsi https://review.opendev.org/730311 | |
| 02:19:07 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |
| 03:23:45 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: PoC: nova healthchecks API https://review.opendev.org/731396 | |
| 06:00:18 | openstackgerrit | Merged openstack/nova stable/train: Add admin doc information about image cache resource accounting https://review.opendev.org/730326 | |
| 06:31:48 | openstackgerrit | Elod Illes proposed openstack/nova stable/queens: Reset the cell cache for database access in Service https://review.opendev.org/720596 | |
| 07:25:20 | gibi | good morning nova | |
| 08:01:52 | lyarwood | morning morning | |
| 08:04:56 | lyarwood | gibi: https://review.opendev.org/#/c/730320/ - an easy one to start the day if you agree, regarding switching the ceph job to voting. | |
| 08:22:29 | bauzas | good morning Nova | |
| 08:44:04 | gibi | lyarwood: +A, thanks! | |
| 08:45:21 | lyarwood | gibi: ah sorry forgot that there's also https://review.opendev.org/#/c/730319/ looking to move a non-voting barbican job into the check queue | |
| 08:45:30 | gibi | looking | |
| 08:46:15 | gibi | +2 | |
| 08:46:23 | gibi | nice coverage addition! | |
| 08:51:26 | lyarwood | cool thanks | |
| 08:52:09 | lyarwood | stephenfin: ^ would you mind hitting that as well? | |
| 09:36:51 | born2bake | maybe any of you guys were struggling with that as well: I deployed stack via k-a(train). I wanted to test ScyllaDB but got errors message related to sse4.2 and clmul instruction set. I ve raised an issues here https://github.com/scylladb/scylla/issues/6528 and been told that "you have a misconfigured VM - a VM that "doesn't give you the clmul instruction for no good reason because the hardware surely has it." Thus, I am wondering if its | |
| 09:36:51 | born2bake | nova configuration? | |
| 09:47:05 | stephenfin | born2bake: https://docs.openstack.org/nova/latest/admin/configuration/hypervisor-kvm.html#specify-the-cpu-model-of-kvm-guests | |
| 09:54:51 | born2bake | stephenfin thank you, I found it before as well... However, I am not really sure which model should I use for my particular case :/ | |
| 09:55:17 | gibi | stephenfin: hi! Could you confirm / triage the bug https://bugs.launchpad.net/nova/+bug/1736920 I see that the generator -> list conversion is still existing on master but the bug report is pretty old | |
| 09:55:17 | openstack | Launchpad bug 1736920 in OpenStack Security Advisory "Glance images are loaded into memory" [Undecided,Incomplete] | |
| 10:01:10 | gibi | aarents: hi! backport of for the bug fix for bug 1878024 is now merged in stable/train so you can propose the stable/stein backport | |
| 10:01:10 | openstack | bug 1878024 in OpenStack Compute (nova) stein "disk usage of the nova image cache is not counted as used disk space" [Low,New] https://launchpad.net/bugs/1878024 - Assigned to Alexandre arents (aarents) | |
| 10:06:04 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |
| 10:08:47 | aarents | gibi: I saw that thanks, will do soon | |
| 10:09:49 | gibi | cool thanks | |
| 10:14:52 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |
| 10:25:11 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |
| 11:52:58 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP block_device: Ensure volume returns to in-use if attachment_delete fails https://review.opendev.org/731505 | |
| 11:52:59 | openstackgerrit | Lee Yarwood proposed openstack/nova master: compute: As cellsv1 is no more fold _detach_volume back into detach_volume https://review.opendev.org/731506 | |
| 12:10:56 | openstackgerrit | Merged openstack/nova master: zuul: Make barbican-simple-crypto-devstack-tempest a non-voting check job https://review.opendev.org/730319 | |
| 12:36:25 | openstackgerrit | Andreas Jaeger proposed openstack/os-resource-classes master: Switch to newer openstackdocstheme and reno versions https://review.opendev.org/731512 | |
| 13:11:06 | stephenfin | gibi: Still investigating that glance bug but I think I'm almost at the bottom of it (tl;dr: it's probably not an issue after all) | |
| 13:12:03 | stephenfin | gibi: question though for you (or anyone else): if an instance fails to build and I then delete it, I see the following warning in my logs | |
| 13:12:21 | stephenfin | instance's host None is down, deleting from database | |
| 13:12:35 | stephenfin | that's from here https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2400-L2401 | |
| 13:12:38 | stephenfin | it seems wrong | |
| 13:14:21 | stephenfin | But I can't decide if we should log something special for that (e.g. LOG.info("instance was not scheduled successfully, deleting from database")) or ignore that case entirely (replace the 'else' with 'elif instance.host') | |
| 13:14:45 | stephenfin | lyarwood: it's pretty trivial, but you might have a opinion on that too ^ | |
| 13:18:20 | gibi | stephenfin: re: glance related bug, thanks. | |
| 13:19:03 | gibi | stephenfin: regarding the misleading log message for local delete of unscheduled instance. I'm more for adding an elif and a special debug message. that is a small cost but helps troubleshoting | |
| 13:21:56 | sean-k-mooney | stephenfin: today we dont delete instance form the db if they are not scheulded correctly so im configed by the message | |
| 13:22:11 | sean-k-mooney | we put the instance into the error state | |
| 13:22:28 | stephenfin | "so im configed by the message" huh/ | |
| 13:22:30 | stephenfin | *? | |
| 13:22:38 | sean-k-mooney | *confused | |
| 13:22:49 | sean-k-mooney | the feeling you feel at reading that | |
| 13:22:53 | stephenfin | how? :D | |
| 13:22:54 | stephenfin | haha | |
| 13:23:08 | stephenfin | sorry, let me restate things | |
| 13:23:17 | stephenfin | we put the instance to error state | |
| 13:23:39 | stephenfin | and I see that message when I later attempt to delete the instance | |
| 13:23:49 | stephenfin | host is unset since the instance failed to schedule | |
| 13:24:08 | sean-k-mooney | it lands in cell 0 right? | |
| 13:24:31 | stephenfin | Specifically, I'm seeing it when I purposefully break nova-glance interactions by setting '[glance] api_servers = <non-existent host>' in 'nova-cpu.conf' | |
| 13:24:37 | stephenfin | Yes, with the host field unset | |
| 13:25:23 | sean-k-mooney | right so after its in error when we delete the isntace we see the "instance was not ..." message int the api log? conductor? | |
| 13:25:56 | stephenfin | gmann: I'm seeing this in logs on a standard DevStack deployment | |
| 13:26:03 | stephenfin | UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required | |
| 13:26:24 | stephenfin | gmann: Before I go investigating, is this something you've seen already/something expected? | |
| 13:27:30 | gmann | stephenfin: yeah those are expected warning for scope cheks. default value change warning are suppressed | |
| 13:28:21 | gmann | that is because of policy has scope_type but enforce_scope is disabled. | |
| 13:29:27 | stephenfin | gmann: Ack, thanks | |
| 13:30:02 | stephenfin | sean-k-mooney: Sorry, couldn't find the log. I see it in nova-api | |
| 13:30:50 | sean-k-mooney | stephenfin: so i suspect what is happening is sicne you only broke glance it the compute agent config we are trying to actully boot the instance and failing then hitting the retry limit and landing in cell0 with no host set | |
| 13:31:06 | sean-k-mooney | so its not wrong in that we failed to find a host where it can boot | |
| 13:31:17 | sean-k-mooney | stephenfin: and ya i was excpecting it to be in the api log | |
| 13:32:05 | sean-k-mooney | so your wondering if we we should drop the level form warning to info | |
| 13:32:36 | sean-k-mooney | sorry https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2400-L2401 is a different warning | |
| 13:32:56 | stephenfin | sean-k-mooney: not quite. More if we should log something special for the host=None case or not log at all for that case | |
| 13:33:13 | stephenfin | we should keep warning for host!=None | |
| 13:33:19 | sean-k-mooney | ah i was thinking if we log it should be at debug | |
| 13:33:29 | sean-k-mooney | i dont think it should be at warning | |
| 13:33:45 | sean-k-mooney | i dont think info is useful | |
| 13:34:09 | sean-k-mooney | i would be fine with LOG.debug("instance was not scheduled successfully, deleting from database") | |
| 13:34:25 | sean-k-mooney | for the host is None case | |
| 13:35:22 | sean-k-mooney | i think the intent behind the orginal warning stems form the fact the host is down | |
| 13:35:44 | sean-k-mooney | so you might need to check that the local delete actully works proably when you bring it back up | |
| 13:41:15 | stephenfin | gibi: https://bugs.launchpad.net/nova/+bug/1736920/comments/9 | |
| 13:41:15 | openstack | Launchpad bug 1736920 in OpenStack Security Advisory "Glance images are loaded into memory" [Undecided,Incomplete] | |
| 13:44:13 | sean-k-mooney | stephenfin: are you sure that has always been the case | |
| 13:44:32 | sean-k-mooney | e.g. the use of the decorator | |
| 13:45:19 | stephenfin | sean-k-mooney: A quick look at stable/ocata for glanceclient suggests yes | |
| 13:46:04 | sean-k-mooney | so if we are not loadign the entire image into memroy as a list then that means our imaage validation logic might be broken | |
| 13:46:04 | stephenfin | for v2, and for v1 the 'data' function is the only one that returns IterableWithLength too | |
| 13:50:53 | sean-k-mooney | ok so RequestIdProxy is its self an iterable which delegates to the IterableWithLength | |
| 13:53:55 | sean-k-mooney | and its internal iterable is initalised to the resopocne body | |
| 13:54:12 | sean-k-mooney | ok so ya it look like you are right | |
| 13:54:37 | sean-k-mooney | sincei it returns an iterable object not a generator it wont take that brnach. | |
| 13:56:17 | sean-k-mooney | "utils.serious_integrity_iter" they have some interesting names | |
| 13:56:52 | gibi | stephenfin: thanks. your comment make sense | |
| 14:17:20 | openstackgerrit | Liang Fang proposed openstack/nova master: DNM - test Nova UT that depends on os-brick patch https://review.opendev.org/731388 | |