| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-01-04 | |||
| 22:43:12 | mriedem | otherwise we'd likely need like a refresh=True query parameter to GET /attachments/{id} | |
| 22:43:37 | mriedem | hemna_: that's part of it yeah | |
| 22:43:38 | hemna_ | in which case, can't cinder always refresh that if nova asks for it? | |
| 22:43:45 | hemna_ | I dunno | |
| 22:43:55 | mriedem | but how does cinder know that we're asking for a refresh? | |
| 22:43:58 | mriedem | or just a simple read-only get | |
| 22:44:13 | mriedem | this is where we got talking about API changes to force a refresh | |
| 22:44:13 | hemna_ | true | |
| 22:44:52 | hemna_ | I guess this could affect other cinder backends too | |
| 22:44:58 | hemna_ | not just ceph | |
| 22:46:05 | hemna_ | multipath IPs can change in between attaching the same volume, if the cinder backend gets changed | |
| 22:46:50 | hemna_ | ok so for now, I'll just tell my customer to bounce their VMs. :( | |
| 22:46:55 | mriedem | like a retype? | |
| 22:47:14 | hemna_ | well, more like a storage array loses one of it's interfaces | |
| 22:47:16 | hemna_ | and the IP changes | |
| 22:47:16 | mriedem | or you mean the backend backend | |
| 22:47:19 | mriedem | ok | |
| 22:47:20 | hemna_ | or new interfaces are added | |
| 22:47:39 | hemna_ | it's kinda the same thing as a new ceph monitor IP | |
| 22:48:11 | lyarwood | hemna_: FWIW restarting the instance is the only way to update the mon IPs for the ephemerial rbd images. | |
| 22:48:21 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in put (1) https://review.openstack.org/531258 | |
| 22:48:29 | lyarwood | ephemeral* | |
| 22:48:41 | hemna_ | lyarwood, yah. they were trying to avoid that, as there could be tons of VMs to bounce | |
| 22:49:03 | mriedem | hmm, actually it looks like for live migration we do refresh the connection_info https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L5882 | |
| 22:49:10 | mriedem | in pre-live migration on the dest host | |
| 22:49:58 | lyarwood | right, the issue hemna_ reported in the bug isn't with rbd volumes :) | |
| 22:50:08 | mriedem | oh | |
| 22:50:30 | mriedem | now i get it | |
| 22:51:22 | mriedem | well, i'm reminded once again that i'd like to just give up and buy a farm in austria and just live out my days there | |
| 22:51:37 | mriedem | because this whole software business isn't worth it | |
| 22:51:41 | hemna_ | lolz | |
| 22:52:01 | hemna_ | you aren't the only one.....I've been in a youtube black whole, watching dudes build log cabins... | |
| 22:52:21 | mriedem | that's the manliest thing i've heard all day | |
| 22:58:49 | hemna_ | lyarwood, should I file a separate bug then to cover the rbd image update during LM ? | |
| 23:00:01 | lyarwood | hemna_: yeah I think so, it's a different codepath etc | |
| 23:00:09 | hemna_ | ok will do | |
| 23:00:25 | lyarwood | hemna_: cool thanks, I'll take a look tomorrow | |
| 23:06:47 | openstackgerrit | Eric Fried proposed openstack/nova master: Raise on API errors getting aggregates/traits https://review.openstack.org/526540 | |
| 23:06:47 | openstackgerrit | Eric Fried proposed openstack/nova master: Track associated sharing RPs in report client https://review.openstack.org/526539 | |
| 23:06:48 | openstackgerrit | Eric Fried proposed openstack/nova master: Track tree-associated providers in report client https://review.openstack.org/526541 | |
| 23:06:48 | openstackgerrit | Eric Fried proposed openstack/nova master: ProviderTree.populate_from_iterable https://review.openstack.org/520756 | |
| 23:06:49 | openstackgerrit | Eric Fried proposed openstack/nova master: WIP: ComputeDriver.update_provider_tree() https://review.openstack.org/521187 | |
| 23:06:49 | openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Scheduler[Report]Client.get_provider_tree https://review.openstack.org/521098 | |
| 23:06:50 | openstackgerrit | Eric Fried proposed openstack/nova master: Fix nits in update_provider_tree series https://review.openstack.org/531260 | |
| 23:06:50 | openstackgerrit | Eric Fried proposed openstack/nova master: WIP: Use update_provider_tree from resource tracker https://review.openstack.org/520246 | |
| 23:07:15 | efried | jaypipes ^ -- and response to review comments on the way... | |
| 23:07:25 | jaypipes | coolio. | |
| 23:08:01 | hemna_ | lyarwood, https://bugs.launchpad.net/nova/+bug/1741364 | |
| 23:08:02 | openstack | Launchpad bug 1741364 in OpenStack Compute (nova) "ceph ephemeral info not updated during live migrate" [Undecided,New] | |
| 23:11:54 | efried | jaypipes See response on https://review.openstack.org/#/c/526539/ -- not sure if I've answered the right question there. | |
| 23:26:09 | mnaser | does nova not set the instance status to ERROR if cinder volume detach fails? | |
| 23:26:39 | mnaser | I have some cinder volumes which show attached servers, but the server is deleted | |
| 23:31:10 | mriedem | mnaser: correct | |
| 23:31:40 | mriedem | normal volume detach? or volume detach during instance delete? | |
| 23:31:53 | mnaser | mriedem: volume detach during instance delete | |
| 23:32:22 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Pass multiattach flag to reserve_block_device_name https://review.openstack.org/531244 | |
| 23:32:22 | openstackgerrit | Matt Riedemann proposed openstack/nova master: [libvirt] Allow multiple volume attachments https://review.openstack.org/267587 | |
| 23:32:24 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: [api] Allow multi-attach in compute api https://review.openstack.org/271047 | |
| 23:32:34 | mriedem | mnaser: yeah that happens here https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2391 | |
| 23:32:35 | mnaser | (boot from volume instance) | |
| 23:32:49 | mriedem | if it fails we log something but keep going | |
| 23:32:54 | mriedem | because we've already destroyed the guest on the hypervisor | |
| 23:33:23 | mriedem | this is where we try to delete the volume if delete_on_termination=True https://github.com/openstack/nova/blob/master/nova/compute/manager.py#L2440 | |
| 23:33:59 | mnaser | hmmm | |
| 23:34:39 | mnaser | because now i end up with volumes with attachments (for whatever reason) and there doesn't seem to be a straight forward way of clearing that out | |
| 23:34:50 | mriedem | force detach in cinder? | |
| 23:35:15 | mnaser | i see force delete but not force detach | |
| 23:35:19 | mnaser | (force delete is ok for me though) | |
| 23:36:17 | mriedem | that might be what i was thinking of | |
| 23:36:29 | openstackgerrit | Andreas Karis proposed openstack/nova master: Add debug output for selected page size https://review.openstack.org/530662 | |
| 23:36:29 | mriedem | smcginnis: knows | |
| 23:36:57 | mnaser | Delete for volume 973d5a3d-07f3-4d05-b62c-8dfe746d298c failed: Invalid volume: Volume must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-ecfad96c-8125-47e4-8e25-9a9e892139aa) | |
| 23:37:01 | mnaser | i guess this is in cinder-land | |
| 23:37:21 | mnaser | (cant force delete an attach volume) | |
| 23:37:50 | mriedem | mnaser: https://developer.openstack.org/api-ref/block-storage/v2/#force-detach-volume | |
| 23:38:22 | mordred | wow. y'all are having all the fun | |
| 23:38:39 | mriedem | mordred: this channel is a barrel of laughs all day every day | |
| 23:38:52 | mordred | mriedem: that's what I tell people | |
| 23:39:15 | mordred | "looking for a barrel of laughs? go check out #openstack-nova!", I tell them | |
| 23:40:19 | mnaser | mriedem: interesting, i could probably even normal detach, but i wonder if the cinder cli client has it | |
| 23:41:01 | mnaser | hopefully scaling up our cinder api endpoints should mean that we don't see this again | |
| 23:41:32 | mriedem | i don't see a force detach command in cinderclient | |
| 23:46:22 | SamYaple | i dont think there is one... | |
| 23:46:50 | SamYaple | inconsitencies between nova and cinder ive always had to go to the db to solve | |
| 23:47:03 | mriedem | there is an api | |
| 23:47:05 | mriedem | so curl should work | |
| 23:47:20 | mriedem | should also be easy enough to add a cli for this in cinderclient | |
| 23:47:38 | SamYaple | indeed | |
| #openstack-nova - 2018-01-05 | |||
| 00:00:54 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in put (2) https://review.openstack.org/531266 | |
| 00:17:24 | openstackgerrit | Matt Riedemann proposed openstack/python-novaclient master: Microversion 2.58 - Instance actions list pagination https://review.openstack.org/528601 | |
| 00:29:02 | mriedem | alex_xu: takashin: important question in https://review.openstack.org/#/c/330406/78/api-ref/source/parameters.yaml@4148 | |
| 00:29:19 | mriedem | this microversion adds a uuid field to the response for GET /os-migrations, | |
| 00:29:42 | mriedem | i suggested we could also take this opportunity to add uuid to the response for GET /servers/{uuid}/migrations as well | |
| 00:29:55 | mriedem | thoughts on that? | |
| 00:30:35 | mriedem | comment on the review if you like, i have to make dinner | |
| 01:29:56 | openstackgerrit | Merged openstack/nova master: Imported Translations from Zanata https://review.openstack.org/524795 | |
| 02:34:35 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in put (3) https://review.openstack.org/531280 | |
| 03:51:14 | openstackgerrit | Hironori Shiina proposed openstack/nova master: virt/ironic: Implement rescue and unrescue https://review.openstack.org/416487 | |
| 05:46:57 | openstackgerrit | Andreas Jaeger proposed openstack/os-vif master: zuul: Enable functional tests in gate https://review.openstack.org/530961 | |
| 06:10:59 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: [placement] Add sending global request ID in get https://review.openstack.org/531299 | |