| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-05-13 | |||
| 11:50:00 | brtknr | gibi: wp | |
| 11:50:07 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.moves https://review.opendev.org/727224 | |
| 11:50:09 | gibi | brtknr: sorry | |
| 11:50:29 | brtknr | np :) | |
| 11:52:53 | openstackgerrit | sean mooney proposed openstack/nova master: Provider Config File: YAML file loading and schema validation https://review.opendev.org/673341 | |
| 11:52:54 | openstackgerrit | sean mooney proposed openstack/nova master: Provider Config File: Function to further validate and retrieve configs https://review.opendev.org/676029 | |
| 11:52:54 | openstackgerrit | sean mooney proposed openstack/nova master: Provider Config File: Functions to merge provider configs to provider tree https://review.opendev.org/676522 | |
| 11:52:55 | openstackgerrit | sean mooney proposed openstack/nova master: Provider Config File: Enable loading and merging of provider configs https://review.opendev.org/693460 | |
| 11:53:42 | sean-k-mooney | gibi: that is just a strait rebae with the merge conflicts and pep8 issues resolved by the way so its basically the same as the previous version | |
| 11:54:51 | gibi | sean-k-mooney: thanks. you and tony_su should sync on who will work on that patch series | |
| 11:55:25 | sean-k-mooney | gibi: yep | |
| 11:56:57 | sean-k-mooney | tony_su: if you want to take it over and have time to adress https://review.opendev.org/#/c/676029/34/nova/tests/unit/compute/test_provider_config.py@174 that was the only open item form last cycle i belive | |
| 11:59:28 | sean-k-mooney | ok i have been awaked since 3:30 and working more or less since 4:30 so im going to take a break for a few hours. ill be back after i have lunch and relax for a bit | |
| 12:09:10 | gibi | sean-k-mooney: have a nice lunch | |
| 12:22:10 | jkulik | anybody else experiencing problems with querying /servers for multiple uuids? nova seems to only get one uuid for filtering. I guess the MultiDict used by webob.Request gets botched here https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/servers.py#L178 see http://paste.openstack.org/show/793512/ for some python-console fuu showing the problem | |
| 12:23:01 | jkulik | docs for the MultiDict stuff https://docs.pylonsproject.org/projects/webob/en/stable/reference.html#query-post-variables | |
| 12:28:12 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.moves https://review.opendev.org/727224 | |
| 12:29:25 | jkulik | should I just open a bug report if I fear something is broken instead of asking on IRC for someone to confirm? | |
| 12:30:16 | sean-k-mooney | jkulik: im not sure if this is actully supported | |
| 12:30:28 | jkulik | oh, down the line it's checked against a list | |
| 12:30:33 | jkulik | let me find that part again | |
| 12:31:43 | sean-k-mooney | jkulik: the servers endpoint only supprot one uuid https://docs.openstack.org/api-ref/compute/?expanded=show-server-details-detail#show-server-details | |
| 12:31:48 | sean-k-mooney | not a list of them | |
| 12:32:03 | sean-k-mooney | at least the server detials endpoint | |
| 12:32:41 | jkulik | index does support more in theory, though. it ends up here in the end https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/api.py#L1849-L1854 | |
| 12:33:11 | jkulik | oh, I mean query params to /servers or /servers/detail | |
| 12:33:13 | sean-k-mooney | well the docs text is | |
| 12:33:34 | sean-k-mooney | right so its not supported for /servers/detail | |
| 12:33:49 | sean-k-mooney | well i guess it might be | |
| 12:34:03 | sean-k-mooney | the docs text reads | |
| 12:34:06 | sean-k-mooney | uuid (Optional) | |
| 12:34:08 | sean-k-mooney | ||
| 12:34:10 | sean-k-mooney | query | |
| 12:34:12 | sean-k-mooney | ||
| 12:34:14 | sean-k-mooney | string | |
| 12:34:16 | sean-k-mooney | ||
| 12:34:18 | sean-k-mooney | Filter the server list result by the UUID of the server. | |
| 12:34:20 | sean-k-mooney | This parameter is only valid when specified by administrators. If non-admin users specify this parameter, it is ignored. | |
| 12:34:23 | sean-k-mooney | so based on the docs we dont supprot it | |
| 12:34:35 | jkulik | it would explicitly state that's it supports a list? | |
| 12:34:41 | sean-k-mooney | it might be possibel but its not intended to work | |
| 12:35:13 | sean-k-mooney | it filters the list of servers by the uuid | |
| 12:35:13 | jkulik | (because for neutron ports "id", it looked the same but works) | |
| 12:35:20 | sean-k-mooney | it does not say it supports a list of uuids | |
| 12:35:40 | jkulik | sure, but the code has extra ifs for a list ;) | |
| 12:36:07 | jkulik | https://github.com/openstack/nova/blob/master/nova/compute/api.py#L2838-L2841 | |
| 12:36:11 | sean-k-mooney | jkulik: do we have api test for the list case | |
| 12:36:20 | jkulik | haven't checked. will do. | |
| 12:48:07 | jkulik | can't find any in the unit-tests at least. for a lot of other query-params, there are tests, but uuid doesn't seem to be in there. | |
| 12:49:21 | sean-k-mooney | jkulik: looking at the code if ti ever worke i suspect it was a nova v2 or nova v1 capablity that was never fully supproted and is not supproted anymore | |
| 12:50:07 | jkulik | looking at the code, it seems totally supported, if we would just convert the MultiDict's multiple entries to a list instead | |
| 12:50:41 | sean-k-mooney | https://github.com/openstack/nova/commit/3f35fe6a88672ea2ab7e080a55235c5cca45dc2c | |
| 12:51:07 | sean-k-mooney | that code is related to listing instance by ip | |
| 12:51:27 | sean-k-mooney | jkulik: its not for listing servers by uuid | |
| 12:51:59 | francoisp | lyarwood, bauzas hello, when you get a chance: https://review.opendev.org/#/c/726508/ (this time around for Queens) - thanks! | |
| 12:52:09 | bauzas | ack, will look | |
| 12:52:39 | sean-k-mooney | jkulik: we support a list there becasue you can have multiple servers with the same ip adress | |
| 12:52:56 | sean-k-mooney | but we dont support the uuid query arg being a list | |
| 12:53:13 | jkulik | sean-k-mooney, but is uses the uuid key out of search_opts which comes from the query-params | |
| 12:53:23 | jkulik | which cannot be a list because it's broken | |
| 12:53:39 | sean-k-mooney | jkulik: the uuid quey arg is not ment to be a list | |
| 12:53:55 | sean-k-mooney | it susing it here so you can filter by ip and uuid | |
| 12:53:59 | jkulik | my use-case would be retrieving infos for multiple servers I know the UUID of in one request btw. | |
| 12:54:03 | sean-k-mooney | the docs say uuid singualr | |
| 12:54:23 | sean-k-mooney | jkulik: yep which as far as im aware we do not support | |
| 12:54:28 | jkulik | sure. the docs say the same for "id" in ports, so I didn't think that's so important ;) | |
| 12:55:06 | jkulik | and since search_opts gets passed down to the db layer in the end, which also can support a list, we would just have to adjust that one line to make it work | |
| 12:55:09 | sean-k-mooney | gmann: your one of our api experst do you know if we have ever supported filtering server list by a list of uuids | |
| 12:55:32 | jkulik | but if it's not supposed to, that's fine, too. I just think the code would support it. | |
| 12:55:37 | sean-k-mooney | jkulik: there is a difference between things that work as a result of internal impemnstion details and what is actully supported | |
| 12:56:55 | jkulik | sean-k-mooney, thanks for looking at it :) | |
| 12:57:37 | sean-k-mooney | jkulik: this is the relevent spec for filtering https://specs.openstack.org/openstack/nova-specs/specs/ocata/implemented/add-whitelist-for-server-list-filter-sort-parameters.html | |
| 13:00:48 | sean-k-mooney | jkulik: so i think we suport filterign with a singel value but not lists or any advance queries. | |
| 13:05:23 | jkulik | I don't see any mentioning of either in the spec, but I can live with the answer "works as designed". | |
| 13:07:09 | sean-k-mooney | it is a feature you could request or propose as a blueprit/spec. | |
| 13:07:21 | sean-k-mooney | i belive its working as designed currently | |
| 13:07:37 | sean-k-mooney | but i dont nessicaly thing it woudl be too contovertall to add support for what you want | |
| 13:07:56 | sean-k-mooney | its just not a bug since i dont think it was ever inteded to wrok | |
| 13:18:47 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.iteritems/itervalues/iterkeys https://review.opendev.org/727757 | |
| 13:21:07 | openstackgerrit | Lee Yarwood proposed openstack/nova master: Add functional test for bug 1550919 https://review.opendev.org/631294 | |
| 13:21:07 | openstack | bug 1550919 in OpenStack Compute (nova) "[Libvirt]Evacuate fail may cause disk image be deleted" [Medium,In progress] https://launchpad.net/bugs/1550919 - Assigned to Lee Yarwood (lyarwood) | |
| 13:21:07 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Don't delete disks on shared storage during evacuate https://review.opendev.org/578846 | |
| 13:39:14 | jkulik | functional tests don't support testing the "uuid as list" case either https://github.com/openstack/nova/blob/master/nova/tests/functional/api/client.py#L248-L250 | |
| 13:39:46 | jkulik | the lack of tests for 'uuid' in search_opts isn't good, though :D | |
| 13:45:45 | sean-k-mooney | jkulik: yep again i think that is becasue we did not orginally plan to expose this via the api and retroactivly had to try and fix it | |
| 13:46:15 | openstackgerrit | Jiri Suchomel proposed openstack/nova master: Add ability to download Glance images into the libvirt image cache via RBD https://review.opendev.org/574301 | |
| 14:24:36 | openstackgerrit | Takashi Natsume proposed openstack/nova master: Remove six.byte2int/int2byte https://review.opendev.org/727777 | |
| 14:34:02 | gmann | jkulik: sean-k-mooney yeah, multi filters things are not supported. for this case where you want to list multiple servers you can use some other query filter which matches multiple servers. like ?name=test so it will return all servers matching with 'test*' | |
| 14:35:58 | gmann | remember, multiple filters are with AND condition | |
| 14:38:34 | gmann | in current behaviour only last present item is being used even you are asking for multi dict | |
| 14:41:03 | gmann | jkulik: it should not be hard to support that, we just need to change the way we fetch filter from GET and query DB with OR condition. | |
| 14:41:35 | gmann | jkulik: anyways, all API change need spec process, please feel free to add BP and spec for the same | |
| 14:43:30 | gmann | but remember any other filter present with mutli dict filter will be with AND condition. so you would not be able to do 'server-uuid1 OR (server-uuid2 AND vm_state=active)' it will be '(server-uuid1 OR server-uuid2) AND vm_state=active)' | |
| 15:32:43 | lyarwood | we should start a club :) | |
| 15:33:37 | lyarwood | gibi: I've not had a chance to look at your caching change btw, I'll try to get to it tomorrow | |
| 15:34:09 | gibi | lyarwood: dont rush it is a very incomplete messy pile of boo | |
| 15:36:02 | gibi | lyarwood: I just figured out that the current imagebacked code my temporarily use double of the image size disk space. For example if an image is a qcow in glance but nova configured to force_raw_images then after image download we copy out the raw data from qcow and the delete the qcow file we downloaded :/ | |
| 15:36:17 | gibi | s/my/might/ | |
| 15:36:47 | gibi | who thought that we will have disk space for that operation?! | |
| 15:38:03 | gibi | I get to feel that I have no power to patch this code in a way I imagined | |