| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-sdks - 2022-04-27 | |||
| 11:49:12 | jm1 | atm users can choose filters freely, we just pass them to the cloud layer unchanged. https://opendev.org/openstack/ansible-collections-openstack/src/branch/master/plugins/modules/identity_user_info.py#L144 | |
| 11:50:13 | jm1 | gtema: we are not sure what is the best solution to this. either continue to use cloud layer functions or change/remove filters and thus break user code? | |
| 11:51:18 | gtema | I think you can stick to cloud layer here | |
| 12:00:13 | opendevreview | Merged openstack/ansible-collections-openstack master: Removed object tags from ci role server https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839505 | |
| 12:01:33 | jm1 | gtema++ ack, thank you :) | |
| 12:01:41 | gtema | wlcm | |
| 12:19:23 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Temporarily run passing tests in our Zuul CI jobs only https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839374 | |
| 12:27:51 | opendevreview | Arx Cruz proposed openstack/ansible-collections-openstack master: Update catalog service for the new sdk https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839352 | |
| 13:08:14 | jm1 | gtema: sdk seems to be inconsistent with postprocessing filters. some functions from cloud layer allow for applying filters to results, e.g. search_users https://opendev.org/openstack/openstacksdk/src/branch/master/openstack/cloud/_identity.py#L162 | |
| 13:09:24 | jm1 | gtema: other cloud layer functions such as search_projects do not allow filtering to the same extent because they use filters as query parameters | |
| 13:10:01 | jm1 | gtema: for example, this fails with the new sdk list(conn.search_projects(filters={"id": "123"})) | |
| 13:10:41 | jm1 | gtema: but this wont list(conn.search_users(filters={"id": "bla2"})) | |
| 13:11:41 | jm1 | gtema: in the first case (where it fails), what is the point of the postprocessing filter if you cannot use anything except for the query parameters anyway? | |
| 13:13:36 | jm1 | gtema: is this "pass all filters as query params and thus only allow valid query params as filters" a design decision which might be applied to other cloud functions such as search_users() later? | |
| 13:14:17 | jm1 | gtema: or is it the opposite, i.e. search_projects() has to be fixed to only pass filters which are valid query params to proxy functions? | |
| 13:49:39 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Temporarily run passing tests in our Zuul CI jobs only https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839374 | |
| 13:57:04 | gtema | jm1: I would say cloud layer may need to be fixed to know what it can pass to API and filter rest. On the other side same might be applied in proxy directly. I wouldn't say there were very strict design decisions, except that proxy for now only supports what API will support (but we may rethink this) | |
| 14:12:01 | jm1 | gtema: afaik proxy layer is a slim python layer on top of the openstack rest api. hence its valid that it raises exceptions on unknown query parameters. QueryParameters and Resource classes have a allow_unknown_params flag which would allow users to force sdk to pass params to rest apis. In case of our cloud layer functions, we do not want to pass unknown params to openstack. instead we want to filter results in a postprocessing step by | |
| 14:12:02 | jm1 | parameters which are not supported as query params. | |
| 14:12:24 | jm1 | gtema: so imho cloud layer functions should only pass valid query params to proxy functions | |
| 14:13:05 | jm1 | gtema: since every resource already has a list of valid query params (_query_parameters), implementing a function to drop invalid params is kind of easy, isnt it? | |
| 14:13:26 | jm1 | gtema: then we could call this drop function from cloud layer functions such as search_projects | |
| 14:13:50 | jm1 | gtema: i am happy to help but i need some guidance on where to best add this kind of code | |
| 14:13:53 | jm1 | ..in the sdk | |
| 14:15:15 | gtema | well yes, it's not so complex, but we need then to implement it in every cloud layer function, and this is close to insanity again | |
| 14:15:43 | gtema | in proxy there is also possibility not to raise exception for unsupported query params | |
| 14:16:01 | jm1 | gtema: why insanity? we only have to add the drop function call to cloud functions which pass filters as query params | |
| 14:16:31 | gtema | so it would be possible to swap process that cloud layer passes everything possible, proxy uses only whatever supported and cloud filters again | |
| 14:16:56 | gtema | insanity because there are many cloud layer functions and we should have things working same everywhere | |
| 14:17:07 | gtema | means we need to invoke it from every list function | |
| 14:19:38 | jm1 | gtema: "in proxy there is also possibility not to raise exception for unsupported query params" => allow_unknown_params? | |
| 14:19:49 | gtema | yes | |
| 14:20:08 | gtema | but it is there primarily to allow special corner cases and need to be checked | |
| 14:21:17 | gtema | main case was that there are some APIs that do not return error if you pass unsupported query params and there are no ways to properly implement all of them (like fuzzy search), but other services might really return error if you try to pass unsupported QP | |
| 14:21:26 | gtema | so this requires some playing | |
| 14:21:59 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Use proxy layer in identity_user_info https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828539 | |
| 14:24:04 | jm1 | that is why i would not go this way. if we "simply" drop filters which are not query params, then we will never run into this issue, at the cost of openstack-api-might-return-more-than-requested | |
| 14:24:43 | gtema | sure, but then you need to implement this drop in every list function | |
| 14:25:23 | jm1 | not in any list function, only list functions which turn filters into query params like here: https://github.com/openstack/openstacksdk/blob/master/openstack/cloud/_identity.py#L54 | |
| 14:25:34 | gtema | for the sake of generalisation I would really consider implementing this deep in proxy list function (to only use what is known to work and ignore rest) | |
| 14:26:01 | jm1 | gtema: sure, do whatever fits the sdk best :) | |
| 14:26:02 | gtema | yeah, but ideally they all do this (at least that was initial idea with those filters) | |
| 14:26:49 | jm1 | gtema: ah ok. hmm.. | |
| 14:27:15 | jm1 | gtema: now i see why you prefer a generic approach | |
| 14:28:03 | gtema | that actually was the biggest point of whole R1 work - to generalize as much as possible to have same behavior across services/methods | |
| 14:29:45 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Use proxy layer in identity_user module https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828742 | |
| 14:30:09 | opendevreview | Ananya proposed openstack/ansible-collections-openstack master: WIP: Moves image_info from cloud to proxy object https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828158 | |
| 14:50:04 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Use proxy layer in identity_user module https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828742 | |
| 14:52:33 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Use proxy layer in identity_user module https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828742 | |
| 15:03:28 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update identity_role_info for latest openstacksdk release https://review.opendev.org/c/openstack/ansible-collections-openstack/+/837751 | |
| 15:09:17 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Use proxy layer in identity_user module https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828742 | |
| 15:12:59 | opendevreview | Ananya proposed openstack/ansible-collections-openstack master: WIP: Moves image_info from cloud to proxy object https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828158 | |
| 15:13:58 | jm1 | gtema: and its much better now! | |
| 15:14:34 | gtema | nice to hear | |
| 15:15:17 | jm1 | gtema: for now we will stick to cloud functions whenever we have code that passes filters. as long as users dont pass invalid query params they are fine. but it would be great if they could do the same as before ^^ | |
| 15:15:38 | gtema | ok, will think what and when to do | |
| 15:15:53 | jm1 | gtema: if you need help ping me | |
| 15:15:57 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update identity_role_info for latest openstacksdk release https://review.opendev.org/c/openstack/ansible-collections-openstack/+/837751 | |
| 15:16:02 | gtema | ok | |
| 15:17:27 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update identity_role_info for latest openstacksdk release https://review.opendev.org/c/openstack/ansible-collections-openstack/+/837751 | |
| 15:17:50 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update identity_role_info for latest openstacksdk release https://review.opendev.org/c/openstack/ansible-collections-openstack/+/837751 | |
| 15:20:47 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Use proxy layer in identity_user_info https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828539 | |
| 15:22:52 | opendevreview | Ananya proposed openstack/ansible-collections-openstack master: WIP: Moves image_info from cloud to proxy object https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828158 | |
| 15:23:35 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Use proxy layer in identity_user_info https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828539 | |
| 15:30:53 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update identity_role to work with latest sdk https://review.opendev.org/c/openstack/ansible-collections-openstack/+/837772 | |
| 15:40:16 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update identity_domain_info to use proxy layer https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839445 | |
| 15:47:04 | opendevreview | Merged openstack/ansible-collections-openstack stable/1.0.0: Added support for specifying a maximum version of the OpenStack SDK https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839349 | |
| 15:51:54 | opendevreview | Ananya proposed openstack/ansible-collections-openstack master: WIP: Moves image_info from cloud to proxy object https://review.opendev.org/c/openstack/ansible-collections-openstack/+/828158 | |
| 16:14:30 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update identity_role to work with latest sdk https://review.opendev.org/c/openstack/ansible-collections-openstack/+/837772 | |
| 18:12:02 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack stable/1.0.0: Removed object tags from ci role server https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839545 | |
| 18:16:57 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Constrain filters in compute_service_info to SDK >= 0.53.0 https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839546 | |
| 20:16:15 | opendevreview | Merged openstack/ansible-collections-openstack master: Constrain filters in compute_service_info to SDK >= 0.53.0 https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839546 | |
| 20:51:42 | opendevreview | Merged openstack/ansible-collections-openstack stable/1.0.0: Removed object tags from ci role server https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839545 | |
| 21:18:57 | opendevreview | Rafael Castillo proposed openstack/ansible-collections-openstack master: Update project module to be compatible with new sdk https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839640 | |
| #openstack-sdks - 2022-04-28 | |||
| 05:49:48 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack stable/1.0.0: Constrain filters in compute_service_info to SDK >= 0.53.0 https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839322 | |
| 06:37:11 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Restricted galaxy-importer script to Python 3.6+ https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839686 | |
| 06:39:04 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Removed Zuul CI job for OpenStack Queens https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839687 | |
| 06:45:13 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Temporarily run passing tests in our Zuul CI jobs only https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839374 | |
| 07:16:12 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Raise minimum OpenStack SDK version to 1.0.0 https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839691 | |
| 07:24:02 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack stable/1.0.0: Lowered maximum OpenStack SDK version to 0.x.x https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839693 | |
| 07:42:46 | opendevreview | Shnaidman Sagi (Sergey) proposed openstack/ansible-collections-openstack master: Change network modules to work with new SDK https://review.opendev.org/c/openstack/ansible-collections-openstack/+/825291 | |
| 07:53:25 | opendevreview | Merged openstack/ansible-collections-openstack stable/1.0.0: Constrain filters in compute_service_info to SDK >= 0.53.0 https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839322 | |
| 08:34:33 | opendevreview | Merged openstack/ansible-collections-openstack master: Restricted galaxy-importer script to Python 3.6+ https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839686 | |
| 08:34:59 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack stable/1.0.0: Restricted galaxy-importer script to Python 3.6+ https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839666 | |
| 08:36:17 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Changed our Zuul CI *-octavia job to non-voting https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839706 | |
| 10:40:51 | opendevreview | Merged openstack/ansible-collections-openstack master: Changed our Zuul CI *-octavia job to non-voting https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839706 | |
| 10:42:03 | opendevreview | Arx Cruz proposed openstack/ansible-collections-openstack master: Update identity_group_info to new sdk https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839365 | |
| 10:42:19 | arxcruz | jm1 filter is back ^ | |
| 11:07:55 | opendevreview | Merged openstack/ansible-collections-openstack stable/1.0.0: Restricted galaxy-importer script to Python 3.6+ https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839666 | |
| 11:17:07 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack stable/1.0.0: Changed our Zuul CI *-octavia job to non-voting https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839735 | |
| 11:19:25 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack master: Temporarily run passing tests in our Zuul CI jobs only https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839374 | |
| 11:27:24 | jm1 | arxcruz: ack, thx :) | |
| 11:41:53 | opendevreview | Merged openstack/ansible-collections-openstack stable/1.0.0: Changed our Zuul CI *-octavia job to non-voting https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839735 | |
| 13:00:48 | opendevreview | Shnaidman Sagi (Sergey) proposed openstack/ansible-collections-openstack master: Change network modules to work with new SDK https://review.opendev.org/c/openstack/ansible-collections-openstack/+/825291 | |
| 13:41:06 | opendevreview | Merged openstack/ansible-collections-openstack master: Temporarily run passing tests in our Zuul CI jobs only https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839374 | |
| 13:46:07 | opendevreview | Jakob Meng proposed openstack/ansible-collections-openstack stable/1.0.0: Temporarily run passing tests in our Zuul CI jobs only https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839736 | |
| 14:13:28 | opendevreview | Merged openstack/ansible-collections-openstack stable/1.0.0: Temporarily run passing tests in our Zuul CI jobs only https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839736 | |
| 14:50:02 | opendevreview | Jan Horstmann proposed openstack/ansible-collections-openstack master: Return details in baremetal_node_info when iterating over all machines https://review.opendev.org/c/openstack/ansible-collections-openstack/+/839776 | |
| 15:04:21 | opendevreview | Merged openstack/openstacksdk master: Run nodepool job https://review.opendev.org/c/openstack/openstacksdk/+/826543 | |
| 15:20:21 | opendevreview | Shnaidman Sagi (Sergey) proposed openstack/ansible-collections-openstack master: Change network modules to work with new SDK https://review.opendev.org/c/openstack/ansible-collections-openstack/+/825291 | |