| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-07-22 | |||
| 12:56:36 | sean-k-mooney | pps series? | |
| 12:56:55 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move port creation to the NeutronFixture https://review.opendev.org/c/openstack/nova/+/787206 | |
| 12:56:55 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] create pps resource on OVS agent RP https://review.opendev.org/c/openstack/nova/+/787205 | |
| 12:56:56 | opendevreview | Balazs Gibizer proposed openstack/nova master: Detect extended_resource_request neutron API extension https://review.opendev.org/c/openstack/nova/+/793618 | |
| 12:56:56 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] neutron fixture for extended resource request https://review.opendev.org/c/openstack/nova/+/794306 | |
| 12:56:57 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move port resource request tests https://review.opendev.org/c/openstack/nova/+/801815 | |
| 12:58:20 | gibi | sean-k-mooney: yepp, pps :D | |
| 13:00:39 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server create with extended resource req https://review.opendev.org/c/openstack/nova/+/793619 | |
| 13:00:40 | opendevreview | Balazs Gibizer proposed openstack/nova master: Reject server operations with extended resource req https://review.opendev.org/c/openstack/nova/+/793620 | |
| 13:04:24 | opendevreview | Balazs Gibizer proposed openstack/nova master: Add same_subtree field to RequestLevelParams https://review.opendev.org/c/openstack/nova/+/791503 | |
| 13:05:47 | opendevreview | Balazs Gibizer proposed openstack/nova master: Bump min placement microversion to 1.36 https://review.opendev.org/c/openstack/nova/+/791504 | |
| 13:05:48 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor assertPortMatchesAllocation https://review.opendev.org/c/openstack/nova/+/792458 | |
| 13:05:48 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support same_subtree in allocation_canadidate query https://review.opendev.org/c/openstack/nova/+/791505 | |
| 13:09:39 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor asserts in qos tests https://review.opendev.org/c/openstack/nova/+/798930 | |
| 13:10:56 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] ports with both bw and pps resources https://review.opendev.org/c/openstack/nova/+/792394 | |
| 13:12:12 | opendevreview | Balazs Gibizer proposed openstack/nova master: Parse extended resource request from the port data https://review.opendev.org/c/openstack/nova/+/800085 | |
| 13:13:28 | opendevreview | Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506 | |
| 13:14:45 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support move ops with extended resource request https://review.opendev.org/c/openstack/nova/+/800087 | |
| 13:16:02 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor interface attach with qos https://review.opendev.org/c/openstack/nova/+/800088 | |
| 13:17:22 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support interaface attach / detach with new resource request format https://review.opendev.org/c/openstack/nova/+/800089 | |
| 13:18:10 | bauzas | stephenfin: awesome ! thanks for the FUP <3 | |
| 13:18:39 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 13:22:58 | gibi | and I f*ck up the rebase at some point and lost a patch in the series :/ | |
| 13:26:34 | sean-k-mooney | hopefully you have it localy | |
| 13:27:49 | gibi | git reflog has it | |
| 13:28:15 | gibi | I basically merged two subseqent commit together | |
| 13:28:20 | gibi | in the series | |
| 13:28:23 | gibi | during the rebase | |
| 13:38:31 | gibi | I hate that git does not warn against commit --amend when during interactive rebase it stops at the commit both because it marked as edit and becuase it has a merge conflict | |
| 13:39:02 | belmoreira | Hello everyone... I have a question regarding DBs... but also related with nova :) | |
| 13:39:07 | sean-k-mooney | well thats becasue you can do commit --amend for valid reasons | |
| 13:39:15 | sean-k-mooney | with an interactive rebase | |
| 13:39:20 | sean-k-mooney | but yes i have done that too | |
| 13:39:30 | gibi | sean-k-mooney: yeah, but not during a conflict resolution I guess | |
| 13:39:32 | sean-k-mooney | belmoreira: nova does have them | |
| 13:39:59 | sean-k-mooney | gibi: i have used it where i was not finsihed with the full resolution | |
| 13:40:07 | belmoreira | sean-k-mooney :) | |
| 13:40:09 | sean-k-mooney | then came back | |
| 13:40:16 | belmoreira | We will need to move some nova DBs from mysql 5.7.x to 8.x. Our DB team was testing this DB migration and a character convertion is required (utf8mb3 -> utf8mb4) | |
| 13:40:46 | belmoreira | Apparently utf8 in mysql 8.x uses 4 bytes instead of 3 bytes (like previously) | |
| 13:40:55 | sean-k-mooney | belmoreira: nova currently does not supeciric any charicterset or coalation type in our schema | |
| 13:41:23 | sean-k-mooney | belmoreira: utf8 in gereal uses between 1 an 4 bytes depending on the charater | |
| 13:41:51 | belmoreira | sean-k-mooney right | |
| 13:42:17 | belmoreira | my concern is that they reported that (silent) changes of data types can happen, for example from TEXT to MEDIUMTEXT to allow the column to accommodate the original data using 4bytes for each character instead of 3. For similar reasons we could also potentially hit the innodb index key max size... | |
| 13:43:06 | belmoreira | Is there something that you are aware? Or this should be safe for Nova | |
| 13:44:01 | sean-k-mooney | i think nova largely should not care but im not sure. | |
| 13:44:19 | sean-k-mooney | nova likely should jsut use utf_8_bin | |
| 13:44:24 | sean-k-mooney | at some point | |
| 13:45:00 | sean-k-mooney | https://en.wikipedia.org/wiki/UTF-8#MySQL_utf8mb3 | |
| 13:46:55 | belmoreira | thanks sean-k-mooney | |
| 13:47:59 | sean-k-mooney | we do use mediumetext in somplaces | |
| 13:48:40 | sean-k-mooney | in general nova does not allow you to change the column data types form what we have in the schema | |
| 13:48:53 | sean-k-mooney | btu the encoding i dont think will break anything | |
| 13:49:09 | sean-k-mooney | belmoreira: are they plannign to actully modify the types in the tables | |
| 13:50:13 | sean-k-mooney | we generally are allowing sqlalchmy to mange the filed types | |
| 13:50:24 | belmoreira | I'm afraid to just discover some of these changes in prod. Anyway I will try to test it as much as possible and I will let you know if I discover something | |
| 13:51:01 | belmoreira | sean-k-mooney no they will not explicitly change the schema but they say it can happen when moving to utf8mb4 | |
| 13:51:34 | sean-k-mooney | well text files unlike nvarcars are not actully stored in the db correct | |
| 13:51:39 | belmoreira | I'm learning about all of this utf8 encoding :) | |
| 13:51:40 | sean-k-mooney | they are stored as sepereate files | |
| 13:51:59 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support boot with extended resource request https://review.opendev.org/c/openstack/nova/+/800086 | |
| 13:51:59 | opendevreview | Balazs Gibizer proposed openstack/nova master: Transfer RequestLevelParams from ports to scheduling https://review.opendev.org/c/openstack/nova/+/791506 | |
| 13:52:00 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] refactor interface attach with qos https://review.opendev.org/c/openstack/nova/+/800088 | |
| 13:52:00 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support move ops with extended resource request https://review.opendev.org/c/openstack/nova/+/800087 | |
| 13:52:29 | sean-k-mooney | we use string https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/models.py#L256 when we wnat fixed lenght nvarchar columns | |
| 13:53:21 | belmoreira | I think the best is to do the conversion of a test DB and I will go manually through the schema. Maybe at the end there is nothing about this | |
| 13:54:16 | sean-k-mooney | ya | |
| 13:55:45 | sean-k-mooney | but ya just confirm that text filds are stored off table https://www.navicat.com/en/company/aboutus/blog/1308-choosing-between-varchar-and-text-in-mysql | |
| 13:55:55 | sean-k-mooney | belmoreira: where the issue might happen | |
| 13:56:02 | sean-k-mooney | would be for user-data | |
| 13:56:22 | sean-k-mooney | text field cans sture up to 64k fo data | |
| 13:57:00 | belmoreira | sean-k-mooney thanks a lot. I will let you know if something comes up | |
| 13:57:01 | sean-k-mooney | user-data is defiened to be medium text already https://github.com/openstack/nova/blob/master/nova/db/sqlalchemy/models.py#L288 | |
| 13:57:04 | opendevreview | Balazs Gibizer proposed openstack/nova master: Support interaface attach / detach with new resource request format https://review.opendev.org/c/openstack/nova/+/800089 | |
| 13:57:17 | sean-k-mooney | so it should not need to be upgraded but ya let us know | |
| 13:58:20 | opendevreview | Balazs Gibizer proposed openstack/nova master: [func test] move unshelve test to the proper place https://review.opendev.org/c/openstack/nova/+/793621 | |
| 13:58:52 | sean-k-mooney | MediumText can store 16 MB but we limit the user-data to 64k i belive in the api so it should fit thats the only filed that is likely to get close to 64k i think so hopefully it will just work out | |
| 14:04:28 | gibi | stephenfin:I've fixed your comments in the pps series | |
| 14:07:36 | gibi | I think we have a gate block due to https://zuul.opendev.org/t/openstack/builds?job_name=openstacksdk-functional-devstack&project=openstack/nova | |
| 14:08:58 | gibi | coudl be due to https://review.opendev.org/c/openstack/cinder/+/792299 | |
| 14:09:04 | gibi | moving to cinder ... | |
| 14:14:56 | lyarwood | Yeah you should be able to drop the v2 tests from osc now on master | |
| 14:15:07 | lyarwood | the sdk even sorry | |
| 14:16:36 | gibi | lyarwood: hm, good point, these are v2 tests | |
| 14:16:51 | gibi | then I'm going to delete them ... | |
| 14:38:25 | gibi | lyarwood: fyi, here is the removal of those tests https://review.opendev.org/c/openstack/openstacksdk/+/801864 | |
| 15:00:57 | sean-k-mooney | gibi: how did the v2 removal impact the nova gate by the way | |
| 15:01:23 | sean-k-mooney | https://review.opendev.org/c/openstack/openstacksdk/+/801864 should not affefct us right | |
| 15:03:05 | melwitt | gibi: thanks! and ack, will check the re-parenting | |
| 15:03:47 | gibi | sean-k-mooney: we gate on openstacksdk-functional-devstack job that started failing as it runs against a devstack and trying to find block storage v2 | |
| 15:04:16 | lyarwood | sean-k-mooney: I don't think it did | |
| 15:04:40 | lyarwood | sean-k-mooney: all of our cinderv2 stuff goes through cinderv3 now anyway | |
| 15:06:27 | sean-k-mooney | gibi: oh it is | |
| 15:14:54 | lyarwood | gibi: re osc, sorry I'm not trying to be difficult but I think we can just exclude these tests for now | |
| 15:17:07 | gibi | lyarwood: sure no worries. I #openstack-sdks gtema said he will inventigate a better way to fix this so I defer to him | |
| 15:17:27 | lyarwood | gibi: ah sorry I'm not in that channel, sounds good :) | |
| 15:17:40 | gibi | yeah it is in good hands now :) | |
| 15:26:02 | gibi | 12 | |
| 15:26:08 | gibi | ups | |
| 15:26:39 | gibi | melwitt: re consumer_types: so you created one transaction that containst both the ensure_consumer and the Allocation.replace_all calls | |