| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-04-21 | |||
| 12:21:33 | sean-k-mooney | for just that one table which we dont use any more :) | |
| 12:21:33 | sean-k-mooney | for just that one table which we dont use any more :) | |
| 12:21:51 | sean-k-mooney | i thinke the rest use whatever you have set as your default type | |
| 12:21:51 | sean-k-mooney | i thinke the rest use whatever you have set as your default type | |
| 12:22:39 | sean-k-mooney | we have a customer which for reasons ended up changing the nova hosts value form lowercase to upper case | |
| 12:22:39 | sean-k-mooney | we have a customer which for reasons ended up changing the nova hosts value form lowercase to upper case | |
| 12:23:00 | sean-k-mooney | so they have 2 compute node recored and had 2 compute service records but they deleted one | |
| 12:23:00 | sean-k-mooney | so they have 2 compute node recored and had 2 compute service records but they deleted one | |
| 12:23:18 | sean-k-mooney | but they have instnace with both the upercase and lower case host value | |
| 12:23:18 | sean-k-mooney | but they have instnace with both the upercase and lower case host value | |
| 12:23:54 | sean-k-mooney | and with teh utf8_general_ci coalation type instance.host will match either the upercase or lowercase compute node recored | |
| 12:23:54 | sean-k-mooney | and with teh utf8_general_ci coalation type instance.host will match either the upercase or lowercase compute node recored | |
| 12:24:24 | sean-k-mooney | SELECT cn.uuid , cn.host, i.host, i.deleted from nova.compute_nodes cn join nova.instances i on cn.host = i.host WHERE i.deleted = 0; | |
| 12:24:24 | sean-k-mooney | SELECT cn.uuid , cn.host, i.host, i.deleted from nova.compute_nodes cn join nova.instances i on cn.host = i.host WHERE i.deleted = 0; | |
| 12:24:45 | sean-k-mooney | i.e. if i do that cn.host and i.host can have different cases | |
| 12:24:45 | sean-k-mooney | i.e. if i do that cn.host and i.host can have different cases | |
| 12:25:31 | sean-k-mooney | i dont think we actully intended that to be how that works so i think we really should be using utf8_bin for all the tables | |
| 12:25:31 | sean-k-mooney | i dont think we actully intended that to be how that works so i think we really should be using utf8_bin for all the tables | |
| 12:26:08 | sean-k-mooney | that might be what we say in the doc and or in the installer tools by setting the db coalation type to utf8_bin | |
| 12:26:08 | sean-k-mooney | that might be what we say in the doc and or in the installer tools by setting the db coalation type to utf8_bin | |
| 12:26:20 | sean-k-mooney | but i just noticed it does not seam to be enforced by our schema | |
| 12:26:20 | sean-k-mooney | but i just noticed it does not seam to be enforced by our schema | |
| 12:26:27 | sean-k-mooney | so i was not sure if this was intentional or not | |
| 12:26:27 | sean-k-mooney | so i was not sure if this was intentional or not | |
| 12:35:10 | sean-k-mooney | gibi: the actual issue the customer is hitting is that the conductor/api and compute agent disagree on what the name of the compute node queue should be | |
| 12:35:10 | sean-k-mooney | gibi: the actual issue the customer is hitting is that the conductor/api and compute agent disagree on what the name of the compute node queue should be | |
| 12:36:00 | sean-k-mooney | rabbitmq cares about the case but we are not enforcing that and depending on when the vms were booted some have the uppercases name and other have the lower case name | |
| 12:36:00 | sean-k-mooney | rabbitmq cares about the case but we are not enforcing that and depending on when the vms were booted some have the uppercases name and other have the lower case name | |
| 12:37:43 | gibi | I see. I'm not against fixing it in our schema but then we need to provide an upgrade script that normalize the casing too | |
| 12:37:43 | gibi | I see. I'm not against fixing it in our schema but then we need to provide an upgrade script that normalize the casing too | |
| 12:43:16 | sean-k-mooney | well im not sure if we can fix it without breaking things | |
| 12:43:16 | sean-k-mooney | well im not sure if we can fix it without breaking things | |
| 12:43:36 | sean-k-mooney | at least i dont think we can do it without requiring a data migration to fix the things that will break | |
| 12:43:36 | sean-k-mooney | at least i dont think we can do it without requiring a data migration to fix the things that will break | |
| 12:43:54 | sean-k-mooney | and likely a nova-status check for some edgecases | |
| 12:43:54 | sean-k-mooney | and likely a nova-status check for some edgecases | |
| 12:44:25 | gibi | true, it is not just a schema change but also some data normalization issue | |
| 12:44:25 | gibi | true, it is not just a schema change but also some data normalization issue | |
| 12:44:46 | sean-k-mooney | gibi: right now im trying to figure out why it was semi operational in this state and how to resovle it for this specific customer | |
| 12:44:46 | sean-k-mooney | gibi: right now im trying to figure out why it was semi operational in this state and how to resovle it for this specific customer | |
| 12:45:13 | sean-k-mooney | i suspect its because they change the nova.conf host value several times | |
| 12:45:13 | sean-k-mooney | i suspect its because they change the nova.conf host value several times | |
| 12:46:35 | sean-k-mooney | i think ill need to get them to use the same case on all host and then etiehr modify the service host value or the instance.host | |
| 12:46:35 | sean-k-mooney | i think ill need to get them to use the same case on all host and then etiehr modify the service host value or the instance.host | |
| 12:47:04 | sean-k-mooney | unless we can make rabbit not care about case but really thats a hack | |
| 12:47:04 | sean-k-mooney | unless we can make rabbit not care about case but really thats a hack | |
| 12:48:49 | sean-k-mooney | i guess one way to fix it would be to normalise just the rabbitmq names | |
| 12:48:49 | sean-k-mooney | i guess one way to fix it would be to normalise just the rabbitmq names | |
| 12:49:02 | sean-k-mooney | for example make them all lowercase | |
| 12:49:02 | sean-k-mooney | for example make them all lowercase | |
| 12:49:43 | sean-k-mooney | we could do that with a workaround config option and backport that maybe | |
| 12:49:43 | sean-k-mooney | we could do that with a workaround config option and backport that maybe | |
| 12:59:54 | openstackgerrit | Merged openstack/nova master: Replace blind retry with libvirt event waiting in detach https://review.opendev.org/c/openstack/nova/+/770246 | |
| 12:59:54 | openstackgerrit | Merged openstack/nova master: Replace blind retry with libvirt event waiting in detach https://review.opendev.org/c/openstack/nova/+/770246 | |
| 13:00:20 | gibi | sean-k-mooney: yeah that could work | |
| 13:00:21 | gibi | sean-k-mooney: yeah that could work | |
| 13:01:14 | openstackgerrit | Merged openstack/nova master: Move the guest.get_disk test to test_guest https://review.opendev.org/c/openstack/nova/+/777151 | |
| 13:01:14 | openstackgerrit | Merged openstack/nova master: Move the guest.get_disk test to test_guest https://review.opendev.org/c/openstack/nova/+/777151 | |
| 13:01:54 | openstackgerrit | Merged openstack/nova master: Enable mypy on libvirt/guest.py https://review.opendev.org/c/openstack/nova/+/777155 | |
| 13:01:54 | openstackgerrit | Merged openstack/nova master: Enable mypy on libvirt/guest.py https://review.opendev.org/c/openstack/nova/+/777155 | |
| 13:02:36 | openstackgerrit | Merged openstack/nova master: Follow up type hints for a634103 https://review.opendev.org/c/openstack/nova/+/777159 | |
| 13:02:36 | openstackgerrit | Merged openstack/nova master: Follow up type hints for a634103 https://review.opendev.org/c/openstack/nova/+/777159 | |
| 13:06:45 | sean-k-mooney | gibi: are we only doing 3 hours each day at the ptg instead of 4 | |
| 13:06:45 | sean-k-mooney | gibi: are we only doing 3 hours each day at the ptg instead of 4 | |
| 13:06:52 | gibi | yes | |
| 13:07:01 | sean-k-mooney | oh ok why so short? | |
| 13:07:01 | sean-k-mooney | oh ok why so short? | |
| 13:07:20 | gibi | 14:00 UTC is still pretty early in west coast | |
| 13:07:20 | gibi | 14:00 UTC is still pretty early in west coast | |
| 13:07:26 | gibi | US | |
| 13:07:26 | gibi | US | |
| 13:07:34 | sean-k-mooney | ya it is | |
| 13:07:34 | sean-k-mooney | ya it is | |
| 13:08:31 | sean-k-mooney | i dont know i guess i just felt 3 days was kind of short to begin with but on the otherhand i guess i cant to the in person whiteborad sessions with peopel on topic remotely so maybe not | |
| 13:08:31 | sean-k-mooney | i dont know i guess i just felt 3 days was kind of short to begin with but on the otherhand i guess i cant to the in person whiteborad sessions with peopel on topic remotely so maybe not | |
| 13:08:55 | sean-k-mooney | if we go back to in person ptgs next cycle it would be nice to have more time again | |
| 13:08:55 | sean-k-mooney | if we go back to in person ptgs next cycle it would be nice to have more time again | |
| 13:09:23 | gibi | if it feels that we are not progressing then I can add extra time | |
| 13:09:23 | gibi | if it feels that we are not progressing then I can add extra time | |
| 13:09:42 | sean-k-mooney | ack | |
| 13:09:58 | sean-k-mooney | * sean-k-mooney only realised it was shorter because i tought i was already late :) | |
| 13:10:23 | gibi | I felt that using 13:00 UTC would be unfair for west coast, so I assume that EU can take a bit more time even after 17:)) UTC | |
| 13:10:23 | gibi | I felt that using 13:00 UTC would be unfair for west coast, so I assume that EU can take a bit more time even after 17:)) UTC | |
| 13:10:25 | sean-k-mooney | * sean-k-mooney now i can be late because i tought i was early | |
| 13:10:43 | gibi | I mean after 17:00 | |
| 13:10:43 | gibi | I mean after 17:00 | |
| 13:10:54 | sean-k-mooney | gibi: ya no that is fine i was happy to go later on the poll | |
| 13:10:54 | sean-k-mooney | gibi: ya no that is fine i was happy to go later on the poll | |
| 13:11:18 | sean-k-mooney | just taught i missed the start and was going to appoligies while i went and got coffee | |
| 13:11:18 | sean-k-mooney | just taught i missed the start and was going to appoligies while i went and got coffee | |
| 13:11:24 | gibi | :) | |
| 13:26:45 | stephenfin | bauzas: If you have time this week outside of PTG, could you look at https://review.opendev.org/q/topic:%22compute_rpc_6.0%22+(status:open%20OR%20status:merged) ? There are follow-up patches to the compute RPC version bump plus a few other things in there | |
| 13:26:45 | stephenfin | bauzas: If you have time this week outside of PTG, could you look at https://review.opendev.org/q/topic:%22compute_rpc_6.0%22+(status:open%20OR%20status:merged) ? There are follow-up patches to the compute RPC version bump plus a few other things in there | |
| 13:27:56 | stephenfin | lyarwood: Can you take a look at this backport https://review.opendev.org/c/openstack/nova/+/757617 (and the train variant also, if you can https://review.opendev.org/c/openstack/nova/+/757618) | |
| 13:27:56 | stephenfin | lyarwood: Can you take a look at this backport https://review.opendev.org/c/openstack/nova/+/757617 (and the train variant also, if you can https://review.opendev.org/c/openstack/nova/+/757618) | |
| 13:31:17 | lyarwood | stephenfin: ack looking | |
| 13:31:17 | lyarwood | stephenfin: ack looking | |
| 13:32:17 | stephenfin | ta | |
| 13:34:02 | bauzas | stephenfin: ack, working tho on the vGPU fix | |
| 13:34:02 | bauzas | stephenfin: ack, working tho on the vGPU fix | |