| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-07-07 | |||
| 19:29:28 | rm_work | nova-compute service | |
| 19:29:40 | sean-k-mooney | that should not happen in the compute service | |
| 19:30:02 | sean-k-mooney | we do use real threas but only to interact with a select number of things liek libvirt | |
| 19:30:18 | rm_work | hmm, no VMs even in this system yet, it's essentially a clean install | |
| 19:30:34 | rm_work | just trying to start it up for the first time | |
| 19:30:54 | sean-k-mooney | so i woudl assume this is somehow related to the perodic taks | |
| 19:31:00 | sean-k-mooney | *tasks | |
| 19:31:43 | sean-k-mooney | do you have anything custom set in you nova.conf | |
| 19:31:48 | rm_work | hmmm... what periodics does nova-compute run? can I disable them to check? | |
| 19:31:57 | sean-k-mooney | e.g. are you trying to use any atypical features | |
| 19:32:03 | sean-k-mooney | it runs quite a few | |
| 19:32:19 | sean-k-mooney | i think all or most of them have config options | |
| 19:32:23 | rm_work | It's hard for me to answer that question -- yes, the conf is probably custom, but I don't know enough about nova's features to know which are atypical | |
| 19:32:29 | rm_work | I've tried to trim it down as much as possible | |
| 19:33:12 | sean-k-mooney | i was wondering if you were tweakign any oslo concurancy setting related to threading for example | |
| 19:33:22 | sean-k-mooney | you coudl try setting https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.run_external_periodic_tasks to false | |
| 19:33:27 | rm_work | ah this is a nova-compute configured for ironic | |
| 19:33:42 | rm_work | ooo, will try that for testing | |
| 19:34:29 | rm_work | no config in oslo_concurrency besides setting the lock_path | |
| 19:34:55 | sean-k-mooney | oh its ironic hum | |
| 19:35:03 | sean-k-mooney | i dont think that shoudl really change things | |
| 19:35:06 | sean-k-mooney | https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.sync_power_state_interval | |
| 19:35:24 | sean-k-mooney | there are several "*_interval" | |
| 19:35:34 | sean-k-mooney | config option which contol the perodic tasks | |
| 19:35:40 | rm_work | hmm, added that `run_external_periodic_tasks` to false, didn't help | |
| 19:35:44 | sean-k-mooney | do you have a more complete errror message | |
| 19:35:54 | sean-k-mooney | so we can see what it was doing right before the error | |
| 19:35:58 | rm_work | yeah secx | |
| 19:38:56 | rm_work | http://paste.openstack.org/show/807242/ | |
| 19:39:26 | sean-k-mooney | oh | |
| 19:39:34 | sean-k-mooney | its right after the heartbeat | |
| 19:39:37 | rm_work | yeah | |
| 19:39:39 | sean-k-mooney | one sec | |
| 19:40:05 | sean-k-mooney | try setting https://github.com/openstack/oslo.messaging/blob/master/oslo_messaging/_drivers/impl_rabbit.py#L90-L100 | |
| 19:40:08 | sean-k-mooney | to false | |
| 19:40:16 | rm_work | kk | |
| 19:40:49 | sean-k-mooney | [oslo_messaging_rabbit]/heartbeat_in_pthread=false | |
| 19:40:56 | sean-k-mooney | in the nova.conf | |
| 19:41:12 | rm_work | well that's ... different | |
| 19:41:31 | sean-k-mooney | no crash? | |
| 19:41:34 | rm_work | oh derp sorry sec | |
| 19:41:38 | rm_work | it crashed but ... lol | |
| 19:41:44 | rm_work | fucking macbook keyboard | |
| 19:42:16 | sean-k-mooney | i recently got a ipad pro and have been trying to use it as an ssh clinet | |
| 19:42:22 | sean-k-mooney | its ... interesting | |
| 19:42:22 | rm_work | yeah looks A++ | |
| 19:42:35 | rm_work | seems to have connected up successfully, starts and shows up in a compute service list | |
| 19:42:36 | rm_work | thanks! | |
| 19:42:55 | rm_work | though, that opt is deprecated it seems ;D | |
| 19:43:02 | sean-k-mooney | well that option is deprecated for removal and planned to be remvoed this cycle | |
| 19:43:11 | sean-k-mooney | so we shoudl file a bug and get oslo invovled | |
| 19:43:16 | sean-k-mooney | to see if they can repoduce this | |
| 19:44:47 | sean-k-mooney | in theory you should not need to run the heatbeat in a real greenthread by the way | |
| 19:44:59 | sean-k-mooney | that was to workaround an issue in the api when service are run under uwsgi | |
| 19:45:11 | sean-k-mooney | since the wsgi server would kill the heatbeat | |
| 19:46:34 | rm_work | hmm | |
| 19:46:57 | opendevreview | melanie witt proposed openstack/nova master: Clear rebalanced compute nodes from resource tracker https://review.opendev.org/c/openstack/nova/+/695187 | |
| 19:46:57 | opendevreview | melanie witt proposed openstack/nova master: Add functional regression test for bug 1853009 https://review.opendev.org/c/openstack/nova/+/695012 | |
| 19:46:58 | opendevreview | melanie witt proposed openstack/nova master: Invalidate provider tree when compute node disappears https://review.opendev.org/c/openstack/nova/+/695188 | |
| 19:47:00 | opendevreview | melanie witt proposed openstack/nova master: Fix inactive session error in compute node creation https://review.opendev.org/c/openstack/nova/+/695189 | |
| 19:47:00 | opendevreview | melanie witt proposed openstack/nova master: Prevent deletion of a compute node belonging to another host https://review.opendev.org/c/openstack/nova/+/694802 | |
| 19:49:06 | sean-k-mooney | rm_work: you should be able to use that as a workaround for now | |
| 19:49:23 | sean-k-mooney | but i mentioned it in #openstack-oslo | |
| 19:49:26 | rm_work | yeah, will do. thanks for the help :) | |
| 19:50:27 | sean-k-mooney | rm_work: if you can file a bug or provide more detail e.g. ubutu20.04 vs centos8 that kind of thing it might help nail this down | |
| 19:51:03 | sean-k-mooney | it should be filed against oslo.messaging but you can also add nova if you like althoguh this is not in the nova code | |
| 19:51:03 | rm_work | kk | |
| 19:54:59 | rm_work | ah k | |
| 20:40:58 | rm_work | posted here: https://bugs.launchpad.net/oslo.messaging/+bug/1934937 | |
| 20:41:03 | rm_work | I am ... not great at launchpad | |
| 20:41:11 | rm_work | hopefully that's enough to start with | |
| 20:41:49 | rm_work | can add more details if someone tells me what would be good to add | |
| 21:21:26 | opendevreview | melanie witt proposed openstack/nova master: Clear rebalanced compute nodes from resource tracker https://review.opendev.org/c/openstack/nova/+/695187 | |
| 21:21:26 | opendevreview | melanie witt proposed openstack/nova master: Add functional regression test for bug 1853009 https://review.opendev.org/c/openstack/nova/+/695012 | |
| 21:21:27 | opendevreview | melanie witt proposed openstack/nova master: Invalidate provider tree when compute node disappears https://review.opendev.org/c/openstack/nova/+/695188 | |
| 21:21:28 | opendevreview | melanie witt proposed openstack/nova master: Prevent deletion of a compute node belonging to another host https://review.opendev.org/c/openstack/nova/+/694802 | |
| 21:21:29 | opendevreview | melanie witt proposed openstack/nova master: Fix inactive session error in compute node creation https://review.opendev.org/c/openstack/nova/+/695189 | |
| #openstack-nova - 2021-07-08 | |||
| 00:49:37 | opendevreview | melanie witt proposed openstack/nova master: Prevent deletion of a compute node belonging to another host https://review.opendev.org/c/openstack/nova/+/694802 | |
| 00:49:38 | opendevreview | melanie witt proposed openstack/nova master: Fix inactive session error in compute node creation https://review.opendev.org/c/openstack/nova/+/695189 | |
| 06:56:55 | opendevreview | ruishawn proposed openstack/nova master: Add armv6l to arch list https://review.opendev.org/c/openstack/nova/+/799964 | |
| 07:00:04 | opendevreview | ruishawn proposed openstack/nova master: Add armv6l to arch list https://review.opendev.org/c/openstack/nova/+/799964 | |
| 09:21:14 | opendevreview | Lee Yarwood proposed openstack/nova master: DNM - Test tempest-integrated-compute-centos-8-stream https://review.opendev.org/c/openstack/nova/+/799996 | |
| 10:10:35 | opendevreview | Ye Haiyang proposed openstack/nova master: Replace `split(' ')` with `split()` https://review.opendev.org/c/openstack/nova/+/800004 | |
| 10:18:25 | bauzas | oh man, would we get some mats if we were having a non-virtual PTG ? :D | |
| 10:19:03 | bauzas | context : look at the Y name | |
| 10:21:48 | lyarwood | If we end up having an in-person PTG and they replace beer with yoga I'm going to be very very upset | |
| 10:22:56 | stephenfin | but very very flexible? | |
| 10:24:06 | stephenfin | jaysus, working on this alembic stuff is like pulling teeth... | |
| 10:40:43 | sean-k-mooney | stephenfin: aren't you glad you elected to do it :) | |
| 10:40:51 | stephenfin | ugh | |
| 10:40:58 | sean-k-mooney | stephenfin: thank you in anycases | |
| 10:41:25 | sean-k-mooney | are you still having issue with the last patch | |
| 10:41:35 | sean-k-mooney | i saw you ask dansmith about it a few days ago | |
| 10:42:30 | stephenfin | nope, zzzeek++ helped me out massively. Just fixing up the issues he pointed out and addressing bugs that I hadn't seen yet because I'd only been running the alembic stuff against SQLite without foreign key constraints enabled /o\ | |
| 10:43:02 | bauzas | lyarwood: I'm pretty sure you can do both | |
| 10:43:10 | bauzas | lyarwood: ie. taking beer on a yoga mat | |
| 10:43:26 | bauzas | I could even take a picture if wanted | |
| 10:43:59 | bauzas | but I'm not sure I could be helpful in giving some yoga practicing, I'm not a streched person :) | |
| 10:44:03 | gibi | I vote for the beer | |
| 10:44:47 | bauzas | people creativity always amazes me | |