| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-05-08 | |||
| 10:41:54 | openstackgerrit | Stephen Finucane proposed openstack/nova master: hardware: Remove '_numa_fit_instance_cell_with_pinning' https://review.opendev.org/714703 | |
| 10:45:36 | hrw | morning | |
| 10:46:05 | hrw | can someone take a look at https://review.opendev.org/#/c/723900/ patch? it is stable/train backport to set aarch64 cpu model | |
| 10:54:52 | kashyap | hrw: I can give a look; just wondering of any migration concerns | |
| 10:55:05 | kashyap | I have it open; about to +1, but made me pause: | |
| 10:55:53 | kashyap | Before there was no default CPU model on AAch64 'Train' VM, but now an "update" brings a default. | |
| 11:14:34 | openstackgerrit | Merged openstack/nova master: config: Explicitly register 'remote_debug' CLI opts https://review.opendev.org/677444 | |
| 11:19:04 | kashyap | hrw: Commented in the change | |
| 12:20:21 | sean-k-mooney | gibi: i was going to ask you about that actully | |
| 12:20:27 | sean-k-mooney | gibi: i can update it | |
| 12:20:38 | sean-k-mooney | has the policy stuff been merged | |
| 12:20:51 | sean-k-mooney | we were waiting for that to complete i think | |
| 12:22:17 | gibi | sean-k-mooney: do you mean we need a policy related spec update? | |
| 12:22:58 | sean-k-mooney | gibi: no gmann or bauzas i think had a spec that was close and i was asked to wait a few days before respinning | |
| 12:23:17 | sean-k-mooney | i was ment to do it last week but got distracted | |
| 12:23:36 | sean-k-mooney | i assume which ever one i was ment to wait for is not done | |
| 12:23:55 | sean-k-mooney | e.g. we wanted to see if it could get completed before rc1 or not | |
| 12:24:30 | sean-k-mooney | gibi: ill update it shortly | |
| 12:24:31 | gibi | looking at the open spec reviews I don't see anything open now | |
| 12:24:37 | gibi | that is close | |
| 12:24:41 | gibi | sean-k-mooney: thanks | |
| 13:41:26 | hrw | kashyap: thx | |
| 13:46:25 | openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Add MigrationTypeField https://review.opendev.org/706013 | |
| 13:46:25 | openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'Migration' https://review.opendev.org/723572 | |
| 13:46:26 | openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Remove 'NovaObjectDictCompat' from 'InstancePCIRequest' https://review.opendev.org/723573 | |
| 15:18:41 | sangeet | Does anyone know what triggers (or paramater) that marks service deleted in Services Table in Nova Database? Somehow consoleauth service was maked deleted and I want to undersatnd how it could have happened, while my service was still up | |
| 15:21:02 | sangeet | Is there a paramater to mark service deleted automatically in services table in nova database? | |
| 15:31:40 | sangeet | Any suggestion for above questions will be much apprecaited. | |
| 15:41:34 | gmann | melwitt: should be 0 :), let me check | |
| 15:43:03 | gmann | sean-k-mooney: gibi that was delete-on-termination spec update which is merged- https://review.opendev.org/#/c/722194/ | |
| 15:59:50 | openstackgerrit | Merged openstack/nova master: objects: Add migrate-on-load behavior for legacy NUMA objects https://review.opendev.org/724381 | |
| 16:06:11 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Moving functional jobs to Victoria testing runtime https://review.opendev.org/725372 | |
| 16:44:23 | ygk_12345 | @gibi hi | |
| 16:54:11 | ygk_12345 | hi all | |
| 16:54:52 | ygk_12345 | i have upgraded the nova from stein to train and I have rebooted the computes. but after the compute is up , it is not listing all the vms in the virsh list | |
| 16:55:17 | ygk_12345 | but the vm's disk files are intact as /var/lib/nova/instances folder | |
| 16:55:23 | ygk_12345 | why is it so ? | |
| 16:55:30 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Suppress remaining policy warnings in unit tests https://review.opendev.org/726272 | |
| 16:56:17 | ygk_12345 | but the vm's disk files are intact in /var/lib/nova/instances folder | |
| 16:57:30 | ygk_12345 | can someone help me please | |
| 16:58:02 | stephenfin | ygk_12345: are the instances appearing if you do 'nova list'? | |
| 16:58:24 | ygk_12345 | stephenfin yes in ERROR state | |
| 16:58:35 | ygk_12345 | i tried reset and rebooted bbut still not coming in the virsh list | |
| 16:59:06 | stephenfin | ygk_12345: do you have 'resume_guests_state_on_host_boot' configured? I assume not? | |
| 16:59:24 | ygk_12345 | stephenfin where to check that ? | |
| 16:59:27 | stephenfin | nova.conf | |
| 16:59:32 | ygk_12345 | let me check | |
| 16:59:33 | stephenfin | If that is left to it's default value, nova won't restart VMs for you | |
| 16:59:50 | openstackgerrit | Takashi Natsume proposed openstack/os-vif master: Remove translation sections from setup.cfg https://review.opendev.org/724974 | |
| 17:00:02 | stephenfin | though the domains should still be there, I would have thought | |
| 17:00:03 | ygk_12345 | so how do I recover those now ? the disk files are intact in the /var/lib/nova folder though | |
| 17:00:19 | ygk_12345 | stephenfin the virsh is not listing all the domain though | |
| 17:01:31 | ygk_12345 | stephenfin yes it is configured "resume_guests_state_on_host_boot = True" | |
| 17:01:52 | stephenfin | Odd. What do the logs say? | |
| 17:02:38 | ygk_12345 | stephenfin the computes log is complaining about just one missing disk of a vm at "nova.exception.DiskNotFound: No disk at /var/lib/nova/instances/e7fefd4e-f2cf-4048-9b37-4ff807243291/disk" | |
| 17:03:22 | stephenfin | can you rebuild that instance? | |
| 17:03:31 | ygk_12345 | stephenfin how ? | |
| 17:04:18 | stephenfin | nova rebuild SERVER_ID IMAGE_ID | |
| 17:04:59 | ygk_12345 | stephenfin ok let me try. please hold on | |
| 17:05:28 | ygk_12345 | stephenfin will I loose any data on this vm ? | |
| 17:05:45 | stephenfin | Yes. Rebuild is a destructive operation | |
| 17:06:19 | ygk_12345 | in that case I can also extract the disk file as image and spawn the vm right ? | |
| 17:06:42 | ygk_12345 | i dont want ot loose data | |
| 17:07:16 | ygk_12345 | stephenfin is there a way to restore those vms ? | |
| 17:07:58 | ygk_12345 | stephenfin I see lot of disk files in the location /var/lib/nova with the uudi's folders | |
| 17:08:07 | ygk_12345 | vm uuids | |
| 17:10:46 | ygk_12345 | can someone help me with this issue ? | |
| 17:10:58 | ygk_12345 | i see active base files still at the folder | |
| 17:12:24 | sean-k-mooney | gmann: ah yes that is the spec i was tinking of. | |
| 17:12:58 | sean-k-mooney | ygk_12345: you can snapshot the vm | |
| 17:13:03 | ygk_12345 | somehow it is not lsiting other virsh domains | |
| 17:13:30 | ygk_12345 | sean-k-mooney even when it is in error state u mean ? | |
| 17:13:45 | sean-k-mooney | oh no im justre reading back now | |
| 17:14:08 | sean-k-mooney | so in its curent state i dont think snapshot would work. | |
| 17:14:26 | sean-k-mooney | but that is generaly how you would preseve the content if you were going to rebuild | |
| 17:15:20 | ygk_12345 | sean-k-mooney why is it not listing the other virsh domains ? | |
| 17:15:31 | sean-k-mooney | ygk_12345: do you have your /var/lib/nova on nfs or other shared storage? | |
| 17:15:45 | sean-k-mooney | ygk_12345: are you using sudo | |
| 17:15:54 | ygk_12345 | sean-k-mooney yes it is an lvm share | |
| 17:15:58 | ygk_12345 | we mounted it | |
| 17:16:10 | sean-k-mooney | lvm is not a shared file system | |
| 17:16:26 | sean-k-mooney | as in shared over the netwrok between multiple hosts | |
| 17:16:27 | ygk_12345 | sean-k-mooney yes | |
| 17:16:36 | ygk_12345 | not in that sense | |
| 17:16:43 | ygk_12345 | it is deidcted to taht server | |
| 17:16:48 | ygk_12345 | *that host | |
| 17:17:11 | sean-k-mooney | there was a bug related to sometimes incorrectly deleting the vm disk if migration or evac failed on nfs not too loong ago | |
| 17:17:24 | sean-k-mooney | i was wondering if that is who you got into this state | |
| 17:17:32 | sean-k-mooney | it woudl appear not to be relatecxd | |
| 17:18:09 | ygk_12345 | sean-k-mooney this is just lvm and the uuid folders are still present in the /var/lib/nova folder which is an lvm | |
| 17:18:31 | sean-k-mooney | yep but the disk file is not correct | |
| 17:18:54 | ygk_12345 | sean-k-mooney what do u mean by correct ? | |
| 17:19:20 | sean-k-mooney | /var/lib/nova/instances/e7fefd4e-f2cf-4048-9b37-4ff807243291/disk is not present wehn you check | |
| 17:19:33 | ygk_12345 | sean-k-mooney yes its there | |
| 17:19:49 | sean-k-mooney | oh its there but nova thinks its not there | |
| 17:19:51 | ygk_12345 | oh yes that only one file is absent | |
| 17:19:58 | ygk_12345 | rest are there | |
| 17:20:00 | sean-k-mooney | ok | |
| 17:20:06 | ygk_12345 | but the domains have vanished | |
| 17:20:21 | ygk_12345 | thats what I am trying to say | |