| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2021-02-15 | |||
| 09:11:17 | lyarwood | https://zuul.opendev.org/t/openstack/build/2d510b007eb14485a5492c51efdc7318/log/controller/logs/screen-n-cpu.txt#11065 | |
| 09:11:37 | lyarwood | the failure to delete the volume is because n-cpu couldn't detach the actual device from the instance | |
| 09:12:54 | kashyap | lyarwood: I see; what are options now? 'recheck'? | |
| 09:12:55 | kashyap | Morning, BTW | |
| 09:13:17 | kashyap | lyarwood: gibi: If you get time this week, can you have a gander at the simple patch below it too (a partial revert of an earlier one), when you can? -- https://review.opendev.org/c/openstack/nova/+/775431 (libvirt: Don't drop CPU flags with policy='disable' from guest XML) | |
| 09:14:13 | kashyap | Sorry for the lengthy commit message; it is due to the example. | |
| 09:14:53 | lyarwood | kashyap: morning :) yeah recheck | |
| 09:15:02 | kashyap | lyarwood: Okay; will do. | |
| 09:15:04 | lyarwood | kk | |
| 09:15:18 | kashyap | Next week I'm on PTO, trying to see if I can get these across the line this week. | |
| 09:21:56 | gibi | kashyap: will look | |
| 09:23:39 | kashyap | Thank you | |
| 10:12:42 | gibi | lyarwood: thanks for the reply in https://review.opendev.org/c/openstack/nova/+/767533 now it is lot clearer to me | |
| 10:13:30 | lyarwood | gibi: np, just rewrote the commit to make it clear and working through some failures in the nova-next job using q35 at the tip of that series | |
| 10:13:41 | lyarwood | brb | |
| 10:15:05 | hemanth_n | lyarwood: sean-k-mooney: elod: zuul build issues are resolved now on nova stable/rocky, can you review this nova backport to rocky when you get time https://review.opendev.org/c/openstack/nova/+/761824 | |
| 10:16:47 | sean-k-mooney | ah the pci stat change | |
| 10:17:11 | sean-k-mooney | am sure just finishing an email | |
| 10:33:53 | openstackgerrit | Lee Yarwood proposed openstack/nova master: nova-next: Drop NOVA_USE_SERVICE_TOKEN as it is now True by default https://review.opendev.org/c/openstack/nova/+/775575 | |
| 10:34:07 | lyarwood | hemanth_n: ack looking | |
| 10:43:58 | lyarwood | kashyap: any idea why blkid wouldn't work within an instance using the q35 machine type? | |
| 10:46:17 | kashyap | lyarwood: It rings a faint bell; but my tired brain cannot seem to recall ... let me see if I can rediscover it | |
| 10:46:44 | sean-k-mooney | lyarwood: i have used it before | |
| 10:47:01 | lyarwood | kashyap: np, the context is https://review.opendev.org/c/openstack/nova/+/708701 where the only failures are due to the IDE bus not being present and these blkid failures to find the config drive | |
| 10:47:03 | sean-k-mooney | lyarwood: it normally works | |
| 10:47:10 | lyarwood | hmm ah wait I think I know what it is | |
| 10:47:21 | lyarwood | just rubber duck'd myself there | |
| 10:47:27 | lyarwood | the config drive is normally IDE | |
| 10:47:29 | sean-k-mooney | ide + q35 | |
| 10:47:36 | lyarwood | really? | |
| 10:47:36 | kashyap | lyarwood: Aaah | |
| 10:47:36 | sean-k-mooney | ya its sata | |
| 10:47:46 | sean-k-mooney | for q35 | |
| 10:47:49 | sean-k-mooney | so different name | |
| 10:47:54 | lyarwood | yeah so it's now SATA so blkid is going to be different | |
| 10:47:57 | lyarwood | yeah | |
| 10:47:58 | lyarwood | fun | |
| 10:48:00 | kashyap | lyarwood: Yes, for Q35 it is SATA -- you did the patch yourself :) | |
| 10:48:09 | lyarwood | yeah I knew the IDE thing | |
| 10:48:15 | lyarwood | I just didn't connect the dots with the config drive | |
| 10:48:39 | lyarwood | I thought the label would be the same tbh | |
| 10:48:45 | lyarwood | hmm | |
| 10:49:09 | sean-k-mooney | the filesystem lable shoudl be | |
| 11:20:30 | lyarwood | hmm can we kill the ovsdbapp.backend.ovs_idl.vlog DEBUG logs in devstack@n-cpu | |
| 11:20:49 | sean-k-mooney | ... yes i kind of ment to do that a while ago | |
| 11:21:15 | sean-k-mooney | its form the lib we use in os-vif | |
| 11:21:18 | lyarwood | ah | |
| 11:21:28 | sean-k-mooney | that said its not that annoying just a bit noisy | |
| 11:21:55 | sean-k-mooney | normally i dont notice it at this point but i perfonally have filtered it out in my head | |
| 11:22:15 | sean-k-mooney | we can register a log filter in the os-vif init | |
| 11:22:22 | sean-k-mooney | or do it in nova | |
| 11:22:59 | lyarwood | yeah it's just killing my devstack env and I assume isn't helpful for our log indexing | |
| 11:23:05 | sean-k-mooney | lyarwood: you are seeing this more recently because we now default to the ptyhon libvary | |
| 11:23:46 | sean-k-mooney | neutron should also have that log in teh l2 agent | |
| 11:24:40 | sean-k-mooney | if you feel like writing a patch it shoudl proably get setup here https://github.com/openstack/os-vif/blob/master/os_vif/__init__.py#L24-L49 | |
| 11:25:04 | lyarwood | yup I can look at that later today | |
| 11:27:36 | lyarwood | kashyap: any idea how I can tell if q35 has a SATA bus? | |
| 11:28:03 | kashyap | lyarwood: 'dmesg' in the guest? | |
| 11:28:11 | sean-k-mooney | well it will the way we generate the xml by default | |
| 11:28:48 | lyarwood | oh wait I wonder if support is actually missing in the cirros image | |
| 11:28:56 | lyarwood | everything looks fine in the domain | |
| 11:29:04 | lyarwood | the device is there and attached as a SATA cdrom etc | |
| 11:29:20 | lyarwood | it's just not there within the guestOS | |
| 11:29:21 | kashyap | lyarwood: Very good point; it's the CirrOS image | |
| 11:29:39 | sean-k-mooney | well the cirros image usess a ubuntu 18.04 kernel | |
| 11:29:44 | sean-k-mooney | so it will have sata support | |
| 11:29:49 | lyarwood | you would think | |
| 11:30:02 | lyarwood | don't they recompile the kernel now? | |
| 11:30:02 | kashyap | Yeah, don't assume. | |
| 11:30:07 | sean-k-mooney | im not | |
| 11:30:20 | sean-k-mooney | i have use it with sata before | |
| 11:31:00 | sean-k-mooney | although i dont know if i have used it with sata and q35 | |
| 11:31:17 | sean-k-mooney | i have used it with sata and pc | |
| 11:32:35 | sean-k-mooney | lyarwood: are you lookign at a gate failure by the way | |
| 11:33:13 | lyarwood | sean-k-mooney: yeah the tip of my q35 series switches nova-next over to using q35 and some tests that rely on config drive (device tagging etc) are failing | |
| 11:33:29 | sean-k-mooney | ah ok | |
| 11:33:42 | lyarwood | sean-k-mooney: have a local reproducer anyway and I can't see anything related to SATA in dmesg within the instance | |
| 11:37:19 | sean-k-mooney | ya its strang | |
| 11:37:23 | sean-k-mooney | i booted it too | |
| 11:37:29 | sean-k-mooney | so it boots fine with sata | |
| 11:37:36 | sean-k-mooney | but lsblk and blkid are empty | |
| 11:38:55 | lyarwood | f33 finds the device fine | |
| 11:39:07 | lyarwood | weird, I could make the cdrom bus host configurable? | |
| 11:39:13 | lyarwood | as a workaround | |
| 11:39:23 | sean-k-mooney | well its configurable via the image alredy | |
| 11:39:52 | sean-k-mooney | whats odd its ist not in /sys/block | |
| 11:40:50 | kashyap | [root@rawhide-1 ~]# dmesg | grep -i sata | head -1 | |
| 11:40:50 | kashyap | [ 1.724456] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 0x3f impl SATA mode | |
| 11:41:21 | sean-k-mooney | i dont see it in /dev either | |
| 11:41:54 | sean-k-mooney | kashyap empty | |
| 11:43:15 | lyarwood | I wonder if SCSI would be a better bus for this anyway | |
| 11:43:34 | kashyap | sean-k-mooney: Look for `dmesg | grep -i sata` | |
| 11:43:41 | kashyap | What gues did you boot? | |
| 11:43:41 | lyarwood | ah I guess we don't know if we have the controller setup | |
| 11:43:56 | sean-k-mooney | kashyap: i did and it gives nothing | |
| 11:44:06 | kashyap | What guest? | |
| 11:44:07 | lyarwood | yeah same for me with cirros | |
| 11:44:11 | sean-k-mooney | cirros | |
| 11:45:16 | kashyap | Right; my guest is Fedora ("Rawhide" - rolling) | |
| 11:45:51 | sean-k-mooney | yes which is not what we are trying to debug | |