| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-03-03 | |||
| 01:16:06 | melwitt | joshualyle: this might be of help https://docs.openstack.org/nova/latest/admin/troubleshooting/orphaned-allocations.html | |
| 01:40:04 | joshualyle | thank you melwitt. I was able to clean up some messed up allocations but I still have a host that refuses to accept any migrations :-/ | |
| 01:55:54 | melwitt | joshualyle: I would get the osc-placement cli (it's a plugin for osc) and use this command to see if there's any allocations that don't belong on it https://docs.openstack.org/osc-placement/latest/cli/index.html#resource-provider-show | |
| 01:56:16 | melwitt | openstack resource provider show --allocations <uuid> | |
| 01:57:15 | melwitt | you can also use that cli to remove bad allocations. just be aware that it does a full replace when you 'set' allocations. so removing allocations is by omission of only the ones you want gone and setting only the ones you want to keep | |
| 02:13:35 | joshualyle | melwitt: I'm currently on rocky. "openstack resource provider" doesn't seem to be available | |
| 02:14:29 | joshualyle | after a lot of troubleshooting, the problem seems to be clock drift because chrony wasn't working and neutron not working correctly on the destination compute node causing preflight check failures | |
| 02:18:51 | openstackgerrit | Merged openstack/nova master: Workaround a race initialising version control in db_version() https://review.opendev.org/619622 | |
| 02:19:01 | openstackgerrit | Merged openstack/nova master: Add description of live_migration_timeout_action option https://review.opendev.org/700124 | |
| 02:19:11 | openstackgerrit | Merged openstack/nova master: doc: note the need to configure cinder auth in reclaim_instance_interval https://review.opendev.org/690602 | |
| 02:19:20 | openstackgerrit | Merged openstack/nova master: Monkey patch original current_thread _active https://review.opendev.org/707474 | |
| 04:21:10 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: ksa auth conf and client for Cyborg access https://review.opendev.org/631242 | |
| 04:21:11 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Create and bind Cyborg ARQs. https://review.opendev.org/631244 | |
| 04:21:11 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Add Cyborg device profile groups to request spec. https://review.opendev.org/631243 | |
| 04:21:12 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Compose accelerator PCI devices into domain XML in libvirt driver. https://review.opendev.org/631245 | |
| 04:21:12 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Pass accelerator requests to each virt driver from compute manager. https://review.opendev.org/698581 | |
| 04:21:13 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable hard/soft reboot with accelerators. https://review.opendev.org/697940 | |
| 04:21:13 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Delete ARQs for an instance when the instance is deleted. https://review.opendev.org/673735 | |
| 04:21:14 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable and use COMPUTE_ACCELERATORS trait. https://review.opendev.org/699554 | |
| 04:21:14 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable start/stop of instances with accelerators. https://review.opendev.org/699553 | |
| 04:21:15 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Block unsupported instance operations with accelerators. https://review.opendev.org/674726 | |
| 04:21:15 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Bump compute rpcapi version and reduce Cyborg calls. https://review.opendev.org/704227 | |
| 04:21:16 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Add cyborg tempest job. https://review.opendev.org/670999 | |
| 06:11:31 | openstackgerrit | Lenny Verkhovsky proposed openstack/os-vif master: WIP: Testing CI https://review.opendev.org/686937 | |
| 07:01:58 | openstackgerrit | Brin Zhang proposed openstack/nova master: Add PATCH volume attachments api to os-volume_attachments https://review.opendev.org/693828 | |
| 09:09:42 | openstackgerrit | Lee Yarwood proposed openstack/nova master: images: Allow the output format of qemu-img info to be controlled https://review.opendev.org/706898 | |
| 09:09:42 | openstackgerrit | Lee Yarwood proposed openstack/nova master: images: Move qemu-img info calls into privsep https://review.opendev.org/706897 | |
| 09:09:43 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Correctly resize encrypted LUKSv1 volumes https://review.opendev.org/706900 | |
| 09:09:43 | openstackgerrit | Lee Yarwood proposed openstack/nova master: virt: Pass request context to extend_volume https://review.opendev.org/706899 | |
| 09:09:44 | openstackgerrit | Lee Yarwood proposed openstack/nova master: DNM - Test TEMPEST_EXTEND_ATTACHED_ENCRYPTED_VOLUME https://review.opendev.org/707593 | |
| 09:20:02 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Use oslo.utils >= 4.1.0 to fetch format-specific image data https://review.opendev.org/710785 | |
| 09:20:03 | openstackgerrit | Lee Yarwood proposed openstack/nova master: images: Remove Libvirt specific configurable use from qemu_img_info https://review.opendev.org/707591 | |
| 09:20:03 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Always provide the size in bytes when calling virDomainBlockResize https://review.opendev.org/707590 | |
| 09:20:04 | openstackgerrit | Lee Yarwood proposed openstack/nova master: libvirt: Remove QEMU_VERSION_REQ_SHARED https://review.opendev.org/710239 | |
| 09:38:16 | happyhemant | https://www.irccloud.com/pastebin/tCZBhkNZ/ | |
| 09:38:16 | happyhemant | Hello folks, I am having trouble creating instance with sriov network port. I tried creating normal instance it works really fine but creating it with sriov network port dosent seems to work for me. The logs of nova-conductor shows `No valid host found`. Look at my config of nova and neutron did i miss anything there ? help will be muc appreciated thank you so much | |
| 09:40:47 | happyhemant | nova.conf https://www.irccloud.com/pastebin/4RPX1qJm/ | |
| 09:42:14 | happyhemant | neutron conf https://www.irccloud.com/pastebin/wByQoY60/ | |
| 10:08:08 | stephenfin | happyhemant: That _looks_ correct. Could you give us the output of 'lspci -vvv' and try again with nova-compute in DEBUG mode though? | |
| 10:11:22 | stephenfin | happyhemant: Also, what's the output of '/sys/class/net/eno1/device/sriov_numvfs' ? | |
| 10:12:07 | stephenfin | happyhemant: Are these VFs you're attempting to use or PFs? eno1 sounds like the latter. If so, you need to do some additional configuration | |
| 10:18:31 | happyhemant | stephenfin: Thank you so much for reply so basically i have two computes so the result of `/sys/class/net/eno1/device/sriov_numvfs`this https://www.irccloud.com/pastebin/BSSYQc9T/ | |
| 10:24:02 | happyhemant | stephenfin: also have look lscpi -vvv output https://pastebin.com/raw/XetJLPuD | |
| 10:25:41 | happyhemant | stephenfin: I will also try to add DEBUG mode and will try to redeploy it | |
| 10:28:03 | stephenfin | happyhemant: okay, you've that configured wrong :) | |
| 10:28:48 | stephenfin | you use 'devname' to passthrough a specific device, so what you're asking nova to passthrough is the PFs eno1 and eno2 | |
| 10:28:53 | stephenfin | not their VFs | |
| 10:31:00 | openstackgerrit | Brin Zhang proposed openstack/nova master: WIP Add functional tests for PATCH volume attachments API https://review.opendev.org/710965 | |
| 10:33:00 | stephenfin | happyhemant: so you need to either (a) find and use the product IDs of the VFs or (b) use the PCI addresses instead | |
| 10:34:44 | happyhemant | stephenfin: well thank you so much stephenfin i will try this and will let you know | |
| 10:37:15 | stephenfin | No problem. Let me know if you get it going. There's a guide for this at [1] and if you think we're missing information, I'd encourage you to submit a patch. Even a draft that one of us can finish for you would be good (y) [1] https://docs.openstack.org/neutron/latest/admin/config-sriov.html | |
| 10:58:07 | happyhemant | stephenfin: hey stephenfin hi again `passthrough_whitelist: '[{physical_network": "public", "vendor_id":"10df", "product_id":"0720"}, {"physical_network": "public", "vendor_id":"10df", "product_id":"0720"}]'` this should be good ? ` | |
| 10:58:42 | stephenfin | 0720 is the VF product_id, yeah? | |
| 10:58:48 | stephenfin | and not the PF | |
| 10:59:04 | happyhemant | https://www.irccloud.com/pastebin/VWAbYQER/ | |
| 10:59:05 | stephenfin | (they nearly always have different product_id's) | |
| 10:59:11 | happyhemant | i found this | |
| 10:59:41 | happyhemant | where `VF offset: 32, stride: 1, Device ID: 0720` | |
| 10:59:51 | stephenfin | ah, perfect | |
| 11:00:06 | stephenfin | they'll show up if you do 'lspci -nn' too, I'd imagine | |
| 11:00:38 | stephenfin | in any case, assuming those are correct then that looks good to me | |
| 11:00:52 | stephenfin | make sure you're in DEBUG mode and away you go | |
| 11:01:51 | happyhemant | stephenfin: yeah sure i already enabled debug mode in nova and neutron conf | |
| 11:02:22 | happyhemant | i am newbie but thanks for 'lspci -nn' `04:00.0 Ethernet controller [0200]: Emulex Corporation OneConnect NIC (Skyhawk) [10df:0720] (rev 10)` | |
| 11:02:29 | happyhemant | this is what i got | |
| 11:02:41 | happyhemant | so i think i am good to go to try this out | |
| 11:02:48 | stephenfin | hmm, not sure that's right | |
| 11:03:13 | stephenfin | what about 'lspci -nn | grep 04:04.0' ? | |
| 11:03:44 | stephenfin | happyhemant: ^ | |
| 11:04:31 | happyhemant | https://www.irccloud.com/pastebin/3Y9y6QdG/ | |
| 11:05:03 | happyhemant | stephenfin: ^ | |
| 11:05:35 | stephenfin | So they use the same product_id. Lovely | |
| 11:05:46 | stephenfin | okay, I think nova will just filter out the PFs so you should be good to go still | |
| 11:05:54 | stephenfin | try that and let me know how it goes | |
| 11:06:43 | happyhemant | stephenfin: but does this sound reasonable to you ? `passthrough_whitelist: '[{"physical_network": "public", "vendor_id":"10df", "product_id":"0720"}, { "physical_network": "public", "vendor_id":"10df", "product_id":"0720"}]' | |
| 11:07:17 | stephenfin | Mostly. You don't need to specify it twice since they say the same thing now, right? | |
| 11:07:31 | happyhemant | yeah | |
| 11:07:48 | happyhemant | thats my question shall specify it one time ? | |
| 11:08:23 | stephenfin | just once, yeah | |
| 11:09:05 | happyhemant | stephenfin: cool will let you know if it works or not | |
| 11:21:39 | happyhemant | stephenfin: i think the conf is not good for me i am missing something ` Invalid PCI devices Whitelist config: Invalid entry: 'map[physical_network:public product_id:0720 vendor_id:10df]'` | |
| 11:22:40 | happyhemant | `passthrough_whitelist: [{ "physical_network": "public", "vendor_id":"10df", "product_id":"0720" }]`this is what i have right now | |
| 11:23:18 | stephenfin | I'm assuming you're using some deployment too. Does it need to be escaped or anything, seeing as it's JSON in a string | |
| 11:25:16 | happyhemant | yes i am using deployment https://www.irccloud.com/pastebin/Uu9vQV2e/ | |
| 11:26:17 | happyhemant | i have no idea tbh | |
| 11:31:46 | stephenfin | happyhemant: Can you put that into a string | |
| 11:31:55 | stephenfin | so passthrough_whitelist: '[{ "physical_network": "public", "vendor_id":"10df", "product_id":"0720" }]' | |
| 11:32:07 | stephenfin | (notice the extra quotes) | |
| 11:32:26 | happyhemant | stephenfin: heyy i think i found out i was missing '' this :( | |
| 11:32:30 | happyhemant | my bad sorry | |
| 11:33:12 | happyhemant | missing quotes sometimes blows your mind :D | |
| 11:39:09 | happyhemant | https://www.irccloud.com/pastebin/etoeESAh/ | |
| 11:39:54 | happyhemant | stephenfin: i created two instances but result is still the same :( https://www.irccloud.com/pastebin/9xC23uMj/ | |
| 11:40:16 | stephenfin | Damn. What are the logs saying? | |
| 11:40:46 | stephenfin | and how are you creating the ports and instances? openstackclient? Can you share the commands you're executing? | |
| 11:40:56 | happyhemant | nova-conductor https://www.irccloud.com/pastebin/UnFf1AUh/ | |
| 11:41:04 | happyhemant | yes using openstackclient | |
| 11:41:40 | stephenfin | what about nova-scheduler? | |
| 11:42:20 | happyhemant | nova-schedular https://www.irccloud.com/pastebin/1cafm67C/ | |
| 11:43:19 | happyhemant | for creating instance i have some script https://www.irccloud.com/pastebin/GNNjRZbJ/ | |