| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-06-13 | |||
| 21:17:58 | sean-k-mooney | spatel: yes | |
| 21:18:40 | spatel | Nice doc.. | |
| 21:18:54 | sean-k-mooney | ovs-dpdk uses hugepage memroy to process packets so that it can DMA transfer packets directly to and from the nic bypassing the kernel | |
| 21:18:58 | spatel | sean-k-mooney: do i also need to give some dedicated CPU to vSwitch? | |
| 21:19:56 | sean-k-mooney | yes ideally 1 PMD(poll mode driver) core per numa node | |
| 21:20:41 | sean-k-mooney | ovs-dpdk scalse effectivly liniarly with the number of cpu cores you give it so you can tune it up or down depending on your data rates | |
| 21:20:52 | spatel | I have two numa zone so i have to give 2 CPU core right? is that CPU core will be pin with vSwitch? | |
| 21:21:30 | sean-k-mooney | yes dpdk will run in a bussy loop waiting for packets and will consume the full core | |
| 21:21:45 | sean-k-mooney | even when idel | |
| 21:22:15 | sean-k-mooney | it does that to miniumese latency but it basically means you cant run other thing on the core at the same time | |
| 21:23:06 | sean-k-mooney | per packet ovs-dpdk is much more efficent then kernel ovs however kernel ovs use kernel thread to process the packet and does not consume cpus cycles when idel | |
| 21:23:12 | sean-k-mooney | so its a trade off | |
| 21:23:25 | sean-k-mooney | ovs-dpdk cpu usage will be fixed based on the cores you allcoate it | |
| 21:24:00 | spatel | core allocation process is automatic or part of configuration? | |
| 21:24:01 | sean-k-mooney | kernel ovs will use less or more cpus as needed includeing stealing cpu cycles form the guests if you do not tune the kernel to prevent that | |
| 21:24:10 | sean-k-mooney | spatel: part of the configuration | |
| 21:24:32 | spatel | ah! ok.. | |
| 21:24:52 | sean-k-mooney | you set a bit mask in the ovs db to choose what core dpdk is allows to use | |
| 21:25:01 | spatel | Do i need to create neutron port for dpdk (like i am create currently for SR-IOV)? | |
| 21:25:32 | sean-k-mooney | you can but no. it used vnic_type=normal which is the default | |
| 21:25:39 | sean-k-mooney | so you dont need to precreate them | |
| 21:25:55 | sean-k-mooney | form a user point of view its identiacl to linux bridge or kernel ovs | |
| 21:26:05 | sean-k-mooney | other then the fact you need a flaovr with hugepages | |
| 21:26:12 | spatel | Perfect!! i love that part, currently in SR-IOV i have to create port in advance to map with vms | |
| 21:26:21 | sean-k-mooney | yes | |
| 21:26:48 | sean-k-mooney | which is annoying but there are reason why we require that | |
| 21:26:51 | spatel | anyway my all vms running with hugepages at moment | |
| 21:27:21 | spatel | Question why does vms required hugepage for dpdk? | |
| 21:27:49 | sean-k-mooney | it has to do with how the packeets are transfered between the vswitch and the vm | |
| 21:27:58 | sean-k-mooney | we use a technology called vhost-user | |
| 21:28:35 | sean-k-mooney | which allows the vswitch to mapp the virtio-rings( tx and rx queues) of the guest nic into the memory of the vswitch | |
| 21:29:10 | spatel | Interesting.. | |
| 21:29:17 | sean-k-mooney | to do that we need to use gest memroy that is mmap shared with an open file discripto, is contiguaon and preallcoated | |
| 21:29:26 | sean-k-mooney | hugepages do all of the above | |
| 21:29:40 | sean-k-mooney | technically you can acive the same wiht out hugepages | |
| 21:29:55 | sean-k-mooney | its just slower, more work and not supported by openstack by defualt | |
| 21:30:17 | spatel | Got it.. so hugepage has big role here | |
| 21:30:34 | sean-k-mooney | if you are using a new enought ovs-dpdk you can actully get 0 copy packet transmistion betwwen the guest and the nic | |
| 21:31:17 | openstackgerrit | Merged openstack/nova master: update constraints url https://review.opendev.org/664771 | |
| 21:31:19 | sean-k-mooney | e.g. when the guest kernel rights the packet to the tx queue it is nver copyied and is drieectly trasmited by the nic similar to sriov | |
| 21:31:34 | sean-k-mooney | 0 copy recive i think is also posibel but experimental | |
| 21:32:12 | sean-k-mooney | that obviorsly depend on if you are using vxlan or vlans feature that may or may not be supported in your nic hardware | |
| 21:32:20 | spatel | ah! ok.. in short it bypass the kernel | |
| 21:32:47 | sean-k-mooney | yep and does everything in userspacce or in hardaware | |
| 21:33:07 | spatel | Do you guys running dpdk in production? | |
| 21:33:31 | spatel | very few people i found using dpdk in prod cloud | |
| 21:33:36 | sean-k-mooney | well i dont run a production cloud. i just work on upstream stuff | |
| 21:33:56 | sean-k-mooney | spatel: but redhat has customer using it in production yest | |
| 21:34:01 | sean-k-mooney | *yes | |
| 21:34:19 | sean-k-mooney | it is much less common then kernel ovs or sriov | |
| 21:34:28 | spatel | Let see how successful i can run in my production. | |
| 21:35:05 | sean-k-mooney | if you want the full intel pitch then https://software.intel.com/en-us/articles/yahoo-japan-accelerates-l7-performance-using-open-vswitch-with-dpdk | |
| 21:35:52 | spatel | Thanks for that link.. | |
| 21:36:53 | sean-k-mooney | hehe when i was working at intel i help some of the yahoo folk tuen there deployment alittle but after it was working i never heard form them how it worked out long term | |
| 21:37:55 | spatel | sean-k-mooney: you are smarty pants :) | |
| 21:39:04 | spatel | sean-k-mooney: hope dpdk support bonding too | |
| 21:39:40 | sean-k-mooney | it does | |
| 21:39:58 | sean-k-mooney | you can have dpdk do it(not recommended) or use ovs bonding of dpdk ports | |
| 21:40:22 | sean-k-mooney | ovs bonding give you more contol and can be modifed while the switch is running | |
| 21:40:57 | sean-k-mooney | dpdk bonding required the switch to be restareted, is less configurable but used to be slight faster at failover and throuput | |
| 21:41:20 | sean-k-mooney | honestly however dpdk bonding not via ovs is an operations pain that is best avoid | |
| 21:41:32 | sean-k-mooney | you should just use ovs bonding | |
| 21:41:42 | sean-k-mooney | anyway im gong to call it a night o/ | |
| 21:43:52 | spatel | sean-k-mooney: Thank you for wonderful tips | |
| 21:43:54 | spatel | Good night | |
| 22:25:59 | openstackgerrit | Eric Fried proposed openstack/nova master: Functional recreate for revert_resize https://review.opendev.org/665253 | |
| 22:45:59 | openstackgerrit | Merged openstack/nova master: update comment on ignore_basepython_conflict https://review.opendev.org/665036 | |
| #openstack-nova - 2019-06-14 | |||
| 00:13:26 | openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Microversion 2.74: Support Specifying AZ to unshelve https://review.opendev.org/665136 | |
| 00:21:01 | izza_ | Hi,can anybody here help me pls...i'm testing rally heat(scenario: create_stack_scale) and i'm encountering below error: ***heat-engine***** 2019-06-13 18:27:19,809.809 1 ERROR heat.engine.service ResourceFailure: resources.asg: HEAT-E99001 Service nova is not available for resource type OS::Nova::Server, reason: Authentication cannot be scoped to multiple targets. Pick one of: project, domain, trust or unscoped | |
| 00:21:10 | izza_ | ***Rally Logs*** TimeoutException: Rally tired waiting 3600.00 seconds for Stack <Stack {u'parent': None, u'disable_rollback': True, u'description': u'No description', u'parameters': {u'OS::project_id': u'53ae40faef3d47938019d7eded6dc4d2', u'OS::stack_id': u'ba39558d-63f7-43de-9a7f-aee7e325f623', u'OS::stack_name': u's_rally_c10f9daf_7eSBDfas', u'image': u'cirros-0.4.0-x86_64-disk', u'scaling_adjustment': u'1', u'flavor': u'm1 | |
| 00:23:34 | izza_ | i badly needed ur help guys...i have deadline Today | |
| 00:45:05 | sean-k-mooney | izza_: i think you need to try the heat or rally channel. this looks liek an issue with the heat templat that rally is using | |
| 00:45:20 | sean-k-mooney | izza_: i dont think this is related to nova from that error | |
| 00:50:41 | igordc | hello sean-k-mooney | |
| 00:51:02 | sean-k-mooney | igordc: o/ | |
| 00:51:04 | igordc | sean-k-mooney, since you're here, can I ask if you had a look at https://review.opendev.org/#/c/576607/ after Stamatis last comment? | |
| 00:51:18 | igordc | cc stephenfin | |
| 00:51:31 | sean-k-mooney | i have not | |
| 00:51:42 | izza_ | ok noted..i already sent message to rally channel...yet no answer..just looking for a chance..if anyone knows how to resolv that issue..but thanks:) | |
| 02:22:13 | openstackgerrit | Brin Zhang proposed openstack/python-novaclient master: Microversion 2.74: Support Specifying AZ to unshelve https://review.opendev.org/665136 | |
| 02:56:48 | openstackgerrit | Merged openstack/nova stable/rocky: [ironic] Don't remove instance info twice in destroy https://review.opendev.org/662584 | |
| 04:00:22 | openstackgerrit | zhufl proposed openstack/nova master: Fix :param: in docstring https://review.opendev.org/665289 | |
| 05:27:48 | openstackgerrit | Boxiang Zhu proposed openstack/nova master: Validate requested host/node during servers create https://review.opendev.org/661237 | |
| 05:27:49 | openstackgerrit | Boxiang Zhu proposed openstack/nova master: Add host and hypervisor_hostname flag to create server https://review.opendev.org/645520 | |
| 06:33:17 | openstackgerrit | Merged openstack/nova master: fup: Merge machine_type_mappings into get_default_machine_type https://review.opendev.org/664036 | |
| 07:45:16 | openstackgerrit | Merged openstack/nova master: Warn for duplicate host mappings during discover_hosts https://review.opendev.org/651947 | |
| 07:45:23 | openstackgerrit | Merged openstack/nova master: Literalize CLI options in docs https://review.opendev.org/665217 | |
| 07:45:32 | openstackgerrit | Merged openstack/nova master: Fix a warning about flags in an expression string https://review.opendev.org/665065 | |
| 08:13:55 | mrch_ | is there redhat production support for? https://www.suse.com/documentation/sles-15/singlehtml/art.amd-sev/art.amd-sev.html | |
| 08:31:17 | aspiers | mrch_: no. I'm working on it | |
| 08:31:38 | aspiers | mrch_: I mean, I'm working on adding SEV support to OpenStack | |
| 08:31:59 | aspiers | not sure if anyone from Red Hat is working on SEV support in the OS | |
| 08:32:07 | openstackgerrit | Yongli He proposed openstack/nova master: clean up orphan instances https://review.opendev.org/627765 | |
| 08:32:07 | openstackgerrit | Yongli He proposed openstack/nova master: Clean up orphan instances virt driver https://review.opendev.org/648912 | |
| 08:32:16 | aspiers | but the RH folks are being very helpful with my work | |
| 08:32:20 | aspiers | mrch_: see http://specs.openstack.org/openstack/nova-specs/specs/train/approved/amd-sev-libvirt-support.html | |
| 08:32:41 | aspiers | mrch_: what's the nature of your interest? | |
| 08:35:41 | mrch_ | aspiers: thx | |
| 12:25:29 | openstackgerrit | sean mooney proposed openstack/nova-specs master: add libvirt pqos spec https://review.opendev.org/662264 | |
| 13:48:35 | dansmith | lyarwood: did you see mriedem's query about "q35" on the master patch for the sata bus thing? | |