| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-02-19 | |||
| 21:04:49 | sean-k-mooney | ksmd as in kernel shared memory deamon? | |
| 21:05:12 | spatel | I did and some folks saying disable for compute node | |
| 21:05:38 | sean-k-mooney | yes i would proably disable it also | |
| 21:06:02 | spatel | I will run my load-test and see if any impact. | |
| 21:06:04 | sean-k-mooney | im just checking that its what i think it is | |
| 21:06:32 | spatel | we found why erlang doesn't like two NUMA nodes. | |
| 21:07:18 | spatel | erlang scheduler default migrate process from CPU to CPU and that is why we were getting performance hit | |
| 21:07:32 | sean-k-mooney | ya so assuming its related to https://www.kernel.org/doc/Documentation/vm/ksm.txt which i think it is we recommend disable ksm on all nfv systems | |
| 21:07:54 | spatel | I will disable KSM | |
| 21:08:41 | spatel | sean-k-mooney: where i should change numa_policy to preferred ? (default is lagacy) | |
| 21:08:54 | spatel | does flavor support that feature on stein? | |
| 21:10:38 | sean-k-mooney | spatel: that has never been suported | |
| 21:11:04 | spatel | so i have only option to set it up in /etc/nova/nova.conf? | |
| 21:11:22 | sean-k-mooney | which numa policy are you refering to specificly | |
| 21:11:42 | spatel | https://specs.openstack.org/openstack/nova-specs/specs/queens/implemented/share-pci-between-numa-nodes.html | |
| 21:12:13 | spatel | I want to spin up VM across numa (default sriov won't let you do that) | |
| 21:12:16 | sean-k-mooney | ah the pci polices | |
| 21:12:22 | spatel | Yes | |
| 21:12:43 | sean-k-mooney | so you can set that in the config and i recently added it to the flavor | |
| 21:12:53 | sean-k-mooney | i need to check if it merged in train but i think it did | |
| 21:13:02 | spatel | but does it available in stein ? | |
| 21:13:22 | spatel | I am running stein (if its not available in stein then only option is nova.conf right?) | |
| 21:13:30 | sean-k-mooney | actully no it only merged in ussuri https://specs.openstack.org/openstack/nova-specs/specs/ussuri/approved/vm-scoped-sriov-numa-affinity.html | |
| 21:13:48 | sean-k-mooney | before ussuri you can only set it in the nova.conf for pci alias | |
| 21:13:58 | sean-k-mooney | meaning it does not work with neutron sriov ports | |
| 21:14:00 | spatel | nova-api service or compute? | |
| 21:14:09 | sean-k-mooney | you have to set it in both | |
| 21:14:17 | spatel | i will give it a try.. | |
| 21:14:43 | sean-k-mooney | it will not work if you are using neutron sriov port e.g. vnic_type=direct | |
| 21:15:10 | sean-k-mooney | it will only be applied to pci devices that are requested vai an alias in the flavor | |
| 21:15:29 | sean-k-mooney | neutron sriov only supports legacy before ussuri | |
| 21:18:17 | spatel | sean-k-mooney: ohhhh! | |
| 21:18:28 | spatel | i am using vnic_type=direct | |
| 21:18:58 | sean-k-mooney | yes the abiltiy to chagne that was only added in ussuri upstream | |
| 21:19:23 | sean-k-mooney | i have backported it downstream but this is not a candiate for backporting upstream | |
| 21:21:13 | sean-k-mooney | spatel: this https://review.opendev.org/#/c/674072/ is the patch you want | |
| 21:23:51 | spatel | any plan that patch get merge in future release? | |
| 21:24:20 | sean-k-mooney | its merged in master so it will be released in ussuri | |
| 21:24:41 | sean-k-mooney | but its adding a new feature so it cant be backported upstream | |
| 21:24:57 | spatel | sean-k-mooney: totally understand.. | |
| 21:25:32 | sean-k-mooney | downstream we are aboult to do a partial backport with out the support for the image property or notification as we cant backport object changes | |
| 21:25:43 | sean-k-mooney | *able | |
| 21:25:56 | sean-k-mooney | that said we avoid it when we can | |
| 21:26:59 | spatel | make sense to avoid thatif there are lots of moving part | |
| 21:27:20 | spatel | http://openstack-in-production.blogspot.com/2015/08/ept-and-ksm-for-high-throughput.html | |
| 21:27:31 | spatel | What do you think about EPT ? | |
| 21:27:45 | sean-k-mooney | you should alway always have it enabeld | |
| 21:28:15 | spatel | CERN suggesting to disable to gain performance | |
| 21:28:16 | sean-k-mooney | if you turn of extended page tables it almost as bad as disbaling kvm and falling back to qemu | |
| 21:28:58 | spatel | hmm! interesting. | |
| 21:29:12 | sean-k-mooney | our perfomance team messurad a huge performance hit to disabeling for the specter/meltdown mitigations | |
| 21:29:49 | spatel | I have that disabled on compute machine but not on VM. | |
| 21:33:25 | sean-k-mooney | spatel: read https://www.redhat.com/pt-br/blog/understanding-l1-terminal-fault-aka-foreshadow-what-you-need-know specifcally the "Beyond bare metal" section alth the full blog is good too | |
| 21:33:43 | spatel | reading... | |
| 21:42:54 | sean-k-mooney | if you turn of EPT you fallback to shadowtables which will result in significat qemu overhead in the 10s or % range based on there testing when fixing l1tf | |
| 21:43:37 | spatel | Yes, you are right. (also based on your link) | |
| 22:40:42 | efried | dansmith: results for the Enum thing are back. Func passed; one unit failed but I'm not sure if it means we need a migration; and grenade failed but I can't tell if it's related. https://review.opendev.org/#/c/708707/ | |
| 23:34:54 | openstackgerrit | Eric Fried proposed openstack/nova master: Use stock mock https://review.opendev.org/708262 | |
| #openstack-nova - 2020-02-20 | |||
| 00:09:58 | openstackgerrit | Eric Fried proposed openstack/nova master: hacking: force explicit import of python's mock https://review.opendev.org/708768 | |
| 00:18:28 | efried | johnthetubaguy: Are you interested in taking over the coding work for vTPM? | |
| 00:18:51 | efried | The design is pretty well described at this point, and the base enablement code is very close to done. | |
| 00:23:16 | efried | stephenfin, gibi, bauzas, alex_xu, johnthetubaguy (and melwitt, dansmith FYI, though I don't expect you to be there so early): In Thursday's Nova meeting, I would like to consider the two spec freeze exceptions that have been requested. | |
| 00:23:17 | efried | They're the first two on this etherpad: https://etherpad.openstack.org/p/nova-ussuri-planning | |
| 00:23:17 | efried | Also, please have a look at the specs and see if you think they're close enough to go. | |
| 00:23:17 | efried | Please attend the meeting if you can. | |
| 00:38:43 | openstackgerrit | Merged openstack/nova master: Follow-up: Add delete_on_termination to volume-attach API https://review.opendev.org/680655 | |
| 01:05:30 | sean-k-mooney | efried: dansmith while i was fixing the cyborg devstack plugin config generation i decied to fix a few other things too. | |
| 01:05:59 | sean-k-mooney | i have one more patch to write to automate the installation of the cyborg python client | |
| 01:06:20 | sean-k-mooney | which ill do tomorrow and then i can add the DNM nova multinode testing job | |
| 01:06:25 | sean-k-mooney | https://review.opendev.org/#/c/708773/1 | |
| 01:06:55 | sean-k-mooney | that is the top of the chain so far | |
| 01:07:31 | sean-k-mooney | anyway after i fixed nested virt in my vms i can now deploy multinode locally and create vms with cybrog flavors | |
| 01:15:36 | sean-k-mooney | dansmith: efried these are teh local.confs i am using http://paste.openstack.org/show/789773/ | |
| 01:18:17 | sean-k-mooney | ill try and get a multinode tempest-full job running in the morning i implement installtion of the client so i can automate creation fo the device profile. although i cloud also do that with curl if i have too | |
| 02:31:25 | openstackgerrit | Merged openstack/nova master: trivial: Remove unused 'cache_utils' APIs https://review.opendev.org/705652 | |
| 02:33:47 | openstackgerrit | melanie witt proposed openstack/nova master: Move nova-manage db archive_deleted_rows to nova-audit https://review.opendev.org/708784 | |
| 02:33:47 | openstackgerrit | melanie witt proposed openstack/nova master: Move nova-manage db purge to nova-audit https://review.opendev.org/708783 | |
| 02:33:48 | openstackgerrit | melanie witt proposed openstack/nova master: Move nova-manage cell_v2 map_instances to nova-audit https://review.opendev.org/708786 | |
| 02:33:48 | openstackgerrit | melanie witt proposed openstack/nova master: Move nova-manage cell_v2 discover_hosts to nova-audit https://review.opendev.org/708785 | |
| 02:33:49 | openstackgerrit | melanie witt proposed openstack/nova master: Move nova-manage placement heal_allocations to nova-audit https://review.opendev.org/708788 | |
| 02:33:49 | openstackgerrit | melanie witt proposed openstack/nova master: Move nova-manage placement sync_aggregates to nova-audit https://review.opendev.org/708787 | |
| 07:32:54 | openstack | bug 1862633 in OpenStack Compute (nova) "unshelve leak allocation if update port fails" [Medium,In progress] https://launchpad.net/bugs/1862633 - Assigned to Balazs Gibizer (balazs-gibizer) | |
| 07:32:54 | openstackgerrit | Merged openstack/nova master: Reproduce bug 1862633 https://review.opendev.org/706867 | |
| 08:56:54 | stephenfin | efried: It would be better if johnthetubaguy can handle vTPM, but if he can't then I can | |
| 09:19:34 | openstackgerrit | Stephen Finucane proposed openstack/python-novaclient master: setup.cfg: Various Python 3 fixes https://review.opendev.org/708824 | |
| 09:40:05 | bauzas | efried: I can't attend this meeting but I'll leave notes in the etherpad | |
| 09:40:10 | bauzas | thanks for the ping either way | |
| 09:46:13 | kashyap | bauzas: "So, given a tempest.log, how do I find which was the last test to run?" | |
| 09:47:44 | bauzas | kashyap: link of the change? | |
| 09:49:17 | kashyap | bauzas: Actually, I forgot it is a local deployment that a QEMY developer was trying | |
| 10:06:03 | openstackgerrit | Stephen Finucane proposed openstack/python-novaclient master: Remove six https://review.opendev.org/708831 | |
| 10:06:03 | openstackgerrit | Stephen Finucane proposed openstack/python-novaclient master: tox: Configure 'ignore_basepython_conflict' https://review.opendev.org/708830 | |
| 10:06:04 | openstackgerrit | Stephen Finucane proposed openstack/python-novaclient master: Bump to hacking 2.x https://review.opendev.org/708832 | |
| 10:13:57 | openstackgerrit | Lee Yarwood proposed openstack/nova master: WIP libvirt: Provide the backing file format when creating qcow2 disks https://review.opendev.org/708745 | |
| 11:07:01 | openstackgerrit | Stephen Finucane proposed openstack/python-novaclient master: Don't print user_data for 'nova show' https://review.opendev.org/708850 | |
| 11:16:07 | ivve | hello, i have a nova block device attachments stuck (i have been trying to get it removed with nova and openstack commands but with no avail) i can see it still in the nova.block_device_mapping table, any recommendations on setting it properly to deleted? | |
| 11:16:35 | ivve | other than removing the entire row | |
| 11:53:04 | openstackgerrit | Merged openstack/nova stable/queens: Mask the token used to allow access to consoles https://review.opendev.org/707845 | |
| 12:50:56 | gibi | efried: I will attend the nova meeting today to talk about FFE but I hope we can make it quick as I have a parallel meeting at the same time. | |
| 12:56:45 | sean-k-mooney | gibi: is that for the local cache or delete on terminate spec or both | |