| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-09-27 | |||
| 13:50:49 | efried | So I think the point is that, in order to do dynamic adjustment of 'reserved' amounts properly, get_inventory itself may need to be listing instances and such. | |
| 13:50:59 | dansmith | no | |
| 13:51:07 | dansmith | inventory has nothing to do with instances | |
| 13:51:42 | rgerganov | dansmith, there could be no way to calculate reserve without listing instances | |
| 13:52:06 | dansmith | reserved is a conf value | |
| 13:52:44 | bauzas | that's my whole point | |
| 13:52:46 | dansmith | you all were talking about other vms not owned by nova on a hypervisor right? and something external adding that value to reserved so nova doesn't try to use it, right? | |
| 13:52:53 | bauzas | reserved is set by the operator | |
| 13:53:08 | bauzas | so, if the operator wants to raise that value, fair enough | |
| 13:53:18 | dansmith | in that case, some other thing could be updating CONF.reserved_whatever and HUPing nova so that the next time the periodic runs, it just stabs the new scalar value into inventory.. no counting required. | |
| 13:53:19 | bauzas | but I don't see why Nova should care of thaty | |
| 13:53:24 | dansmith | bauzas: most definitely | |
| 13:53:26 | bauzas | dansmith: +1 | |
| 13:55:10 | mriedem | bauzas: in case you didn't see this https://bugs.launchpad.net/nova/+bug/1719730 | |
| 13:55:12 | openstack | Launchpad bug 1719730 in OpenStack Compute (nova) pike "Reschedule after the late affinity check fails with "'NoneType' object is not iterable"" [High,Confirmed] | |
| 13:55:19 | mriedem | bauzas: melwitt might be working on a fix, i'm not sure | |
| 13:55:19 | efried | As user experiences go, "Extend SAN disk, edit conf file, HUP n-cpu" ain't as friendly as "Extend SAN disk". | |
| 13:55:24 | mriedem | bauzas: but it's a regression in pike | |
| 13:55:32 | bauzas | mriedem: yup, I just provided my thoughts litterally 5 mins ago :p | |
| 13:55:53 | bauzas | mriedem: tl;dr I don't understand how we can get a ReqSpec group info that isn't accurate | |
| 13:55:54 | rgerganov | efried +1 | |
| 13:56:12 | dansmith | efried: nova wouldn't be reporting the inventory for a SAN disk, so no problem there :) | |
| 13:56:30 | dansmith | efried: and anything that an agent is surveying would be updated automatically | |
| 13:56:52 | dansmith | efried: if you hotplug some memory into your compute node, then nova-compute would automatically report that on the next periodic | |
| 13:57:19 | dansmith | efried: what you are talking about is updating the reserved value, which is static, operator-configured or operator-scripted | |
| 13:57:36 | mriedem | bauzas: provided your thoughts where? don't see anything in the bug or the linked pike change | |
| 13:57:39 | dansmith | efried: the HUP is so we notice the change to the config file.. certainly you don't want us to be live reloading the config file whenever we feel like it | |
| 13:57:54 | bauzas | mriedem: oh snap, duplicate bug | |
| 13:58:05 | bauzas | mriedem: https://bugs.launchpad.net/nova/+bug/1719859 | |
| 13:58:06 | openstack | Launchpad bug 1719859 in OpenStack Compute (nova) "Resize failure due to instance group being None in request spec" [Undecided,New] | |
| 13:58:30 | efried | dansmith Right, extending SAN was a bad example. | |
| 13:58:44 | bauzas | mriedem: mmm, nevermind, different issue, it seems | |
| 13:59:34 | efried | Not being super well-versed on how OVS comes into play for libvirt, can we apply the same principle to networking resources? | |
| 13:59:42 | mriedem | bauzas: ok, mel's is pretty straight forward | |
| 13:59:49 | mriedem | we used to set group_members in the filter_properties, | |
| 13:59:56 | mriedem | your change in pike stopped using filter_properties, | |
| 13:59:58 | efried | I.e. similar UX statement: "Do OVS thingy, edit conf file, HUP n-cpu" not as friendly as "Do OVS thingy" | |
| 14:00:02 | mriedem | but forgot to include the group_members stuff | |
| 14:00:12 | mriedem | she already said that the 1 line change fixes the issue | |
| 14:00:20 | mriedem | i just asked that a functional regression test get created | |
| 14:00:24 | bauzas | mriedem: okay, I'll wait for melwitt's patch | |
| 14:00:29 | dansmith | efried: no, nova-compute isn't reporting any network resources | |
| 14:00:53 | bauzas | mriedem: thanks for the catch | |
| 14:01:00 | mriedem | bauzas: which reminds me, did you cleanup that num_instances one? | |
| 14:01:06 | bauzas | mriedem: I got some late pings yesterday | |
| 14:01:08 | mriedem | melwitt found the problem, i just helped debug | |
| 14:01:22 | mriedem | https://review.openstack.org/#/c/506093/ | |
| 14:01:33 | dansmith | efried: I think the block you're stumbling over is that nova does not count things it does not count. Therefore, it does not dynamically update inventory for things it does not count. If you want to override the inventory for a thing it _does_ count to account for things it does not count, then you put that in config an HUP it to notice. | |
| 14:01:42 | bauzas | mriedem: yeah, just needs rebase | |
| 14:01:46 | mriedem | i need to start making an etherpad of bug fixes we need in pike... | |
| 14:02:07 | bauzas | mriedem: I also have a couple of bugfixes that are on hold in my queue | |
| 14:02:17 | bauzas | like the fact we don't destroy the Spec objects | |
| 14:02:42 | bauzas | mriedem: an etherpad seems a good idea to me | |
| 14:02:54 | bauzas | that would also help me focusing on rebasing such bugs | |
| 14:03:10 | mriedem | https://etherpad.openstack.org/p/nova-pike-bug-fix-backports | |
| 14:04:01 | bauzas | ack | |
| 14:04:25 | tssurya | dansmith, mriedem, sdague : so basically I have a simple set up using devstack with one cell, then I added a new 'cell2' that has some unmapped instances in its DB. However when I run the map_instances command specifying the cell uuid, it does not work since like sdague said earlier, the db url is being taken from nova.conf (which is that of cell0) while the db url for the new cell is inside the cell_mappings table of nova_api db. So I | |
| 14:05:06 | dansmith | tssurya: create a small config with just the db url you need | |
| 14:05:19 | efried | dansmith Thanks, that makes sense. | |
| 14:06:56 | tssurya | dansmith : okay! so that means the current working is as expected ? | |
| 14:07:31 | dansmith | tssurya: it's been a while since I looked at that command, but I would guess so | |
| 14:07:48 | mriedem | tssurya: nova.conf in default devstack points at cell0 on purpose | |
| 14:08:00 | mriedem | tssurya: nova-manage uses nova.conf if no other --config-file is specified | |
| 14:08:02 | mriedem | on the command line | |
| 14:08:31 | mriedem | so if you want to do things to cell1, you would do something like: nova-manage --config-file /etc/nova/nova_cell1.conf db archive_deleted_instances --verbose --until-complete | |
| 14:08:37 | mriedem | for archiving deleted instances in cell1 | |
| 14:08:52 | stephenfin | efried: You didn't start work converting this to a seqdiag, did you? https://photos.google.com/share/AF1QipNpWVQKU8GK4_9wxVbiRJUqJnMzqPcBh6DvjVyBPIjjmi6ZU8r9TleQNo6pV1t9SA?key=NUl3OUFGYkRFTE8tMHhSX0lfc0Y1eEdoeHo4SUhn | |
| 14:08:55 | openstackgerrit | Eric Berglund proposed openstack/nova master: WIP(5): PowerVM driver: ovs vif https://review.openstack.org/422512 | |
| 14:09:01 | stephenfin | I think mriedem asked for it? | |
| 14:09:04 | tssurya | mriedem, dansmith : okay thanks that makes sense | |
| 14:09:13 | dansmith | tssurya: yeah look at the docstring on that method, it says it assumes the config points at the right database | |
| 14:09:30 | mriedem | tssurya: related https://bugs.launchpad.net/nova/+bug/1719487 | |
| 14:09:32 | openstack | Launchpad bug 1719487 in OpenStack Compute (nova) "nova-manage db archive_deleted_rows is not multi-cell aware" [Wishlist,Triaged] - Assigned to Zhenyu Zheng (zhengzhenyu) | |
| 14:09:39 | dansmith | tssurya: you could make it smarter :) | |
| 14:09:40 | openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif stable/pike: Updated from global requirements https://review.openstack.org/493146 | |
| 14:09:43 | mriedem | stephenfin: that's already done | |
| 14:09:59 | mriedem | stephenfin: https://docs.openstack.org/nova/latest/reference/live-migration.html | |
| 14:10:01 | efried | stephenfin Yes, merged. | |
| 14:10:03 | mriedem | there is one thing missing | |
| 14:10:07 | mriedem | i noticed yesterday | |
| 14:10:31 | mriedem | on the failure path, it doesn't have a box saying that the source node is running the _rollback_live_migration method | |
| 14:10:42 | mriedem | which does some stuff on the source node, and calls the dest node to cleanup | |
| 14:10:49 | tssurya | dansmith , mriedem : ok, will have a look at it :) | |
| 14:11:17 | openstackgerrit | OpenStack Proposal Bot proposed openstack/python-novaclient stable/pike: Updated from global requirements https://review.openstack.org/493187 | |
| 14:11:26 | efried | mriedem That would be like a box to the left of that final 'call' arrow at the bottom? | |
| 14:11:54 | mriedem | efried: i think more like how the post_live_migration box is in the success path on the source node | |
| 14:14:40 | efried | sdague cdent Care to render an opinion/ruling on jichenjc's concerns here: https://review.openstack.org/#/c/488137/21/nova/conf/utils.py@85 ? | |
| 14:17:01 | cdent | efried: remind me when I’m back in about 20 mins | |
| 14:17:08 | efried | ack, thx | |
| 14:17:55 | openstackgerrit | Eric Fried proposed openstack/nova master: _rollback_live_migration in live-migration seqdiag https://review.openstack.org/507871 | |
| 14:18:23 | efried | mriedem ^ | |
| 14:19:26 | mriedem | thanks | |
| 14:19:56 | mriedem | claudiub|3: hyperv ci seems to have gone crazy | |
| 14:19:57 | mriedem | http://cloudbase-ci.com//nova/507871/1/console.log.gz | |
| 14:20:08 | mriedem | not sure if that's a zuulv3 side effect or what | |
| 14:22:30 | openstackgerrit | Matt Riedemann proposed openstack/nova master: xenapi: pass migrate_data to recover_method if live migrate fails https://review.openstack.org/507874 | |
| 14:23:20 | openstackgerrit | OpenStack Proposal Bot proposed openstack/os-vif stable/pike: Updated from global requirements https://review.openstack.org/493146 | |
| 14:24:54 | openstackgerrit | OpenStack Proposal Bot proposed openstack/python-novaclient stable/pike: Updated from global requirements https://review.openstack.org/493187 | |
| 14:27:50 | mriedem | gibi: appears that test_live_migrate_delete has introduced a race http://logs.openstack.org/87/507687/2/check/gate-nova-tox-functional-ubuntu-xenial/90cc144/testr_results.html.gz | |
| 14:28:13 | mriedem | i was noticing some stuff like this yesterday when writing another test, | |