| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-08-22 | |||
| 10:04:58 | openstackgerrit | Chen proposed openstack/nova master: Normalize dashless 'resource provider create' uuid https://review.openstack.org/567191 | |
| 10:09:54 | openstackgerrit | Stephen Finucane proposed openstack/nova master: api: Remove unnecessary default parameter https://review.openstack.org/564451 | |
| 10:21:03 | openstackgerrit | Stephen Finucane proposed openstack/nova master: objects: Remove legacy '_from_dict' functions https://review.openstack.org/537414 | |
| 10:27:22 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: WIP: Record cell success/failure/timeout in CrossCellLister https://review.openstack.org/594265 | |
| 10:27:23 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Add get_by_cell_and_project() method to InstanceMappingList https://review.openstack.org/591656 | |
| 10:27:24 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Return a minimal construct for nova list when a cell is down https://review.openstack.org/567785 | |
| 10:34:22 | openstackgerrit | Stephen Finucane proposed openstack/nova master: conf: Use new-style choice values https://review.openstack.org/530924 | |
| 10:37:46 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Modify PciDevice.uuid generation code https://review.openstack.org/530487 | |
| 10:37:47 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Add an online migration for PciDevice.uuid https://review.openstack.org/530905 | |
| 10:45:34 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Record cell success/failure/timeout in CrossCellLister https://review.openstack.org/594265 | |
| 10:45:35 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: WIP: Optimize global marker re-lookup in multi_cell_list https://review.openstack.org/594577 | |
| 10:50:52 | kashyap | mdbooth: Hi, I saw the scrollback discussion here this morning, and you pointed to your "essay code comment" about Nova consuming block device job events | |
| 10:51:01 | kashyap | mdbooth: That is still indeed a thing, as you guessed | |
| 10:51:16 | openstack | bugzilla.redhat.com bug 1382165 in libvirt "virDomainGetBlockJobInfo: Adjust job reporting based on QEMU stats & the "ready" field of `query-block-jobs`" [Unspecified,New] - Assigned to libvirt-maint | |
| 10:51:16 | kashyap | As the relevant upstrema libvirt bug is still open: https://bugzilla.redhat.com/show_bug.cgi?id=1382165 | |
| 10:51:33 | kashyap | And Eric Blake (from libvirt) did acknowledge: | |
| 10:51:35 | kashyap | munging the output to state cur<end (even if qemu reported cur==end) if | |
| 10:51:35 | kashyap | in favor of fixing libvirt to work around the qemu bug, by intentionally | |
| 10:51:35 | kashyap | Yes, changing Nova to use event handlers is a good idea. But I'm ALSO | |
| 10:51:35 | kashyap | [quote] | |
| 10:51:37 | kashyap | qemu reports ready:false | |
| 10:51:40 | kashyap | [/quote] | |
| 10:54:55 | mdbooth | kashyap: Ah, ok. I wondered if the same applied to live migration, events, that is the preferred api being the events. | |
| 10:55:05 | mdbooth | danpb seemed to be saying not. | |
| 10:56:23 | kashyap | mdbooth: I see. Dan knows the migration internals much better, obviously. | |
| 11:14:10 | sean-k-mooney | kashyap: the qemu bug might actully be a libvirt bug in a way. dan asked me to open a bug for the fact libvirt did not fail the compatilblity check when we removed setting the host_mtu on the interface as part of a migration | |
| 11:14:53 | kashyap | sean-k-mooney: Yeah, saw that discussion scroll-by. Do file the upstream bug before you forget :-) | |
| 11:15:16 | kashyap | sean-k-mooney: Here's a convenient URL: https://bugzilla.redhat.com/enter_bug.cgi?product=Virtualization%20Tools&component=libvirt | |
| 11:16:28 | sean-k-mooney | i will i have it written on my whiteboard. i need to check a few things in nova also to confim if there is something we can do in this case. such as setting the mtu for vhost-user interface in the xml. | |
| 11:17:44 | sean-k-mooney | i left out vhost-uesr because i was told setting the mtu in the vswich was all that was required, and non of the example show setting it in qemu but i will test it and see what happens. | |
| 11:17:49 | kashyap | Yep, noted. Nice, you seem to have a physical whiteboard. /me was thinking of getting such a thing for a while. | |
| 11:18:57 | sean-k-mooney | ya im terible at justing any kind of software tooling to track tings but makeing a note on a phyicla whiteboard works for me | |
| 11:19:26 | sean-k-mooney | /justing/using/ | |
| 11:19:44 | kashyap | Quite happy with it | |
| 11:20:28 | sean-k-mooney | hehe but then i would have to learn emacs | |
| 11:40:41 | sean-k-mooney | o/ | |
| 12:08:52 | openstackgerrit | Sergii Golovatiuk proposed openstack/nova master: libvirt: Always escape IPv6 addresses when used in migration URI https://review.openstack.org/589548 | |
| 12:14:36 | mriedem | sean-k-mooney: in case you haven't seen, https://review.openstack.org/#/c/594508/ was the tactical fix for the live migration bug you were hitting where we incorrectly activate the dest host port binding even on migration failure - for rocky rc3 i'm proposing that we just ignore that event since we're not properly checking the job status; | |
| 12:14:46 | mriedem | sean-k-mooney: then the patch on top of that *does* check the job status for that event | |
| 12:15:14 | mriedem | but i have less confidence in the 2nd patch where we check job status | |
| 12:15:35 | mriedem | since it sounds like job info might be somewhat unreliable depending on when you get the job info object | |
| 12:16:11 | mriedem | i've tried to be conservative and unless we can determine that it completed successfully, it just falls back to the previous behavior for that event (before rocky) | |
| 12:35:42 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: [WIP] Add scatter_gather_single_cell utility https://review.openstack.org/594947 | |
| 12:37:22 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: [WIP] Add scatter_gather_single_cell utility https://review.openstack.org/594947 | |
| 12:49:51 | mriedem | sahid: i see you asked for the reno on https://review.openstack.org/#/c/589548/ - do we really need a release note for this? | |
| 12:50:48 | sean-k-mooney | mriedem: i had not i was away having lunch. ill take a look now | |
| 12:51:56 | dr_gogeta86 | hi guys | |
| 12:52:07 | dr_gogeta86 | who can help me with this nova-manage problem | |
| 12:52:18 | dr_gogeta86 | says doesn't have the grant for nova_api database | |
| 12:52:29 | dr_gogeta86 | but on the other two controllers is it ok | |
| 12:52:33 | dr_gogeta86 | with the same nova.conf | |
| 12:53:07 | tssurya | dr_gogeta86: are you sure the [api_database] is set on the nova.conf you are trying ? | |
| 12:53:30 | dr_gogeta86 | yep | |
| 12:53:39 | dr_gogeta86 | and is the same along controllers | |
| 12:53:56 | tssurya | what is the nova-manage command that you are running ? | |
| 12:54:00 | dr_gogeta86 | but the error says ... it tries without password | |
| 12:54:11 | dr_gogeta86 | /usr/bin/nova-manage --log-file /tmp/test_verbose --verbose api_db sync | |
| 12:54:43 | tssurya | ah auth issues..? | |
| 12:55:05 | tssurya | doesn't look like a "nova-manage problem" not sure then.. | |
| 12:56:32 | sahid | mriedem: that seemed good to have it, i don't have strong opinion, you probably have better of view than me in such topic | |
| 12:56:56 | mriedem | we can leave it, frickler also asked for one | |
| 12:57:06 | dr_gogeta86 | tssurya, i dunno | |
| 12:58:29 | dr_gogeta86 | write(1, "error: (pymysql.err.OperationalE"..., 115error: (pymysql.err.OperationalError) (1045, u"Access denied for user 'nova'@'10.20.105.31' (using password: NO)") | |
| 12:58:29 | dr_gogeta86 | even on nova | |
| 12:58:39 | mriedem | dr_gogeta86: same user trying to run nova-manage on all the systems with the same permissions? | |
| 12:58:50 | mriedem | compare the nova user permissions | |
| 12:58:54 | mriedem | or whatever you're using to run the command | |
| 12:59:09 | dr_gogeta86 | all nodes got the same nova.conf | |
| 12:59:19 | mriedem | i'm not talking about nova.conf | |
| 12:59:25 | dr_gogeta86 | how to check it ? | |
| 13:01:45 | mriedem | are you able to run other nova-manage commands? | |
| 13:02:47 | openstackgerrit | Matt Riedemann proposed openstack/nova master: libvirt: Always escape IPv6 addresses when used in migration URI https://review.openstack.org/589548 | |
| 13:03:45 | dr_gogeta86 | mriedem, no | |
| 13:03:55 | dr_gogeta86 | but i dunno why happen just in one node | |
| 13:04:02 | dr_gogeta86 | i've also checked the grant is there | |
| 13:05:46 | tssurya | mriedem: any known gate issues or do we just recheck? http://logs.openstack.org/50/594050/6/gate/tempest-slow/fe8c5c0/job-output.txt.gz#_2018-08-22_11_44_24_316767, http://logs.openstack.org/50/594050/6/gate/tempest-slow/fe8c5c0/job-output.txt.gz#_2018-08-22_11_48_21_890678 | |
| 13:06:02 | alex_xu | mriedem: yes, gmann is on vacation | |
| 13:07:18 | klosp | hi, does anyone have tips about the best way/docs to start learn how nova "works" internally? My goal in principle is not to commit anything, but I am working in a proof of concept where I would use OpenStack/nova to program an FPGA instead of booting VMs | |
| 13:10:17 | dr_gogeta86 | mriedem, i've strace it doesn't read nova.conf | |
| 13:13:08 | mriedem | tssurya: recheck | |
| 13:13:34 | mriedem | klosp: you probably want to talk to the cyborg team | |
| 13:18:17 | openstackgerrit | Merged openstack/nova stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky https://review.openstack.org/590731 | |
| 13:20:49 | klosp | mriedem: thanks for the tip. I am aware of cyborg project but I am looking for some simpler and faster solution for demo only. In my understanding cyborg need driver support also from vendor and I am not aware that the FPGA vendor I am using will support it in the short term | |
| 13:21:18 | openstackgerrit | Merged openstack/osc-placement stable/rocky: Update .gitreview for stable/rocky https://review.openstack.org/589773 | |
| 13:22:26 | dr_gogeta86 | if i allow a grant on mysql without password it works just on one node | |
| 13:22:32 | dr_gogeta86 | and doesn't work in the others | |
| 13:27:26 | openstackgerrit | Merged openstack/osc-placement stable/rocky: Update UPPER_CONSTRAINTS_FILE for stable/rocky https://review.openstack.org/589774 | |
| 13:29:36 | dr_gogeta86 | nova-manage where did he get db settings ? | |
| 13:29:44 | dr_gogeta86 | directly from nova.conf | |
| 13:29:48 | dr_gogeta86 | or some other service ? | |
| 13:44:15 | mriedem | dr_gogeta86: nova.conf | |
| 13:44:27 | dr_gogeta86 | doesn't fit | |
| 13:44:29 | mriedem | sean-k-mooney: is there anything bad that can happen if we are plugging an inactive port? | |
| 13:44:42 | dr_gogeta86 | i've replaced a strange value as address | |
| 13:44:50 | dr_gogeta86 | doesn't change in what i see with strace | |
| 13:45:18 | sean-k-mooney | mriedem: i am not sure. it would depend on the backend i think. | |
| 13:45:38 | mriedem | ovs | |
| 13:45:49 | mriedem | Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:a9:39,bridge_name='br-int',has_traffic_filtering=True,id=b835ff51-0262-4237-ab52-7b08206bd099,network=Network(6c9a79d8-b508-4a97-a15d-bf4acee8b4a8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb835ff51-02') | |
| 13:45:52 | sean-k-mooney | mriedem: for linux bridge we are just using brctl to say when a netdev with this name appears attach it to this bridge | |
| 13:46:35 | sean-k-mooney | for ovs its similar but depends on if its hybridg plug true/false or vhost-user | |