| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-02-07 | |||
| 17:46:10 | lyarwood | nikeshm: hmmm can you document this in a bug and I'll take a look this evening? I can't reproduce that locally on Fedora 24 | |
| 17:46:18 | sfinucan | so why don't we keep cells v1 (which doesn't have a complete migration path) and kill nova-net (which does - neutron) | |
| 17:46:42 | mriedem | sfinucan: because then we'd have to switch the cells v1 CI job to neutron, | |
| 17:46:52 | mriedem | and we don't have that external vif plugging callback stuff plumbed into cells v1 upstream | |
| 17:47:00 | mriedem | which would require work to make cells v1 work with nova in our CI | |
| 17:47:12 | mriedem | work we don't care to do for something that we're effectively crippling and setting up to remove | |
| 17:48:13 | sfinucan | mriedem: ah, so it's a non-trivial amount of work | |
| 17:48:19 | mriedem | correct | |
| 17:48:34 | sfinucan | Gotcha. I didn't get that link. Thanks for clearing it up | |
| 17:48:50 | mriedem | np | |
| 17:49:33 | sfinucan | mikal: Do I recall talk of file injection going away? | |
| 17:49:35 | sean-k-mooney | sfinucan: so back to your original question we proably have to keep that function untill cells v1 goes... or move it to the linux bridge os-vif driver | |
| 17:49:49 | sfinucan | sean-k-mooney: That would sound about right | |
| 17:50:19 | mriedem | blam! pike is the current focus of dev now https://launchpad.net/nova | |
| 17:50:33 | sfinucan | But we probably don't need to keep it after that point, because neutron can do what libvirt is doing here | |
| 17:51:24 | sfinucan | ...and what libvirt is doing probably wouldn't even work for folks using OVS and/or security groups, which is most people if the surveys are to be believed | |
| 17:55:58 | mriedem | sfinucan: i plan on proposing a spec for pike to deprecate file injection (personalities) in the REST API (outside of config drive anyway) | |
| 17:56:34 | mriedem | http://lists.openstack.org/pipermail/openstack-dev/2016-November/107195.html | |
| 17:56:35 | mdbooth | mriedem: Fun. Does that mean nobody is using that? | |
| 17:57:16 | mriedem | via config drive or the personality files or just in general? | |
| 17:57:32 | gabor_antal_ | Hey there, may I ask a question? Is it okay if I update test-requirements with a newer version of hacking? | |
| 17:57:45 | mdbooth | cfriesen mriedem: Incidentally, IIRC that also fails for config drives because we're constantly blowing config drives away and rebuilding them. | |
| 17:58:05 | mriedem | gabor_antal_: requirements changes to nova go through the openstack/requirements repo, and updating hacking there is a global change which impacts all projects, | |
| 17:58:10 | mriedem | gabor_antal_: so it's a large undertaking | |
| 17:58:55 | mriedem | mdbooth: http://lists.openstack.org/pipermail/openstack-dev/2016-November/107195.html was also in the operators list and go no responses | |
| 17:58:59 | auggy | nova bugs team meeting at the top of the hour in #openstack-meeting-4 ! | |
| 17:59:02 | mriedem | so i have no idea how much it's used | |
| 18:00:00 | johnthetubaguy | honestly, I am not sure as operators if they would know either | |
| 18:00:04 | openstackgerrit | Diana Clarke proposed openstack/nova master: Reduce the number of COMMIT & SELECT 1 statements https://review.openstack.org/430390 | |
| 18:00:09 | gabor_antal_ | mriedem: Should we propose to that repo or where? I just checked the new hacking, and has a great feature | |
| 18:00:40 | mriedem | gabor_antal_: if you're going to propose it, it starts in the openstack/requirements repo | |
| 18:03:46 | gabor_antal_ | mriedem: I think I wanted to push this, but that is already merged: https://review.openstack.org/#/c/409626/ | |
| 18:04:31 | mriedem | gabor_antal_: oh so we just need to update https://github.com/openstack/nova/blob/master/test-requirements.txt#L5 | |
| 18:04:48 | mriedem | i didn't realize hacking was excluded from global updates | |
| 18:04:53 | mriedem | then i guess it's simpler since it's just nova | |
| 18:05:19 | gabor_antal_ | Yeah, so then it's okay if I modify this line, | |
| 18:35:09 | openstackgerrit | Matthew Booth proposed openstack/nova master: libvirt: Fix races with nfs volume mount/umount https://review.openstack.org/383859 | |
| 18:52:22 | openstackgerrit | Sean McCully proposed openstack/nova master: allocations.consumer_id is not used in query. https://review.openstack.org/430399 | |
| 19:00:25 | openstackgerrit | John Garbutt proposed openstack/nova master: Stop _undefine_domain erroring if domain not found https://review.openstack.org/430400 | |
| 19:02:58 | cdent | edleafe, bauzas: didn't we already have a fix like 430399 ^^ before? | |
| 19:15:05 | openstackgerrit | John Garbutt proposed openstack/nova master: WIP: Stop leaving failed live-migrates in the migrating state https://review.openstack.org/430404 | |
| 19:15:43 | cdent | edleafe, bauzas never mind, it's not, it's the same problem somewhere else | |
| 19:17:05 | johnthetubaguy | mriedem: FYI, there seems to be another nastly little live-migrate bug that has cropped up in our testing: https://review.openstack.org/430400 | |
| 19:17:21 | johnthetubaguy | mriedem: still investigation, just a general heads up that stuff is cooking there | |
| 19:19:52 | mriedem | johnthetubaguy: ok i've left my -1 for your dessert :) | |
| 19:24:12 | openstackgerrit | Sean McCully proposed openstack/nova master: allocations.consumer_id is not used in query. https://review.openstack.org/430399 | |
| 19:50:24 | openstack | Launchpad bug 1662626 in OpenStack Compute (nova) "live-migrate left in migrating as domain not found" [Undecided,In progress] - Assigned to John Garbutt (johngarbutt) | |
| 19:50:24 | cfriesen | johnthetubaguy: got a theory on the race in https://bugs.launchpad.net/nova/+bug/1662626 between live migration and deletion. instance deletion synchronizes on instance.uuid, but I don't think _post_live_migration() does. | |
| 20:02:31 | johnthetubaguy | cfriesen: it could be, I need to look at what the periodic tasks are doing, there is just a loop of live-migrates on a test rig for this test, AFAIK. | |
| 20:02:50 | johnthetubaguy | mriedem: yeah, you are right, I meant to look that up, but wanted dinner | |
| 20:04:51 | cfriesen | question...if instance.old_flavor refers to a deleted flavor, will it still be able to load it from the DB? | |
| 20:28:52 | mriedem | cfriesen: yes | |
| 20:29:08 | mriedem | the old_flavor is stored in the extras table | |
| 20:29:26 | mriedem | *instance_extra | |
| 20:38:14 | cfriesen | do we allow resizing from a flavor with ephemeral/swap to a flavor without? I only see a check for root_gb. | |
| 20:38:18 | cfriesen | mriedem: thanks | |
| 20:43:20 | openstackgerrit | Emilien Macchi proposed openstack/nova master: DNM - test tripleo without nova api in WSGI/apache https://review.openstack.org/429008 | |
| 20:43:49 | openstackgerrit | Maciej Szankin proposed openstack/nova master: conf: mark glance.api_servers opt as required https://review.openstack.org/428241 | |
| 21:03:15 | smcginnis | johnthetubaguy: Start here: https://review.openstack.org/#/c/297140/ | |
| 21:03:28 | smcginnis | johnthetubaguy: Then here: https://review.openstack.org/#/c/346438/ | |
| 21:04:28 | smcginnis | johnthetubaguy: Actually, the second one isn't the one I was looking for. This one might be more interesting: https://review.openstack.org/#/c/346470/ | |
| 21:07:27 | openstackgerrit | Diana Clarke proposed openstack/nova master: Reduce the number of COMMIT & SELECT 1 statements https://review.openstack.org/430390 | |
| 21:11:28 | johnthetubaguy | smcginnis: cool, thank you, something for the morning :) | |
| 21:12:40 | smcginnis | ;) | |
| 21:15:34 | cdent | diana_clarke: I want to subscribe to your newsletter | |
| 21:19:14 | diana_clarke | cdent: Nah... it's just a low-hanging fruit, migration 216 only, thing. Nothing much to see there. | |
| 21:20:06 | cdent | diana_clarke I don't know, there's just something fascinating about the collected works of your commits. Not sure what it is. | |
| 21:23:00 | diana_clarke | cdent: perhaps it's because I have no clue what openstack is, so my commits always dance around that, lol. | |
| 21:23:36 | cdent | oh you still worry about that? yeah, apparently you're supposed to stop worrying about that and just accept it | |
| 21:24:28 | artom | diana_clarke, don't tell anyone, openstack is everything to everyone | |
| 21:26:29 | mriedem | diana_clarke: any numbers on how much faster that makes that migration? | |
| 21:26:54 | mriedem | i came across an open nova bug last week from tripleo about how the nova db migrations were timing them out | |
| 21:26:55 | artom | Telcos want to orchestrate some NFV stuff, Rackspace wants a webhosting cloud, you want a job, and I want something I can use to forget the loneliness when alcohol isn't doing it | |
| 21:27:17 | mriedem | artom: there is always opium | |
| 21:27:54 | artom | mriedem, that's next on the list: 1. Alcohol 2. Openstack 3. Opium 4. ??? 5. Profit! | |
| 21:28:05 | cdent | artom, that's the best description of openstack I've ever read | |
| 21:28:08 | artom | I'll proll'y never reach 5 though | |
| 21:28:34 | openstack | Launchpad bug 1661396 in OpenStack Compute (nova) "undercloud install fails (nova-db-sync timeout) on VM on an SATA disk hypervisor" [Undecided,Incomplete] | |
| 21:28:34 | mriedem | diana_clarke: this one https://bugs.launchpad.net/nova/+bug/1661396 | |
| 21:28:45 | artom | cdent, :) | |
| 21:28:55 | dansmith | mriedem: that's ours and it's something with our setup as far as we can tell | |
| 21:29:23 | mriedem | "This seems to be related to the switch to innodb_file_per_table to ON which has doubled the amount of time the db sync takes on this class of hardware." | |
| 21:29:54 | diana_clarke | mriedem: It doesn't make 216 all that much faster, just a few seconds. Here are the nova db migrations, sorted slowest to fastest: http://paste.openstack.org/show/598003/ | |
| 21:29:57 | dansmith | it's way more than double, it's like 100x or something | |
| 21:30:52 | mriedem | heh, 267 is mine | |
| 21:30:56 | mriedem | \o/ | |
| 21:31:13 | mriedem | but that's also because it's scanning all of the tables | |
| 21:31:35 | cdent | https://www.percona.com/blog/2015/02/24/mysqls-innodb_file_per_table-slowing/ | |
| 21:31:46 | cdent | "Many of you in the audience are responsible for running automated tests on your codebase before deploying to production" | |
| 21:31:53 | diana_clarke | mriedem: I started looking at them b/c of that tripleo bug, but honestly I don't think this will help much. Something else is up (like dansmith already said, I see now). | |
| 21:32:07 | dansmith | yep | |
| 21:32:38 | dansmith | but if it makes unit tests faster and doesn't alter the schema at all, then that's cool, although I'm skeptical since we cache the schema the first time we create it in the fixture | |
| 21:33:19 | diana_clarke | dansmith: before I take the WIP off my patch, I'll do a DB dump before and after and diff them. It's already on my TODO list. | |
| 21:33:40 | dansmith | diana_clarke: excellent, thanks | |
| 21:34:09 | diana_clarke | mriedem: And here are the api database migration times, if you're curious. This time sorted by migration number: http://paste.openstack.org/show/598005/ | |
| 21:36:06 | mriedem | diana_clarke: fyi https://github.com/openstack/nova/blob/master/tools/db/schema_diff.py | |
| 21:36:19 | mriedem | dprince wrote that when he was collapsing migrations way back when | |
| 21:36:32 | diana_clarke | mriedem: ah, thanks! | |
| 22:05:31 | pumaranikar | sdague, can you please check https://review.openstack.org/#/c/395194/. Placement json formatter change. | |
| 22:10:44 | openstackgerrit | Diana Clarke proposed openstack/nova master: Reduce the number of COMMIT & SELECT 1 statements https://review.openstack.org/430390 | |