| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-05-31 | |||
| 23:24:17 | tasker | function named 'fsFreeze'. The only bug report I've found referencing is from last May and says to use libvirt >= 1.2.5.. what am I missing? anyone have any ideas? | |
| 23:27:07 | clarkb | tasker: what version of libvirt and what version of libvirt-python? | |
| 23:27:48 | tasker | using OSA, the venv has 1.3.2, the dpkg for the system wide is 1.3.1 | |
| 23:28:18 | mriedem | you need at least libvirt 1.2.5 | |
| 23:28:35 | cfriesen_ | can you run "virsh domfsfreeze" manually on the compute node? | |
| 23:28:39 | mriedem | fsFreeze is a function on libvirt-python i believe | |
| 23:28:40 | tasker | nova calls oslo_utils.importutils.import_module("libvirt") which pulls in the 1.3.2 found in /openstack/venvs/nova/lib/python2.7/site-packages/libvirt.py | |
| 23:29:04 | cfriesen_ | what version is your actual libvirt though? | |
| 23:29:14 | mriedem | you also need hw_qemu_guest_agent in the image | |
| 23:29:52 | cfriesen_ | tasker: what does "virsh --version" give? | |
| 23:30:13 | tasker | 'virsh --version' reports "1.3.1" | |
| 23:30:25 | tasker | and I can call and issue domfsfreeze manually. | |
| 23:30:55 | mriedem | seems like a problem with the libvirt-python package, | |
| 23:31:03 | tasker | myproblem is that there is no function called fsFreeze. | |
| 23:31:19 | mriedem | people have reported issues like this before where libvirt and the libvirt-python package say they are at a certain version but the python binding is actually old or missing some things | |
| 23:31:34 | clarkb | the way libvirt-python works is it exposes the features of libvirt that it was built against | |
| 23:31:36 | cfriesen_ | tasker: what's your "virt_type"? | |
| 23:31:36 | mriedem | i'm not really sure how | |
| 23:31:48 | clarkb | so if you installed via a wheel or similar that was built against an old version of libvirt that could explain it | |
| 23:31:54 | tasker | virt_type = 'kvm' | |
| 23:32:12 | tasker | clarkb: i like that explanation. it makes a lot of sense. | |
| 23:32:29 | clarkb | pip install --no-binary -U libvirt-python should force it to rebuild though that will affect whatever system you build against | |
| 23:32:36 | openstack | Launchpad bug 1539506 in Ubuntu Cloud Archive liberty "AttributeError: 'virDomain' object has no attribute 'fsFreeze" [Medium,Fix committed] | |
| 23:32:36 | mriedem | https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1539506 | |
| 23:33:25 | tasker | mriedem: that bug only says what you've mentioned regarding libvirt versions and where to get updated ones. I did not find it helpful. | |
| 23:33:42 | mriedem | ok i can't tell if they put out an updated libvirt-python for mitaka or not | |
| 23:33:50 | tasker | your's and clark's mention of misbuilt packages makes a lot more sense. | |
| 23:34:06 | tasker | neither could I; hence my coming here. | |
| 23:34:29 | tasker | clarkb: I'll give that pip incantation a shot. | |
| 23:35:24 | tasker | could you explain how doing that would affect "whatever system you bulid against" in some more detail? | |
| 23:35:58 | clarkb | tasker: it will overwrite any existing libvirt-python install potentially breaking other working functionality :) | |
| 23:36:04 | clarkb | It should be safe though | |
| 23:36:17 | tasker | ahh .. ok. so backups for everyone! | |
| 23:37:10 | tasker | now, I use OSA which puts a lot of the bits into virtual environments. I'm thinking I want to do this there (in the venv) and not for the system-wide libvirt-python. | |
| 23:37:38 | mriedem | i can only find https://launchpadlibrarian.net/242454264/libvirt-python_1.3.1-1ubuntu1~cloud0_source.changes | |
| 23:37:49 | mriedem | for the change log for libvirt-python in mitaka UCA | |
| 23:38:07 | tasker | mriedem: thanks! I"ll take a look. | |
| 23:38:19 | mriedem | jamespage is probably the person you need to reach out to, | |
| 23:38:25 | mriedem | he's in the UK so you'll have to try later | |
| 23:39:03 | tasker | right. I'll try clarkb's method first and come back to let you know of success / disaster. | |
| 23:40:15 | tasker | b'ah -- "Requirement already up-to-date". this is going to be a bit trickier. | |
| #openstack-nova - 2017-06-01 | |||
| 00:01:38 | openstackgerrit | melanie witt proposed openstack/nova master: Add FixedIP.get_count_by_project() https://review.openstack.org/446246 | |
| 00:01:39 | openstackgerrit | melanie witt proposed openstack/nova master: Add FloatingIP.get_count_by_project() https://review.openstack.org/446247 | |
| 00:01:40 | openstackgerrit | melanie witt proposed openstack/nova master: Add get_count_by_vm_state() to Instance object https://review.openstack.org/446244 | |
| 00:01:42 | openstackgerrit | melanie witt proposed openstack/nova master: Add SecurityGroup.get_counts() https://review.openstack.org/446245 | |
| 00:01:43 | openstackgerrit | melanie witt proposed openstack/nova master: Remove 'reserved' count from used limits https://review.openstack.org/446242 | |
| 00:01:44 | openstackgerrit | melanie witt proposed openstack/nova master: Remove useless quota_usage_refresh from nova-manage https://review.openstack.org/446243 | |
| 00:01:45 | openstackgerrit | melanie witt proposed openstack/nova master: Count server groups to check quota https://review.openstack.org/446240 | |
| 00:01:46 | openstackgerrit | melanie witt proposed openstack/nova master: Count networks to check quota https://review.openstack.org/446241 | |
| 00:01:49 | openstackgerrit | melanie witt proposed openstack/nova master: Count instances to check quota https://review.openstack.org/416521 | |
| 00:01:53 | openstackgerrit | melanie witt proposed openstack/nova master: Add InstanceGroup.get_counts() https://review.openstack.org/457857 | |
| 00:01:54 | openstackgerrit | melanie witt proposed openstack/nova master: Add InstanceGroup._remove_members_in_db https://review.openstack.org/457858 | |
| 00:01:59 | openstackgerrit | melanie witt proposed openstack/nova master: Count server group members to check quota https://review.openstack.org/457859 | |
| 00:02:00 | openstackgerrit | melanie witt proposed openstack/nova master: Count security groups to check quota https://review.openstack.org/457860 | |
| 00:02:06 | openstackgerrit | melanie witt proposed openstack/nova master: Make Quotas object favor the API database https://review.openstack.org/410945 | |
| 00:02:07 | openstackgerrit | melanie witt proposed openstack/nova master: Count fixed ips to check quota https://review.openstack.org/457861 | |
| 00:02:09 | openstackgerrit | melanie witt proposed openstack/nova master: Add online migration to move quotas to API database https://review.openstack.org/410946 | |
| 00:02:12 | openstackgerrit | melanie witt proposed openstack/nova master: Count floating ips to check quota https://review.openstack.org/457862 | |
| 00:11:27 | cfriesen_ | anyone know offhand of reported issues with upgrading from kilo but the service version being stuck at 0? | |
| 00:13:26 | masber | good morning all, to which nova config file do I need to add the parameter dhcp_domain? | |
| 00:14:36 | melwitt | cfriesen_: are you using the nova-api wsgi script? it doesn't work properly with service records so it will always see service version 0 https://github.com/openstack/nova/blob/master/nova/wsgi/nova-api.py | |
| 00:15:12 | cburgess | @masbar it needs to be read by the metadata service. So usually just nova.conf | |
| 00:15:20 | cburgess | @masber ^^^^ | |
| 00:16:42 | cfriesen_ | melwitt: we did a kilo->mitaka upgrade, and all the services except for nova-osapi_compute and nova-metadata are stuck on version 0 even if I do things like disable/enable them. I'm trying to figure out why we're not writing the new service version of 9 to the DB | |
| 00:17:22 | cfriesen_ | this has run fine for a long time, but now I can't run the online migrations script in Mitaka since it fails the minimum version check | |
| 00:17:47 | cfriesen_ | I'm guessing we missed something from liberty since we skipped it, but not sure what | |
| 00:18:51 | melwitt | by skipped it do you mean you didn't run "nova-manage db sync" with the liberty code? | |
| 00:19:25 | melwitt | and "nova-manage db online_data_migrations" | |
| 00:19:26 | cfriesen_ | melwitt: no, we ran that from mitaka | |
| 00:19:45 | cfriesen_ | and I dont' think there was an online_data_migrations for liberty | |
| 00:19:46 | tasker | some victory. I was unable to use clarkb's 'pip' incantantion, but I did uninstall the libvirt-python from the venv and link in the libvirt files from the system-wide libivrt-python installed via the package manager. | |
| 00:19:55 | melwitt | okay. that might be a problem. would have to read through the liberty relnotes to see what, if anything was missed | |
| 00:20:15 | cfriesen_ | I did read the relnotes and didn't see anything suspicious, but will check again | |
| 00:20:19 | tasker | so, the idea that the libvirt module I'm using is incomplete has some evidence to back it up. now I need to figure out what happened where it came from. | |
| 00:20:41 | melwitt | I don't know off the top of my head details about how the service version stuff got set up when it was introduced | |
| 00:20:48 | tasker | clarkb: and mriedem: thank you for your help. | |
| 00:22:10 | tasker | I wonder if OSA is responsible for building the libvirt binary module itself or if it pulls in a pre-compiled module from some central repo. | |
| 00:22:11 | clarkb | tasker: fwiw you can also create virtualenvs wit system libs with a flag | |
| 00:23:03 | cfriesen_ | melwitt: don't see anything in the nova upgrade notes for either liberty or mitaka. there's hardly anything in the liberty notes | |
| 00:23:13 | melwitt | the liberty notes are really sparse. guess that was back when we didn't add many | |
| 00:26:53 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: adds REST API for nested providers https://review.openstack.org/384807 | |
| 00:26:54 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: allow filter providers in tree https://review.openstack.org/377215 | |
| 00:26:55 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: adds ProviderTree for nested resources https://review.openstack.org/415920 | |
| 00:26:55 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: integrate ProviderTree to report client https://review.openstack.org/415921 | |
| 00:26:56 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: add nested resource providers https://review.openstack.org/377138 | |
| 00:26:56 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: update client to set parent provider https://review.openstack.org/385693 | |
| 00:32:40 | openstackgerrit | Merged openstack/nova master: libvirt: expand checks for SubclassSignatureTestCase https://review.openstack.org/464765 | |
| 00:32:53 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: test for agg association not sharing https://review.openstack.org/461901 | |
| 00:32:53 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: tests for non-shared with shared https://review.openstack.org/461899 | |
| 00:32:54 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: shared resources when finding providers https://review.openstack.org/461574 | |
| 00:32:54 | openstackgerrit | Jay Pipes proposed openstack/nova master: placement: test non-shared out of inventory https://review.openstack.org/461900 | |
| 00:33:15 | jaypipes | dansmith: addressed your concerns and all the commit message over-wraps :) | |
| 00:33:19 | jaypipes | on ^^ | |
| 00:37:04 | masber | cburgess, I did the deployment with kolla, which I mean I have multiple nova.conf files for each container... I think I will need to ask them | |
| 00:37:08 | openstackgerrit | Merged openstack/nova master: libvirt: wait for interface detach from the guest https://review.openstack.org/349014 | |
| 00:38:15 | masber | Also I would like to ask, I am having an issue with designate and nova. Somehow my vms got the domain from designate after instance creation, however the domain moves from designate to novalocal after reboot, any idea? | |
| 00:45:53 | openstackgerrit | Merged openstack/nova master: Handle conflict from neutron when addFloatingIP fails https://review.openstack.org/468136 | |
| 00:46:27 | cfriesen_ | melwitt: looks like we're missing https://github.com/openstack/nova/commit/854c39e26d94f006f539ea993ffaafa4892b100c from stable/mitaka | |
| 00:49:06 | openstack | Launchpad bug 1579839 in OpenStack Compute (nova) mitaka "Service version does not update on restart" [High,Fix committed] - Assigned to Brian Elliott (belliott) | |
| 00:49:06 | melwitt | cfriesen_: hm, it says it was backported to mitaka though, in 13.1.2 https://bugs.launchpad.net/nova/+bug/1579839 | |