| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-06-13 | |||
| 19:29:23 | mriedem | jmlowe: the testing on that patch is spectacular | |
| 19:29:44 | jmlowe | .... | |
| 19:30:09 | mriedem | having said that, i don't speak heat code so not sure what you're seeing for failures | |
| 19:30:11 | jmlowe | my mother did teach me that if I have nothing nice to say | |
| 19:30:12 | mriedem | check the nova-api logs? | |
| 19:30:25 | mriedem | jmlowe: if the server group was created successfully, then that's not the issue | |
| 19:30:31 | mriedem | do you have the proper scheduler filters enabled? | |
| 19:30:57 | mriedem | https://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#servergroupaffinityfilter | |
| 19:31:04 | mriedem | note the affinity filters are enabled by default, | |
| 19:31:06 | mriedem | as is the soft weigher | |
| 19:31:21 | mriedem | https://docs.openstack.org/nova/latest/admin/configuration/schedulers.html#id15 | |
| 19:31:25 | jaypipes | melwitt: :) | |
| 19:32:11 | mriedem | god our docs are confusing for people new to nova and cells v2 | |
| 19:32:12 | mriedem | "If cells are used, cells are weighted by the scheduler in the same manner as hosts." | |
| 19:32:14 | jmlowe | http://paste.openstack.org/show/723412/ | |
| 19:32:30 | jmlowe | I should have the defaults | |
| 19:32:32 | mriedem | we should asterisk all 'cells' mentions in the docs :) | |
| 19:32:57 | melwitt | bugathon candidate | |
| 19:33:04 | jmlowe | single v2 cell, I'm on pike | |
| 19:33:34 | mriedem | jmlowe: looks like 2.15 isn't specified | |
| 19:33:41 | jmlowe | grumble | |
| 19:33:43 | mriedem | jmlowe: is there something in the logs right before that with the request id and microversion? | |
| 19:34:20 | mriedem | jmlowe: you could just creating one on the command line as a test | |
| 19:34:47 | mriedem | openstack --os-compute-api-version 2.15 server group create --policy soft-anti-affinity jmlowe-test | |
| 19:35:21 | jmlowe | openstack server group create: error: argument --policy: invalid choice: u'soft-anti-affinity' (choose from 'affinity', 'anti-affinity') | |
| 19:35:26 | jmlowe | so... | |
| 19:36:02 | mgagne | mriedem: thanks for allocation healer =) | |
| 19:37:12 | jmlowe | I don't have available_filters or enabled_filters in my nova.conf | |
| 19:38:25 | jmlowe | also default for scheduler_driver | |
| 19:40:00 | mriedem | jmlowe: you have to specify the microversoin with osc | |
| 19:40:09 | mriedem | explicitly, it's not like nova cli | |
| 19:40:22 | mriedem | mgagne: thanks for kicking the tires - glad it's working out for you | |
| 19:40:43 | mriedem | jmlowe: hmm, which version of osc | |
| 19:40:43 | mriedem | ? | |
| 19:41:00 | mriedem | openstack server group create --help | |
| 19:41:05 | mriedem | that will tell you if it's new enough | |
| 19:41:12 | mgagne | mriedem: now time to see how to upgrade to Queens now that part of job is done already =) | |
| 19:41:25 | jmlowe | openstack 3.12.0 | |
| 19:41:34 | mriedem | https://review.openstack.org/#/c/521397/ | |
| 19:41:35 | mriedem | doh | |
| 19:41:38 | mriedem | you need <= 3.15 | |
| 19:41:40 | mriedem | * | |
| 19:41:42 | mriedem | >=3.15 | |
| 19:42:03 | mriedem | jmlowe: ooo 3.12.1 https://review.openstack.org/#/c/523858/ | |
| 19:42:05 | mriedem | pick that up | |
| 19:42:12 | mriedem | or use nova cli | |
| 19:42:48 | melwitt | +W needed on this change to "reserve" an ironic node up front before beginning the spawn process https://review.openstack.org/563722 | |
| 19:42:57 | melwitt | if anyone's interested | |
| 19:42:59 | jmlowe | same error on 3.15.0 | |
| 19:43:00 | mriedem | https://docs.openstack.org/python-novaclient/latest/cli/nova.html#nova-server-group-create | |
| 19:43:11 | mriedem | jmlowe: did you specify --os-compute-api-version 2.15? | |
| 19:45:55 | jmlowe | (openstack) Mikes-MacBook-Pro-3:~ jmlowe$ openstack --os-compute-api-version 2.15 server group create --policy soft-anti-affinity jmlowe-test | |
| 19:46:29 | jmlowe | that patch was in my cli | |
| 19:47:57 | mriedem | and that fails? | |
| 19:48:08 | mriedem | openstack --version | |
| 19:48:08 | mriedem | ? | |
| 19:49:57 | jmlowe | X-OpenStack-Nova-API-Version: 2.15 is in the request, ran with debug | |
| 19:50:11 | jmlowe | that version was 3.15.0 | |
| 19:50:16 | mriedem | and you got a 400? | |
| 19:50:30 | jmlowe | yes | |
| 19:50:35 | mriedem | pike? | |
| 19:50:43 | jmlowe | yes | |
| 19:51:05 | jmlowe | nova 16.1.4 | |
| 19:52:45 | mriedem | this all looks fine to me https://github.com/openstack/nova/blob/stable/pike/nova/api/openstack/compute/server_groups.py#L151 | |
| 19:53:19 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add trusted_image_certificates to REST API https://review.openstack.org/486204 | |
| 19:53:20 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add notification support for trusted_certs https://review.openstack.org/563269 | |
| 19:53:21 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add certificate validation docs https://review.openstack.org/560158 | |
| 19:53:22 | openstackgerrit | Matt Riedemann proposed openstack/nova master: WIP: Add trusted certs to feature support matrix docs https://review.openstack.org/574890 | |
| 19:53:23 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Remove max_size parameter from fake_libvirt_utils.fetch_*image methods https://review.openstack.org/574911 | |
| 19:53:26 | mriedem | bpoulos: melwitt: ^ | |
| 19:57:10 | mriedem | jmlowe: i'm stumped | |
| 19:58:44 | bpoulos | mriedem: thank you for making those updates! | |
| 20:00:39 | mriedem | mgagne: were you working a patch for bug 1776743? if not, i can start on that | |
| 20:00:40 | openstack | bug 1776743 in OpenStack Compute (nova) "Allocation healer should ignore deleted instances" [High,Triaged] https://launchpad.net/bugs/1776743 - Assigned to Matt Riedemann (mriedem) | |
| 20:02:41 | mgagne | mriedem: didn't start work yet. but I found that you need to update filters at 2 places just so you know | |
| 20:03:27 | mriedem | mgagne: yup, the 2 places i pointed out? :P | |
| 20:03:51 | mgagne | only saw one? might be be that didn't read carefully as usual. | |
| 20:04:12 | mgagne | yea... just me being myself :-/ | |
| 20:05:44 | jmlowe | I'm looking for some way I may have restricted the max microversion | |
| 20:08:31 | jmlowe | Is there some way I may be stuck in v2 compatibility mode? | |
| 20:11:10 | melwitt | jmlowe: check the url in the service catalog (apologies if this has been said before in previous scrollback). it should end in /v2.1 | |
| 20:11:18 | mriedem | jmlowe: hmm, i wouldn't think so, were you hitting any microversions beyond 2.1 before pike? | |
| 20:11:30 | mriedem | might want to also check your api-paste.ini | |
| 20:11:41 | melwitt | I've seen people get stuck if they had an old url that ends in /v2.0, that would prevent you from ever getting any new microversions | |
| 20:11:51 | jmlowe | https://iu.jetstream-cloud.org:8774/v2/e0c43302e9a740a480d05381d20aa66e/os-server-groups | |
| 20:14:01 | jmlowe | hmm which probably comes from /v2/%(tenant_id)s | |
| 20:15:26 | melwitt | I think that v2 there is wrong, that will prevent you from getting microversions | |
| 20:15:39 | melwitt | it should be v2.1 | |
| 20:15:58 | jmlowe | yep, that endpoint dates all the way back to kilo probably | |
| 20:16:18 | jmlowe | and I now get my microversions | |
| 20:16:40 | melwitt | yeah, the folks at Oath ran into the same thing, upgrading from Juno, they had an old school url in the service catalog that they needed to update to v2.1 | |
| 20:17:24 | jmlowe | thanks melwitt and mriedem! | |
| 20:18:16 | mriedem | i was just wondering that too | |
| 20:18:21 | melwitt | we have a cells v2 faq but not a general faq | |
| 20:18:24 | mriedem | we don't really have faqs, only for cells v2 | |
| 20:18:45 | mriedem | it's likely already on ask.o.o but not sure how discoverable it would be since it's a really obscure problem | |
| 20:19:08 | mriedem | it wouldn't be asked as "microversions don't work", it would be, "operation foo" doesn't work | |
| 20:19:50 | melwitt | yeah, agreed | |
| 20:21:13 | mriedem | the endpoint creation here in the install guide is correctly v2.1 https://docs.openstack.org/nova/latest/install/controller-install-ubuntu.html | |
| 20:21:23 | mriedem | but there is/was nothing like that for upgrades from pre-microversions to microversions | |