| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-04-11 | |||
| 16:21:30 | cdent | sdague: avolkov is working on getting the publishing jobs linked up right. the html drafts are created but not linking into the test results yet | |
| 16:21:46 | sdague | cdent: is the publishing job up for review anywhere? | |
| 16:22:19 | openstack | Launchpad bug 1680363 in OpenStack Compute (nova) "Raise Unexpected API Error when get console log from stopped instance" [Undecided,In progress] - Assigned to Zhenyu Zheng (zhengzhenyu) | |
| 16:22:19 | mriedem | markus_z: https://bugs.launchpad.net/nova/+bug/1680363 | |
| 16:22:33 | mriedem | markus_z: UnboundLocalError on https://github.com/openstack/nova/blob/master/nova/virt/libvirt/driver.py#L2801 | |
| 16:22:43 | sdague | traits seems big enough I don't want us to be digging too giant of a hole on the docs side, as we know how long it takes to dig out from the past nova experience | |
| 16:23:07 | cdent | sdague: the initial ones have merged, last I talked to avolkov there's more that's WIP, but I don't currently have the details | |
| 16:24:02 | cdent | https://review.openstack.org/#/q/project:openstack-infra/project-config+owner:avolkov%2540mirantis.com+status:merged | |
| 16:25:40 | sdague | cdent: yeh, doesn't seem like any open patches | |
| 16:25:59 | cdent | yeah, I think in this case WIP means "on his disk" | |
| 16:26:29 | sdague | ok | |
| 16:28:17 | cdent | sdague: since we're in the same place at the same time, did you see that I left some notes on the uwsgi etherpad, just some playing around with options https://etherpad.openstack.org/p/devstack-uwsgi ? | |
| 16:28:28 | sdague | cdent: sure | |
| 16:28:39 | openstackgerrit | melanie witt proposed openstack/nova-specs master: Amend spec for placement project/user association https://review.openstack.org/454352 | |
| 16:29:07 | sdague | so the line 85 bit | |
| 16:29:12 | cdent | it's opened some question on what we're actually trying to accomplish with uwsgi, logs, etc. because, as ever, there are options... | |
| 16:29:28 | sdague | can you do that without ports | |
| 16:30:29 | sdague | what I'd really like to do is find a way to not have the custom ports used anywhere | |
| 16:30:59 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: Make all timestamps formats equal https://review.openstack.org/421981 | |
| 16:31:49 | sdague | which I think means, 1 http server with a lot of /paths, talking to a bunch of uwsgi processes over the local app socket | |
| 16:32:02 | cdent | line 85 can do that | |
| 16:32:31 | sdague | cdent: that I think gets us the most win | |
| 16:33:12 | cdent | is the port issue to make sure that nothing connects to the port (even over localhost) because the first example binds to localhost only, so isn't externally exposed. | |
| 16:33:48 | markus_z | mriedem: OK, will review it tomorrow. Thanks for the notice | |
| 16:35:01 | mordred | sdague: btw - if you get rid of the custom ports, I will buy you a unicornpony | |
| 16:35:03 | mriedem | markus_z: nvm it's latent anyway | |
| 16:35:09 | mriedem | markus_z: easy fix, it's not a regression | |
| 16:36:01 | sdague | cdent: I want nothing to connect to it, because we still have collisions if we require them anywhere | |
| 16:36:13 | sdague | cdent: I'm starting a new bit at the top about behaviors of the system | |
| 16:36:33 | cdent | sdague: cool, I'll build the example of the l85 version tonight or tomorrow morning, and dump its implications when I do. should be simple-ish | |
| 16:39:00 | sdague | cdent: yeh, before you run off, look at my list of behaviors at the top of that etherpad | |
| 16:39:08 | sdague | and make sure they make sense | |
| 16:39:52 | cdent | they do make sense, thanks for that, will leave some comments | |
| 16:41:57 | cdent | sdague: one question about logs: coming from a webby background I think in terms of an access log and and error log, as showin in one of the examples lower in the doc. uwsgi can have specific request logs if configured to do so but I'm not sure if those logs can go to systemd in the same was as the error log, does that matter | |
| 16:43:03 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: fix null_safe_int when called with 0 https://review.openstack.org/455778 | |
| 16:43:05 | sdague | cdent: we're going to be hooking the journal directly in the oslo.log setup I think | |
| 16:43:41 | sdague | i.e. I think we're going to straight bypass that ... but we'll see | |
| 16:44:13 | cdent | okay, but what about request logs (of the access_log vareity). do they matter? | |
| 16:44:51 | cdent | for me they've always been at least as important as the log messages generated by LOG.*('some message') | |
| 16:45:03 | openstackgerrit | melanie witt proposed openstack/nova-specs master: Amend spec for placement project/user association https://review.openstack.org/454352 | |
| 16:49:02 | sdague | cdent: honestly, I don't think the access logs are all that useful one way or another, because they are lacking all the identifiable information about request-id / project-id / user-id that let you dig any deeper about what was going on | |
| 16:49:17 | sdague | mostly only really for high level statistics I think | |
| 16:49:33 | bauzas | p!spy | |
| 16:49:44 | sdague | at least that's how I react when I look at something like this - http://logs.openstack.org/31/450431/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/38bb8c6/logs/apache/tls-proxy_access.txt.gz | |
| 16:49:48 | cdent | huh, I think they're the least noisy way to answer the question: is the service getting the hits I expect | |
| 16:50:08 | cdent | but it's not really an issue, that info is a variety of places | |
| 16:52:08 | sdague | yeh, and with the journal, that should be a better way to see it. The logging standards are that those things should be in the INFO block, which should be easy to query. | |
| 16:52:55 | melwitt | has anyone seen a docs job failure like this? "WARNING: no "man_pages" config value found; no manual pages will be written" | |
| 16:53:11 | dansmith | melwitt: my docs job is failing too | |
| 16:56:34 | openstackgerrit | Balazs Gibizer proposed openstack/nova master: fix null_safe_int when called with 0 https://review.openstack.org/455778 | |
| 16:59:36 | jaypipes | bauzas: have you checked out https://etherpad.openstack.org/p/new-instance-reservation ? | |
| 17:00:17 | openstack | sdague: Error: Could not gather data from Launchpad for bug #1681658 (https://launchpad.net/bugs/1681658). The error has been logged | |
| 17:00:17 | sdague | jaypipes / bauzas / cdent - https://bugs.launchpad.net/nova/+bug/1681658 | |
| 17:00:29 | sdague | oh... thank you openstack bot :P | |
| 17:01:21 | cdent | sdague: that's correct behavior: max_unit means you can't have more than max_unit | |
| 17:01:30 | cdent | it's doesn't depend on allocation_ratio | |
| 17:01:54 | cdent | total capacity does | |
| 17:02:10 | sdague | cdent: ok, cool, can you update the bug with why it's a Won't Fix then? | |
| 17:02:13 | cdent | sdague: you wanna get that or shall I? | |
| 17:02:17 | cdent | jinxish | |
| 17:02:21 | cdent | yeah, will do | |
| 17:03:56 | sfinucan | dansmith, melwitt: It's a broken gate. There was a bot message on infra or docs a while back | |
| 17:04:08 | dansmith | sfinucan: that was for the py3 thing | |
| 17:04:13 | dansmith | which was supposedly already fixed | |
| 17:04:29 | sfinucan | Oh, wait - different issue | |
| 17:05:26 | sfinucan | the no man_pages thing can be fixed by removing same from Sphinx's conf.py or setting 'builders = html' in '[build_sphinx]' of 'setup.cfg' | |
| 17:06:03 | sfinucan | blame pbr being too clever for its own good :( | |
| 17:06:31 | sfinucan | https://github.com/openstack-dev/pbr/blob/master/pbr/builddoc.py#L66 | |
| 17:07:08 | dansmith | sfinucan: are you saying that something has changed in some package such that we're dead until we start doing that? | |
| 17:07:58 | sfinucan | dansmith: Depends on what project the issue is happening in. This isn't nova, is it? | |
| 17:08:11 | dansmith | sfinucan: it's neutron, we're just talking about it in the nova channel | |
| 17:08:17 | dansmith | sfinucan: kidding, yes nova :P | |
| 17:08:46 | dansmith | actually, melwitt, mine seems to still be the py3 thing | |
| 17:09:09 | sdague | yeh, the known broken thing was python3 going on by default | |
| 17:09:15 | melwitt | hmm | |
| 17:09:20 | dansmith | one of my changes is working though so maybe the puppet didn't propagate fully yet | |
| 17:09:57 | jaypipes | sdague: done. | |
| 17:10:28 | sfinucan | dansmith: Yeah, it shouldn't happen for nova. All 'source/conf.py's (doc, api-ref, api-guide) have 'man_page' removed or set to something | |
| 17:10:42 | sfinucan | Hence "this isn't nova" :) | |
| 17:15:13 | melwitt | sfinucan: my failure is happening in nova-specs | |
| 17:16:21 | melwitt | I see 'man_pages = []' under doc/source/conf.py | |
| 17:16:42 | melwitt | so it seems like it shouldn't be failing | |
| 17:16:51 | melwitt | it's not failing locally, only in the gate | |
| 17:17:01 | melwitt | and I rebased it already | |
| 17:18:08 | melwitt | ¯\_(ツ)_/¯ | |
| 17:18:27 | jaypipes | melwitt: yeah, I had the same reaction looking at your spec amendment's docs failure :( | |
| 17:24:18 | openstackgerrit | Mario Villaplana proposed openstack/nova master: virt/ironic: Implement rescue and unrescue https://review.openstack.org/416487 | |
| 17:38:48 | cdent | sdague: hiccup on mod_proxy_uwsgi: we need this version https://uwsgi-docs.readthedocs.io/en/latest/Changelog-2.0.13.html to get unix socket support, xenial is 2.0.12 | |
| 17:39:12 | cdent | do we have a usual solution to such issues? | |
| 17:41:44 | clarkb | cdent: you can ask ubuntu to backport, but generally if its not a bug I don't think they do. The other option is to get it into cloud archive (and then use cloud archive). Or maybe just use tcp? | |
| 17:42:17 | cdent | clarkb: not using tcp is a design goal | |
| 17:42:28 | cdent | clarkb: https://etherpad.openstack.org/p/devstack-uwsgi | |
| 17:42:51 | openstackgerrit | Andy McCrae proposed openstack/nova master: Allow CONTENT_LENGTH to be present but empty https://review.openstack.org/455710 | |
| 17:43:08 | clarkb | cdent: to avoid the port allcoation madness? | |
| 17:43:15 | cdent | in part yeah | |
| 17:43:34 | clarkb | another option may be to use not apache if another tls terminator has better uwsgi support? | |
| 17:44:26 | cdent | clarkb: yeah, nginx was the original plan, but we're doing discovery on apache options to see about limit the surface of the change | |
| 17:55:25 | sdague | cdent: we have a certain amount of flexibility in making it a reasonable dev environment, even if it means more change. I'm totally find with the nginx cut over at the same time | |
| 17:58:07 | openstack | Launchpad bug 1676363 in OpenStack Compute (nova) "The network metadata should be more useful" [Medium,In progress] - Assigned to Dr. Jens Rosenboom (j-rosenboom-j) | |
| 17:58:07 | clarkb | can I selfishly ask that https://bugs.launchpad.net/nova/+bug/1676363 and its associated changes get reviews/input/etc? This is the sort of issue in the pike release that will break us (us being infra) when the noav change that precipitated this hits clouds | |