Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2017-05-03
14:46:48 edmondsw mriedem edleafe is there spec for the capabilities work that was discussed at the PTG?
14:46:53 edmondsw All I'm finding is https://blueprints.launchpad.net/nova/+spec/expose-host-capabilities which is languishing and doesn't talk about what was discussed at PTG
14:47:15 openstackgerrit Zhenyu Zheng proposed openstack/nova master: Use plain routes list for block_device_mapping instead of stevedore https://review.openstack.org/462180
14:48:43 jaypipes edmondsw: are you referring to the API capabilities or are you referring to the resource provider traits stuff?
14:48:56 edmondsw jaypipes API
14:49:26 edleafe edmondsw: The api-wg spec for capabilities was abandoned: https://review.openstack.org/#/c/386555/
14:50:47 openstackgerrit Zhenyu Zheng proposed openstack/nova master: Use plain routes list for user_data instead of stevedore https://review.openstack.org/462183
14:51:01 edmondsw edleafe the abandon comment talks about "first fixing the immediate problems
14:51:06 edmondsw where is that happening?
14:51:40 openstackgerrit Gábor Antal proposed openstack/nova master: Transform aggregate.add_host notification https://review.openstack.org/396210
14:52:19 edleafe edmondsw: as far as I know no one has picked that up
14:52:41 edmondsw k
14:53:01 edleafe edmondsw: so if you've got some spare cycles... :)
14:53:11 edmondsw edleafe wish I did...
14:53:24 edleafe heh, welcome to the club!
14:56:43 melwitt sdague: when I was debugging locally, I found this is where it blows up in the log formatting, it's trying to convert the message to unicode, but with the Instance object I found it only works if the encoding 'utf-8' is specified to six.text_type(), and that requires the instance arg be a string, not an Instance object type
14:56:58 melwitt https://github.com/openstack/oslo.log/blob/3ee14a1/oslo_log/formatters.py#L83-L93
14:58:14 mriedem sdague: jaypipes: dansmith: bauzas: i assume none of us have a touchscreen laptop to project if we don't have a flip chart or whiteboard right?
14:58:34 mriedem that would be easier to see than a flip chart if we're expecting 40 people
14:58:54 melwitt so in my patch I'm doing repr(instance) followed by six.text_type(instance_repr, 'utf-8') if six.PY2
14:59:26 dansmith mriedem: drawing on that kind of thing is pretty hard to do well, IMHO, but no I don't have one
14:59:55 mriedem dansmith: i thought they were supposed to be super awesome nowadays?
14:59:58 mriedem but yeah i don't have one either
15:01:22 melwitt I have a msft surface and drawing pens, but I dunno how to project with it
15:01:22 mriedem efried: ah ok so this is what you needed https://github.com/openstack/requirements/commit/f7ebce161764236086957451d21d0fcae9fa86e9
15:01:40 mriedem melwitt: i assume projecting is same as always
15:01:49 mriedem usb adapter probably
15:02:16 efried mriedem Yes, that was one piece of the puzzle.
15:02:30 melwitt yeah, it has limited ports. it has usb though
15:04:56 mriedem dansmith: jaypipes: for the nova project update slides, we could talk over those tomorrow if you want. i think it would be pretty simple. i figured i could start, then jay covers any placement slides, dan covers any cells slides, and i can do the rest of the misc stuff
15:04:57 sdague mriedem: honestly, I also find drawing on those live quite hard. Flipboard would definitely be more useful
15:05:19 mriedem sdague: well someone should tell all of the marketers that for every time i watch an NFL game
15:05:24 dansmith mriedem: sounds good to me
15:05:25 mriedem because they all said it was super easy and awesome
15:11:32 sdague dansmith: did changing the use_journal option with your runs help?
15:12:04 dansmith sdague: they're not done yet
15:12:10 sdague dansmith: ok
15:20:15 dansmith mriedem: so, looking at the few other onboarding threads on the ML, I'm kinda curious... what are the other projects doing for this slot?
15:25:24 mdbooth dansmith: Perhaps a hazing?
15:26:43 bauzas dansmith: mriedem: FWIW, most of the Upstream Training attendees previously were trying to look at devstack and provide a change against a project
15:27:24 bauzas dansmith: mriedem: now that the Institute doesn't really provide devstack, I think they just want to have some technical discussions :)
15:29:01 openstackgerrit Gábor Antal proposed openstack/nova master: Transform aggregate.add_host notification https://review.openstack.org/396210
15:31:41 mriedem dansmith: i've wondered the same, and i saw the cinder etherpad at one point
15:31:45 mriedem but can't find it now
15:32:29 mordred efried: nice! looking now
15:35:05 mriedem smcginnis: where is your guys' cinder onboarding etherpad?
15:35:12 mriedem kevinbenton: ^ do you guys have one?
15:35:36 giuseppe1992 Hello all!!!
15:38:12 openstackgerrit Gábor Antal proposed openstack/nova master: Transform aggregate.add_host notification https://review.openstack.org/396210
15:38:53 mordred efried: oh - also - I'm making the patch to keystoneauth right now to deal with teh service type list - so hopefully we can make a follow up soon to your patch to consume that ..
15:39:31 openstackgerrit Mathieu Gagné proposed openstack/nova master: Add ability to signal and perform online volume size change https://review.openstack.org/454322
15:41:45 mordred efried: patch looks mostly great on first read - excellent work -I've got a few nitpicky things I'll leave in just a bit
15:44:34 openstackgerrit Gábor Antal proposed openstack/nova master: Transform aggregate.remove_host notification https://review.openstack.org/396211
15:45:23 smcginnis mriedem: I dont believe we have an etherpad for that.
15:47:51 efried mordred Roger that, and thanks.
15:48:11 efried mordred Please add me to that service type list patch once it's up.
15:48:42 mordred will do!
15:49:35 efried mordred I will certainly do that, for whatever it's worth. I still have your ML threads awaiting deeper dives.
15:54:41 jaypipes mriedem: works for me. I'll be on IRC all day of course.
15:55:00 jaypipes mriedem: well, after around 9:30am EDT... it's Thursday morning golf before that. :)
15:56:03 mriedem ooo this looks like a new fun gate bug http://logs.openstack.org/73/461473/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/a277636/logs/screen-n-cpu.txt.gz#_May_02_17_49_07_771248
15:57:08 jaypipes mriedem, sdague: are we still seeing issues with the live-migration jobs?
15:57:18 mriedem jaypipes: no
15:57:27 mriedem cells v1 job is the main failure right now
15:59:12 dansmith FWIW, it looks like my job is going to pass without journal usage
15:59:13 dansmith I'm not sure that makes sense
15:59:22 dansmith I was hoping to just get the rest of my debug with that hack,
15:59:36 dansmith but I suppose it's possible that it's occasionally causing us to deadlock something
15:59:46 dansmith I'll recheck a few times to see if I just got uber lucky this time
16:07:50 sdague dansmith: ok, cool
16:08:02 sdague I did one more tweak on my general patch, once that's passes, I'll get that in
16:08:11 dansmith sdague: that "okay cool" was for the rechecking right?
16:08:16 dansmith I was not expecting it to actually make it pass
16:08:24 dansmith I was expecting it to let me see my own debug for the real failure
16:08:49 sdague yes, for rechecking
16:09:16 sdague ok, so someone that understands more about eventlet than might be needed to understand why this fails
16:11:02 sdague https://github.com/systemd/python-systemd/blob/c06c5d401d60ae9175367be0797a6c2b562ac5ba/systemd/journal.py#L412-L457 is the function we're calling into
16:11:54 sdague https://github.com/systemd/python-systemd/blob/c06c5d401d60ae9175367be0797a6c2b562ac5ba/systemd/_journal.c which I goes into native code
16:12:17 sdague jaypipes so presumably related to the same reason gRPC doesn't work
16:15:41 mriedem melwitt: ^ see in that first link to journal.py "MESSAGE must be a string and will be sent as UTF-8 to the journal."
16:16:03 jaypipes sdague: maybe, not sure though. the grpc vs. eventlet thing was around how grpc's generated python code doesn't play well with monkey-patched envs
16:17:01 sdague jaypipes: potentially similar issue?
16:17:09 mriedem sdague: was it intentional to enable syslog handler to put all of the service logs into syslog? because syslog is huge now, and basically unusable in a browser
16:17:26 mriedem http://logs.openstack.org/73/461473/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/a277636/logs/syslog.txt.gz
16:17:31 jaypipes sdague: maybe. I'm no eventlet expert though :( perhaps worth asking vstinner or dims to take a look into it.
16:17:46 jaypipes sdague: or perhaps one of the swift folks?
16:17:50 sdague mriedem: we didn't enable the syslog handler
16:17:54 sdague this is the journal
16:18:26 sdague mriedem: this is what things under systemd look like, we can trim what ends up in the extracted syslog.txt
16:18:29 openstackgerrit melanie witt proposed openstack/nova master: WIP Use six.text_type() when logging Instance object https://review.openstack.org/461912
16:18:46 mriedem sdague: i thought this did something
16:18:47 mriedem https://github.com/openstack/oslo.log/commit/391635475a5877c2078856b5c3a7d2929682764a
16:18:49 sdague mriedem: https://github.com/openstack-infra/devstack-gate/blob/87a9ef290fa371862f30702497238fffdfdfe8fe/functions.sh#L647-L649
16:19:06 sdague mriedem: nope, unrelated
16:19:36 dansmith sdague: don't we have a global log lock or something?
16:20:01 dansmith that was the reason why logging in the db api was so problematic I think
16:20:17 dansmith we wouldn't have deadlocks in the same way here I think, but it could still be a problem
16:20:20 melwitt mriedem: okay. I wrote a better commit message to explain what I was seeing in local debugging. the ContextFormatter tries to convert every message to unicode, it was failing on the Instance object, and I found to convert it properly I had to specify the encoding to six.text_type()
16:20:32 dansmith we can't really hold any locks while making a native call or we're going to cause problems
16:23:28 sdague dansmith: I didn't think we did

Earlier   Later