Earlier  
Posted Nick Remark
#openstack-sdks - 2018-07-18
22:26:06 mordred corvus: so - I'll have to dig in on that one a bit - another option is conn.create_container(name='corvustest', public=True)
22:26:30 corvus oh neat, i didn't see that
22:27:21 corvus mordred: also, the next thing i was about to dig into (once it's unbroken) is how do i set X-Container-Meta-Web-Index ?
22:27:37 mordred corvus: it's the shade layer rather than the sdk object layer - also, fwiw, conn.create_object will automatically use large object segments for you if any of your files are over the object size limit for the cloud
22:28:59 corvus mordred: oh, i feel like i missed an important fork in the road :)
22:29:13 mordred corvus: conn.update_container(headers={'X-Container-Meta-Web-Index': 'blah'}) should do the trick
22:29:14 corvus mordred: i went to https://docs.openstack.org/openstacksdk/latest/user/index.html#api-documentation which led me to https://docs.openstack.org/openstacksdk/latest/user/proxies/object_store.html and that's why i thought i should be using conn.object_store
22:29:26 mordred corvus: ah - that's a great feedback note
22:30:24 mordred corvus: I'll work on some better entrypoint roadmapping ...
22:30:33 mordred corvus: https://docs.openstack.org/openstacksdk/latest/user/connection.html might be interesting to look at
22:30:36 corvus mordred: i see https://docs.openstack.org/openstacksdk/latest/user/connection.html now
22:30:37 corvus ya
22:30:57 mordred corvus: although - I'm now going to apologize for lacking some docstrings
22:31:05 mordred corvus: you're making several todo list items for me :)
22:31:14 corvus mordred: i think i would have needed that to be the first thing, and probably the text "The Connection class is the primary interface to the Python SDK" in the introduction page. that would have gotten me to the right place.
22:31:47 mordred corvus: yeah ... there's a piece of narrative that needs to be written
22:32:20 mordred corvus: that describes the different interfaces in some short but descriptive terms and leads you to the one that you want
22:33:34 corvus mordred: when you said you were going to apologize for lacking some docstrings, was the docstring for "create_container" one of them? :)
22:34:34 mordred corvus: yes. also for set_container_access and get_container and update_container and get_object_metadata
22:45:53 openstackgerrit Monty Taylor proposed openstack/openstacksdk master: Add missing swift docstrings https://review.openstack.org/583790
22:45:57 mordred corvus: ^^
22:46:00 mordred corvus: sorry about that
22:48:25 corvus mordred: oh noes you have the whitespace in that change
22:48:46 mordred NOT WHITESPACE OH NO WE'RE ALL DOOMED
22:49:25 openstackgerrit Monty Taylor proposed openstack/openstacksdk master: Add missing swift docstrings https://review.openstack.org/583790
22:50:09 mordred corvus: now - your use case brings up an interesting point ... which is that I could see you _not_ wanting the "create client-side-checksums and upload as metadata" behavior
22:50:28 mordred corvus: which is on by default to help prevent double-uploads of large files
22:50:45 mordred but there isn't a great way to disable it
22:51:09 corvus mordred: there's a really good chance we'll upload the same file more than once
22:51:18 corvus like a nova config file
22:51:28 mordred corvus: yah - but it would be to different paths
22:51:34 mordred so that's fine
22:51:35 corvus oh ok
22:51:47 corvus so you're just concerned about the time spent generating the checksum?
22:51:56 mordred yeah. it's wasted
22:52:01 mordred for the log upload case
22:52:05 corvus true. probably not huge though.
22:52:21 mordred yah. I'll make a flag and you can pick it up in an update
#openstack-sdks - 2018-07-19
01:16:38 openstackgerrit Merged openstack/openstacksdk master: Add /v3 to the auth_url for vexxhost https://review.openstack.org/583737
01:55:57 openstackgerrit wangxiyuan proposed openstack/keystoneauth master: Add netloc and version check for version discovery https://review.openstack.org/583215
02:19:00 openstackgerrit wangxiyuan proposed openstack/keystoneauth master: Add netloc and version check for version discovery https://review.openstack.org/583215
04:43:51 openstackgerrit Hongbin Lu proposed openstack/openstacksdk master: [DNM] Test neutron change https://review.openstack.org/583851
07:27:16 openstackgerrit Merged openstack/openstacksdk master: Add missing swift docstrings https://review.openstack.org/583790
08:40:11 openstackgerrit Josephine Seifert proposed openstack/python-openstackclient master: [WIP] osc-included image signing (using openstacksdk) https://review.openstack.org/580086
09:14:56 openstackgerrit Josephine Seifert proposed openstack/python-openstackclient master: [WIP] osc-included image signing (using openstacksdk) https://review.openstack.org/580086
09:54:15 Luzi mordred, could you review our osc-included image signing? parts have been uploaded to sdk: https://review.openstack.org/#/c/580080/ and osc: https://review.openstack.org/#/c/580086/
10:50:35 cdent dtantsur|bbl, edleafe, elmiko : I may miss start of ap-sig meeting. need to cart sarah and her ankle around a bit before that and not sure how long it will be
12:02:14 dtantsur cdent: ack
12:31:04 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: Support for microversions in base Resource https://review.openstack.org/583491
13:51:00 openstackgerrit Monty Taylor proposed openstack/openstacksdk master: Add missing release note about vexxhost auth_url https://review.openstack.org/583962
13:59:13 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: [WIP] Support for microversions in baremetal resources https://review.openstack.org/583532
14:21:39 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: [WIP] Support for microversions in baremetal resources https://review.openstack.org/583532
14:23:50 cdent edleafe: oh my, the solar panel installers keep saying "huzzah"
14:27:17 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: [WIP] Support for microversions in baremetal resources https://review.openstack.org/583532
14:29:26 edleafe cdent: were they saying it to me??
14:29:48 mordred edleafe: yes
15:01:49 dtantsur cdent, edleafe, elmiko, having a headache the whole day, may skip the meeting if I don't recover by then :(
15:02:10 cdent dark rooms, plenty of water
15:06:01 openstackgerrit Merged openstack/openstacksdk master: Implement signature generation functionality https://review.openstack.org/580080
15:14:42 openstackgerrit Merged openstack/openstacksdk master: Add set_provision_state and wait_for_provision_state for baremetal Node https://review.openstack.org/570895
16:03:40 openstackgerrit Valentin Boucher proposed openstack-infra/shade master: Fix doc mistake https://review.openstack.org/584010
16:28:34 cdent edleafe: https://etherpad.openstack.org/p/api-sig-newsletter please and thank you
16:31:22 edleafe cdent: it is a marvel of wordsmithery. Ship it!
16:31:34 cdent it took so many keypresses
16:31:48 edleafe every one was worth it
16:52:18 openstackgerrit Merged openstack/keystoneauth master: Add netloc and version check for version discovery https://review.openstack.org/583215
16:58:34 openstackgerrit Hongbin Lu proposed openstack/openstacksdk master: Use valid filters to list floating IPs in neutron https://review.openstack.org/584029
17:00:34 openstackgerrit Hongbin Lu proposed openstack/openstacksdk master: [DNM] Test neutron change https://review.openstack.org/583851
17:06:42 corvus mordred: another issue with Connection.create_object: there's no way to upload a zero-byte file without creating one on disk
17:06:59 corvus mordred: (more generally, there's no way to upload data without it being on disk)
17:09:58 openstackgerrit Merged openstack/openstacksdk master: meta: don't throw KeyError on misconfigured floating IPs https://review.openstack.org/582460
17:10:00 openstackgerrit Merged openstack/openstacksdk master: Add missing release note about vexxhost auth_url https://review.openstack.org/583962
17:21:45 Shrews corvus: that's a strange comment (possibly b/c of lack of context)
17:22:14 Shrews why upload data you don't have?
17:22:50 corvus Shrews: continued conversation from yesterday about proxy vs connection
17:23:01 corvus Shrews: apparently i need to create a zero byte object in swift as a directory marker
17:23:31 Shrews corvus: hrm, that seems like something i had to deal with at some point in the past
17:23:38 corvus aiui, if i were to use the connection object, i would have to create a zero byte file on disk and pass the path to it. if i use the proxy, i can say data=''
17:24:12 Shrews corvus: but now i have context (so thx) :)
17:24:23 corvus np
17:27:37 Shrews actually, i think it was with the shade create_container code i originally wrote. there was weirdness with it
17:28:09 corvus i'm happy to use the proxy object for now. i'm trying that, but i'm not sure it's sending the headers i'm telling it to.
17:28:09 Shrews err, create_object
17:33:21 corvus Shrews: this is what i think i should be doing: http://paste.openstack.org/show/726298/ but the additional headers don't show up in the curl debug output. should they?
17:34:10 Shrews corvus: not sure, tbh
17:36:19 mordred Shrews, corvus: we should add support for specifying the data to upload to create_object
17:39:10 mordred yes - I would expect extra headers to be sent ...
17:40:25 mordred corvus: you could also just do the put directly ... cloud.object_store.put('/{container}/{relative_path}', headers=headers)
17:43:42 Shrews is it too late to switch to using the shade-version of things?
17:43:49 Shrews through Connection
17:44:17 mordred that's what he's mostly using - but the shade vesion doesn't allow zero-byte uploads
17:44:25 mordred corvus: I'm making a quick patch to add a data param
17:44:26 Shrews ah, i see
17:44:51 corvus also, would be nice to avoid the checksums
17:45:06 mordred yup. I made that patch lat night - this one is on top of it
17:45:11 corvus ack
17:45:26 mordred corvus: also, I would like to cut an sdk release today - so it shouldn't be super terrible to get both in
17:45:28 corvus i will switch to put for now to keep moving
17:45:35 mordred corvus: ++
17:47:14 Shrews i could have swore the shade create_container handled the "directory" nature he's looking to achieve, but i'm probably misremembering

Earlier   Later