Earlier  
Later
New Search
Posted Nick Remark
#openstack-sdks - 2018-07-18
22:50:09 mordred corvus: now - your use case brings up an interesting point ... which is that I could see you _not_ wanting the "create client-side-checksums and upload as metadata" behavior
22:50:28 mordred corvus: which is on by default to help prevent double-uploads of large files
22:50:45 mordred but there isn't a great way to disable it
22:51:09 corvus mordred: there's a really good chance we'll upload the same file more than once
22:51:18 corvus like a nova config file
22:51:28 mordred corvus: yah - but it would be to different paths
22:51:34 mordred so that's fine
22:51:35 corvus oh ok
22:51:47 corvus so you're just concerned about the time spent generating the checksum?
22:51:56 mordred yeah. it's wasted
22:52:01 mordred for the log upload case
22:52:05 corvus true. probably not huge though.
22:52:21 mordred yah. I'll make a flag and you can pick it up in an update
#openstack-sdks - 2018-07-19
01:16:38 openstackgerrit Merged openstack/openstacksdk master: Add /v3 to the auth_url for vexxhost https://review.openstack.org/583737
01:55:57 openstackgerrit wangxiyuan proposed openstack/keystoneauth master: Add netloc and version check for version discovery https://review.openstack.org/583215
02:19:00 openstackgerrit wangxiyuan proposed openstack/keystoneauth master: Add netloc and version check for version discovery https://review.openstack.org/583215
04:43:51 openstackgerrit Hongbin Lu proposed openstack/openstacksdk master: [DNM] Test neutron change https://review.openstack.org/583851
07:27:16 openstackgerrit Merged openstack/openstacksdk master: Add missing swift docstrings https://review.openstack.org/583790
08:40:11 openstackgerrit Josephine Seifert proposed openstack/python-openstackclient master: [WIP] osc-included image signing (using openstacksdk) https://review.openstack.org/580086
09:14:56 openstackgerrit Josephine Seifert proposed openstack/python-openstackclient master: [WIP] osc-included image signing (using openstacksdk) https://review.openstack.org/580086
09:54:15 Luzi mordred, could you review our osc-included image signing? parts have been uploaded to sdk: https://review.openstack.org/#/c/580080/ and osc: https://review.openstack.org/#/c/580086/
10:50:35 cdent dtantsur|bbl, edleafe, elmiko : I may miss start of ap-sig meeting. need to cart sarah and her ankle around a bit before that and not sure how long it will be
12:02:14 dtantsur cdent: ack
12:31:04 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: Support for microversions in base Resource https://review.openstack.org/583491
13:51:00 openstackgerrit Monty Taylor proposed openstack/openstacksdk master: Add missing release note about vexxhost auth_url https://review.openstack.org/583962
13:59:13 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: [WIP] Support for microversions in baremetal resources https://review.openstack.org/583532
14:21:39 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: [WIP] Support for microversions in baremetal resources https://review.openstack.org/583532
14:23:50 cdent edleafe: oh my, the solar panel installers keep saying "huzzah"
14:27:17 openstackgerrit Dmitry Tantsur proposed openstack/openstacksdk master: [WIP] Support for microversions in baremetal resources https://review.openstack.org/583532
14:29:26 edleafe cdent: were they saying it to me??
14:29:48 mordred edleafe: yes
15:01:49 dtantsur cdent, edleafe, elmiko, having a headache the whole day, may skip the meeting if I don't recover by then :(
15:02:10 cdent dark rooms, plenty of water
15:06:01 openstackgerrit Merged openstack/openstacksdk master: Implement signature generation functionality https://review.openstack.org/580080
15:14:42 openstackgerrit Merged openstack/openstacksdk master: Add set_provision_state and wait_for_provision_state for baremetal Node https://review.openstack.org/570895
16:03:40 openstackgerrit Valentin Boucher proposed openstack-infra/shade master: Fix doc mistake https://review.openstack.org/584010
16:28:34 cdent edleafe: https://etherpad.openstack.org/p/api-sig-newsletter please and thank you
16:31:22 edleafe cdent: it is a marvel of wordsmithery. Ship it!
16:31:34 cdent it took so many keypresses
16:31:48 edleafe every one was worth it
16:52:18 openstackgerrit Merged openstack/keystoneauth master: Add netloc and version check for version discovery https://review.openstack.org/583215
16:58:34 openstackgerrit Hongbin Lu proposed openstack/openstacksdk master: Use valid filters to list floating IPs in neutron https://review.openstack.org/584029
17:00:34 openstackgerrit Hongbin Lu proposed openstack/openstacksdk master: [DNM] Test neutron change https://review.openstack.org/583851
17:06:42 corvus mordred: another issue with Connection.create_object: there's no way to upload a zero-byte file without creating one on disk
17:06:59 corvus mordred: (more generally, there's no way to upload data without it being on disk)
17:09:58 openstackgerrit Merged openstack/openstacksdk master: meta: don't throw KeyError on misconfigured floating IPs https://review.openstack.org/582460
17:10:00 openstackgerrit Merged openstack/openstacksdk master: Add missing release note about vexxhost auth_url https://review.openstack.org/583962
17:21:45 Shrews corvus: that's a strange comment (possibly b/c of lack of context)
17:22:14 Shrews why upload data you don't have?
17:22:50 corvus Shrews: continued conversation from yesterday about proxy vs connection
17:23:01 corvus Shrews: apparently i need to create a zero byte object in swift as a directory marker
17:23:31 Shrews corvus: hrm, that seems like something i had to deal with at some point in the past
17:23:38 corvus aiui, if i were to use the connection object, i would have to create a zero byte file on disk and pass the path to it. if i use the proxy, i can say data=''
17:24:12 Shrews corvus: but now i have context (so thx) :)
17:24:23 corvus np
17:27:37 Shrews actually, i think it was with the shade create_container code i originally wrote. there was weirdness with it
17:28:09 corvus i'm happy to use the proxy object for now. i'm trying that, but i'm not sure it's sending the headers i'm telling it to.
17:28:09 Shrews err, create_object
17:33:21 corvus Shrews: this is what i think i should be doing: http://paste.openstack.org/show/726298/ but the additional headers don't show up in the curl debug output. should they?
17:34:10 Shrews corvus: not sure, tbh
17:36:19 mordred Shrews, corvus: we should add support for specifying the data to upload to create_object
17:39:10 mordred yes - I would expect extra headers to be sent ...
17:40:25 mordred corvus: you could also just do the put directly ... cloud.object_store.put('/{container}/{relative_path}', headers=headers)
17:43:42 Shrews is it too late to switch to using the shade-version of things?
17:43:49 Shrews through Connection
17:44:17 mordred that's what he's mostly using - but the shade vesion doesn't allow zero-byte uploads
17:44:25 mordred corvus: I'm making a quick patch to add a data param
17:44:26 Shrews ah, i see
17:44:51 corvus also, would be nice to avoid the checksums
17:45:06 mordred yup. I made that patch lat night - this one is on top of it
17:45:11 corvus ack
17:45:26 mordred corvus: also, I would like to cut an sdk release today - so it shouldn't be super terrible to get both in
17:45:28 corvus i will switch to put for now to keep moving
17:45:35 mordred corvus: ++
17:47:14 Shrews i could have swore the shade create_container handled the "directory" nature he's looking to achieve, but i'm probably misremembering
17:50:12 Shrews hrm, my old test code doesn't do that, so i guess my brain is telling lies
17:55:16 openstackgerrit Monty Taylor proposed openstack/openstacksdk master: Add flag for disabling object checksum generation https://review.openstack.org/584044
17:55:17 openstackgerrit Monty Taylor proposed openstack/openstacksdk master: Add ability to pass data to create_object https://review.openstack.org/584045
17:55:19 mordred Shrews, corvus: ^^
17:56:05 mordred corvus, Shrews: should we add a method for "create_object_directory" or something? that will do the right thing to create the zero-byte file as a pseudo-directory?
17:56:36 Shrews mordred: i think that was what i was remembering... i *wanted* to make an api for doing that, but then just forgot to do it
17:57:11 Shrews seems like a common enough thing we could help users out with
17:57:15 mordred yah
18:03:07 corvus just make sure you can still pass in the other parameters (like expire-at, etc)
18:03:17 openstackgerrit Monty Taylor proposed openstack/openstacksdk master: Add create_object_pseudo_directory method https://review.openstack.org/584050
18:03:38 mordred corvus: yup! ^^ how's that?
18:04:05 Shrews mordred: https://docs.openstack.org/newton/user-guide/cli-swift-pseudo-hierarchical-folders-directories.html
18:04:44 Shrews i think if you just create the top-level container, then put the heirarchy in the object name, it works as expected
18:04:49 Shrews i think i remember trying this now
18:04:58 Shrews corvus: ^^
18:05:36 mordred corvus: your code was passing text/html - but the docs from mnaser said that the directory objects wanted to be application/directory so I put that in the helper method - but obviously I havent' tested that in the wild
18:05:56 corvus mordred: yeah my snippet was an example of an actual file
18:06:06 mordred Shrews: hrm that makes me want to make a list_object_directories method or something similar that does delimiter='/' and whatnot from that doc
18:06:13 mordred corvus: ah - gotcha
18:06:32 mordred I should probably add some unittests of those
18:06:38 mordred or else Shrews might be unhappy
18:17:57 Shrews mordred: corvus: so i confirmed that naming the object with heirarchy works as expected
18:18:23 Shrews corvus: so you can avoid the whole empty file workaround if you do that
18:19:31 mordred Shrews: I'm not sure what you mean?
18:20:01 corvus Shrews: apparently that's true with actual swift. but perhaps not with ceph/rados. at least, that's what i heard. so i wanted to do a quick 5 minute experiment to verify. :)

Earlier   Later