Earlier  
Posted Nick Remark
#openstack-nova - 2019-10-08
15:32:54 dansmith mriedem: yeah, exactly
15:33:15 dansmith once per day batch is exactly this
15:34:14 cdent yeah, 202 is probably fine
15:34:15 mriedem unrelated to the response code, something i thought about while tossing and turning at 3am last night was that your api validation should probably check that the list of dicts is a unique set of image IDs and 400 if not
15:34:29 dansmith mriedem: already doing that :)
15:34:33 mriedem whew
15:34:36 gibi bauzas: tested your latest audit patch with bandwidth and left the result in https://review.opendev.org/#/c/670112/7
15:34:51 bauzas gibi: /me is scared
15:35:00 efried fwiw I vote for 202 dansmith cdent mriedem
15:35:30 gibi bauzas: There is some confusing printout, and as you stated the current code does not handle child RPs
15:35:43 bauzas gibi: thanks for the paste, very insightful
15:36:38 gibi bauzas: cleary there is progress as the instance and the compute is found in cell1.
15:36:56 gibi bauzas: no worries. I leave for today now anyhow
15:37:11 bauzas gibi: I appreciate your positivity :
15:37:12 bauzas :p
15:37:23 gibi :)
15:49:09 openstackgerrit Dan Smith proposed openstack/nova master: Add image caching API for aggregates https://review.opendev.org/687140
15:50:14 openstackgerrit Stephen Finucane proposed openstack/nova master: fixtures: Add support for security groups https://review.opendev.org/686802
15:50:18 openstackgerrit Stephen Finucane proposed openstack/nova master: fixtures: Add support for security groups https://review.opendev.org/686802
15:50:25 artom dansmith, left some thoughts about exception handling in your series
15:50:35 artom dansmith, tell me if I'm way off base
15:51:13 dansmith artom: ack, thanks
15:51:32 dansmith mriedem: looks like the bulk of our aggregate docs are in the user guide.. is that where you think I should put my stuff?
15:53:20 mriedem dansmith: rebase, that all recently moved and just merged
15:53:38 mriedem https://docs.openstack.org/nova/latest/admin/aggregates.html
15:53:54 dansmith mriedem: like, this week?
15:53:57 mriedem yeah
15:54:02 dansmith mkay
15:54:07 mriedem https://review.opendev.org/#/c/667133/
15:54:13 mriedem merged last night
15:54:41 mriedem efried: before i make changes please ack that i've answered your questions here https://review.opendev.org/#/c/686835/2/nova/tests/functional/test_boot_from_volume.py@192
15:56:55 mriedem dansmith: if we had docs on the image cache in general i'd say that would be a good place but we don't have any docs about the image cache :(
15:57:06 dansmith heh
15:58:27 mriedem i guess another place you could stuff it is https://docs.openstack.org/nova/latest/admin/manage-the-cloud.html if that aggregates page isn't a good fit
16:01:05 dansmith erm, the aggregates page seems better than that
16:01:15 dansmith but obviously something image- or imagecache-specific would be better
16:01:33 dansmith I'll add it here in minimal detail and then we should probably shoot for some imagecache doc
16:02:34 dansmith looks like something has reshuffled in that aggregates doc to put the usage section after the more advanced topics
16:02:41 mriedem i think a pretty simple image cache doc could start with a high level description, list of drivers that support it, and the related config options
16:03:00 mriedem dansmith: you'll have to wrestle with stephenfin about that
16:04:09 dansmith heh yeah all the google linkage is broken now after that admin/user shuffleup
16:04:47 mriedem yeah i'm not surprised, the patch didn't account for redirects
16:06:16 dansmith yeah that new aggregates page is just kindof a mess and the ordering makes no sense
16:06:24 dansmith I guess I'll just chuck my thing at the bottom
16:06:34 openstackgerrit Merged openstack/nova master: compute: refactor volume bdm rollback error handling https://review.opendev.org/656500
16:06:41 openstackgerrit Merged openstack/nova master: doc: Improve PDF document structure https://review.opendev.org/682746
16:06:51 openstackgerrit Merged openstack/nova master: docs: Remove a whole load of unused images, most remainder https://review.opendev.org/686211
16:06:57 openstackgerrit Merged openstack/nova master: trivial: Change name of network provided by NeutronFixture https://review.opendev.org/686798
16:07:05 openstackgerrit Merged openstack/nova master: nova-net: Stop mocking the instance network cache https://review.opendev.org/686799
16:07:16 openstackgerrit Merged openstack/nova master: trivial: Make it obvious where we're getting our names from https://review.opendev.org/686800
16:09:13 mriedem luckily infra has a report of active docs 404s
16:10:35 sean-k-mooney the most annoying thing about google+docs is it does not priorties latest
16:10:47 mriedem http://files.openstack.org/docs-404s/
16:11:11 dansmith sean-k-mooney: that's probably good since we apparently just break our latest a lot
16:11:49 mriedem 5 /nova/latest/user/aggregates.html
16:11:55 mriedem yeah we should have a redirect for that
16:11:58 mriedem stephenfin: ^
16:13:33 stephenfin Did I miss one?
16:13:39 stephenfin crap, yeah, let me add it now
16:15:05 mriedem dansmith: just for tracking: https://bugs.launchpad.net/nova/+bug/1847302
16:15:05 openstack Launchpad bug 1847302 in OpenStack Compute (nova) "doc: need admin guide for the image cache" [Undecided,New]
16:16:04 openstackgerrit Dan Smith proposed openstack/nova master: Add cache_image() driver method and libvirt implementation https://review.opendev.org/687137
16:16:04 openstackgerrit Dan Smith proposed openstack/nova master: Add cache_image() support to the compute rpc, api, and manager https://review.opendev.org/687138
16:16:05 openstackgerrit Dan Smith proposed openstack/nova master: Add cache_images() to conductor https://review.opendev.org/687139
16:16:05 openstackgerrit Dan Smith proposed openstack/nova master: Add image caching API for aggregates https://review.opendev.org/687140
16:16:06 openstackgerrit Dan Smith proposed openstack/nova master: WIP: Add image precaching docs for aggregates https://review.opendev.org/687348
16:17:09 openstackgerrit Matt Riedemann proposed openstack/nova master: doc: fix formatting in mitigation-for-Intel-MDS-security-flaws https://review.opendev.org/687350
16:18:47 dansmith gibi: (or mriedem) are there any examples of not-instance-related notifications I can copy for image pre-caching?
16:19:03 mriedem there are notifications for aggregates and services
16:19:11 mriedem agg add/remove host i think
16:19:41 dansmith ah yep
16:20:19 mriedem there are also the more generic compute_task.* ones but i'm guessing we should follow the aggregate ones since this is on the aggregates route
16:20:45 dansmith well, the aggregates ones are api-centric, but this would be host-centric
16:20:48 mriedem aggregate.image.cache.start|end?
16:20:51 dansmith i.e. "host foo started downloading a thing"
16:21:01 dansmith no, I want it to be host-specific so you can monitor progress
16:22:03 dansmith although I guess notify_about_aggregate_update could be sent from the conductor
16:22:08 dansmith as long as it mentions the host
16:22:42 dansmith that would allow us to notify about timeouts, etc
16:23:13 mriedem i think notify_about_aggregate_update is the legacy thing
16:23:21 mriedem notify_about_aggregate_action is the versioned notification thing
16:23:44 mriedem there is also a legacy notify_about_host_update for things on the os-hosts api
16:23:48 dansmith okay
16:23:51 mriedem and that's likely closer to what you're looking for
16:24:15 mriedem i don't think those got converted to versioned notifications b/c the os-hosts api is deprecated
16:27:10 openstackgerrit Stephen Finucane proposed openstack/nova master: docs: Add redirects for '/user/aggregates' https://review.opendev.org/687353
16:27:15 stephenfin mriedem: ^
16:27:38 mriedem yar matey
16:30:02 mriedem huh, that patch is triggering functional jobs, must have something missing in our zuul yaml blacklist
16:30:19 dansmith mriedem: so, I'm not really sure what the rules are on our new notifications.. I think I could use AggregatePayload to convey what I want, but not sure if I should
16:30:47 dansmith i.e. AggregatePayload(name="aggregate.imagecache.start", uuid=agg.uuid, hosts=[this_compute])
16:30:59 mriedem no i don't think that's what you want
16:31:52 mriedem my guess is you'll end up creating a new single purpose thing like VolumeUsagePayload and MetricsPayload
16:32:48 mriedem so,
16:32:56 mriedem maybe you're thinking of something like this:
16:33:08 mriedem 1. generic aggregate payload based thing to start the operation sent from conductor
16:33:17 mriedem 2. start/end notifications per compute which would be a new payload
16:33:28 mriedem 3. end version of #1 in conductor once it's done processing all hosts
16:33:58 mriedem so if a consumer cares about only the overall op being done and not the host specific details they can just listen for that
16:34:04 dansmith yeah

Earlier   Later