Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-05-22
22:40:25 mriedem to forcefully detach a volume when we didn't have a token
22:41:23 mriedem so if there is host-level stuff we need to do i'd expect those apis to be admin-only by policy in cyborg
22:41:35 mriedem i don't know enough about their api though
22:41:51 mriedem like, you as a user can create an fpga resource and provide that to nova on server create to wire it up right?
22:42:06 sean-k-mooney mriedem: that was one of the thing in the spec we called out
22:42:35 sean-k-mooney e.g. that cyborgs api whoudl be admin by default
22:42:44 mriedem so ironic
22:43:08 sean-k-mooney since its manaing host level resouces that are potentially damaging if used incorrectly
22:43:23 mriedem there are also nova/cinder interactions we probably should have done differently from the start, because some cinder apis that nova uses leak host level connection information and aren't admin apis
22:43:51 mriedem weee https://bugs.launchpad.net/cinder/+bug/1740950
22:43:52 openstack Launchpad bug 1740950 in Cinder "Volume details shows attached compute host for non-admins" [Undecided,New]
22:44:04 sean-k-mooney lick the conection context or whatever its called that has the iscsi info
22:44:15 sean-k-mooney attachment?
22:44:17 mriedem heh "If it lingers past Queens release day, we can revisit the advisory task."
22:44:34 mriedem yes the attachment has the connection_info dict
22:44:45 sean-k-mooney ya that has come up a few times
22:46:43 sean-k-mooney in the cyborg case that is one of the open items in the spec here https://review.opendev.org/#/c/603955/12/specs/train/approved/nova-cyborg-interaction.rst@301
22:49:51 sean-k-mooney :( https://github.com/openstack/cyborg/blob/master/cyborg/common/policy.py#L76-L122
22:50:23 sean-k-mooney why is the program endpoint using allow ...
22:53:15 efried sean-k-mooney: That (cyborg APIs being admin only) was something you brought up, but it sounds like that's not how they're planning on doing it.
22:54:28 mriedem someone call lbragstad
22:54:29 sean-k-mooney yes well currently anyway can update any fpga recored with there default policy so how they were planning on doing it and what they proably should do are likely not the same thing
22:55:04 efried mriedem: Just this morning someone was asking about a rare failure in the logs where cinder complained of not having admin creds.
22:55:09 mriedem admin-only by default seems smartest and makes the nova interaction strict from the get-go
22:55:29 efried http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2019-05-22.log.html#t2019-05-22T12:46:19
22:55:41 mriedem but idk, that might make it hard to allow non-admin stuff later
22:55:43 sean-k-mooney the deployable create/update/delete are adming only
22:56:22 efried mriedem: seems to me like that's worse, because it means we *require* admin creds in the conf, and all operations would be allowable.
22:56:29 sean-k-mooney update and delete on acclertors are admin or own so for those it proably fine
22:57:14 efried cyborg sounds like they have a plan for granular policy (is that the right use of that term?) and if so it makes sense to do user auth from nova.
22:57:37 mriedem efried: without knowing where that users was getting the error i can't really say on that cinder thing,
22:58:09 mriedem it was added b/c there is a periodic in the compute which will shelve offload instances after a period of time, and cleanup soft-deleted instances after a period of time, which means doing things on volumes w/o a user token
22:58:10 sean-k-mooney efried: for some things that makes sense but i think there fpga update should ast least be admin_or_owner
22:58:36 efried mriedem: Well, I wound up concluding that it was probably the thing you just mentioned, the parts of cinder where we need the admin creds for those weird periodic edge cases.
22:59:15 efried they didn't have any admin creds in their conf
22:59:19 mriedem ok on the cyborg policy thing, idk, if only we had like a technical committee in openstack or something with security guidelines
22:59:23 mriedem or an auth/identity team...
22:59:41 mriedem but it's 6pm and i'm not sean-k-mooney so i need to drop off
22:59:46 efried o/
22:59:53 sean-k-mooney o/
23:00:22 sean-k-mooney hay look its thursday ...
23:00:41 sean-k-mooney i should proably go to sleep soon.
23:01:06 sean-k-mooney efried: i didnt get to rework the vidoe-model stuff but i shoudl get that done tomorrow
23:01:11 efried no worries
23:03:08 sean-k-mooney Sundar: is there a reason that anyone can update any fpga recored even if they dont own it or are not admins https://github.com/openstack/cyborg/blob/master/cyborg/common/policy.py#L119-L121
23:03:16 sean-k-mooney becaue ^ seams like a bug
23:04:35 Sundar sean-k-mooney: We got some holdovers from previous releases. We need to scrub all these policies for sure.
23:04:43 sean-k-mooney the same issue is there for the deployable program endpoint.
23:05:06 sean-k-mooney Sundar: ok as long as you are aware but that is something that shoudl be backported
23:05:30 sean-k-mooney normally you would not backport that kind of change but in this case i think its needed
23:05:43 Sundar Backport to v1 API?
23:06:20 sean-k-mooney Sundar: yes that would almost qualify for a revert in my book if you had not already released it
23:06:24 Sundar I need to get my head around how these rules interact with API versions
23:07:08 sean-k-mooney normally it would be a microverion bump
23:08:29 openstackgerrit Eric Fried proposed openstack/nova master: WIP: Support old & new versions of svm and vmx traits https://review.opendev.org/660515
23:32:20 Sundar mriedem, sean-k-mooney: Re. earlier discussion today on https://review.opendev.org/#/c/603955/ , yes, I haven't updated the spec, mainly because I have been trying to understand the implications of moving the bind to compute, etc.
23:32:39 Sundar I will shortly update the spec.
#openstack-nova - 2019-05-23
00:25:33 openstackgerrit Brin Zhang proposed openstack/python-novaclient master: Set the lower limit of api_version for volume_type https://review.opendev.org/660861
01:07:58 openstackgerrit Jake Yip proposed openstack/nova master: refactor nova-manage archive_deleted_rows https://review.opendev.org/643779
01:08:21 openstackgerrit Jake Yip proposed openstack/nova master: Add --before to nova-manage db archive_deleted_rows https://review.opendev.org/556751
02:06:59 openstackgerrit Merged openstack/nova stable/stein: Restore connection_info after live migration rollback https://review.opendev.org/660370
02:48:23 openstackgerrit Merged openstack/nova stable/rocky: xenapi/agent: Change openssl error handling https://review.opendev.org/656307
03:13:35 openstackgerrit Merged openstack/python-novaclient master: Allow passing negative values for the locked search_opt in cs.servers.list https://review.opendev.org/659783
04:28:37 openstackgerrit Merged openstack/nova stable/stein: libvirt: Do not reraise DiskNotFound exceptions during resize https://review.opendev.org/660361
05:49:19 openstackgerrit Arthur Dayne proposed openstack/nova stable/rocky: Add the missing ' in routes.py https://review.opendev.org/660885
06:38:35 ileixe Hi forks.
06:40:08 ileixe I got an simple test using cpu pinning lately, and the result is somewhat unexpected. So if you are experince in the same environment, please let me know what's wrong.
06:41:11 ileixe My test is that VMs with cpu pinning host can interfere affect to each other.
06:42:45 ileixe I assume that VM with CPU pinning can achieve their own workload though, but the fact is If nosiy VM (which is also CPU pinned) is there they affect to each other.
07:09:38 openstackgerrit Merged openstack/nova stable/stein: Log when port resource is leaked during port delete https://review.opendev.org/657581
07:30:42 openstackgerrit Merged openstack/nova stable/stein: Include all network devices in nova diagnostics https://review.opendev.org/657125
07:30:55 openstackgerrit Merged openstack/nova master: Update description of valid whitelist for non-admin user https://review.opendev.org/642403
07:34:07 openstackgerrit Hamdy Khader proposed openstack/os-vif master: OVS DPDK port representors support https://review.opendev.org/658786
07:37:45 openstackgerrit Alexandre arents proposed openstack/nova master: Fix live-migration when glance image deleted https://review.opendev.org/659054
07:43:05 openstackgerrit Merged openstack/nova master: Skip existing VMs when hosts apply force_config_drive https://review.opendev.org/659703
07:44:42 openstackgerrit Lee Yarwood proposed openstack/nova stable/stein: Skip existing VMs when hosts apply force_config_drive https://review.opendev.org/660914
07:45:08 openstackgerrit Lee Yarwood proposed openstack/nova stable/rocky: Skip existing VMs when hosts apply force_config_drive https://review.opendev.org/660915
07:45:26 openstackgerrit Lee Yarwood proposed openstack/nova stable/queens: Skip existing VMs when hosts apply force_config_drive https://review.opendev.org/660917
08:05:00 alex_xu ileixe: what kind of nosiy you pointed to?
08:05:13 ileixe CPU load
08:05:24 ileixe alex_xu: I used stress and ssl encryption
08:05:32 ileixe tool called 'stress'
08:08:07 alex_xu ileixe: the vcpu and pcpu is 1:1 pinning, but in the same cpu socket, they still share cpu cache
08:08:50 ileixe I made them to be separated by using cpu_thread_policy
08:08:59 ileixe to 'require'
08:09:17 ileixe so I think no VMs share physical core for the test environment.
08:11:40 ileixe alex_xu: Have you ever expereince cpu pinning? Is it assure that VMs could not interfere each other?
08:12:03 ileixe (if there are only cpu loads)
08:13:21 lyarwood # git review
08:13:24 lyarwood Could not connect to gerrit.
08:13:34 lyarwood hmm anyone seeing this or have I just borked something locally?
08:15:35 lyarwood `RSA host key for review.openstack.org has changed and you have requested strict checking.` - nope it's remote
08:21:33 alex_xu ileixe: i only can suggestion you to check whether is system process running on the those pinned pcpu. and setting the emulator thread policy ensure the emulator thread not running on those pcpu.
08:23:14 ileixe alex_xu: Hm.. I double checked libvirt configuration and PID/stats at proc interface, and it was expected. Thanks anyway.
08:25:59 alex_xu ileixe: np, good luck
09:15:25 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove 'ComputeManager._reschedule' https://review.opendev.org/660774
09:15:25 openstackgerrit Stephen Finucane proposed openstack/nova master: Remove cells v1 parameter from 'ComputeTaskAPI.resize_instance' https://review.opendev.org/651311
09:15:26 openstackgerrit Stephen Finucane proposed openstack/nova master: Stop passing 'kwargs' to 'rebuild_instance' https://review.opendev.org/651312
09:15:26 openstackgerrit Stephen Finucane proposed openstack/nova master: Stop passing 'delete_type' to 'terminate_instance' https://review.opendev.org/651313
09:15:27 openstackgerrit Stephen Finucane proposed openstack/nova master: filters: Stop handling cells v1 https://review.opendev.org/651314

Earlier   Later