Earlier  
Posted Nick Remark
#openstack-nova - 2018-04-26
21:46:53 jaypipes mriedem: "the great placement schism of 2018" lol :)
21:48:07 mriedem lance stepped right into a big pile of it
22:27:53 openstackgerrit Eric Fried proposed openstack/nova master: WIP: Use helpers in test_resource_provider (func) https://review.openstack.org/564638
22:31:02 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in test_xenapi.py (1) https://review.openstack.org/564639
22:40:29 openstackgerrit Ed Leafe proposed openstack/nova master: WIP - Add consumer generation checking logic https://review.openstack.org/564641
22:45:45 melwitt mriedem: did you mention sort of recently that we had a new dbdeadlock somewhere?
22:46:59 openstack Launchpad bug 1642537 in OpenStack Compute (nova) "finish_resize fails with DBDeadlock on migrations table" [Undecided,Confirmed]
22:46:59 mriedem yeah, but now i don't remember if i opened a bug for it, since i only see https://bugs.launchpad.net/nova/+bug/1642537
22:47:06 melwitt yeah, same
22:47:22 melwitt logstashin it
22:49:15 melwitt lots in neutron
22:50:14 mriedem neutron has a lot of retry_on_deadlock decorators
22:50:32 mriedem you likely need to add: AND tags:"screen-n-cpu.txt"
22:50:49 melwitt thanks, was about to try that
22:51:20 melwitt [instance: 6dcdb60e-e398-43c0-a6c0-21d0494185c1] RemoteError: Remote error: DBDeadlock (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') [SQL: u'UPDATE migrations SET updated_at=%(updated_at)s, status=%(status)s WHERE migrations.id = %(migrations_id)s'] [parameters: {'status': u'post-migrating', 'migrations_id': 4, 'updated_at': datetime.datetime(2018, 4, 26, 21, 16, 31, 790833)}]
22:52:58 melwitt 8 hits in the last 7 days but all on the same change and all in the ceph job. seems weird
22:53:23 melwitt hah, it's my backport https://review.openstack.org/564615
22:55:01 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in test_xenapi.py (2) https://review.openstack.org/564643
22:57:09 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in unit/virt/xenapi/test_vmops.py https://review.openstack.org/561846
23:07:32 melwitt how does DBDeadlock work if there's already a @oslo_db_api.wrap_db_retry(max_retries=5, retry_on_deadlock=True) decorator on the method? does that mean it tried 5 times already and still got deadlocked?
23:10:51 mriedem i think so
23:11:42 melwitt okay. seeing it on an internal bug in queens during the service record report_count update by the conductor service (service heartbeat)
23:12:08 melwitt not sure what could be clashing with that
23:14:39 melwitt although, this is a scale test situation and seeing messaging timeouts, so maybe it's just all of the various service heartbeats being affected by that
23:17:59 mriedem lbragstad: hitting something weird in a test for placement policy; it's a fake token / user context, but it has the 'admin' role in the context, and the rule it's checking against is "role:admin", and these are the policy values from the context:
23:18:01 mriedem {'is_admin_project': True, 'user_id': 'admin', 'service_project_id': None, 'project_domain_id': None, 'service_user_domain_id': None, 'service_user_id': None, 'roles': ['admin'], 'service_project_domain_id': None, 'user_domain_id': None, 'project_id': 'admin', 'service_roles': []}
23:18:08 mriedem is there something obvious i might not be thinking of?
23:18:16 mriedem i figured 'roles': ['admin'] would be enough
23:19:11 mriedem oh sorry, it's actually using this rule: rule:admin_api
23:19:19 mriedem which is defined as: is_admin:True
23:19:44 mriedem and i'm guessing that's failing because the policy creds don't have an is_admin key?
23:19:49 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in test_xenapi.py (3) https://review.openstack.org/564645
23:20:14 mriedem i think this might be due to that goofy context_is_admin middleware thing
23:20:22 mriedem which i'm not using in the placement policy stuff
23:23:24 mriedem ah yes, nova.context.RequestContext overrides to_policy_values to add is_admin https://github.com/openstack/nova/blob/master/nova/context.py#L263
23:46:52 mriedem yup that was it, got it fixed now
23:47:18 mriedem melwitt: would be sweet if we could build docs locally again https://review.openstack.org/#/c/564631/
23:51:08 melwitt +2
23:54:44 mriedem danke
23:55:22 openstackgerrit Matt Riedemann proposed openstack/nova master: WIP: Implement granular policy rules for placement https://review.openstack.org/524425
#openstack-nova - 2018-04-27
00:24:34 openstackgerrit Dinesh Bhor proposed openstack/nova master: PCPU: Define numa dedicated CPU resource class https://review.openstack.org/561770
00:31:31 openstackgerrit Sam Morrison proposed openstack/nova master: Allow ability for non admin users to use all filters on server list. https://review.openstack.org/526558
00:59:02 yikun_ @mriedem, @melwitt I will complete the novaclient change for micover 2.62 today. : ) thanks!
01:06:22 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in tests/unit/api/*/test_volumes.py https://review.openstack.org/564655
01:17:18 lbragstad[m] Figure it out mriedem?
01:18:19 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in test_live_migrate.py https://review.openstack.org/564656
01:34:32 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in test_conductor.py (1) https://review.openstack.org/564658
01:54:59 openstackgerrit Takashi NATSUME proposed openstack/nova master: Remove mox in test_conductor.py (2) https://review.openstack.org/564659
02:09:34 openstackgerrit Tetsuro Nakamura proposed openstack/nova-specs master: Return resources of entire trees in Placement https://review.openstack.org/559466
04:01:14 openstackgerrit Nguyen Hai proposed openstack/nova-specs master: Follow the new PTI for document build https://review.openstack.org/551802
04:15:41 openstackgerrit Yikun Jiang (Kero) proposed openstack/python-novaclient master: Microversion 2.62 - Add host/hostId to instance action event https://review.openstack.org/564667
04:20:26 openstackgerrit Yikun Jiang (Kero) proposed openstack/python-novaclient master: Microversion 2.62 - Add host/hostId to instance action event https://review.openstack.org/564667
06:53:38 openstackgerrit Tetsuro Nakamura proposed openstack/nova master: Add unit tests for alloc_cands with member_of https://review.openstack.org/561399
06:53:39 openstackgerrit Tetsuro Nakamura proposed openstack/nova master: Fix member_of with shared providers https://review.openstack.org/561400
07:21:00 giblet ehh somebody registered the giblet nick :/
07:38:04 openstackgerrit Yikun Jiang (Kero) proposed openstack/python-novaclient master: Microversion 2.62 - Add host/hostId to instance action event https://review.openstack.org/564667
08:10:45 openstackgerrit Martin Midolesov proposed openstack/nova master: vmware:Validation video ram against the max video ram allowed. https://review.openstack.org/564193
08:26:47 openstackgerrit Takashi NATSUME proposed openstack/python-novaclient master: Fix the policy argument in server-group-create https://review.openstack.org/564699
08:39:07 openstackgerrit Takahito Hirose proposed openstack/python-novaclient master: modified novaclient/api_versions.py When using python 3.5.0, [- 4] can not take information. Necessary information is in the [-5]. Because it better is using 'for loops'. https://review.openstack.org/564702
09:03:16 gameon Hi all - I am running Pike, and have set 'osapi_compute_unique_server_name_scope = "global"' in nova.conf across all Nova nodes and scheduler containers, but I can still attempt to create two instances with the same name. The second will sit in a scheduling state, the expected 'InstanceExists' isn't produced. Does anyone have any advise, please?
10:17:58 openstackgerrit Takahito Hirose proposed openstack/python-novaclient master: modified novaclient/api_versions.py When using python 3.5.0, [- 4] can not take information. Necessary information is in the [-5]. Because it better is using 'for loops'. https://review.openstack.org/564722
10:33:03 openstackgerrit Takahito Hirose proposed openstack/python-novaclient master: api_version decorator becomes an error in Python 3.5.0. https://review.openstack.org/564722
10:38:07 openstackgerrit Kashyap Chamarthy proposed openstack/nova master: libvirt: Lift the restriction of choices for `cpu_model_extra_flags` https://review.openstack.org/563926
11:04:58 openstackgerrit Takahito Hirose proposed openstack/python-novaclient master: api_version decorator becomes an error in Python 3.5.0. https://review.openstack.org/564731
11:32:05 sean-k-mooney stephenfin: impresive http://eavesdrop.openstack.org/irclogs/%23openstack-nova/%23openstack-nova.2018-04-26.log.html#t2018-04-26T10:23:28 ill add them to my review queue but it could take a while to get to all of them. is it working end ot end?
11:34:00 openstackgerrit Martin Midolesov proposed openstack/nova master: vmware:Validation video ram against the max video ram allowed. https://review.openstack.org/564193
11:59:45 fried_rice ō/
12:00:23 sean-k-mooney fried_rice: o/
12:01:37 sean-k-mooney fried_rice: am i correct in assuming that you are currently targeting Rocky 2 to complete the granular resouce request now that we are past rocky 1
12:02:03 fried_rice sean-k-mooney: I hadn't really considered a "target" tbh
12:02:44 fried_rice sean-k-mooney: I'm not hurrying, because jaypipes had said he didn't want it to go in until nrp was done.
12:03:19 fried_rice sean-k-mooney: I personally don't think it needs to wait (we can still get some good scenarios with just sharing providers) but that's taken some of the steam off.
12:03:35 sean-k-mooney nrp is kind of done already. at least the ablity to model things with nested resouce providers but i gues you mean the ablity to use nRPs with allocation candiates
12:03:44 mdbooth LibvirtDriver._should_disconnect_volume() has no locking :(
12:03:58 fried_rice sean-k-mooney: The latter, without which nrp doesn't help us much.
12:03:59 mdbooth s/volume/target/
12:04:29 fried_rice mdbooth: locking schmocking. It must be eventlet's fault.
12:04:48 mdbooth fried_rice: Every time... we never add locking to this stuff.
12:04:52 sean-k-mooney fried_rice: well it allows you to do all of the discovery part in things like cyborg or other project that will use NPRs in the future just not the schduling part
12:05:29 fried_rice sean-k-mooney: Right. And without the scheduling part... what can we do with it?
12:06:03 cdent gaze at our lovely towers?
12:06:04 mdbooth The rule of thumb is: if there's an opportunity for a race, it's almost always actually a race.
12:06:33 sean-k-mooney fried_rice: expose our inventories of resouces and starte to think about how to organise the tree and what to model as seperate resouces classes/ common with traits
12:07:17 sean-k-mooney fried_rice: so baicaly nothing beyond get a feel for how the api will work when we have requests
12:07:41 fried_rice sean-k-mooney: Yup. We should totally start to think about that. And like half of the specs open/approved for Rocky think about it.
12:07:43 sean-k-mooney cdent: i proably should
12:08:19 fried_rice sean-k-mooney: Which of course means that those specs are dead in the water until nrp works in alloc cands.
12:08:21 sean-k-mooney fried_rice: yes i just find its eaiser to do that kind of thing when you have something concreate to test it with
12:28:46 openstackgerrit Takashi NATSUME proposed openstack/python-novaclient master: Fix the policy argument in server-group-create https://review.openstack.org/564699
12:31:19 leakypipes sean-k-mooney: https://review.openstack.org/#/c/554529/
12:32:01 sean-k-mooney leakypipes: oh cool i see its jsut pending a +w
12:38:40 fried_rice sean-k-mooney: tbc, that patch does *not* enable nrp in alloc cands. There's half a dozen patches on top of it that get closer. But the actual microversion patch to make it work through the API has not yet been proposed (to my knowledge).
12:39:41 sean-k-mooney fried_rice: ok im just reading through the patch now
12:40:01 fried_rice sean-k-mooney: Best of luck.
12:40:14 fried_rice sean-k-mooney: If you understand this sqla stuff, we could use your help :)
12:40:29 kashyap sean-k-mooney: When you can, want to ACK this: https://review.openstack.org/#/c/563926/
12:40:38 kashyap (It's the Lift the restriction of choices for `cpu_model_extra_flags`)
12:40:59 kashyap sean-k-mooney: After discussion with QEMU / libvirt folks, I've lifted restriction for all three CPU modes
12:41:01 sean-k-mooney fried_rice: i understad some of it but leakypipes still runs rings around me when it comes to sql
12:41:26 kashyap (See the config file help text for a valid use case.)

Earlier   Later