Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2020-03-23
15:59:07 sean-k-mooney so as to not was gate resouces
16:01:47 openstackgerrit Marcin Juszkiewicz proposed openstack/nova master: CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439
16:02:04 hrw ok, will reedit it then back
16:03:26 openstackgerrit Marcin Juszkiewicz proposed openstack/nova master: [WIP] CI: add tempest-integrated-compute-aarch64 job https://review.opendev.org/714439
16:04:25 hrw ok, my redeployment finished, can now teach tempest to use it
16:34:28 gibi /away
16:46:23 openstackgerrit John Garbutt proposed openstack/nova master: WIP: update quota apis with keystone limits and usage https://review.opendev.org/713499
16:55:27 hrw Took 15.46 seconds to build instance.
16:55:30 hrw now better
16:58:10 hrw uf. tempest even run with it
17:04:27 hrw - Passed: 0
17:04:27 hrw Ran: 353 tests in 34.9147 sec.
17:04:33 hrw so back to config
17:06:37 dansmith sean-k-mooney: gibi: we've got +2s pretty far up the stack, aside from one -1 from alex_xu on top of +2s, and then one -1 from gibi
17:07:05 dansmith sean-k-mooney: gibi: What do you think about dropping the -2 on the bottom patch to let some of those start to flow into the gate while Sundar fixes that one -1 from gibi?
17:07:20 sean-k-mooney dansmith: ya im trying to make my way through the stack today.
17:07:33 dansmith sean-k-mooney: okay you have +1s on a bunch of them too
17:07:46 sean-k-mooney i think the bottom patches i have looked at so far look sane to me
17:08:03 sean-k-mooney so i would be ok with droping the -2 and starting to merge those
17:08:24 sean-k-mooney i have not made it to the later patches in a while but if you feel comfortable with them then i would not be against droping the -2
17:14:26 openstackgerrit Lee Yarwood proposed openstack/nova stable/queens: nova-live-migration: Wait for n-cpu services to come up after configuring Ceph https://review.opendev.org/713845
17:14:26 openstackgerrit Lee Yarwood proposed openstack/nova stable/queens: Replace ansible --sudo with --become in live_migration/hooks scripts https://review.opendev.org/713844
17:18:56 openstackgerrit Lee Yarwood proposed openstack/nova stable/queens: nova-live-migration: Wait for n-cpu services to come up after configuring Ceph https://review.opendev.org/713845
17:21:42 dansmith sean-k-mooney: okay let's see what gibi thinks
17:26:32 gibi dansmith sean-k-mooney: I think it is in a good enough shape to start merging the bottom
17:26:50 dansmith gibi: ack, will drop and make sure those that can merge are +Wd
17:27:00 gibi dansmith: ack, thanks
17:27:24 Sundar dansmith, sean-k-mooney, gibi: Thanks. FWIW, I have started responding to gibi's -1 comments.
17:27:41 gibi Sundar: ack. thanks
17:27:59 dansmith Sundar: cool, if and when you propose fixes, be sure to use git review -R to avoid rebasing the patches that may be in the gate below
17:28:57 dansmith gibi: alex_xu's concern on the "create and bind" is an existing problem not a new one, AFAICT.. I don't want to override his -1 but I don't think there's going to be anything we can or should do in that patch
17:29:13 dansmith gibi: can you have a look at his concern and my response and see if you agree? https://review.opendev.org/#/c/631244
17:30:34 openstackgerrit Lee Yarwood proposed openstack/nova stable/pike: nova-live-migration: Wait for n-cpu services to come up after configuring Ceph https://review.opendev.org/713036
17:31:27 openstackgerrit Lee Yarwood proposed openstack/nova stable/queens: nova-live-migration: Wait for n-cpu services to come up after configuring Ceph https://review.opendev.org/713845
17:32:44 sean-k-mooney dansmith: the whole multi create process cause extra issues.. if you set like --min 2 --max 4 and 1 fails but you end up with 3 running vms then that fine right
17:33:03 gibi dansmith: will check soon
17:33:33 sean-k-mooney so if we do fail to create a binding im not sure if we should be killing the full multi create or just that vm. ideally we woudl reshdule just the one vm that filed right
17:34:02 sean-k-mooney but you were saying the way the funtion currenly works that is not easy to do
17:36:38 hrw is there a tool which takes tempest and gives user readable report? "here are tests which worked, here are skipped ones. and here are failed ones with their output" instead of "here you have @%@Y*T@TGWGHWERIGWYT$(@#YTGWEGHYW as a log"
17:36:53 sean-k-mooney dansmith: doing a continue after cleaning up the current instnace i think could work fine
17:37:04 sean-k-mooney well work in a more intuitive way
17:37:19 sean-k-mooney then killing the entire multi create because 1 instnace failed
17:38:11 sean-k-mooney hrw: you are using a non zuulv3 native job yes?
17:38:34 sean-k-mooney hrw: im guessing the logs you are looking at are double compressed
17:38:52 hrw sean-k-mooney: running tempest locally
17:39:08 sean-k-mooney if that is the issue then you can fix it by doing "curl <log url> | zcat | <program of choice or file>"
17:39:17 sean-k-mooney oh so its not that issue
17:39:36 gibi dansmith: responded. I think the current code is OK, that loop was never designed to try multiple hosts for a single instance
17:40:12 sean-k-mooney gibi: but should it contiue to the next iteration and try the other instnaces?
17:40:40 gibi sean-k-mooney: honestly I would not try that right now. Separately we can think about such enhancement
17:40:42 hrw sean-k-mooney: I start to think that at the end I will write a python script which with load that 10-20MB json file into memory and parse to provide some sane report
17:41:07 gibi sean-k-mooney: this is now simple and it cleans up properly as far as I see.
17:41:13 sean-k-mooney gibi: ok dansmith raised that question in https://review.opendev.org/#/c/631244/68/nova/conductor/manager.py@1621
17:41:44 gibi and I responded there
17:42:00 sean-k-mooney hrw: there is a tool upstream that renders a nice html output
17:42:03 dansmith otp, bbl
17:42:18 sean-k-mooney gibi: cool havent reloaded
17:42:27 sean-k-mooney im going to move on to the next patch in the chain
17:42:46 gibi sean-k-mooney: thanks.
17:42:51 gibi I'm going offline :)
17:42:53 gibi o/
17:44:50 hrw sean-k-mooney: it would be too good.
18:01:42 hrw sean-k-mooney: thanks
19:03:42 artom dansmith, got the energy to look at https://review.opendev.org/#/c/714228/ again?
19:04:53 openstackgerrit Merged openstack/nova master: Make serialize_args handle exception messages safely https://review.opendev.org/712697
19:08:34 artom stephenfin ^^ same, but you're probably done for the day by now
19:24:35 openstackgerrit Merged openstack/nova master: Store instance action event exc_val fault details https://review.opendev.org/694428
19:24:44 openstackgerrit Merged openstack/nova master: Enable unshelve with qos ports https://review.opendev.org/705475
19:38:09 openstackgerrit Merged openstack/nova master: Merge qos related renos for Ussuri https://review.opendev.org/706766
20:12:57 spatel sean-k-mooney: is rcp_thread_pool_size has been replaced with executor_thread_pool_size ?
20:13:04 spatel https://docs.openstack.org/nova/queens/configuration/config.html#executor_thread_pool_size
20:14:18 sean-k-mooney https://docs.openstack.org/nova/queens/configuration/config.html#DEFAULT.executor_thread_pool_size
20:14:31 sean-k-mooney according to the docs yes
20:15:39 spatel cool, i will use executor_thread_pool_size :)
20:32:01 spatel sean-k-mooney: what do you suggest about heal_instance_info_cache_interval value, its ok to keep it little high (default: 60)
20:33:01 sean-k-mooney in theory it should not be needed at all. it is intended to ensure that nova and neutron does not get out of sync if you modify attributes of the neutron port out of band of nova
20:33:21 sean-k-mooney so yes it can be set longer that said it should not be disabled
20:33:39 sean-k-mooney mainly because there is not testing for running without the healing.
20:34:25 spatel i am trying to reduce load on neutron-servers so trying to tune some value
20:35:18 spatel as VMs grows it put more pressure on neutron
20:38:44 sean-k-mooney you should be able to set it to 300 safely enough
20:41:10 spatel cool
21:15:00 sean-k-mooney dansmith: gibi Sundar just finished reviewing the cyborg series. i noticed a few nits all of which could be adressed in a follow up patch but one thing is definetly missing. i think we all agree that cyborg integration qualifies for a release note but i dont see one in the series
21:16:16 sean-k-mooney we could add it in the followup patch when adressing some fo the nits but strictly speaking i belive it should be added here https://review.opendev.org/#/c/673735/46 and then update by each of the follow on patches to reflect the different capablities
21:16:44 sean-k-mooney that said we can just add it in https://review.opendev.org/#/c/674726/9 which is the last functional patch
21:21:11 Sundar sean-k-mooney: Ack. I'll take a look
21:21:24 Sundar Thanks for the reviews.
21:21:44 Sundar Any luck with testing the rescheduling?
21:33:17 sean-k-mooney i have not had a chance to test it but i might get to do it tomororow. i will be redeploying the latest version tomorow in anycase
21:33:43 sean-k-mooney i was condiering locally modifying the spawn to fail on one node to then assert the correct behaviro for reschdule
21:42:06 sean-k-mooney artom: whitebox is breaking thing it should not be able to break...
21:42:08 sean-k-mooney https://zuul.opendev.org/t/openstack/build/bc5fd77019b74363ab3b06478fd386de
21:42:51 sean-k-mooney artom: its causing tempest-tox-plugin-sanity-check to fail
21:43:01 sean-k-mooney .
21:43:04 artom Whoa
21:43:23 sean-k-mooney i have no idea why its checking whitebox either
21:43:34 sean-k-mooney but we should proably fix that
21:44:07 sean-k-mooney its becasue we merged https://opendev.org/x/whitebox-tempest-plugin/commit/c1285626fee890a00f247ff0d0bde1249b90a59f
21:44:17 artom sean-k-mooney, right, I get the error
21:44:28 artom I just have no idea how we ended up in that job

Earlier   Later