| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-12-06 | |||
| 00:10:17 | sean-k-mooney | haha ya but this would be on i guess the conductor | |
| 00:10:29 | sean-k-mooney | or supper conductor | |
| 00:11:17 | sean-k-mooney | the node status is in i think both the api and cell db so we dont need to run this on every compute node | |
| 00:11:42 | tssurya | node status is only in the cell db's | |
| 00:11:57 | sean-k-mooney | ok so but it could run on the cell conductor then | |
| 00:12:14 | tssurya | yea could be | |
| 00:12:40 | sean-k-mooney | an you could set the interval to a week if you wanted and this time supprot disabling it right out of the box by setting to 0 | |
| 00:13:06 | tssurya | but not sure if its an upcall when updating the api aggregate table frm the cell conductor but yea these are implementation details | |
| 00:13:11 | sean-k-mooney | if you trust it to not get out of sync our you will fix it later then no need to run it | |
| 00:13:50 | sean-k-mooney | tssurya: oh im talking about placemetn aggreagtes not nova host aggrats by the way | |
| 00:14:45 | tssurya | sean-k-mooney: oh okay! | |
| 00:15:05 | tssurya | since you saud "nova" adds hosts, got confused | |
| 00:15:34 | sean-k-mooney | ya i should have said nova update the placment aggragte with the compute node RP uuid | |
| 00:16:06 | tssurya | right yea | |
| 01:28:47 | jaypipes | cfriesen: you have awoken the kraken. but unfortunately, the kraken is too tired from playing tennis to fight tonight :) so, will chat tomorrow about it. | |
| 02:23:55 | openstackgerrit | Jack Ding proposed openstack/nova master: Preserve UEFI NVRAM variable store https://review.openstack.org/621646 | |
| 02:33:19 | openstackgerrit | Guo Jingyu proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.openstack.org/623120 | |
| 02:44:30 | openstackgerrit | Guo Jingyu proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.openstack.org/623120 | |
| 02:46:48 | openstackgerrit | Guo Jingyu proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.openstack.org/623120 | |
| 02:51:53 | openstackgerrit | Guo Jingyu proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.openstack.org/623120 | |
| 03:11:01 | openstackgerrit | Guo Jingyu proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.openstack.org/623120 | |
| 03:26:36 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Handle tags in _bury_in_cell0 https://review.openstack.org/621856 | |
| 03:43:55 | openstackgerrit | Takashi NATSUME proposed openstack/nova stable/rocky: Add a bug tag for nova doc https://review.openstack.org/623130 | |
| 04:16:45 | openstackgerrit | Guo Jingyu proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.openstack.org/623120 | |
| 04:52:18 | openstackgerrit | Guo Jingyu proposed openstack/nova-specs master: Proposal for a safer noVNC console with password authentication https://review.openstack.org/623120 | |
| 06:58:42 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: api-ref: Body verification for the lock action https://review.openstack.org/622835 | |
| 07:00:32 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Handle tags in _bury_in_cell0 https://review.openstack.org/621856 | |
| 07:41:25 | openstackgerrit | Merged openstack/nova master: Update mailinglist from dev to discuss https://review.openstack.org/621827 | |
| 07:41:36 | openstackgerrit | Merged openstack/nova master: modify the avaliable link https://review.openstack.org/616905 | |
| 09:16:53 | gibi | stephenfin: regarding shorted notification payload, would you like to see the samples stored in nova sorted only or also the json emitted on the message bus? | |
| 09:23:39 | gibi | mdbooth: in the failure in nova.tests.functional.regressions.test_bug_1550919.LibvirtFlatEvacuateTest in http://logs.openstack.org/22/606122/7/check/nova-tox-functional/1f3126b/testr_results.html.gz there are 9 seconds gap between '[nova.virt.libvirt.driver] Creating image' and the first polling of the server state. So someting is definitely slow there _before_ even the test try to wait for 5 seconds | |
| 09:23:45 | gibi | to see the server is ACTIVE state | |
| 09:24:06 | mdbooth | gibi: looking | |
| 09:24:33 | mdbooth | gibi: That's one of the ones which looked 'generally unhappy' I think. | |
| 09:25:08 | gibi | mdbooth: unfortunately we dont have such timing data from successful runs :/ | |
| 09:26:14 | mdbooth | gibi: Or DEBUG logs :( | |
| 09:26:19 | gibi | does 'Creating image' means that in these test we really generate the root fs for the instance? | |
| 09:27:28 | mdbooth | gibi: No. The disk creation is stubbed to just touch the file. | |
| 09:27:58 | mdbooth | However, it does execute _resolve_driver_format in imagebackend, which executes qemu-img. | |
| 09:28:16 | mdbooth | I have a patch locally to mock that out, but on my unloaded system it doesn't make a massive difference. | |
| 09:28:46 | mdbooth | I can see that it's about 3 seconds of wall clock time, although multithreaded. | |
| 09:32:59 | gibi | mdbooth: I see. Honestly I don't know what could be the real problem. In the run http://logs.openstack.org/22/606122/7/check/nova-tox-functional/1f3126b/testr_results.html.gz I see missing DB table exceptions as well that reminds me the race we fixed with cdent last week in the placement db fixture. Maybe that race had other side effects. However we only fixed that in the split out placement repo. | |
| 09:34:05 | mdbooth | gibi: Like I said yesterday, I suspect it's just a canary: the first thing to die when conditions get bad. | |
| 09:34:30 | mdbooth | I could mock another couple of things out, and increase the timeout. | |
| 09:35:00 | gibi | mdbooth: could very well be it. Still it woul be nice to know why 5 seconds in not enough in these tests. But I know that we don't have data to figure that out | |
| 09:35:18 | mdbooth | gibi: Why don't we have debug enabled, btw? | |
| 09:36:09 | gibi | mdbooth: I'm not sure, maybe we don't want to store that much of logs. | |
| 09:37:13 | gibi | mdbooth: but if you can propose a patch that turns the debug log on, I can support that. and we will see if there are other oppinions | |
| 09:42:47 | gibi | stephenfin: I can try to propose the sorting patch and see if people start puking | |
| 09:43:03 | gibi | stephenfin: anyhow, thanks for the reviews on those patches | |
| 09:43:27 | mdbooth | gibi: Thanks for spending time on this. | |
| 09:43:50 | gibi | mdbooth: I mysteries :) | |
| 09:44:14 | mdbooth | Sometimes, anyway. | |
| 10:10:40 | yan0s | I have a question about nova policies | |
| 10:11:27 | yan0s | are variables "compute:create", "compute:get" etc deprecated? | |
| 10:12:08 | yan0s | I see they are not mentioned in the latest documentation | |
| 10:12:09 | yan0s | https://docs.openstack.org/nova/rocky/configuration/policy.html | |
| 10:13:15 | yan0s | also testing some of them I think they affect access rights | |
| 10:13:42 | yan0s | only their "os_compute_api" equivalents work | |
| 10:19:22 | kashyap | gibi: Heya, Zuul was "-2" on this: https://review.openstack.org/#/c/620327/. Guess if I do a 'rechek', I'll "lose" all the ACKs? | |
| 10:20:00 | gibi | kashyap: I don't think so | |
| 10:20:05 | kashyap | Seems to be a 'neutron-grenade' failure | |
| 10:20:19 | gibi | kashyap: if you checked the fauilre and seems unrealated to your patch then feel free to recheck | |
| 10:20:53 | kashyap | Yeah, they're unrelated; I can't spot anything related to my patch: http://logs.openstack.org/27/620327/3/gate/neutron-grenade/8ffe31b/job-output.txt.gz | |
| 10:23:01 | gibi | kashyap: yeah the cells-v1 test failure seems unrelated | |
| 10:24:03 | gibi | kashyap: and I dont see anything suspicious in the grenade log either | |
| 10:24:33 | kashyap | Thanks! I hit a 'recheck' | |
| 10:24:34 | gibi | kashyap: btw, you only loose the +W if you need to rebase | |
| 10:24:49 | kashyap | gibi: Ah, noted. | |
| 10:48:43 | lyarwood | mdbooth: https://review.openstack.org/#/c/619804/ - I know you're busy with your own func test hell but can you add this to your queue today, happy to close it out if it isn't useful. | |
| 10:50:06 | mdbooth | lyarwood: Oh, nice. Does it work? | |
| 10:50:46 | mdbooth | lyarwood: I see you're using it in the patch above. | |
| 10:50:58 | lyarwood | mdbooth: I was, but I've dropped the patch above now | |
| 10:51:06 | lyarwood | mdbooth: so I either rebase this on your stuff or kill it | |
| 10:51:15 | lyarwood | mdbooth: and it works, I think. | |
| 11:28:54 | openstackgerrit | Merged openstack/nova master: Clean up cpu_shared_set config docs https://review.openstack.org/614864 | |
| 11:29:00 | openstackgerrit | Merged openstack/nova master: Delete NeutronLinuxBridgeInterfaceDriver https://review.openstack.org/616995 | |
| 11:53:02 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: Add DownCellFixture https://review.openstack.org/614810 | |
| 11:53:03 | openstackgerrit | Surya Seetharaman proposed openstack/nova master: API microversion 2.68: Handles Down Cells https://review.openstack.org/591657 | |
| 12:04:41 | openstackgerrit | Chris Dent proposed openstack/nova master: Correct lower-constraints.txt and the related tox job https://review.openstack.org/622972 | |
| 12:25:24 | openstackgerrit | Guo Jingyu proposed openstack/nova master: Add rfb.VNC support for novncproxy https://review.openstack.org/622336 | |
| 12:33:32 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: Handle tags in _bury_in_cell0 https://review.openstack.org/621856 | |
| 12:58:49 | openstack | Launchpad bug 1805989 in OpenStack Compute (nova) "Weight policy to stack/spread instances and "max_placement_results"" [Undecided,New] | |
| 12:58:49 | mriedem | tssurya: belmoreira: i'm not sure what i'm missing here https://bugs.launchpad.net/nova/+bug/1805989 | |
| 13:03:17 | tssurya | mriedem: I guess from our prespective since we don't use any scheduler fitlers (except the Compute Filter), as opposed to a scenario where placement would return all results as in all possible available resources on which the weights would be applied versus what happens now when we do this only the max_placement_results number of available resources (hosts) | |
| 13:03:46 | tssurya | would effect the way packing/spreading is done | |
| 13:03:52 | mriedem | that's working as designed.... | |
| 13:04:04 | mriedem | max_placement_results is just a front-end filter | |
| 13:04:23 | sean-k-mooney | tssurya: you dont use any filetre so you dont use sriov/pci passthrough/cpu pinning/hugepages or numa in your cloud | |
| 13:04:26 | mriedem | like i said in the bug, even before placement, if you have 1k hosts, if the filters narrow that down to 10, then only 10 get weighed | |
| 13:04:33 | mriedem | sean-k-mooney: no they don't, | |
| 13:04:37 | mriedem | oh well, | |
| 13:04:39 | mriedem | nvm | |
| 13:04:55 | mriedem | b/c of cells v1 there were several things they couldn't support before, like affinity | |
| 13:05:04 | mriedem | idk about pci/numa | |
| 13:05:15 | openstack | Launchpad bug 1805984 in OpenStack Compute (nova) "Placement is not aware of disable compute nodes" [Wishlist,Triaged] | |
| 13:05:15 | sean-k-mooney | this seams kindof like a duplicate of https://bugs.launchpad.net/nova/+bug/1805984 | |
| 13:05:18 | tssurya | sean-k-mooney: we use pci passthrough, but not that much (just for one cell) | |
| 13:05:48 | mriedem | sean-k-mooney: that is definitely a different problem | |
| 13:06:02 | mriedem | that bug is that placement is returning only disabled computes | |