| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-12-05 | |||
| 12:15:23 | jangutter | kashyap: use the "curl XX | sudo bash" compression method. | |
| 12:15:35 | kashyap | Haha, yikes | |
| 12:16:55 | sean-k-mooney | jangutter: i mean that is how you install docker right :p | |
| 12:18:29 | sean-k-mooney | actully i wonder if my old docker devstack still works... | |
| 12:20:12 | jangutter | kashyap: you know the history behind tcc? ( https://en.wikipedia.org/wiki/Tiny_C_Compiler ) | |
| 12:20:33 | kashyap | jangutter: Hehe, funny you mention that! That was one of the images I prepared for the 2016 Advent Calendar! | |
| 12:20:44 | sean-k-mooney | jangutter: wasnt it for an obfucation compition intally | |
| 12:21:18 | kashyap | jangutter: Checkout the day-16 image: https://www.qemu-advent-calendar.org/2016/#day-16 | |
| 12:22:23 | jangutter | sean-k-mooney: yep. It just goes to show you that in every thousand cool hacks at least once something really useful emerges. | |
| 12:23:51 | sean-k-mooney | i used to use this as my primay dev env in a vm for about 6-9 months | |
| 12:23:53 | sean-k-mooney | https://github.com/SeanMooney/docker-devstack | |
| 12:24:42 | jangutter | kashyap: Ah, day 13 of 2016 - turtles all the way down. | |
| 12:24:53 | sean-k-mooney | its 2 docker continers one of which had a dev environment e.g. ide, wireshark firefoxd, rdp server and another that run systemd and was where devstack woudl be run | |
| 12:25:30 | sean-k-mooney | jangutter: well i had a 10 node openstack dev cluster already | |
| 12:25:35 | kashyap | jangutter: Yep, do read the README before you run it :D | |
| 12:26:03 | kashyap | Because it will create a "loop" of nested guests until your system runs out of memory (a.k.a crashes) | |
| 12:27:31 | jangutter | kashyap: In other words it emulates nearly all my OpenStack setups perfectly. | |
| 12:29:08 | sean-k-mooney | why do i get the feeling ill have to learn to debug casandra with all the edge stuff in the future | |
| 12:30:29 | jangutter | sean-k-mooney: You're just making doomed predictions that nobody believes.... like Cassandra did. | |
| 12:32:12 | sean-k-mooney | no im reading the mail tread that jsut said we need a weakly consitent backend for openstack to replace mysql and casandra is the only "db" i know of that is weakly consitent | |
| 12:32:53 | sean-k-mooney | jangutter: i was reading http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000606.html | |
| 12:36:27 | jangutter | sean-k-mooney: and yet.... python still has the GIL. | |
| 12:38:37 | sean-k-mooney | jangutter: well that serves a different usecase | |
| 12:38:54 | sean-k-mooney | eventual consitence does not mean you allow data races | |
| 12:39:08 | sean-k-mooney | you just may be working on old data | |
| 12:39:17 | sean-k-mooney | but it was still valid data | |
| 12:39:25 | jangutter | sean-k-mooney: yeah, like RCU. | |
| 12:40:04 | sean-k-mooney | yep | |
| 12:40:24 | kashyap | gibi: stephenfin: I think this can be merged, FWIW; added my +1 with notes: https://review.openstack.org/#/c/575735/ (handle logfiles for tcp-based consoles) | |
| 12:42:22 | gibi | kashyap: thanks. I upgrade my vote | |
| 13:05:07 | openstackgerrit | Merged openstack/nova master: Deprecate the nova-console service https://review.openstack.org/610075 | |
| 13:08:39 | mdbooth | This is interesting. Profiling the execution with testtools.run of a single functional test, top results by individual call time: http://paste.openstack.org/show/736703/ | |
| 13:09:08 | mdbooth | Am I reading that right, do we call Compute.API.__init__() 616 times? | |
| 13:09:36 | cdent | sure looks that way | |
| 13:10:02 | mdbooth | That seems suboptimal | |
| 13:10:38 | cdent | also a tshirt | |
| 13:10:57 | mdbooth | Hehe | |
| 13:12:17 | mdbooth | In wallclock time, it's db access which is slow. | |
| 13:12:25 | sean-k-mooney | well at least its not a global | |
| 13:14:05 | mdbooth | I wonder where we're creating new Compute.API objects. It's not the cheapest operation. | |
| 13:18:43 | openstackgerrit | Merged openstack/nova master: Deprecate the nova-xvpvncproxy service https://review.openstack.org/610076 | |
| 13:18:52 | openstackgerrit | Merged openstack/nova stable/rocky: hardware: fix memory check usage for small/large pages https://review.openstack.org/599413 | |
| 13:22:23 | cdent | mdbooth: you are likely on the edge of a deep deep hole. One which, if you choose to enter, will lead to riches beyond your dreams. But you might be there a while. | |
| 13:34:18 | mdbooth | cdent: Hehe. Yeah, I'm going to reduce the scope to establishing why mriedem had to revert my functional test. | |
| 13:34:41 | mdbooth | And for that I need a stand-out, obvious culprit. | |
| 13:34:50 | mdbooth | The above was just a surprising observation. | |
| 14:01:15 | kaisers | mdbooth: regarding https://review.openstack.org/#/c/554195/ - some time ago you were'nt happy with the issue details, i tried to shed a bit more light on things, could you revisit this at some point pls? | |
| 14:03:29 | mdbooth | kaisers: Is the fix still required in the context of the systemd bugfix? | |
| 14:04:36 | kaisers | mdbooth: yes, the problem ist that we added the --user flag. that fails for multiple reasons | |
| 14:04:52 | kaisers | (i listed them in the commit message and the bugs new description | |
| 14:04:53 | kaisers | ) | |
| 14:06:06 | mdbooth | kaisers: Which version of CentOS doesn't support --user? | |
| 14:06:21 | kaisers | latest as of two days ago | |
| 14:06:22 | mdbooth | Which operating systems don't ship with the systemd fix? | |
| 14:06:33 | mdbooth | kashyap: So CentOS 7? | |
| 14:06:52 | kaisers | The problem ist not the fix for systemd but that it ships with an older systemd that does not support the --user flag | |
| 14:08:29 | kaisers | centos 7 comes with v219, the bug came up with v229 (i think) and was fixed with 23x | |
| 14:09:43 | kaisers | Fixed in v238 according to https://github.com/systemd/systemd/blob/master/NEWS | |
| 14:10:43 | kaisers | mmh, sorry, bug described with v233 in that news link, not v229 | |
| 14:20:20 | openstackgerrit | Chris Dent proposed openstack/nova master: Correct lower-constraints.txt and the related tox job https://review.openstack.org/622972 | |
| 14:20:44 | cdent | stephenfin: ^ has an issue that needs to be resolved before it can be merged, but gets close | |
| 14:25:49 | gibi | stephenfin, mriedem: hi! the last two notification transformation patch is good to go from my perspective https://review.openstack.org/#/q/topic:bp/versioned-notification-transformation-stein+status:open | |
| 14:27:14 | stephenfin | cdent: I'd kill the test, personally. lbragstad added it in 6244a442784 and, while I get what it's doing, I don't think the lower-constraints thing is more of an issue | |
| 14:27:20 | stephenfin | Good to get a second opinion though | |
| 14:28:26 | stephenfin | kaisers: The bug's introduced in v233 and fixed in v238? | |
| 14:29:03 | kaisers | stephenfin: I'm not sure when it was introduced but that's the version for which it is reported in the systemd changelog. | |
| 14:29:13 | kashyap | mdbooth: Hi, was AFK for a break; reading the scroll | |
| 14:29:16 | mriedem | gibi: ack | |
| 14:29:41 | kaisers | stephenfin: But as stated earlier, the more direct problem is that centos 7 comes with v219 and e.g. xenial with 229, both not supporting the --user flag | |
| 14:30:08 | kashyap | mdbooth: Okay, I see kaisers already mentioned which version of systemd ships in CentOS and which one you care about | |
| 14:30:12 | kaisers | stephenfin: scratch that last comment, v229 does support it | |
| 14:30:24 | kaisers | so the old version issue only comes up with centos | |
| 14:30:36 | stephenfin | kaisers: Yup, gotcha | |
| 14:31:05 | mdbooth | mriedem: Hey, about that functional test. Appreciate it made sense to take it out, but I'm trying to work out how we can safely get it back in. Problem is that we basically have no idea why it was failing and now way of finding out that I can think of without running it in CI. Could I perhaps fire up a non-voting job which enabled DEBUG output? | |
| 14:31:36 | mdbooth | I responded on the bug that I *suspect* a performance issue in CI. | |
| 14:31:38 | gibi | mdbooth: does it only fail in CI? | |
| 14:31:59 | mdbooth | gibi: Well it never fails locally. I've run it hundreds of times. | |
| 14:32:12 | stephenfin | kaisers: OK, I can't speak for mdbooth but the last thing I'd like to see is a comment in the code itself explaining that this is only required for CentOS 7 | |
| 14:32:19 | mriedem | mdbooth: i suspect globals | |
| 14:32:20 | gibi | mdbooth: let me try it and see if I can make it fail | |
| 14:32:29 | mriedem | could try the REQUIRES_LOCKING variable or whatever | |
| 14:32:43 | stephenfin | Presumably once CentOS 8 (or 8.1) is out and starts gaining traction, we can remove this again | |
| 14:32:44 | mdbooth | stephenfin kaisers: Also there's a better way to detect systemd | |
| 14:32:48 | mriedem | but i also suggesting writing a libvirt driver extension which overrides methods rather than mock them | |
| 14:32:54 | mriedem | *suggested | |
| 14:32:55 | kaisers | stephenfin: mdbooth: I'm still not sure why the third issue comes up, the --user flag failing when run via oslo_concurrency.processutils.execute. The error shown is similar to running --user as root but the python call should be executed as user nova afaics. I'm still digging into this but currently this fails, too | |
| 14:32:57 | mdbooth | mriedem: What makes you think globals? | |
| 14:33:17 | aspiers | dansmith, mriedem: any thoughts on latest patch set of SEV spec? I tried to capture the results of our Berlin conversations, and sean-k-mooney seems happier now IIUC | |
| 14:33:30 | mriedem | mdbooth: i'd have to look at the bug report again | |
| 14:33:37 | kaisers | mdbooth: regarding the systemd detection i'm all ears, i'm using the method danpb recommended to me some time ago | |
| 14:33:38 | mriedem | in the middle of a different evacuate issue with CI | |
| 14:33:45 | mriedem | aspiers: i haven't looked yet | |
| 14:33:56 | aspiers | mriedem: for your convenience :) https://review.openstack.org/#/c/609779/14..15/specs/stein/approved/amd-sev-libvirt-support.rst | |
| 14:34:38 | kaisers | stephenfin: I'll add the CentOS / systemd release version info to the change | |
| 14:34:51 | stephenfin | gibi: ack. I need to get some reviews done. Only just finished reading 3 weeks of emails (yes, it is already Wednesday :-\) | |
| 14:35:21 | aspiers | mriedem: it looks like only 16MB will need to be accounted for per VM in CONF.reserved_host_memory_mb | |
| 14:35:23 | gibi | stephenfin: no worries, this is the last two patches and we have still time til milestone 2 :) | |
| 14:36:31 | mdbooth | mriedem: Interesting. What difference would it make to override rather than mock? Are you thinking class variables? | |
| 14:36:33 | mriedem | aspiers: and that's something the operator needs to calculate and configure that option based on how many sev instances they think will be on a given host? | |
| 14:36:38 | kaisers | stephenfin: oh, i misread, you do _not_ want that change pointed out to be specifically for centos 7, sry | |