| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-12-05 | |||
| 12:06:34 | jangutter | kashyap: Will December 24's image be a virtualization platform capable of running December 24's image? | |
| 12:07:03 | kashyap | gibi: Some 3 years ago, I tried to compress an OpenStack DevStack install under 200 MB. But I could only come up to 618 MB. :-( | |
| 12:07:13 | kashyap | (The artifact is still here: https://kashyapc.fedorapeople.org/virt/advent-qemu/) | |
| 12:07:26 | kashyap | jangutter: 24th / 25th is usually a custom surprise. | |
| 12:07:45 | kashyap | jangutter: And even custom-coded by some community members. Not going to ruin the surprise further :D | |
| 12:07:49 | jangutter | kashyap: I still fondly remember the QNX boot floppies. | |
| 12:08:35 | kashyap | So here's an open challenge: I wonder if anyone can really get a "xz-compressed" DevStack disk image that is _under_ 280 MB. | |
| 12:08:44 | kashyap | jangutter: Heh | |
| 12:10:11 | kashyap | An extremely minimal DevStack that fits under 280 MB in a disk image requires ugly hacks like removing directories (e.g doc, man pages) from the OS. Tried some of those and gave up as it was a really uphill battle | |
| 12:11:24 | sean-k-mooney | kashyap: i mean it does not sound that hard | |
| 12:11:35 | kashyap | Try it. | |
| 12:11:44 | sean-k-mooney | espially if i dont have to include the git repos | |
| 12:11:46 | kashyap | I dare you, double-dare you :D | |
| 12:12:00 | kashyap | sean-k-mooney: Yeah, that's also I considered | |
| 12:12:06 | kashyap | Removing the 'git repos' | |
| 12:12:16 | gibi | I root for you, sean-k-mooney | |
| 12:12:41 | kashyap | It's going to take a full week of concentrated effort to prepare this image. If one attempts at all | |
| 12:13:35 | kashyap | (In the past, i.e.) | |
| 12:13:39 | sean-k-mooney | kashyap: well what base os did you start with | |
| 12:13:58 | kashyap | sean-k-mooney: Bare-minimal Fedora -- with @base (300 packages or so) | |
| 12:14:05 | jangutter | kasyap: you just want someone to port OpenStack to OpenEmbedded | |
| 12:14:19 | kashyap | That's the kickstart: https://kashyapc.fedorapeople.org/virt/fed-minimal.ks | |
| 12:14:26 | kashyap | s/base/core/ | |
| 12:14:52 | jangutter | kasyap: it should be pretty trivial if the image just loads a 1GB blob from the network into RAM. | |
| 12:15:23 | jangutter | kashyap: use the "curl XX | sudo bash" compression method. | |
| 12:15:35 | kashyap | Haha, yikes | |
| 12:16:55 | sean-k-mooney | jangutter: i mean that is how you install docker right :p | |
| 12:18:29 | sean-k-mooney | actully i wonder if my old docker devstack still works... | |
| 12:20:12 | jangutter | kashyap: you know the history behind tcc? ( https://en.wikipedia.org/wiki/Tiny_C_Compiler ) | |
| 12:20:33 | kashyap | jangutter: Hehe, funny you mention that! That was one of the images I prepared for the 2016 Advent Calendar! | |
| 12:20:44 | sean-k-mooney | jangutter: wasnt it for an obfucation compition intally | |
| 12:21:18 | kashyap | jangutter: Checkout the day-16 image: https://www.qemu-advent-calendar.org/2016/#day-16 | |
| 12:22:23 | jangutter | sean-k-mooney: yep. It just goes to show you that in every thousand cool hacks at least once something really useful emerges. | |
| 12:23:51 | sean-k-mooney | i used to use this as my primay dev env in a vm for about 6-9 months | |
| 12:23:53 | sean-k-mooney | https://github.com/SeanMooney/docker-devstack | |
| 12:24:42 | jangutter | kashyap: Ah, day 13 of 2016 - turtles all the way down. | |
| 12:24:53 | sean-k-mooney | its 2 docker continers one of which had a dev environment e.g. ide, wireshark firefoxd, rdp server and another that run systemd and was where devstack woudl be run | |
| 12:25:30 | sean-k-mooney | jangutter: well i had a 10 node openstack dev cluster already | |
| 12:25:35 | kashyap | jangutter: Yep, do read the README before you run it :D | |
| 12:26:03 | kashyap | Because it will create a "loop" of nested guests until your system runs out of memory (a.k.a crashes) | |
| 12:27:31 | jangutter | kashyap: In other words it emulates nearly all my OpenStack setups perfectly. | |
| 12:29:08 | sean-k-mooney | why do i get the feeling ill have to learn to debug casandra with all the edge stuff in the future | |
| 12:30:29 | jangutter | sean-k-mooney: You're just making doomed predictions that nobody believes.... like Cassandra did. | |
| 12:32:12 | sean-k-mooney | no im reading the mail tread that jsut said we need a weakly consitent backend for openstack to replace mysql and casandra is the only "db" i know of that is weakly consitent | |
| 12:32:53 | sean-k-mooney | jangutter: i was reading http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000606.html | |
| 12:36:27 | jangutter | sean-k-mooney: and yet.... python still has the GIL. | |
| 12:38:37 | sean-k-mooney | jangutter: well that serves a different usecase | |
| 12:38:54 | sean-k-mooney | eventual consitence does not mean you allow data races | |
| 12:39:08 | sean-k-mooney | you just may be working on old data | |
| 12:39:17 | sean-k-mooney | but it was still valid data | |
| 12:39:25 | jangutter | sean-k-mooney: yeah, like RCU. | |
| 12:40:04 | sean-k-mooney | yep | |
| 12:40:24 | kashyap | gibi: stephenfin: I think this can be merged, FWIW; added my +1 with notes: https://review.openstack.org/#/c/575735/ (handle logfiles for tcp-based consoles) | |
| 12:42:22 | gibi | kashyap: thanks. I upgrade my vote | |
| 13:05:07 | openstackgerrit | Merged openstack/nova master: Deprecate the nova-console service https://review.openstack.org/610075 | |
| 13:08:39 | mdbooth | This is interesting. Profiling the execution with testtools.run of a single functional test, top results by individual call time: http://paste.openstack.org/show/736703/ | |
| 13:09:08 | mdbooth | Am I reading that right, do we call Compute.API.__init__() 616 times? | |
| 13:09:36 | cdent | sure looks that way | |
| 13:10:02 | mdbooth | That seems suboptimal | |
| 13:10:38 | cdent | also a tshirt | |
| 13:10:57 | mdbooth | Hehe | |
| 13:12:17 | mdbooth | In wallclock time, it's db access which is slow. | |
| 13:12:25 | sean-k-mooney | well at least its not a global | |
| 13:14:05 | mdbooth | I wonder where we're creating new Compute.API objects. It's not the cheapest operation. | |
| 13:18:43 | openstackgerrit | Merged openstack/nova master: Deprecate the nova-xvpvncproxy service https://review.openstack.org/610076 | |
| 13:18:52 | openstackgerrit | Merged openstack/nova stable/rocky: hardware: fix memory check usage for small/large pages https://review.openstack.org/599413 | |
| 13:22:23 | cdent | mdbooth: you are likely on the edge of a deep deep hole. One which, if you choose to enter, will lead to riches beyond your dreams. But you might be there a while. | |
| 13:34:18 | mdbooth | cdent: Hehe. Yeah, I'm going to reduce the scope to establishing why mriedem had to revert my functional test. | |
| 13:34:41 | mdbooth | And for that I need a stand-out, obvious culprit. | |
| 13:34:50 | mdbooth | The above was just a surprising observation. | |
| 14:01:15 | kaisers | mdbooth: regarding https://review.openstack.org/#/c/554195/ - some time ago you were'nt happy with the issue details, i tried to shed a bit more light on things, could you revisit this at some point pls? | |
| 14:03:29 | mdbooth | kaisers: Is the fix still required in the context of the systemd bugfix? | |
| 14:04:36 | kaisers | mdbooth: yes, the problem ist that we added the --user flag. that fails for multiple reasons | |
| 14:04:52 | kaisers | (i listed them in the commit message and the bugs new description | |
| 14:04:53 | kaisers | ) | |
| 14:06:06 | mdbooth | kaisers: Which version of CentOS doesn't support --user? | |
| 14:06:21 | kaisers | latest as of two days ago | |
| 14:06:22 | mdbooth | Which operating systems don't ship with the systemd fix? | |
| 14:06:33 | mdbooth | kashyap: So CentOS 7? | |
| 14:06:52 | kaisers | The problem ist not the fix for systemd but that it ships with an older systemd that does not support the --user flag | |
| 14:08:29 | kaisers | centos 7 comes with v219, the bug came up with v229 (i think) and was fixed with 23x | |
| 14:09:43 | kaisers | Fixed in v238 according to https://github.com/systemd/systemd/blob/master/NEWS | |
| 14:10:43 | kaisers | mmh, sorry, bug described with v233 in that news link, not v229 | |
| 14:20:20 | openstackgerrit | Chris Dent proposed openstack/nova master: Correct lower-constraints.txt and the related tox job https://review.openstack.org/622972 | |
| 14:20:44 | cdent | stephenfin: ^ has an issue that needs to be resolved before it can be merged, but gets close | |
| 14:25:49 | gibi | stephenfin, mriedem: hi! the last two notification transformation patch is good to go from my perspective https://review.openstack.org/#/q/topic:bp/versioned-notification-transformation-stein+status:open | |
| 14:27:14 | stephenfin | cdent: I'd kill the test, personally. lbragstad added it in 6244a442784 and, while I get what it's doing, I don't think the lower-constraints thing is more of an issue | |
| 14:27:20 | stephenfin | Good to get a second opinion though | |
| 14:28:26 | stephenfin | kaisers: The bug's introduced in v233 and fixed in v238? | |
| 14:29:03 | kaisers | stephenfin: I'm not sure when it was introduced but that's the version for which it is reported in the systemd changelog. | |
| 14:29:13 | kashyap | mdbooth: Hi, was AFK for a break; reading the scroll | |
| 14:29:16 | mriedem | gibi: ack | |
| 14:29:41 | kaisers | stephenfin: But as stated earlier, the more direct problem is that centos 7 comes with v219 and e.g. xenial with 229, both not supporting the --user flag | |
| 14:30:08 | kashyap | mdbooth: Okay, I see kaisers already mentioned which version of systemd ships in CentOS and which one you care about | |
| 14:30:12 | kaisers | stephenfin: scratch that last comment, v229 does support it | |
| 14:30:24 | kaisers | so the old version issue only comes up with centos | |
| 14:30:36 | stephenfin | kaisers: Yup, gotcha | |
| 14:31:05 | mdbooth | mriedem: Hey, about that functional test. Appreciate it made sense to take it out, but I'm trying to work out how we can safely get it back in. Problem is that we basically have no idea why it was failing and now way of finding out that I can think of without running it in CI. Could I perhaps fire up a non-voting job which enabled DEBUG output? | |
| 14:31:36 | mdbooth | I responded on the bug that I *suspect* a performance issue in CI. | |
| 14:31:38 | gibi | mdbooth: does it only fail in CI? | |