| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-12-05 | |||
| 11:55:42 | gibi | kashyap: yes | |
| 11:56:02 | kashyap | gibi: And is that on baremetal? Or in a VM (that's capable of nested virt) | |
| 11:56:45 | gibi | kashyap: in a kvm VM, with 8G ram and 2 vcpu | |
| 11:57:24 | kashyap | Interesting. I'm doing something same (on a pre-prod Haswell hardware from 5 years ago) | |
| 11:57:28 | kashyap | ENABLED_SERVICES=g-api,g-reg,key,n-api,n-cpu,placement-api,n-sch,n-cond,n-sproxy,mysql,rabbit,dstat,quantum,q-svc,q-agt,q-dhcp,q-l3,q-meta | |
| 11:57:35 | kashyap | gibi: The above are my services ^ | |
| 11:57:54 | kashyap | I think I'll get a different timing if I run it on an SSD disk. | |
| 11:58:28 | gibi | kashyap: this is my local conf http://paste.openstack.org/show/736698/ | |
| 11:58:56 | gibi | kashyap: I'm running this on a fairly new hp 840 G5 | |
| 11:59:12 | sean-k-mooney | kashyap: devstack is still one of the fasest installes i have used | |
| 12:00:18 | kashyap | gibi: That's mine: http://paste.openstack.org/show/736699/ | |
| 12:00:30 | sean-k-mooney | in genreal even with RECLONE=True i rarely exceed 15Mins on baremetal or 20 on a vm | |
| 12:00:33 | kashyap | sean-k-mooney: Oh, agreed. It is "the" fastest, IMO | |
| 12:00:51 | sean-k-mooney | kashyap: kolla-ansible is fater if you have the images | |
| 12:00:54 | kashyap | I don't have RECLONE enabled. (I'll assume it defaults to 'false') | |
| 12:01:00 | sean-k-mooney | but not by much | |
| 12:01:05 | sean-k-mooney | kashyap: it does | |
| 12:01:16 | sean-k-mooney | i normally run in offline mode however | |
| 12:01:30 | kashyap | What does 'OFFLINE' do, remind me again, please | |
| 12:02:02 | sean-k-mooney | it skips cloning and uses the git repos you have and also skps installing packages | |
| 12:02:18 | sean-k-mooney | it just configres teh services/dbs and runs them | |
| 12:02:24 | gibi | kashyap: my runs from a nvme ssd | |
| 12:03:13 | sean-k-mooney | on baremetal with OFFLINE=True a compute node will stack in under a miniute | |
| 12:03:19 | kashyap | Yeah, I NVMe on my laptop as well; mine is running on a slow remote machine; /me refreshes his local env. | |
| 12:03:36 | kashyap | [OT] Meanwhile, check this out folks: http://qemu-advent-calendar.org/ | |
| 12:03:45 | kashyap | Today's image is by yours truly :D | |
| 12:03:58 | kashyap | (If you liked it, we also organized it in 2016: http://www.qemu-advent-calendar.org/2016/) | |
| 12:04:03 | kashyap | And this year is 15 years of QEMU. | |
| 12:04:32 | kashyap | If you're wondering WTH is this QEMU Advent, then read the "About" paragraph (https://www.qemu-advent-calendar.org/2018/#about) | |
| 12:05:29 | kashyap | The QEMU Advent Calendar 2018 features a QEMU disk image each day of December until Christmas. Each day a new package becomes available for download | |
| 12:05:29 | kashyap | [quote] | |
| 12:05:32 | kashyap | [...] | |
| 12:05:34 | kashyap | The disk images contain interesting operating systems and software that run under the QEMU emulator. Some of them are well-known or not-so-well-known operating systems, old and new, others are custom demos and neat algorithms. | |
| 12:05:38 | kashyap | [/quote] | |
| 12:05:41 | kashyap | If anyone has ideas for images, more than welcome! | |
| 12:06:05 | gibi | kashyap: :) | |
| 12:06:34 | jangutter | kashyap: Will December 24's image be a virtualization platform capable of running December 24's image? | |
| 12:07:03 | kashyap | gibi: Some 3 years ago, I tried to compress an OpenStack DevStack install under 200 MB. But I could only come up to 618 MB. :-( | |
| 12:07:13 | kashyap | (The artifact is still here: https://kashyapc.fedorapeople.org/virt/advent-qemu/) | |
| 12:07:26 | kashyap | jangutter: 24th / 25th is usually a custom surprise. | |
| 12:07:45 | kashyap | jangutter: And even custom-coded by some community members. Not going to ruin the surprise further :D | |
| 12:07:49 | jangutter | kashyap: I still fondly remember the QNX boot floppies. | |
| 12:08:35 | kashyap | So here's an open challenge: I wonder if anyone can really get a "xz-compressed" DevStack disk image that is _under_ 280 MB. | |
| 12:08:44 | kashyap | jangutter: Heh | |
| 12:10:11 | kashyap | An extremely minimal DevStack that fits under 280 MB in a disk image requires ugly hacks like removing directories (e.g doc, man pages) from the OS. Tried some of those and gave up as it was a really uphill battle | |
| 12:11:24 | sean-k-mooney | kashyap: i mean it does not sound that hard | |
| 12:11:35 | kashyap | Try it. | |
| 12:11:44 | sean-k-mooney | espially if i dont have to include the git repos | |
| 12:11:46 | kashyap | I dare you, double-dare you :D | |
| 12:12:00 | kashyap | sean-k-mooney: Yeah, that's also I considered | |
| 12:12:06 | kashyap | Removing the 'git repos' | |
| 12:12:16 | gibi | I root for you, sean-k-mooney | |
| 12:12:41 | kashyap | It's going to take a full week of concentrated effort to prepare this image. If one attempts at all | |
| 12:13:35 | kashyap | (In the past, i.e.) | |
| 12:13:39 | sean-k-mooney | kashyap: well what base os did you start with | |
| 12:13:58 | kashyap | sean-k-mooney: Bare-minimal Fedora -- with @base (300 packages or so) | |
| 12:14:05 | jangutter | kasyap: you just want someone to port OpenStack to OpenEmbedded | |
| 12:14:19 | kashyap | That's the kickstart: https://kashyapc.fedorapeople.org/virt/fed-minimal.ks | |
| 12:14:26 | kashyap | s/base/core/ | |
| 12:14:52 | jangutter | kasyap: it should be pretty trivial if the image just loads a 1GB blob from the network into RAM. | |
| 12:15:23 | jangutter | kashyap: use the "curl XX | sudo bash" compression method. | |
| 12:15:35 | kashyap | Haha, yikes | |
| 12:16:55 | sean-k-mooney | jangutter: i mean that is how you install docker right :p | |
| 12:18:29 | sean-k-mooney | actully i wonder if my old docker devstack still works... | |
| 12:20:12 | jangutter | kashyap: you know the history behind tcc? ( https://en.wikipedia.org/wiki/Tiny_C_Compiler ) | |
| 12:20:33 | kashyap | jangutter: Hehe, funny you mention that! That was one of the images I prepared for the 2016 Advent Calendar! | |
| 12:20:44 | sean-k-mooney | jangutter: wasnt it for an obfucation compition intally | |
| 12:21:18 | kashyap | jangutter: Checkout the day-16 image: https://www.qemu-advent-calendar.org/2016/#day-16 | |
| 12:22:23 | jangutter | sean-k-mooney: yep. It just goes to show you that in every thousand cool hacks at least once something really useful emerges. | |
| 12:23:51 | sean-k-mooney | i used to use this as my primay dev env in a vm for about 6-9 months | |
| 12:23:53 | sean-k-mooney | https://github.com/SeanMooney/docker-devstack | |
| 12:24:42 | jangutter | kashyap: Ah, day 13 of 2016 - turtles all the way down. | |
| 12:24:53 | sean-k-mooney | its 2 docker continers one of which had a dev environment e.g. ide, wireshark firefoxd, rdp server and another that run systemd and was where devstack woudl be run | |
| 12:25:30 | sean-k-mooney | jangutter: well i had a 10 node openstack dev cluster already | |
| 12:25:35 | kashyap | jangutter: Yep, do read the README before you run it :D | |
| 12:26:03 | kashyap | Because it will create a "loop" of nested guests until your system runs out of memory (a.k.a crashes) | |
| 12:27:31 | jangutter | kashyap: In other words it emulates nearly all my OpenStack setups perfectly. | |
| 12:29:08 | sean-k-mooney | why do i get the feeling ill have to learn to debug casandra with all the edge stuff in the future | |
| 12:30:29 | jangutter | sean-k-mooney: You're just making doomed predictions that nobody believes.... like Cassandra did. | |
| 12:32:12 | sean-k-mooney | no im reading the mail tread that jsut said we need a weakly consitent backend for openstack to replace mysql and casandra is the only "db" i know of that is weakly consitent | |
| 12:32:53 | sean-k-mooney | jangutter: i was reading http://lists.openstack.org/pipermail/openstack-discuss/2018-December/000606.html | |
| 12:36:27 | jangutter | sean-k-mooney: and yet.... python still has the GIL. | |
| 12:38:37 | sean-k-mooney | jangutter: well that serves a different usecase | |
| 12:38:54 | sean-k-mooney | eventual consitence does not mean you allow data races | |
| 12:39:08 | sean-k-mooney | you just may be working on old data | |
| 12:39:17 | sean-k-mooney | but it was still valid data | |
| 12:39:25 | jangutter | sean-k-mooney: yeah, like RCU. | |
| 12:40:04 | sean-k-mooney | yep | |
| 12:40:24 | kashyap | gibi: stephenfin: I think this can be merged, FWIW; added my +1 with notes: https://review.openstack.org/#/c/575735/ (handle logfiles for tcp-based consoles) | |
| 12:42:22 | gibi | kashyap: thanks. I upgrade my vote | |
| 13:05:07 | openstackgerrit | Merged openstack/nova master: Deprecate the nova-console service https://review.openstack.org/610075 | |
| 13:08:39 | mdbooth | This is interesting. Profiling the execution with testtools.run of a single functional test, top results by individual call time: http://paste.openstack.org/show/736703/ | |
| 13:09:08 | mdbooth | Am I reading that right, do we call Compute.API.__init__() 616 times? | |
| 13:09:36 | cdent | sure looks that way | |
| 13:10:02 | mdbooth | That seems suboptimal | |
| 13:10:38 | cdent | also a tshirt | |
| 13:10:57 | mdbooth | Hehe | |
| 13:12:17 | mdbooth | In wallclock time, it's db access which is slow. | |
| 13:12:25 | sean-k-mooney | well at least its not a global | |
| 13:14:05 | mdbooth | I wonder where we're creating new Compute.API objects. It's not the cheapest operation. | |