| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-08-29 | |||
| 18:31:54 | sean-k-mooney | the other option is to say screwit and just make it use nested vert and only run it on vexhost | |
| 18:32:00 | artom | So the second option would be better for a "permanent" CI thing | |
| 18:32:07 | artom | that's not | |
| 18:32:56 | sean-k-mooney | it depense if you are emulating other architefure like when rackspace used to run x86 on power its realisitc | |
| 18:33:21 | sean-k-mooney | but most people will use kvm or xen or hardware accleration | |
| 18:35:08 | artom | So I think yeah, go with the most realistic scenario | |
| 18:36:08 | artom | Also, keep in mind Fort Nebula was willing to provide multi-node NUMA flavors, and though infra wasn't thrilled because they want to be cloud-agnostic, they were OK with an experimental manually-triggered job to run on only that nodeset. | |
| 18:36:26 | mriedem | efried: belay that | |
| 18:37:08 | sean-k-mooney | ok in that case ill rebase it on top of your stuff to test that too but i might wait a bit before doing that | |
| 18:37:44 | artom | donnyd, actually, since we're on the topic, is ^^ still a thing you're planning to do, and do you need any assistance in doing it? | |
| 18:38:12 | donnyd | artom: I surely can | |
| 18:38:39 | sean-k-mooney | it would be nice to get a nightly job running. i can proably propose something if there is a lable wew can use | |
| 18:38:49 | donnyd | I wanted to make sure FN was stable and would run jobs without a bunch of FN related issues... seems to me like its going well enough | |
| 18:39:09 | donnyd | and I may need some assistance in getting it running | |
| 18:39:54 | sean-k-mooney | if you can create a flavor and we can add a lable to upstream node pool to provide a limited number of that flavor say 2-4 instances | |
| 18:40:02 | sean-k-mooney | i can proably do the rest. | |
| 18:40:09 | sean-k-mooney | but not for a week or two | |
| 18:40:55 | donnyd | I already have a custom label for FN nobody uses | |
| 18:41:33 | sean-k-mooney | yes bute we would need FN-multi_numa on that mapped to a specil flavor with hw:numa_nodes=2 set | |
| 18:42:25 | donnyd | oh ok | |
| 18:42:53 | donnyd | Well I am up for anything and I can do up to 4 numa nodes because my hypervisors have 4 procs | |
| 18:43:16 | sean-k-mooney | are they ivybridge or newer? | |
| 18:43:33 | donnyd | unlikley - checking | |
| 18:43:37 | artom | mriedem, FWIW, I've added next wednesday's stx meeting to my calendar, and installed that 'Zoom' thing they yse | |
| 18:43:39 | artom | *use | |
| 18:43:44 | sean-k-mooney | cause you could do 8 if they have more then 10 cores with a bios tweek but we only need 2 | |
| 18:44:04 | sean-k-mooney | with 2 numa nodes we can test everything | |
| 18:44:38 | sean-k-mooney | stx is starlingX | |
| 18:44:39 | donnyd | https://ark.intel.com/content/www/us/en/ark/products/64607/intel-xeon-processor-e5-4620-16m-cache-2-20-ghz-7-20-gt-s-intel-qpi.html | |
| 18:44:41 | donnyd | sandy bridge | |
| 18:44:47 | donnyd | no may not be helpful | |
| 18:44:56 | openstackgerrit | Merged openstack/nova master: Ensure online migrations have a unique name https://review.opendev.org/679096 | |
| 18:45:00 | artom | sean-k-mooney, yeah, they wanted to test NUMA LM as well | |
| 18:45:08 | openstackgerrit | Merged openstack/nova master: Allow strict_proxies for sdk Connection https://review.opendev.org/676926 | |
| 18:45:13 | sean-k-mooney | donnyd its the generation before intel added cluser on die | |
| 18:45:14 | artom | But... it might just be faster to get FN running in CI :) | |
| 18:45:26 | sean-k-mooney | but as i said 2 numa nodes is all that is needed | |
| 18:46:06 | sean-k-mooney | intel is also ment to be fixing the nfv ci at some point | |
| 18:46:14 | sean-k-mooney | maybe | |
| 18:46:19 | donnyd | so will mine work? | |
| 18:46:23 | sean-k-mooney | yep | |
| 18:46:46 | artom | sean-k-mooney, let's make a bet on who gets there first, FN in CI, Intel, or stx :D | |
| 18:47:03 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Rename the nova-grenade-live-migration job to nova-grenade-multinode https://review.opendev.org/678841 | |
| 18:47:03 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Move live_migration test hooks under gate/ https://review.opendev.org/679251 | |
| 18:47:04 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add cold migrate and resize to nova-grenade-multinode https://review.opendev.org/679210 | |
| 18:47:37 | mriedem | artom: you can ask them to use bluejeans during their meeting | |
| 18:48:04 | artom | It's OK, I'm not dogmatic about my video conferencing solutions :D | |
| 18:48:36 | sean-k-mooney | i think me testing stuff manully will be fater tehn all 3. i should start commint with my sean-mooney-ci gerrit account to confuse people | |
| 18:49:09 | donnyd | I can work on it later tonight (after my real job) or tomorrow morning (before my real job) | |
| 18:49:20 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Introduce live_migration_claim() https://review.opendev.org/635669 | |
| 18:49:21 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: LM: Use Claims to update numa-related XML on the source https://review.opendev.org/635229 | |
| 18:49:21 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: New objects for NUMA live migration https://review.opendev.org/634827 | |
| 18:49:22 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Deprecate CONF.workarounds.enable_numa_live_migration https://review.opendev.org/640021 | |
| 18:49:22 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: NUMA live migration support https://review.opendev.org/634606 | |
| 18:49:23 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: DNM: Run LM integration tests with NUMA flavor https://review.opendev.org/678887 | |
| 18:49:23 | openstackgerrit | Artom Lifshitz proposed openstack/nova master: Functional tests for NUMA live migration https://review.opendev.org/672595 | |
| 18:49:34 | donnyd | any good docs to point me to for setup? | |
| 18:50:23 | sean-k-mooney | donnyd: i can send you the command or document them in an etherpad if you like | |
| 18:50:46 | sean-k-mooney | over all there is not too much that you need too do | |
| 18:50:54 | sean-k-mooney | we jus tneed to know the name of the flavor | |
| 18:50:55 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Rename the nova-grenade-live-migration job to nova-grenade-multinode https://review.opendev.org/678841 | |
| 18:50:56 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Add cold migrate and resize to nova-grenade-multinode https://review.opendev.org/679210 | |
| 18:51:00 | sean-k-mooney | and you need to add a few extra specs | |
| 18:51:06 | mriedem | artom: ha just did ours | |
| 18:51:34 | sean-k-mooney | and then 2 patches 1 for the project-config repo to add the new lable to nodepool and 1 to nova to add the perodic job | |
| 18:51:35 | mriedem | unbelievably, the teacher didn't comment on my new fresh haircut | |
| 18:51:42 | artom | mriedem, D: | |
| 18:51:56 | mriedem | "oh maya nice to meet....WHO IS THIS HANDSOME DEVIL?!" | |
| 18:51:58 | artom | The nerve of some people. | |
| 18:52:21 | artom | Seriously. The female version of https://www.youtube.com/watch?v=4pXfHLUlZf4. | |
| 18:52:23 | artom | (NFSW) | |
| 18:52:48 | sean-k-mooney | see now there is plasible deniablity | |
| 18:54:18 | donnyd | sure that would work great sean-k-mooney | |
| 18:54:33 | donnyd | I can name things however you like | |
| 18:55:06 | sean-k-mooney | we just need to know the name to put it in the project-config patch so it does not really matter | |
| 19:03:20 | donnyd | have to be something like ubuntu-bionic-fn-numa | |
| 19:03:28 | donnyd | centos-7-fn-numa | |
| 19:03:39 | sean-k-mooney | yep | |
| 19:03:45 | donnyd | something like that.. .whatever you come up with, I will just put it in FN | |
| 19:03:49 | sean-k-mooney | although the ubunutu one is proably enough | |
| 19:04:18 | donnyd | why not just use the label that is already there and i can fixup the flavor | |
| 19:04:26 | sean-k-mooney | ubuntu-bionic-fn-numa is fine the the lable and then we need a flavor name that can be numa or whatever | |
| 19:04:27 | donnyd | ubuntu-bionic-expanded | |
| 19:04:33 | donnyd | ok | |
| 19:05:01 | donnyd | i don't think anyone has ever scheduled a job against it | |
| 19:05:02 | sean-k-mooney | donnyd: we could but other jobs are not expecting muliptle numa nodes | |
| 19:05:21 | sean-k-mooney | well you also have the standard lables right | |
| 19:05:26 | donnyd | other jobs don't run on it right now | |
| 19:05:33 | sean-k-mooney | on FN | |
| 19:05:43 | donnyd | i created a label that had 16G of memory | |
| 19:05:45 | donnyd | yes | |
| 19:05:51 | sean-k-mooney | oh ok | |
| 19:05:57 | donnyd | look in nl02 | |
| 19:06:19 | donnyd | i already have a custom label that is completely unused | |
| 19:07:28 | sean-k-mooney | these ones https://github.com/openstack/project-config/blob/master/nodepool/nl02.openstack.org.yaml#L330 | |
| 19:07:41 | donnyd | yep | |
| 19:07:49 | sean-k-mooney | if you added hw:numa_nodes=2 to those it woudl work too | |
| 19:08:06 | sean-k-mooney | that would be very close to how the intel ci used to run | |
| 19:08:12 | donnyd | what do you mean? | |
| 19:08:20 | donnyd | you mean in project-config | |