| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-08-30 | |||
| 09:49:23 | openstackgerrit | Brin Zhang proposed openstack/nova master: Add operator user_id/project_id to the migrations https://review.opendev.org/679413 | |
| 10:08:10 | sean-k-mooney | for those not on the neutron channel i just confrimed that cold migration and live migration with vnic_type=direct-physical is broken | |
| 10:09:40 | sean-k-mooney | there are at least two related issues, 1 we do not update the mac on migration and second we do not correctly find the device to detach it on live migration | |
| 10:09:58 | sean-k-mooney | live migration also like has the first issue but its failing before it gets that far | |
| 10:12:55 | sean-k-mooney | it looks like detach works correctly for suspend and the live migration code should be useing the same fucntion i think but maybe its not | |
| 10:14:35 | sean-k-mooney | im going to try and fix this next week and ill file the upstream bug shortly. i think the cold migration behavior is broken all the way back to queens. the live migration behavior is obviouly new since we added that this cycle | |
| 10:25:12 | stephenfin | aspiers: Hit that whole SEV series. Couple of comments left, but ping me when you've tackled them and I'll re-review | |
| 10:36:51 | artom | sean-k-mooney, hey, so how feasible would be to hack together a tempest job that runs https://review.rdoproject.org/r/#/c/18832/ on that new FN flavor? | |
| 10:36:57 | artom | ('morning!) | |
| 10:37:34 | sean-k-mooney | artom: well my nfv test job did actully work a few months ago so i could make it work on FN pretty quick | |
| 10:37:42 | sean-k-mooney | as in today | |
| 10:37:54 | sean-k-mooney | but im currently reworking functional test | |
| 10:38:07 | sean-k-mooney | want me to give it ago when im done | |
| 10:38:52 | artom | sean-k-mooney, that'd be awesome :) whitebox needs a bunch of configs to be set, I can help with those | |
| 10:39:26 | artom | https://review.opendev.org/#/c/678887/ failed with KVM errors, so I'm trying think of other possibilities | |
| 10:39:54 | sean-k-mooney | ya well first thing would be to just get it stacking multinode with a few smoketests. then we can add the plugin | |
| 10:40:47 | artom | Right, baby steps :) | |
| 10:40:58 | sean-k-mooney | artom: i dont see errors in the n-cpu log | |
| 10:41:15 | sean-k-mooney | oh multinode | |
| 10:41:40 | sean-k-mooney | still no erros on the other node | |
| 10:42:03 | artom | sean-k-mooney, no, they're in the qemu logs | |
| 10:42:06 | artom | ex: https://zuul.opendev.org/t/openstack/build/905b52e0b1e84532944f0606b5455381/log/logs/subnode-2/libvirt/qemu/instance-00000005.txt.gz | |
| 10:42:33 | sean-k-mooney | oh thats the kernel bug i mentioned to donnyd | |
| 10:42:54 | sean-k-mooney | actully may be not | |
| 10:43:12 | sean-k-mooney | it could be but that looks like an issue with the cpu model | |
| 10:43:29 | donnyd | i am using host-passthrough on nova | |
| 10:43:41 | sean-k-mooney | its checking for svm with is amds version of vt-x | |
| 10:43:54 | sean-k-mooney | donnyd: ya this is on vexhost | |
| 10:44:01 | sean-k-mooney | but i think this is a different issue | |
| 10:44:07 | donnyd | oh | |
| 10:44:25 | sean-k-mooney | ya so | |
| 10:44:27 | sean-k-mooney | [libvirt] | |
| 10:44:28 | sean-k-mooney | live_migration_uri = qemu+ssh://stack@%s/system | |
| 10:44:30 | sean-k-mooney | cpu_mode = none | |
| 10:44:32 | sean-k-mooney | virt_type = kvm | |
| 10:45:04 | sean-k-mooney | we should be setting cpu_mode=custom and cpu_model=kvm64 in devstack | |
| 10:45:22 | sean-k-mooney | with cpu_mode=none we default to host-model | |
| 10:45:40 | sean-k-mooney | but host-model does not always detect the capablity proably espcailly with nested virt | |
| 10:45:58 | openstackgerrit | Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243 | |
| 10:46:02 | artom | sean-k-mooney, I'll just add that to Matt's devstack nuke | |
| 10:46:10 | sean-k-mooney | so this host whihc is likel intel x86 was detected as support svm which from the kvm error it is not | |
| 10:46:22 | sean-k-mooney | cool | |
| 10:46:32 | artom | But coffee first | |
| 10:46:43 | sean-k-mooney | kvm64 is the most portable cpu model that work with kvm | |
| 10:47:02 | artom | Daughter started school. I'm guess I'm just excited/stressed for her. | |
| 10:47:20 | sean-k-mooney | first time | |
| 10:47:24 | artom | Gym attendance took a hit as well | |
| 10:47:26 | artom | Yeah | |
| 10:47:58 | kashyap | sean-k-mooney: IIRC, there was a reason we went with existing CPU model 'qemu64' | |
| 10:48:02 | kashyap | In DevStack | |
| 10:48:04 | sean-k-mooney | that can be stressful for both her and you. im sure it will be fine | |
| 10:48:09 | kashyap | Because not all Gate hosts support KVM | |
| 10:48:25 | sean-k-mooney | kashyap: yes but we are specific testing someing with nested vert | |
| 10:48:39 | sean-k-mooney | e.g we are hardcodeing stuff and targeting 1 cloud that does | |
| 10:48:58 | sean-k-mooney | so we are trying to undo all the other suff that hard codes it to qemu | |
| 10:49:42 | kashyap | sean-k-mooney: Ah, for that context, sure | |
| 10:49:57 | alex_xu | stephenfin: emm...all are expected, since he still using vcpu_pin_set, that means no PCPU | |
| 10:50:02 | openstackgerrit | Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243 | |
| 10:50:09 | sean-k-mooney | kashyap: ill be writing a sperate permenet job later but this is a quick hack just to do some non me testing of artoms code | |
| 10:50:34 | kashyap | sean-k-mooney: Sure. I didn't realize the full context. | |
| 10:50:59 | openstackgerrit | Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243 | |
| 10:51:29 | sean-k-mooney | kashyap: its kind of a libvirt/qemu bug. | |
| 10:52:04 | sean-k-mooney | with host model it should not be trying to use svm for the l2 guest on a l1 guest that does not have it | |
| 10:52:21 | sean-k-mooney | but if we use kvm64 it wont do that so its all good | |
| 10:52:57 | sean-k-mooney | i would not run real workload with kvm64 but its perfect for testing | |
| 10:53:26 | kashyap | sean-k-mooney: What precisely is a libvirt/QEMU bug? /me reads on | |
| 10:53:31 | openstackgerrit | Luyao Zhong proposed openstack/nova master: object: Introduce Resource and ResouceList objs https://review.opendev.org/678448 | |
| 10:53:32 | openstackgerrit | Luyao Zhong proposed openstack/nova master: Retrive the allocations early https://review.opendev.org/678450 | |
| 10:53:32 | openstackgerrit | Luyao Zhong proposed openstack/nova master: Add resources dict into _Provider https://review.opendev.org/678449 | |
| 10:53:33 | openstackgerrit | Luyao Zhong proposed openstack/nova master: libvirt: Enable driver configuring PMEM namespaces https://review.opendev.org/678453 | |
| 10:53:33 | openstackgerrit | Luyao Zhong proposed openstack/nova master: Claim resources in resource tracker https://review.opendev.org/678452 | |
| 10:53:34 | openstackgerrit | Luyao Zhong proposed openstack/nova master: libvirt: Support VM creation with vpmems and vpmems cleanup https://review.opendev.org/678455 | |
| 10:53:34 | openstackgerrit | Luyao Zhong proposed openstack/nova master: libvirt: report VPMEM resources by provider tree https://review.opendev.org/678454 | |
| 10:53:35 | openstackgerrit | Luyao Zhong proposed openstack/nova master: Add functional tests for virtual persistent memory https://review.opendev.org/678470 | |
| 10:53:35 | openstackgerrit | Luyao Zhong proposed openstack/nova master: Parse vpmem related flavor extra spec https://review.opendev.org/678456 | |
| 10:54:14 | sean-k-mooney | kashyap: we are default to host-model because cpu_mode is none | |
| 10:54:17 | sean-k-mooney | but https://zuul.opendev.org/t/openstack/build/905b52e0b1e84532944f0606b5455381/log/logs/subnode-2/libvirt/qemu/instance-00000005.txt.gz | |
| 10:54:57 | kashyap | sean-k-mooney: Right | |
| 10:55:14 | sean-k-mooney | but qemu expose an cpu flag to the l2 guest that the l1 guest does not suport | |
| 10:56:08 | kashyap | sean-k-mooney: Hmm. (Also, yes, agreed - on kvm64 for testing-only) | |
| 10:56:32 | sean-k-mooney | its deffintly a qemu bug since we are not passing the -cpu flag at all in this case | |
| 10:56:53 | sean-k-mooney | so its up to qemu to figure out what cpu model to use and it selected an invalid one for the host | |
| 10:57:20 | kashyap | sean-k-mooney: File a bug, please, if you're confident. I'm struggling to multi-task | |
| 10:57:34 | kashyap | I'll be interested to see a simple reproducer. | |
| 10:57:41 | openstackgerrit | Brin Zhang proposed openstack/nova master: Add operator user_id/project_id to the migrations https://review.opendev.org/679413 | |
| 10:57:54 | sean-k-mooney | i have hit this many many times | |
| 10:58:04 | sean-k-mooney | its been a thing in qemu for quite a while | |
| 10:58:09 | sean-k-mooney | but yes i should file a bug | |
| 10:58:11 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Nova object changes for forbidden aggregates request filter https://review.opendev.org/671072 | |
| 10:58:12 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Add a new request filter to isolate aggregates https://review.opendev.org/671075 | |
| 10:58:12 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: DB API changes to get non-matching aggregates from metadata https://review.opendev.org/671074 | |
| 10:58:13 | openstackgerrit | Shilpa Devharakar proposed openstack/nova master: Enable request filter isolate_aggregates https://review.opendev.org/667952 | |
| 10:59:10 | sean-k-mooney | the reproduce is basicaly boot a qemu l2 gues with kvm enabled in a l1 guest where the host is intel x86 | |
| 10:59:35 | sean-k-mooney | it picks up support for vmx in the l1 guest but enable svm in the l2 guest | |
| 10:59:49 | donnyd | sean-k-mooney: is the numa thing working | |
| 10:59:51 | sean-k-mooney | i have seen other similar case for other instruction too | |
| 11:00:00 | sean-k-mooney | donnyd: havent tried it yet | |
| 11:00:06 | donnyd | oh ok | |
| 11:00:11 | sean-k-mooney | but im 99% sure it will | |
| 11:00:27 | sean-k-mooney | you have configured the flavor more or less how i do for dev | |