Earlier  
Later
New Search
Posted Nick Remark
#openstack-nova - 2019-08-30
10:36:51 artom sean-k-mooney, hey, so how feasible would be to hack together a tempest job that runs https://review.rdoproject.org/r/#/c/18832/ on that new FN flavor?
10:36:57 artom ('morning!)
10:37:34 sean-k-mooney artom: well my nfv test job did actully work a few months ago so i could make it work on FN pretty quick
10:37:42 sean-k-mooney as in today
10:37:54 sean-k-mooney but im currently reworking functional test
10:38:07 sean-k-mooney want me to give it ago when im done
10:38:52 artom sean-k-mooney, that'd be awesome :) whitebox needs a bunch of configs to be set, I can help with those
10:39:26 artom https://review.opendev.org/#/c/678887/ failed with KVM errors, so I'm trying think of other possibilities
10:39:54 sean-k-mooney ya well first thing would be to just get it stacking multinode with a few smoketests. then we can add the plugin
10:40:47 artom Right, baby steps :)
10:40:58 sean-k-mooney artom: i dont see errors in the n-cpu log
10:41:15 sean-k-mooney oh multinode
10:41:40 sean-k-mooney still no erros on the other node
10:42:03 artom sean-k-mooney, no, they're in the qemu logs
10:42:06 artom ex: https://zuul.opendev.org/t/openstack/build/905b52e0b1e84532944f0606b5455381/log/logs/subnode-2/libvirt/qemu/instance-00000005.txt.gz
10:42:33 sean-k-mooney oh thats the kernel bug i mentioned to donnyd
10:42:54 sean-k-mooney actully may be not
10:43:12 sean-k-mooney it could be but that looks like an issue with the cpu model
10:43:29 donnyd i am using host-passthrough on nova
10:43:41 sean-k-mooney its checking for svm with is amds version of vt-x
10:43:54 sean-k-mooney donnyd: ya this is on vexhost
10:44:01 sean-k-mooney but i think this is a different issue
10:44:07 donnyd oh
10:44:25 sean-k-mooney ya so
10:44:27 sean-k-mooney [libvirt]
10:44:28 sean-k-mooney live_migration_uri = qemu+ssh://stack@%s/system
10:44:30 sean-k-mooney cpu_mode = none
10:44:32 sean-k-mooney virt_type = kvm
10:45:04 sean-k-mooney we should be setting cpu_mode=custom and cpu_model=kvm64 in devstack
10:45:22 sean-k-mooney with cpu_mode=none we default to host-model
10:45:40 sean-k-mooney but host-model does not always detect the capablity proably espcailly with nested virt
10:45:58 openstackgerrit Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243
10:46:02 artom sean-k-mooney, I'll just add that to Matt's devstack nuke
10:46:10 sean-k-mooney so this host whihc is likel intel x86 was detected as support svm which from the kvm error it is not
10:46:22 sean-k-mooney cool
10:46:32 artom But coffee first
10:46:43 sean-k-mooney kvm64 is the most portable cpu model that work with kvm
10:47:02 artom Daughter started school. I'm guess I'm just excited/stressed for her.
10:47:20 sean-k-mooney first time
10:47:24 artom Gym attendance took a hit as well
10:47:26 artom Yeah
10:47:58 kashyap sean-k-mooney: IIRC, there was a reason we went with existing CPU model 'qemu64'
10:48:02 kashyap In DevStack
10:48:04 sean-k-mooney that can be stressful for both her and you. im sure it will be fine
10:48:09 kashyap Because not all Gate hosts support KVM
10:48:25 sean-k-mooney kashyap: yes but we are specific testing someing with nested vert
10:48:39 sean-k-mooney e.g we are hardcodeing stuff and targeting 1 cloud that does
10:48:58 sean-k-mooney so we are trying to undo all the other suff that hard codes it to qemu
10:49:42 kashyap sean-k-mooney: Ah, for that context, sure
10:49:57 alex_xu stephenfin: emm...all are expected, since he still using vcpu_pin_set, that means no PCPU
10:50:02 openstackgerrit Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243
10:50:09 sean-k-mooney kashyap: ill be writing a sperate permenet job later but this is a quick hack just to do some non me testing of artoms code
10:50:34 kashyap sean-k-mooney: Sure. I didn't realize the full context.
10:50:59 openstackgerrit Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243
10:51:29 sean-k-mooney kashyap: its kind of a libvirt/qemu bug.
10:52:04 sean-k-mooney with host model it should not be trying to use svm for the l2 guest on a l1 guest that does not have it
10:52:21 sean-k-mooney but if we use kvm64 it wont do that so its all good
10:52:57 sean-k-mooney i would not run real workload with kvm64 but its perfect for testing
10:53:26 kashyap sean-k-mooney: What precisely is a libvirt/QEMU bug? /me reads on
10:53:31 openstackgerrit Luyao Zhong proposed openstack/nova master: object: Introduce Resource and ResouceList objs https://review.opendev.org/678448
10:53:32 openstackgerrit Luyao Zhong proposed openstack/nova master: Retrive the allocations early https://review.opendev.org/678450
10:53:32 openstackgerrit Luyao Zhong proposed openstack/nova master: Add resources dict into _Provider https://review.opendev.org/678449
10:53:33 openstackgerrit Luyao Zhong proposed openstack/nova master: libvirt: Enable driver configuring PMEM namespaces https://review.opendev.org/678453
10:53:33 openstackgerrit Luyao Zhong proposed openstack/nova master: Claim resources in resource tracker https://review.opendev.org/678452
10:53:34 openstackgerrit Luyao Zhong proposed openstack/nova master: libvirt: Support VM creation with vpmems and vpmems cleanup https://review.opendev.org/678455
10:53:34 openstackgerrit Luyao Zhong proposed openstack/nova master: libvirt: report VPMEM resources by provider tree https://review.opendev.org/678454
10:53:35 openstackgerrit Luyao Zhong proposed openstack/nova master: Add functional tests for virtual persistent memory https://review.opendev.org/678470
10:53:35 openstackgerrit Luyao Zhong proposed openstack/nova master: Parse vpmem related flavor extra spec https://review.opendev.org/678456
10:54:14 sean-k-mooney kashyap: we are default to host-model because cpu_mode is none
10:54:17 sean-k-mooney but https://zuul.opendev.org/t/openstack/build/905b52e0b1e84532944f0606b5455381/log/logs/subnode-2/libvirt/qemu/instance-00000005.txt.gz
10:54:57 kashyap sean-k-mooney: Right
10:55:14 sean-k-mooney but qemu expose an cpu flag to the l2 guest that the l1 guest does not suport
10:56:08 kashyap sean-k-mooney: Hmm. (Also, yes, agreed - on kvm64 for testing-only)
10:56:32 sean-k-mooney its deffintly a qemu bug since we are not passing the -cpu flag at all in this case
10:56:53 sean-k-mooney so its up to qemu to figure out what cpu model to use and it selected an invalid one for the host
10:57:20 kashyap sean-k-mooney: File a bug, please, if you're confident. I'm struggling to multi-task
10:57:34 kashyap I'll be interested to see a simple reproducer.
10:57:41 openstackgerrit Brin Zhang proposed openstack/nova master: Add operator user_id/project_id to the migrations https://review.opendev.org/679413
10:57:54 sean-k-mooney i have hit this many many times
10:58:04 sean-k-mooney its been a thing in qemu for quite a while
10:58:09 sean-k-mooney but yes i should file a bug
10:58:11 openstackgerrit Shilpa Devharakar proposed openstack/nova master: Nova object changes for forbidden aggregates request filter https://review.opendev.org/671072
10:58:12 openstackgerrit Shilpa Devharakar proposed openstack/nova master: Add a new request filter to isolate aggregates https://review.opendev.org/671075
10:58:12 openstackgerrit Shilpa Devharakar proposed openstack/nova master: DB API changes to get non-matching aggregates from metadata https://review.opendev.org/671074
10:58:13 openstackgerrit Shilpa Devharakar proposed openstack/nova master: Enable request filter isolate_aggregates https://review.opendev.org/667952
10:59:10 sean-k-mooney the reproduce is basicaly boot a qemu l2 gues with kvm enabled in a l1 guest where the host is intel x86
10:59:35 sean-k-mooney it picks up support for vmx in the l1 guest but enable svm in the l2 guest
10:59:49 donnyd sean-k-mooney: is the numa thing working
10:59:51 sean-k-mooney i have seen other similar case for other instruction too
11:00:00 sean-k-mooney donnyd: havent tried it yet
11:00:06 donnyd oh ok
11:00:11 sean-k-mooney but im 99% sure it will
11:00:27 sean-k-mooney you have configured the flavor more or less how i do for dev
11:02:38 stephenfin kashyap: Is the secure boot spec punted til U?
11:02:42 stephenfin *to
11:02:50 stephenfin (i.e. https://review.opendev.org/#/c/506720/)
11:03:33 kashyap stephenfin: No, it's not. It's the CPU APIs spec that's punted to U
11:03:54 kashyap SB spec aiming for Train, still. I'm optimistic like that
11:05:28 openstackgerrit Brin Zhang proposed openstack/nova master: Filter migrations by user_id/project_id https://review.opendev.org/674243
11:21:20 openstackgerrit Artom Lifshitz proposed openstack/nova master: DNM: Run LM integration tests with NUMA flavor https://review.opendev.org/678887

Earlier   Later