| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-02-04 | |||
| 22:55:14 | sean-k-mooney | yes i think he used to do touch <file> && tox -e ... | |
| 22:57:32 | gmann | ohk. if that happens before installing deps then that is something i am looking for. | |
| 23:06:23 | efried | dansmith: Sorry, I got started, but ran out of time. I'll try to get to that patch (cyborg request groups) early tomorrow. | |
| 23:07:34 | efried | I got to the point where I was starting to remember asking Sundar to make this look more like how we feed bandwidth requests into the RequestSpec, and this doesn't look like it's doing that (at least the way I expected). But I'll dig in more tomorrow. | |
| 23:13:17 | dansmith | efried: okay, well, glad I waited then but..yeah, would be good if we can get that feedback in the queue so he has some time to address it | |
| 23:30:37 | openstackgerrit | Michael Bayer proposed openstack/nova master: remove DISTINCT ON SQL instruction that does nothing on MySQL https://review.opendev.org/705850 | |
| 23:40:27 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable hard/soft reboot with accelerators. https://review.opendev.org/697940 | |
| 23:40:28 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable and use COMPUTE_ACCELERATORS trait. https://review.opendev.org/699554 | |
| 23:40:28 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Enable start/stop of instances with accelerators. https://review.opendev.org/699553 | |
| 23:40:29 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Add cyborg tempest job. https://review.opendev.org/670999 | |
| 23:40:29 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Bump compute rpcapi version and reduce Cyborg calls. https://review.opendev.org/704227 | |
| 23:56:29 | sean-k-mooney | im still fleshing out the script and ill continue working on it tomorrow but i am still seeing arq bidning issues | |
| 23:56:34 | sean-k-mooney | this is what i ahve so far http://paste.openstack.org/show/789138/ | |
| 23:57:16 | sean-k-mooney | that was the error reported to the user http://paste.openstack.org/show/789139/ | |
| #openstack-nova - 2020-02-05 | |||
| 00:00:54 | sean-k-mooney | "Feb 04 23:58:11 cyborg devstack@cyborg-api.service[1026]: 2020-02-04 23:58:11.561 1162 DEBUG wsme.api [req-e73cfa00-93fe-48ec-ac53-f7cde5e7ba68 587231efdc20474ba378d4dff3c7bfd3 aaa44c9e9ced4e328a3503c86899f01f - default default] Client-side error: ExtArq not found with uuid=cb27c864-8a56-4440-85f1-09023019e1ab format_exception /usr/local/lib/python3.7/dist-packages/wsme/api.py:222" that is the error | |
| 00:00:56 | sean-k-mooney | in the cyborg log | |
| 00:01:51 | sean-k-mooney | oh there is a traceback in the cyborg conductor too | |
| 00:03:20 | sean-k-mooney | oh that is unrealated i tried to create duplicate profiles previously | |
| 00:05:16 | sean-k-mooney | oh i found the issue its the same one i had before i think http://paste.openstack.org/show/789142/ | |
| 00:05:53 | sean-k-mooney | so it looks like the cyborg api is not able to call back the nova api to notify it of the binding completion | |
| 00:06:28 | sean-k-mooney | im sligly confused why the cyborg api woudl be trying to do that and not the cyborg conductor but that is the issue | |
| 00:07:06 | sean-k-mooney | efried: dansmith sundar ^ any ideas. i might look at the tempest jobs to see what they are setting | |
| 00:08:15 | dansmith | yeah, I dunno, but agreed it seems weird that it would be cyborg api | |
| 00:08:23 | dansmith | is the "conductor" really the compute agent? | |
| 00:08:33 | sean-k-mooney | no that is seperate | |
| 00:08:37 | sean-k-mooney | they have all 3 | |
| 00:08:48 | sean-k-mooney | copying novas architecure | |
| 00:09:18 | dansmith | okay, I guess I'd have thought it'd be the compute agent sending that then, but I guess if the conductor is blocking on the compute to finish then maybe that makes sense | |
| 00:09:52 | sean-k-mooney | well it seams like the api is blocking on the agent or conductor | |
| 00:09:52 | dansmith | I gotta run in a sec to meet people, but maybe we can get an answer from sundar tomorrow | |
| 00:10:02 | sean-k-mooney | ya | |
| 00:10:06 | dansmith | that sounds like a recipe for disaster :/ | |
| 00:10:08 | sean-k-mooney | im going to call it a day anyway | |
| 00:10:16 | dansmith | cool, thanks for looking at this | |
| 00:11:35 | sean-k-mooney | no worries | |
| 00:18:08 | sean-k-mooney | huh so in the ci i see " Ignoring Nova notification error that the instance 79390576-dd09-4f1c-a925-5f8d30c83bdc is not yet associated with a host." at the point i see the trace back in my setup. so im guessing if we win the race so that nova has assocaited the instance with the host cyborg expolodes | |
| 00:19:28 | dansmith | okay that's an expected situation for the fake driver | |
| 00:19:38 | dansmith | should not be tracing on the cyborg side, but.. | |
| 00:19:53 | sean-k-mooney | well both are the fake driver | |
| 00:20:16 | sean-k-mooney | anyway tomorrows problem o/ | |
| 01:38:45 | huaqiang | stephenfin: got your message, thanks. | |
| 04:31:17 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Add cyborg tempest job. https://review.opendev.org/670999 | |
| 04:31:17 | openstackgerrit | Sundar Nadathur proposed openstack/nova master: Bump compute rpcapi version and reduce Cyborg calls. https://review.opendev.org/704227 | |
| 06:37:21 | openstackgerrit | Qiu Fossen proposed openstack/nova-specs master: Support fuzzy querying instance by tag https://review.opendev.org/691651 | |
| 07:18:48 | huaqiang | ls | |
| 07:23:22 | MUUSEE_ | Hi can anyone help me with a query regarding " libvirt: virtio-net multiqueue " | |
| 08:42:17 | gibi | cores: easy +A potential https://review.opendev.org/#/c/698053 | |
| 08:45:02 | bauzas | gibi: looking | |
| 08:45:27 | bauzas | easy indeed | |
| 09:55:26 | openstackgerrit | Brin Zhang proposed openstack/nova master: Store instance action event exc_val fault details https://review.opendev.org/694428 | |
| 10:36:29 | openstackgerrit | Qiu Fossen proposed openstack/nova-specs master: specify mac for creating instance https://review.opendev.org/700429 | |
| 10:37:00 | openstackgerrit | Merged openstack/nova master: Minor improvements to cell commands https://review.opendev.org/698053 | |
| 11:07:26 | stephenfin | gibi: Could you revisit https://review.opendev.org/#/c/705760/ ? ralonsoh spotted some paths I'd missed | |
| 11:07:42 | stephenfin | and dansmith had comments but I've addressed them, afaict | |
| 11:12:44 | sandonov | openstack-nova | |
| 11:35:19 | openstackgerrit | Brin Zhang proposed openstack/nova-specs master: FUP: Fixed the invalid index in References https://review.opendev.org/705933 | |
| 11:52:17 | openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Remove unused 'cache_utils' APIs https://review.opendev.org/705652 | |
| 11:52:18 | openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Bump minimum version of websockify https://review.opendev.org/705654 | |
| 11:52:18 | openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Address TODO https://review.opendev.org/705653 | |
| 11:52:19 | openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Remove 'run_once' helper https://review.opendev.org/705656 | |
| 11:52:19 | openstackgerrit | Stephen Finucane proposed openstack/nova master: trivial: Merge unnecessary 'NovaProxyRequestHandlerBase' separation https://review.opendev.org/705655 | |
| 11:52:20 | openstackgerrit | Stephen Finucane proposed openstack/nova master: mypy: Add type annotations to 'nova.pci' https://review.opendev.org/676209 | |
| 11:52:20 | openstackgerrit | Stephen Finucane proposed openstack/nova master: tox: Integrate mypy https://review.opendev.org/676208 | |
| 11:52:21 | openstackgerrit | Stephen Finucane proposed openstack/nova master: WIP: mypy: Add type annotations to top-level modules https://review.opendev.org/705658 | |
| 11:52:21 | openstackgerrit | Stephen Finucane proposed openstack/nova master: mypy: Add nova.cmd, nova.conf, nova.console https://review.opendev.org/705657 | |
| 12:03:44 | kashyap | stephenfin: Hiya; I've addressed your questions, and added additional useful bits where needed: https://review.opendev.org/#/c/693844/ | |
| 12:25:17 | openstackgerrit | Merged openstack/nova master: nova-net: Remove use of legacy 'SecurityGroup' object https://review.opendev.org/697155 | |
| 12:36:31 | mriosfer | Hi, We got Openstack Queens RDO. Some customers are telling us that their Windows VM CPU performs bad as a hell. We deployed the lasted virtio already to check improvements. I got a video an its true work its frustating, I/O is less than <1ms | |
| 12:40:34 | sean-k-mooney | what are you deploying on libvirt/kvm | |
| 12:41:42 | sean-k-mooney | the first thing i woudl do is alter the cpu topology to be sane for windows | |
| 12:41:56 | sean-k-mooney | by defualt we allcoate 1 cpu socket per favor.vcpu | |
| 12:42:34 | mriosfer | we're ussing quemu-kvm for instances . | |
| 12:42:41 | sean-k-mooney | if the guest dont have a numa toplogy set hw:cpu_sockets=1 and hw:cpu:threads=2 | |
| 12:42:43 | mriosfer | How do you do that? | |
| 12:42:59 | sean-k-mooney | assuming the host has Hyper thread enabled. | |
| 12:43:04 | mriosfer | yes of course | |
| 12:43:19 | mriosfer | do you setup that extra features in the flavors? | |
| 12:43:35 | sean-k-mooney | yes you can do it in the flavor or image | |
| 12:43:50 | sean-k-mooney | in the image its hw_ instead of hw: | |
| 12:44:00 | mriosfer | i prefer image | |
| 12:44:31 | sean-k-mooney | that should help the windows shcduler if you have more then 4 vcpu in the vm | |
| 12:44:45 | mriosfer | yes.. some cpu got 8cpu or 12vcpu | |
| 12:44:57 | mriosfer | and with terminal server the performance its terrible | |
| 12:45:07 | sean-k-mooney | ya so windows will see that as 8 to 12 cpu sockets with out default setting | |
| 12:45:30 | sean-k-mooney | the next thing to look at would be the graphics device model | |
| 12:45:38 | sean-k-mooney | you said you were on queens | |
| 12:45:41 | mriosfer | yes | |
| 12:45:59 | mriosfer | our nodes dont have pcie addtional graphic card just the integrated one by Dell | |
| 12:46:09 | sean-k-mooney | ya that is ok | |
| 12:46:44 | sean-k-mooney | on train+ would suggest using the virtio gpu but on queens you should set hw_video_model=qxl | |
| 12:47:18 | sean-k-mooney | i belive qxl is the best performing graphic device that qemu can emulate prior to support for virtio | |
| 12:47:28 | sean-k-mooney | https://github.com/openstack/glance/blob/master/etc/metadefs/compute-libvirt-image.json#L71-L84 | |
| 12:47:47 | sean-k-mooney | you could also use the hw_video_ram element to increase that | |
| 12:47:57 | sean-k-mooney | i belive it default to 64mb | |
| 12:48:07 | mriosfer | thath ram uses the instance ram no? | |
| 12:48:13 | sean-k-mooney | no | |
| 12:48:16 | sean-k-mooney | its addtional host ram | |
| 12:48:24 | mriosfer | oh , ok | |
| 12:48:41 | sean-k-mooney | it can only be set on the image if the flavor allows it by setting hw_video:ram_max_mb | |
| 12:49:25 | sean-k-mooney | i would start with the qxl video model and then if that is not enough after the cpu changes then increae the ram to say 128 or 256 | |