| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-02-13 | |||
| 14:09:47 | kashyap | mriedem: Indeed | |
| 14:09:53 | mriedem | (knowing people skip several years of openstack releases now) | |
| 14:10:07 | sean-k-mooney | adrianc: i dont think there is anything controvertiol in any of the coments on the seirs so if you have time to make the requested change go for it | |
| 14:10:38 | mriedem | looks like we don't have zkvm 3rd party CI anymore... | |
| 14:10:45 | kashyap | Release-wise, we're just about to reach M3 (Mar 04-08), and the GA is aroud 12-Apr — I feel we're still okay | |
| 14:11:05 | adrianc | sean-k-mooney: Ack, ill start from the base patch then :) | |
| 14:11:11 | kashyap | mriedem: Yeah, was wondering this morning about it | |
| 14:11:17 | mriedem | https://wiki.openstack.org/wiki/ThirdPartySystems/IBM_zKVM_CI | |
| 14:11:33 | kashyap | Today I spent 4 hours digging into s390x and their fun serial console stuff | |
| 14:11:49 | openstackgerrit | Alexandra Settle proposed openstack/nova master: Adding cross refs for config options in scheduler filter guide https://review.openstack.org/636635 | |
| 14:11:52 | mriedem | kashyap: so how about you send a reminder to the mailing list and also copy zkvm-ci@linux.vnet.ibm.com and bjzhjing@linux.vnet.ibm.com | |
| 14:11:56 | kashyap | MarkusZ left a note in the code with a pointer to a bug ... and it turned out it's a bug _I_ filed 4 years ago :P | |
| 14:12:17 | mriedem | markus_z is long gone from openstack | |
| 14:12:21 | kashyap | mriedem: I guess you mean now, right? | |
| 14:12:35 | mriedem | kashyap: yeah, i'd say do that now and if we don't hear any strong objections by end of week we go ahead | |
| 14:12:40 | kashyap | mriedem: I know, I just found it sadly funny that when I decided to learn more from the bug ... apparently I filed it. | |
| 14:12:45 | kashyap | mriedem: Alright, let me draft it right away. | |
| 14:13:04 | kashyap | mriedem: I spent a painful 8 days on-and-off arriving at the root cause. But hey, fun :-) | |
| 14:13:37 | kashyap | Thanks for your time. Appreciate it | |
| 14:13:38 | mriedem | you've grown as a person i'm sure | |
| 14:14:18 | kashyap | I did; I grew in "(positive) complexity" :D | |
| 14:15:42 | kashyap | What tags would I use? [ops][nova] suffices I guess? | |
| 14:15:48 | kashyap | s/suffices/suffice/ | |
| 14:16:34 | mriedem | yeah | |
| 14:17:10 | kashyap | mriedem++ | |
| 14:17:25 | kashyap | Hm, we should get a 'karma bot' in | |
| 14:32:04 | efried | Shilpa: It looks to me like you're not specifying an engine for your task flow. I thought the default was a linear one, but it's possible it's not. Do you get the same results if you specify a linear engine explicitly? | |
| 14:32:45 | Shilpa | efried: tried with engine='serial' but no sucess | |
| 14:33:22 | Shilpa | i will check setting engine='linear' and get back to you | |
| 14:33:51 | efried | Shilpa: I don't remember exactly what the engine names are, would have to consult the docs. | |
| 14:34:02 | Shilpa | ok | |
| 14:35:31 | efried | Shilpa: Beyond that, I'm probably not a whole lot of use to you. Josh Harlow (harlowja) is the guy who could help, but I don't see him in the usual haunts; possible he's moved on to greener pastures. | |
| 14:35:47 | efried | You may want to try posting your bug to the taskflow github repo | |
| 14:35:54 | Shilpa | efried: its serial but no sucess | |
| 14:36:03 | efried | Shilpa: Okay. | |
| 14:36:57 | Shilpa | efried: at taskflow github repo, in REDME posted Bugs: https://bugs.launchpad.net/taskflow/ | |
| 14:38:49 | bauzas | holy shit, I'm deploying devstack and placement gives me a 503 when being started | |
| 14:38:52 | bauzas | wtf | |
| 14:39:10 | sean-k-mooney | bauzas: its likely the same issue i had | |
| 14:39:21 | sean-k-mooney | you have old apache config files | |
| 14:39:22 | bauzas | efried: cdent: any thoughts on that ? | |
| 14:39:28 | bauzas | hah | |
| 14:39:32 | bauzas | i asked to reclone | |
| 14:39:41 | sean-k-mooney | it wont fix it | |
| 14:39:44 | bauzas | yeah | |
| 14:39:54 | bauzas | but then we're missing something in lib/placemenbt | |
| 14:40:04 | bauzas | because a clean.sh didn't fix it too | |
| 14:40:24 | openstackgerrit | Alexandra Settle proposed openstack/nova master: Adding cross refs for config options in scheduler filter guide https://review.openstack.org/636635 | |
| 14:40:24 | sean-k-mooney | nuke your /etc/http/site-available and sites-enabled | |
| 14:40:38 | sean-k-mooney | bauzas: ya i was ment to wite a change to devstack to fix it | |
| 14:40:45 | sean-k-mooney | its on my todo list | |
| 14:40:50 | efried | cool | |
| 14:40:51 | bauzas | ok | |
| 14:40:54 | bauzas | gtk | |
| 14:40:55 | sean-k-mooney | hopefully ill get to it by next week | |
| 14:40:57 | cdent | it's a generic problem with how apache stuff is config'd not just placement | |
| 14:41:18 | cdent | there are additional issues when you switch back and forth between using uwsgi and not | |
| 14:41:19 | sean-k-mooney | ya i hit the same issue with cinder i think | |
| 14:41:23 | openstackgerrit | Alexandra Settle proposed openstack/nova master: Adding cross refs for config options in scheduler filter guide https://review.openstack.org/636635 | |
| 14:41:34 | bauzas | sean-k-mooney: wait, I'm running devstack with uwsgi | |
| 14:41:40 | sean-k-mooney | yes | |
| 14:41:48 | bauzas | I don't have httpd site | |
| 14:41:50 | efried | cdent: is it the kind of thing it would be appropriate to put a hack into devstack to clean up / make sure it dtrt? | |
| 14:41:50 | sean-k-mooney | apache is still being used as a reverse proxy | |
| 14:42:06 | cdent | efried: sean-k-mooney plans to figure it out | |
| 14:42:12 | efried | woot | |
| 14:42:25 | bauzas | sean-k-mooney: wait, I don't know what to bitch | |
| 14:42:30 | sean-k-mooney | if your using ubnuntu its under /etc/apache2/... | |
| 14:42:37 | bauzas | my httpd directory is sane | |
| 14:42:56 | bauzas | it's RHEL, so /etc/httpd but whatever | |
| 14:43:02 | sean-k-mooney | bauzas: for me it was poining at an old socket name nova-placement.socket | |
| 14:43:39 | bauzas | ah, interesting | |
| 14:43:42 | sean-k-mooney | you could see the error in the apache errror log in /var/httpd/error.log | |
| 14:43:43 | bauzas | in conf.d, I have two files | |
| 14:44:03 | bauzas | nova-placement-api.conf and placement-api.conf | |
| 14:44:27 | sean-k-mooney | bauzas: the simple solution is to run clean unistall httpd and delete /etc/httpd then stack | |
| 14:44:30 | sean-k-mooney | it will fix everything | |
| 14:44:46 | sean-k-mooney | but really you just need to remove the placemetn config file | |
| 14:45:21 | bauzas | I guess | |
| 14:45:22 | bauzas | lemme try | |
| 14:46:08 | sean-k-mooney | i have done ^ 3 times in the last week for this issue on different systems | |
| 14:46:28 | sean-k-mooney | but ill look at actully just makeing devstack fix it properly next week | |
| 14:46:36 | bauzas | cdent: edleafe: efried: somehow, we changed from nova-placement-api.conf to placement-api.conf without thinking of folks who upgrade | |
| 14:46:38 | bauzas | :) | |
| 14:46:48 | bauzas | words of wisdom, people do upgrade :) | |
| 14:47:01 | sean-k-mooney | bauzas: yep but its also devstack soo.... | |
| 14:47:01 | cdent | of devstack? | |
| 14:47:22 | cdent | i thought the three letters on the front was a clue? | |
| 14:47:43 | sean-k-mooney | i assume grenade is just nuking the configs and replaceing them with new ones | |
| 14:48:12 | sean-k-mooney | cdent: it still shows up on the openstack survay in prod ocationally | |
| 14:48:51 | sean-k-mooney | cdent: honestly with the ansible rules we use in the gate for deploying it and the swap to systemd for all the things its actully a lot less dumb then it used to be | |
| 14:49:02 | sean-k-mooney | cdent: it now support host reboots again | |
| 14:49:03 | bauzas | cdent: you don't imagine how much devstack is insightful for deployers :) | |
| 14:49:17 | bauzas | but anyway, not a big deal | |
| 14:49:17 | cdent | I'm not disputing that devstack should clean up apache configs better. Just trying to point out that this is an old and not related to placement problem and not something that is super urgent. it's just a bug that needs to be fixed | |
| 14:49:21 | cdent | anyone can fix it | |
| 14:50:17 | sean-k-mooney | fixed and then backported as this only happens if you swap branches | |
| 14:50:51 | jroll | I'm surprised clean.sh doesn't remove apache configs, seems like an easy fix | |
| 14:50:55 | sean-k-mooney | which developer do a lot but ci systems and normal peole do not | |
| 14:51:44 | cdent | jroll: I really think it simply comes down to "nobody has got around to it yet or been burned enough to bother". sean-k-mooney is nearly there. | |