| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2023-07-27 | |||
| 17:42:54 | dansmith | ohhh hang on | |
| 17:43:11 | dansmith | melwitt: does the running instance have a source= tag in the console/pty element? | |
| 17:43:25 | dansmith | if not, then it's never finding this console_type==pty thing because the xpath won't match | |
| 17:44:01 | melwitt | dansmith: it does after the initial create. I haven't checked if it does after I start it after stopping it. checking now | |
| 17:44:10 | dansmith | okay I thought you said it didn't on stop | |
| 17:44:11 | sean-k-mooney | it does | |
| 17:44:22 | sean-k-mooney | after we stop it it goes away | |
| 17:44:40 | melwitt | dansmith: ? I said it has <source> before stop and then it does not have <source> after stop | |
| 17:44:42 | sean-k-mooney | when we do a dumpxml we are not actully reading a file | |
| 17:44:51 | sean-k-mooney | we are geting the responce form the libvirt deamon | |
| 17:45:02 | dansmith | so after stop we should be getting the actual file on disk without the pty messing it up | |
| 17:45:07 | sean-k-mooney | i dont know if the console is ever on the file on disk | |
| 17:45:31 | sean-k-mooney | ya proably does anyoen know where that file is and we can check | |
| 17:46:13 | melwitt | if I start it again it has <source> agian | |
| 17:46:14 | sean-k-mooney | ah its in /etc/libvirt/qemu/instance-00000001.xml | |
| 17:46:16 | melwitt | *again | |
| 17:46:24 | dansmith | okay, so | |
| 17:46:34 | dansmith | after we shutdown, | |
| 17:46:49 | dansmith | we match neither pty or file, the path.exists fails and we just return "" for the console log | |
| 17:47:02 | dansmith | is that the thinking? | |
| 17:47:19 | dansmith | (sorry if I'm just being slow) | |
| 17:47:33 | melwitt | (and console log get works again) | |
| 17:47:54 | dansmith | I just so don't see how this is working for the non-lvm cases | |
| 17:47:56 | melwitt | no it's bailing before it ever gets to the log file part | |
| 17:48:03 | sean-k-mooney | so so the file on disk is not updated with the souce element when its running so its only updated in the trainient domain while its running | |
| 17:48:09 | dansmith | melwitt: right, so here right? https://github.com/openstack/nova/blame/master/nova/virt/libvirt/driver.py#L4483 | |
| 17:48:11 | melwitt | because it doesn't parse <source>. I don't think that's intended probably | |
| 17:48:34 | melwitt | no, like this https://paste.openstack.org/show/bpovXD89OL2QzukI3BWi/ | |
| 17:49:10 | melwitt | fails (returns) before that | |
| 17:49:39 | dansmith | melwitt: shouldn't that return an error through the api then? | |
| 17:49:41 | sean-k-mooney | oh interesting https://termbin.com/0qcj | |
| 17:49:54 | dansmith | tempest is getting blank logs not an error, AFAIK | |
| 17:51:07 | sean-k-mooney | ya the error iss """AssertionError: '' is not true : Console output was empty.""" | |
| 17:51:33 | dansmith | unless we're not actually raising that, but I thought we were in one case you pasted earleir | |
| 17:51:35 | sean-k-mooney | the test is doing self.assertTrue(output, "Console output was empty.") | |
| 17:51:46 | dansmith | wait what | |
| 17:51:47 | melwitt | yeah... looking to see if I can see how. for me I think it goes here and raises HTTPNotFound https://github.com/openstack/nova/blob/master/nova/api/openstack/compute/console_output.py#L58 | |
| 17:51:53 | sean-k-mooney | no i think the test is not checking the return code | |
| 17:52:01 | melwitt | so it must be something the client is doing? | |
| 17:52:34 | dansmith | omh | |
| 17:52:48 | dansmith | sean-k-mooney: it's checking to see that the console is actually empty in shutoff state/ | |
| 17:53:16 | sean-k-mooney | no output will be true if its not the empty string | |
| 17:53:33 | melwitt | on the command line I get "ResourceNotFound: 404: Client Error for url: http://127.0.0.1/compute/v2.1/servers/68b8344b-10dc-4a84-90e4-ad8be7a2bb60/action, Guest does not have a console available." | |
| 17:53:37 | melwitt | osc | |
| 17:53:48 | dansmith | wtf | |
| 17:54:00 | dansmith | so I guess I totally misread the test | |
| 17:54:02 | sean-k-mooney | ya thats what i get too | |
| 17:54:09 | sean-k-mooney | 404 | |
| 17:54:22 | sean-k-mooney | but i think the 404 has an empy body | |
| 17:54:33 | dansmith | I thought the test was asserting that the console was *still* available | |
| 17:54:33 | melwitt | yeah and it's bc | |
| 17:54:33 | melwitt | except (exception.InstanceNotFound, | |
| 17:54:33 | melwitt | exception.ConsoleNotAvailable) as e: | |
| 17:54:33 | melwitt | raise webob.exc.HTTPNotFound(explanation=e.format_message()) | |
| 17:54:48 | melwitt | wait what | |
| 17:54:53 | sean-k-mooney | dansmith: the test is | |
| 17:55:07 | sean-k-mooney | https://github.com/openstack/tempest/blob/04cb0adc822ffea6c7bfccce8fa08b03739894b7/tempest/api/compute/servers/test_server_actions.py#L211C7-L213 | |
| 17:55:10 | dansmith | it's not, it's asserting that the result is "console is empty" | |
| 17:55:14 | melwitt | """Test getting console output for a server in SHUTOFF status | |
| 17:55:14 | melwitt | Should be able to GET the console output for a given server_id | |
| 17:55:14 | melwitt | in SHUTOFF status. | |
| 17:55:24 | dansmith | sean-k-mooney: L213 | |
| 17:55:37 | frickler | you can add --debug to the osc call to verify the body | |
| 17:55:47 | melwitt | uh wtf self.assertTrue(output, "Console output was empty.") | |
| 17:55:50 | sean-k-mooney | no self.assertTrue takes an object to test and a message to return if it fails | |
| 17:55:56 | dansmith | melwitt: yeah I wonder if that means "doesn't fail" | |
| 17:56:08 | melwitt | this is asserting the exact opposite of what the docstring says | |
| 17:56:12 | dansmith | sean-k-mooney: ahhh, right okay | |
| 17:56:19 | dansmith | not assertEqual | |
| 17:56:29 | melwitt | ohh ok right | |
| 17:56:30 | dansmith | confusing | |
| 17:56:32 | sean-k-mooney | right | |
| 17:56:42 | sean-k-mooney | they shoudl not be useing assertTrue relaly in this case | |
| 17:56:48 | dansmith | yeah for serious | |
| 17:56:56 | sean-k-mooney | as i said they are relying on the boolean convertion to true of a non empty string | |
| 17:57:07 | melwitt | yeah bc they're saying "I got an error string, it must be a console!" | |
| 17:57:28 | sean-k-mooney | right so the fact this is failing | |
| 17:57:39 | sean-k-mooney | is telliing me the 404 had an emptyp body | |
| 17:57:48 | sean-k-mooney | im going to get the request id and check the api log | |
| 17:57:54 | dansmith | I wish frickler wasn't here watching this circus of three seasoned nova cores trying to figure out how one of the most basic calls works :/ | |
| 17:57:57 | sean-k-mooney | it should have the content lenght | |
| 17:58:19 | melwitt | seasoned curlies | |
| 17:58:39 | dansmith | frickler: I'm kidding of course, just .. not our best moment :) | |
| 17:59:14 | frickler | well I can't say I'm not enjoying it ;) | |
| 17:59:18 | dansmith | lol | |
| 17:59:49 | melwitt | this means not an empty string no? | |
| 17:59:49 | melwitt | DEBUG nova.api.openstack.wsgi [None req-2441eccd-ea63-4c9d-94a3-29aaf1ecf5c4 demo demo] Returning 404 to user: Guest does not have a console available. {{(pid=2011570) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} | |
| 18:00:19 | melwitt | I guess I should do osc --debug | |
| 18:00:25 | sean-k-mooney | status: 404 len: 86 microversion: 2.91 time: 0.719216 | |
| 18:00:42 | melwitt | RESP BODY: {"itemNotFound": {"code": 404, "message": "Guest does not have a console available."}} | |
| 18:00:44 | sean-k-mooney | 86 bytes might just be the header | |
| 18:00:49 | gmann | status code is already checked in service client side so we can just remove this assert itself ? | |
| 18:00:54 | sean-k-mooney | oh actully no | |
| 18:00:58 | sean-k-mooney | RESP BODY: {"itemNotFound": {"code": 404, "message": "Guest does not have a console available."}} | |
| 18:01:11 | melwitt | so I think it really is going assertTrue("Guest does not have a console available.") | |
| 18:01:32 | sean-k-mooney | ya but why whoudl that be false | |
| 18:01:45 | dansmith | maybe it's ... AI... | |
| 18:01:48 | melwitt | maybe for lvm it's not returning a non empty string? I dunno why | |
| 18:01:57 | melwitt | AI yes | |
| 18:02:03 | sean-k-mooney | no that form lvm | |