| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2024-03-01 | |||
| 16:13:07 | ratailor_ | bauzas, ack. Thanks! | |
| 16:13:32 | ratailor_ | sean-k-mooney, gibi Thanks! | |
| 16:13:32 | bauzas | but if we can't merge it on Monday, then it will be punted to Dalmatian | |
| 16:14:06 | ratailor_ | bauzas, ack. sure. | |
| 16:14:17 | bauzas | sean-k-mooney: dansmith: about the log merging, | |
| 16:14:40 | bauzas | sean-k-mooney: dansmith: could we modify our ansible scripts to create some host logs ? | |
| 16:14:46 | bauzas | 2024-02-28 13:50:19.602722 | TASK [fetch-devstack-log-dir : Collect devstack logs] | |
| 16:15:17 | dansmith | bauzas: I'm cooking something right now, we'll see if it's helpful | |
| 16:15:51 | bauzas | dansmith: I need to go off by now but I could see it on Monday | |
| 16:16:21 | dansmith | o/ | |
| 16:18:45 | dansmith | man, we have got to get brick to stop logging tracebacks any time multipathd is missing | |
| 16:19:33 | sean-k-mooney | but how else would you know... | |
| 16:19:41 | sean-k-mooney | it is a littel excessive | |
| 16:20:12 | bauzas | dansmith: https://opendev.org/openstack/devstack/src/branch/master/roles/export-devstack-journal/tasks/main.yaml#L9-L18 | |
| 16:20:27 | bauzas | dansmith: I think we could change this to create some host log | |
| 16:20:58 | sean-k-mooney | well we do just in binary form | |
| 16:21:09 | dansmith | bauzas: we already have them combined in the journal, and I bet duplicating them in the log dump would not be popular, so just having something I can dump a log url into in the terminal is good enough I think | |
| 16:21:09 | sean-k-mooney | https://opendev.org/openstack/devstack/src/branch/master/roles/export-devstack-journal/tasks/main.yaml#L37-L49 | |
| 16:21:19 | dansmith | less good than in the browser, but the browser struggles anyway | |
| 16:21:29 | bauzas | sean-k-mooney: yeah but as dansmith said, you need to download the whole journal | |
| 16:21:45 | sean-k-mooney | right which woudl be the same... | |
| 16:21:46 | dansmith | https://termbin.com/mqhd | |
| 16:21:53 | bauzas | anyway, /me goes off by now | |
| 16:22:07 | dansmith | if you run that with the url copied from the zuul manifest it drops you right into journalctl with the whole thing merged | |
| 16:22:19 | dansmith | and you can use '-u devstack@n*' to get only nova stuff | |
| 16:22:19 | gibi | bauzas: ratailor_ cool, Im looking at it now | |
| 16:22:27 | sean-k-mooney | cool | |
| 16:22:33 | sean-k-mooney | i was playing iwht something like | |
| 16:22:36 | sean-k-mooney | curl https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_f81/904568/14/check/tempest-integrated-compute/f81f16a/controller/logs/devstack.journal.gz | zcat | lnav -q | |
| 16:22:48 | dansmith | can lnav read journal files? | |
| 16:23:15 | sean-k-mooney | kind of but it does not render them well | |
| 16:23:26 | dansmith | well, journalctl can :) | |
| 16:23:31 | sean-k-mooney | so you would proably want to pass them thorugh systemd-joural-remote | |
| 16:23:41 | dansmith | not as nice highlighting and stuff, but.. | |
| 16:24:07 | sean-k-mooney | well i normally pipe journalctl to lnav | |
| 16:24:30 | sean-k-mooney | so ya that script would be useful wehn i need ot do that | |
| 16:25:06 | dansmith | oh yeah just running that | lnav is very nice | |
| 16:25:15 | dansmith | that script I mean | |
| 16:25:20 | sean-k-mooney | ya | |
| 16:25:44 | sean-k-mooney | so we recently moved our new installer to put all the logs into the jorunal | |
| 16:25:46 | dansmith | the comment in there isn't right, let me fix it | |
| 16:26:11 | sean-k-mooney | and in those ci jobs we just are dumping /var/log/messages in to the job logs | |
| 16:26:20 | sean-k-mooney | and i have been using lnave to parst them | |
| 16:26:28 | dansmith | there: https://termbin.com/qpbv | |
| 16:26:52 | dansmith | so I can just right-click copy a url out of a zuul manifest and run that on it, optionally | lnav and it just dumps me into a merged log | |
| 16:26:54 | dansmith | that's nice | |
| 16:27:11 | gibi | bauzas: I'm +2 on the AZ series | |
| 16:29:48 | sean-k-mooney | "/usr/lib/systemd/systemd-journal-remote: No such file or directory" installing that might help | |
| 16:30:18 | dansmith | yeah | |
| 16:30:36 | dansmith | it's also in a different place on ubuntu, so I should make it use either | |
| 16:30:59 | sean-k-mooney | you could just leave it up to the path | |
| 16:31:11 | dansmith | it's not in path on either I think | |
| 16:31:27 | sean-k-mooney | oh ok odd | |
| 16:31:36 | sean-k-mooney | im installing it now but ill let you know | |
| 16:32:33 | sean-k-mooney | /usr/lib/systemd/systemd-journal-remote works on debian testing | |
| 16:32:44 | dansmith | on ubuntu it's /lib/systemd/systemd-journal-remote | |
| 16:32:58 | dansmith | oh is there a link? | |
| 16:33:37 | sean-k-mooney | rwxrwxrwx 1 root root 7 May 30 2023 /lib -> usr/lib | |
| 16:33:58 | sean-k-mooney | so ya /lib links to /usr/lib | |
| 16:33:58 | dansmith | oh heh | |
| 16:34:04 | dansmith | okay perfect then | |
| 16:34:22 | dansmith | I guess I should gist this | |
| 16:34:50 | sean-k-mooney | or we can have the ci also provide the script | |
| 16:35:07 | sean-k-mooney | i like that you dont redownload the file if its there | |
| 16:35:17 | sean-k-mooney | ../log-download.sh https://zuul.opendev.org/t/openstack/build/83d6dc665c2643f88d0025c385987c92/logs | lnav -q | |
| 16:35:21 | sean-k-mooney | that works for me nicely | |
| 16:35:54 | dansmith | https://gist.github.com/kk7ds/9a77939bd314cd4b5a35139adcdcedce | |
| 16:36:17 | sean-k-mooney | osgatelog is a better name | |
| 16:36:44 | dansmith | I also have an osfinger, that attaches to a live running job's console at the terminal | |
| 16:38:02 | sean-k-mooney | oh cool. i never got the finger gateway stuff to work localy | |
| 16:38:14 | sean-k-mooney | i didn know we had that configured for the public zuul | |
| 16:38:55 | dansmith | https://termbin.com/4mx2 | |
| 16:39:22 | dansmith | wait that's not it | |
| 16:39:25 | sean-k-mooney | oh its litrally just conenct with nc or telnet | |
| 16:39:28 | dansmith | that was an earlier bash only one, hang on | |
| 16:39:35 | dansmith | haaaang on | |
| 16:40:25 | sean-k-mooney | why do i feel like you might also have an emacs keybinding for this | |
| 16:40:26 | dansmith | https://github.com/kk7ds/openstack-gerrit-dashboard/blob/master/osfinger.py | |
| 18:10:50 | Uggla | sean-k-mooney[m], question, is the db test_migrations are run during manage db command ? | |
| 18:34:30 | dansmith | Uggla: I'm not sure what that means | |
| 18:34:58 | dansmith | test_migrations is only run when you run functional (I think) not when an admin actually uses nova-manage .. is that what you're asking? | |
| 18:36:00 | dansmith | er, no s/functional/unit/ but.. same answer about nova-manage | |
| 19:38:42 | stblatzheim | https://review.opendev.org/c/openstack/nova/+/910616 | |
| 19:39:35 | stblatzheim | sean-k-mooney: ^ review got stuck after checks, is there a additional review needed? | |
| 19:42:01 | dansmith | stblatzheim: I can hit that but, are we sure that's safe to backport? | |
| 19:42:20 | dansmith | it's ovn-specific in non-ovn-specific code and depends on neutron stuff | |
| 19:47:05 | dansmith | reading through the bug, sean was originally against this and then +2d it so there must be some context I'm missing | |
| 19:47:56 | dansmith | even though it was changed "in victoria" I still don't see the seeming api breakage addressed | |
| 19:49:19 | dansmith | we can circle back on monday where maybe sean can explain why it's the right thing to do | |
| 19:55:09 | stblatzheim | We can wait till monday for sure. Infact the change is about a reliable fix to get the info if dhcp is enabled on the subnet or not. There was infact no real api change but a different device_owner cause of the introduction of ovn. This was never adressed in nova-metadata-api and should be safe to backport. | |
| 20:05:03 | opendevreview | Merged openstack/nova master: Add hw_ephemeral_encryption_secret_uuid image property https://review.opendev.org/c/openstack/nova/+/870935 | |
| 20:05:17 | opendevreview | Merged openstack/nova master: libvirt: make |
|
| 20:05:28 | opendevreview | Merged openstack/nova master: testing: Add ephemeral encryption support to fixtures https://review.opendev.org/c/openstack/nova/+/910571 | |
| 20:11:22 | dansmith | melwitt: I should be able to test the ephemeral encryption stuff by just enabling the barbican devstack plugin, right? assuming I just manually create a flavor after the stack is up for use with it | |
| 20:39:02 | opendevreview | Merged openstack/nova master: Add support for showing requested az in output https://review.opendev.org/c/openstack/nova/+/904568 | |
| 21:19:36 | melwitt | dansmith: pretty much. let me double check if there's any other gotcha in the dnm test patch | |
| 21:22:05 | melwitt | dansmith: yeah, looks like that's all you need | |
| 21:27:15 | melwitt | I think rescue is broken at the moment since I changed things to require the hw_ephemeral_encryption_format if the image is encrypted. slowly working through the stack again | |
| #openstack-nova - 2024-03-02 | |||
| 01:18:37 | opendevreview | Jeffrey Zhang proposed openstack/nova master: Perform quick format when making ntfs filesystem https://review.opendev.org/c/openstack/nova/+/910859 | |
| 01:23:16 | opendevreview | melanie witt proposed openstack/nova master: Support create with ephemeral encryption for qcow2 https://review.opendev.org/c/openstack/nova/+/870932 | |