| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2019-03-13 | |||
| 17:09:06 | gmann | mriedem: https://bugs.launchpad.net/nova/+bug/1819794 https://bugs.launchpad.net/nova/+bug/1819944 | |
| 17:09:07 | openstack | Launchpad bug 1819944 in OpenStack Compute (nova) "nova-grenade-live-migration job failing on ubuntu bionic" [Undecided,New] | |
| 17:09:48 | gmann | mriedem: we should make n-v or fix. keeping them on xenial makes inconsistent that few job running on xenail and few on bionic | |
| 17:10:16 | mriedem | gmann: i don't have a fix if ceph doesn't have packages on bionic yet, or whatever the issue is there | |
| 17:10:34 | mriedem | we could temporarily disable the tls proxy stuff in the nova-next job on master | |
| 17:10:45 | mriedem | but i'd need melwitt and/or stephenfin to help with that stuff | |
| 17:10:48 | mriedem | and stephenfin is out this week | |
| 17:11:29 | mriedem | dansmith: i'll write a functional test for that resize revert az thing because i got thinking about this with my cross-cell stuff so it'll be an issue there as well | |
| 17:11:37 | dansmith | ack | |
| 17:11:49 | mriedem | gibi: ack, but we can't wait forever since we want those docs in the stein GA | |
| 17:11:52 | gmann | yeah melwitt is trying the tsl-proxy with 2048 bit cert but that did not pass | |
| 17:12:10 | mriedem | does she have a patch somewhere? | |
| 17:12:12 | mriedem | is she around? | |
| 17:12:35 | gmann | this one (and deppends-on) - https://review.openstack.org/#/c/639017/8 | |
| 17:12:56 | mriedem | ok https://review.openstack.org/#/c/643045/ | |
| 17:15:50 | mriedem | honestly melwitt probably has a better handle on the ceph CI stuff as well since i'm assuming she's got downstream ceph contacts | |
| 17:15:59 | mriedem | or eharney etc | |
| 17:17:21 | mriedem | coreycb: actually you're probably the person to ask | |
| 17:18:06 | openstack | Launchpad bug 1819944 in OpenStack Compute (nova) "nova-grenade-live-migration job failing on ubuntu bionic due to missing ceph package" [Undecided,Confirmed] | |
| 17:18:06 | mriedem | coreycb: https://bugs.launchpad.net/nova/+bug/1819944 | |
| 17:23:50 | coreycb | mriedem: hi, we have luminous in our bionic /queensrepos | |
| 17:23:57 | coreycb | bionic/queens repos | |
| 17:25:03 | mriedem | yeah just saw http://download.ceph.com/debian-luminous/dists/bionic/ | |
| 17:25:16 | coreycb | i think they should be installing from ubuntu repos rather than http://download.ceph.com/debian-hammer/dists/bionic/main/binary-amd64/Packages | |
| 17:25:49 | mriedem | i haven't looked into the actual devstack-ceph-plugin job yet to see where it's getting packages | |
| 17:29:43 | coreycb | mriedem: i commented on the bug | |
| 17:29:48 | mriedem | so apparently this isn't enough https://review.openstack.org/#/c/611594/ | |
| 17:30:34 | coreycb | that should at least be sleeping for 6 seconds :) | |
| 17:33:29 | mriedem | umm, so https://review.openstack.org/#/c/611594/4/devstack/lib/ceph@942 | |
| 17:33:55 | mriedem | frickler: probably need your help here | |
| 17:36:03 | mriedem | gmann: is devstack-plugin-ceph-tempest-py3 ok with bionic? that's a single-node job | |
| 17:36:13 | mriedem | i wonder if it's something with grenade in the nova-grenade-live-migration job | |
| 17:36:17 | gmann | mriedem: yeah that is working fine | |
| 17:36:31 | mriedem | hmm, ok, so then it's probably something in the nova setup scripts for that live migration job | |
| 17:36:48 | gmann | i am figuring out on 611594 that why it is not picking luminous | |
| 17:37:04 | gmann | seems so. in live_migration/hooks/run_tests.sh | |
| 17:37:43 | gmann | as it is failing while post_test_hook - http://logs.openstack.org/17/639017/8/check/nova-grenade-live-migration/735242b/logs/devstack-gate-post_test_hook.txt.gz | |
| 17:39:17 | mriedem | gmann: how about the nova-live-migration job, is that ok with bionic? | |
| 17:39:54 | gmann | mriedem: yes, that working fine on bionic | |
| 17:42:30 | mriedem | hmm, that post-test hook ceph script just runs functions from devstack-plugin-ceph, | |
| 17:42:41 | mriedem | which is branchless | |
| 17:43:54 | gmann | nova-live-migration has same issue with that ceph pckg but use old one and process further- http://logs.openstack.org/17/639017/8/check/nova-live-migration/87084aa/logs/devstack-gate-post_test_hook.txt.gz#_2019-03-13_14_34_20_967 | |
| 17:44:22 | gmann | is something else stopping/failing the nova-grenade-live-migration | |
| 17:45:39 | mriedem | i think the nova-live-migration job just isn't failing properly | |
| 17:45:51 | mriedem | and then goes on to run the evacuate stuff, which nova-grendae-live-migration doesn't run | |
| 17:47:24 | gmann | yeah. not sure how d-g handle the failure on post_test_hook | |
| 17:47:55 | mriedem | it must not | |
| 17:49:40 | openstack | bug 1819944 in OpenStack Compute (nova) "nova-grenade-live-migration job failing on ubuntu bionic due to missing ceph package" [Undecided,New] https://launchpad.net/bugs/1819944 | |
| 17:49:40 | mriedem | gmann: to workaround bug 1819944 for now, we should probably just comment this out: | |
| 17:50:14 | mriedem | https://github.com/openstack/nova/blob/master/nova/tests/live_migration/hooks/run_tests.sh#L46-L52 | |
| 17:50:20 | mriedem | gmann: do you want to push a patch for that and i'll +2 | |
| 17:50:48 | mriedem | that way the job continues to run and be voting but the ceph stuff is disabled until someone fixes it | |
| 17:50:49 | gmann | mriedem: ok thats even better, we run some stuff on that jobs | |
| 17:50:59 | gmann | i will push | |
| 17:51:10 | mriedem | make sure to push it real good | |
| 17:51:21 | mriedem | https://www.youtube.com/watch?v=vCadcBR95oU | |
| 17:51:50 | dansmith | mriedem: see, I was going to say that I had noted the reference, | |
| 17:51:57 | dansmith | but you keep going all self-serving with the youtube links | |
| 17:52:48 | gmann | :) | |
| 17:55:10 | dansmith | it's like laughing at your own jokes.. just.. so uncouth. | |
| 17:58:18 | openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/os-vif master: Remove IP proxy methods https://review.openstack.org/643115 | |
| 18:02:23 | mriedem | dansmith: i did that for gmann's benefit, | |
| 18:02:30 | mriedem | because i don't know if he grew up listening to TLC | |
| 18:02:39 | mriedem | not that i did, but i'm aware, it was hard to avoid | |
| 18:03:02 | dansmith | Do you mean SnP ? | |
| 18:03:05 | dansmith | we're not discussing waterfalls here | |
| 18:03:37 | mriedem | oh yeah heh | |
| 18:03:53 | mriedem | or did i *really* know that but was trying to throw you off my trail? | |
| 18:04:26 | mriedem | twice in one day | |
| 18:04:48 | dansmith | I could do this all day | |
| 18:06:09 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Skip the ceph based live migration testing https://review.openstack.org/643122 | |
| 18:06:26 | gmann | mriedem: ^^ | |
| 18:06:28 | openstack | bug 1819794 in OpenStack Compute (nova) "nova-next job fail on Ubuntu Bionic" [Undecided,New] https://launchpad.net/bugs/1819794 | |
| 18:06:28 | mriedem | gmann: for bug 1819794 just do what you have here - disable tls https://review.openstack.org/#/c/639017/7 | |
| 18:07:20 | mriedem | dansmith: want to +W https://review.openstack.org/#/c/643122/ | |
| 18:07:24 | gmann | i have not listen TLC or SNP yet :) | |
| 18:07:46 | gmann | mriedem: yes, doing on 643122 | |
| 18:07:49 | mriedem | gmann: well, something for you to bring home for dinner discussion with the mrs | |
| 18:07:53 | dansmith | gmann: mriedem really likes 80s hip-hop | |
| 18:08:00 | gmann | humm | |
| 18:08:02 | dansmith | mriedem: will look in a bit | |
| 18:08:27 | mriedem | this is true https://www.youtube.com/watch?v=O4o8TeqKhgY | |
| 18:14:19 | cfriesen | is there any way to get detailed hypervisor/host resource information in nova? Or is that a placement query now? | |
| 18:14:26 | cfriesen | (for an admin, I mean) | |
| 18:15:49 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Disbale the tls-proxy in nova-next job for Bionic https://review.openstack.org/643129 | |
| 18:16:01 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Disbale the tls-proxy in nova-next job for Bionic https://review.openstack.org/643129 | |
| 18:16:38 | gmann | mriedem: ^^ doing it separately to revert those easily. | |
| 18:18:35 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Migrate legacy jobs to Ubuntu Bionic https://review.openstack.org/639017 | |
| 18:18:55 | openstackgerrit | Ghanshyam Mann proposed openstack/nova master: Migrate legacy jobs to Ubuntu Bionic https://review.openstack.org/639017 | |
| 18:20:13 | mriedem | gmann: by "devstack based jobs" do you mean inheriting from the zuulv3 devstack job? | |
| 18:20:25 | gmann | mriedem: yeah | |
| 18:21:13 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Disable the tls-proxy in nova-next job for Bionic https://review.openstack.org/643129 | |
| 18:21:23 | mriedem | ok +2 on both of those | |
| 18:21:31 | mriedem | efried: melwitt: fyi ^ to unblock bionic job migration | |
| 18:21:47 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Migrate legacy jobs to Ubuntu Bionic https://review.openstack.org/639017 | |
| 18:22:05 | gmann | mriedem: thanks, testing this on both of those - https://review.openstack.org/#/c/639017/10 | |
| 18:24:25 | mriedem | i'll throw these on the nova meeting agenda for gate bugs | |
| 18:24:49 | gmann | +1. thanks | |
| 18:36:39 | mriedem | gmann: https://review.openstack.org/#/c/643052/ works | |
| 18:36:42 | mriedem | http://logs.openstack.org/59/643059/1/check/tempest-slow/095dc55/compute1/logs/local_conf.txt | |