| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2020-10-27 | |||
| 15:14:31 | sean-k-mooney | that should work | |
| 15:16:14 | sean-k-mooney | gibi: also "review\.opendev\.org" is what im using for the site regex/matcher thing for the code injector plugin | |
| 15:16:36 | sean-k-mooney | i have it set to run on page load | |
| 15:37:51 | gibi | sean-k-mooney: works nicely (after an extra refresh) | |
| 15:47:58 | bauzas | gibi: sean-k-mooney: fwiw dev mode on FF or Chrome works fine | |
| 15:48:05 | bauzas | no need for a plugin | |
| 15:48:25 | bauzas | newspapers* | |
| 15:48:42 | sean-k-mooney | bauzas: to add it sure but its kind of annoying to have to keep changing it | |
| 15:48:54 | bauzas | I don't really copy/paste a lot | |
| 15:49:16 | bauzas | what you can also do is just to click on "reply" at a comment | |
| 15:49:30 | sean-k-mooney | ya but that quotes it | |
| 15:49:32 | bauzas | you'll get the text with a "> " prefix | |
| 15:49:34 | bauzas | right | |
| 15:49:39 | bauzas | but easy peasy nope ? | |
| 15:49:42 | sean-k-mooney | its annoying when you providing code examples | |
| 15:50:01 | bauzas | humm, really ? | |
| 15:50:13 | sean-k-mooney | yep why do you think i wrote a script :) | |
| 15:50:20 | sean-k-mooney | i want it to just work | |
| 15:50:28 | bauzas | cut -c1 - ? | |
| 15:50:41 | bauzas | whoops | |
| 15:50:43 | sean-k-mooney | more work the copy paste :P | |
| 15:50:46 | bauzas | cut -c1- | |
| 15:51:19 | bauzas | sean-k-mooney: well, if you're lazy enough to copy/paste some hand-written code, then I can understand your point :p | |
| 15:53:46 | sean-k-mooney | lol i copy paste it but i use my skills to make my job more efficent | |
| 15:53:56 | sean-k-mooney | but speaking of reviewing my code | |
| 15:54:25 | sean-k-mooney | https://review.opendev.org/#/c/751642/7 and https://review.opendev.org/#/c/602432/22 coudl do with some reivew | |
| 15:57:18 | bauzas | sean-k-mooney: ping me those changes next week | |
| 15:57:26 | bauzas | this week, I focused on open specs | |
| 16:22:55 | gibi | bauzas: see you tomorrow o/ | |
| 17:31:04 | lyarwood | kashyap: https://bugs.launchpad.net/nova/+bug/1901739 - odd LM issue if you have time tomorrow | |
| 17:31:04 | openstack | Launchpad bug 1901739 in OpenStack Compute (nova) " libvirt.libvirtError: internal error: missing block job data for disk 'vda'" [Undecided,New] | |
| #openstack-nova - 2020-10-28 | |||
| 00:48:47 | brinzhang | bauzas:hi, yesterday was my wife's brithday, I am sorry replied later | |
| 06:20:26 | openstackgerrit | sean mooney proposed openstack/nova master: enable host shuffeling by default https://review.opendev.org/760055 | |
| 06:39:39 | openstackgerrit | Jorhson Deng proposed openstack/nova master: Reject to attach and detach volume while task_state is not None https://review.opendev.org/758918 | |
| 07:27:34 | openstackgerrit | Brin Zhang proposed openstack/nova-specs master: Re-proposes 'Proposal for a safer remote console with password authentication https://review.opendev.org/759828 | |
| 08:00:42 | openstackgerrit | Brin Zhang proposed openstack/nova-specs master: Re-proposes 'Proposal for a safer remote console with password authentication https://review.opendev.org/759828 | |
| 08:13:40 | bauzas | brinzhang0: absolutely no worries, priorities go to the family | |
| 08:14:10 | bauzas | good morning Nova | |
| 08:16:00 | brinzhang0 | bauzas: good morning, thanks | |
| 08:31:21 | lyarwood | well the gate is fun at the moment | |
| 08:31:41 | lyarwood | melwitt++ thanks for the ER query and other bug you raised, looks like we have hit *more* issues overnight | |
| 08:33:50 | bauzas | lyarwood: /o\ | |
| 08:35:23 | bauzas | lyarwood: mmmm, the gate looks all good for me | |
| 08:36:47 | lyarwood | https://review.opendev.org/#/c/759831/ check the failures here, a random collection of unrelated failures | |
| 08:37:03 | lyarwood | the gate isn't jammed, jobs are just failing | |
| 08:50:44 | bauzas | lyarwood: I see | |
| 08:50:57 | bauzas | we're just lucky then | |
| 08:57:25 | kashyap | lyarwood: Mornin; will check | |
| 09:01:15 | lyarwood | kashyap: ack, is that streaming somewhere? | |
| 09:01:43 | kashyap | lyarwood: It is per-email-based login; costs $25 | |
| 09:01:52 | kashyap | lyarwood: Yeah, your recollection is right | |
| 09:02:04 | kashyap | BTW, don't worry; the full talks will be available on YouTube soon | |
| 09:02:16 | lyarwood | kk no issues, I'll watch it once it's posted there | |
| 09:02:20 | kashyap | (Even the panel discussion was preprecorded) | |
| 09:04:45 | kashyap | lyarwood: So the test that's failing is live migration _without_ shared storage? | |
| 09:06:17 | frickler | gibi: lyarwood: since https://review.opendev.org/759831 failed once more on unrelated issues, how about force-merging it in order to unblock things? I think we can be pretty sure that the patch itself is working fine by now | |
| 09:06:51 | lyarwood | kashyap: https://opendev.org/openstack/tempest/src/branch/master/tempest/api/compute/admin/test_live_migration.py#L151 | |
| 09:07:12 | lyarwood | frickler: I'd be happy with that if it unblocks everyone, gibi should have the final say as PTL however. | |
| 09:07:39 | lyarwood | I'm going to spend some time this morning going over the other failures and making sure we have bugs / ER queries etc for each | |
| 09:09:21 | lyarwood | kashyap: hmm why is this even listed as live block migration? | |
| 09:09:26 | lyarwood | kashyap: it's just a paused instance | |
| 09:09:51 | kashyap | lyarwood: So it is migrating a paused instance but _with_ storage, isn't it? | |
| 09:10:18 | lyarwood | kashyap: yeah, it's just making assumptions about the env that storage isn't shared | |
| 09:10:37 | lyarwood | I guess that's what block_migration_for_live_migration is checking | |
| 09:10:37 | kashyap | Aah, so it might well be a shared storage setup, but the test is dubious | |
| 09:11:06 | kashyap | I wonder if that's why the NBD copy was cancelled - it must've detected "hey, it's shared storage, no need for copy, hence I'm cancelling it" | |
| 09:11:33 | lyarwood | kashyap: no I don't think the storage is in this job | |
| 09:11:42 | kashyap | So, it is non-shared storage? | |
| 09:11:57 | lyarwood | yeah sorry I'm just confusing the situation | |
| 09:12:16 | kashyap | No prob | |
| 09:12:23 | lyarwood | oh you know what this is | |
| 09:12:49 | lyarwood | it's the back and forth LM of a paused instance issue we saw downstream | |
| 09:13:28 | kashyap | Ohh, wait - that rings a faint bell | |
| 09:13:46 | lyarwood | 2020-10-27 16:59:16.022725 | primary | 2020-10-27 16:59:16.022 | 2020-10-27 16:59:06,664 22654 INFO [tempest.api.compute.admin.test_live_migration] Live migrate back to source ubuntu-bionic-rax-iad-0021082674 | |
| 09:13:54 | kashyap | IIRC, we ruled it out as a bogus test? | |
| 09:14:05 | lyarwood | yeah the QEMU devs said it was fubar | |
| 09:14:36 | kashyap | Do you recall that other bug no. by any chance, from your browser history? | |
| 09:14:48 | kashyap | Hang on, I found it | |
| 09:15:02 | kashyap | Because I recall "fixing" the bug description myself :D | |
| 09:15:07 | lyarwood | haha | |
| 09:21:19 | kashyap | lyarwood: https://bugzilla.redhat.com/show_bug.cgi?id=1713009 | |
| 09:21:19 | openstack | bugzilla.redhat.com bug 1713009 in qemu-kvm "[QEMU] Back-n-forth live migration of a paused VM results in QEMU crash with: "bdrv_inactivate_recurse: Assertion `!(bs->open_flags & BDRV_O_INACTIVE)' failed."" [Unspecified,New] - Assigned to kwolf | |
| 09:21:19 | kashyap | "Back-n-forth live migration of a paused VM results in QEMU crash ..." | |
| 09:21:19 | lyarwood | you know what, I didn't even check the QEMU logs for this failure upstream | |
| 09:21:20 | kashyap | If we see the QEMU crash, then it's this. Let's see | |
| 09:21:20 | lyarwood | I don't see this | |
| 09:21:20 | kashyap | 1 sec, on the phone | |
| 09:24:21 | kashyap | lyarwood: So the libvirtd log in the bug is from destination host, yeah? | |
| 09:24:39 | kashyap | (I think so, based on the "migrate-incoming" bit in the log) | |
| 09:25:41 | lyarwood | kashyap: yeah | |
| 09:28:44 | kashyap | lyarwood: So, to recap: should we care about this test that is "invalid" - what is the point of doing back-n-forth LM of a paused instance? | |
| 09:28:59 | kashyap | Also, have you got the QEMU command-line of the instance log in question? /me goes searching | |
| 09:31:17 | kashyap | Hm, which of the instances is it here - https://api.us-east.open-edge.io:8080/swift/v1/AUTH_e02c11e4e2c24efc98022353c88ab506/zuul_opendev_logs_30d/759831/4/gate/nova-grenade-multinode/30d8eb1/logs/libvirt/qemu/index.html | |
| 09:31:33 | lyarwood | instance-0000001e | |
| 09:31:46 | kashyap | Okay, I looked at the "right one", then | |
| 09:32:05 | kashyap | (Also, the "-incoming defer" confirms it's the dest host) | |
| 09:32:57 | kashyap | lyarwood: It's also in the instance log, as you surely must know - 4d564e22-8ba4-48fb-ac93-27bea660fd77 | |
| 09:34:39 | lyarwood | kashyap: right my point was that the log should use the UUID as the filename, IOW we should use it as the domain name | |
| 09:34:54 | lyarwood | kashyap: but I think there's an upgrade issue with that so we've never tried | |
| 09:34:56 | kashyap | Ah, guessed as much; consistency across the board | |