| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2017-02-17 | |||
| 12:25:10 | mdbooth | VT hasn't had fresh for about a week, I think | |
| 12:25:31 | bauzas | planned for tonight IIRC | |
| 12:26:07 | bauzas | either way, I recommend you to enjoy on mornings, afternoons could be a bit not that good | |
| 12:47:06 | openstackgerrit | Sean Dague proposed openstack/nova master: Verify project_id when quotas are checked https://review.openstack.org/435010 | |
| 12:57:18 | openstackgerrit | Sean Dague proposed openstack/nova master: Verify project id for flavor access calls https://review.openstack.org/435432 | |
| 13:04:36 | sdague | alex_xu: https://review.openstack.org/#/c/435010 if you have a chance | |
| 14:11:53 | openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Fix paths when moving specs https://review.openstack.org/432470 | |
| 14:11:53 | openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Fix a couple of spec names https://review.openstack.org/432469 | |
| 14:11:54 | openstackgerrit | Matt Riedemann proposed openstack/nova-specs master: Move implemented specs for Ocata https://review.openstack.org/432471 | |
| 14:38:00 | openstackgerrit | Artom Lifshitz proposed openstack/nova-specs master: Virtual guest device role tagging https://review.openstack.org/435397 | |
| 14:47:24 | artom | Has anyone with gmail solved the CI bot spam problem? | |
| 14:47:34 | artom | Gmail is retarded in that it applies filters to entire "conversations" | |
| 14:48:04 | artom | So while it filters out all the CIs spamming me, it also filters out the useful human reviews, and Jenkins, since they're in the same conversation | |
| 14:50:26 | sdague | artom: I found gmail filtering completely unuseful for gerrit, one of the reasons I moved over to fastmail | |
| 14:51:25 | artom | sdague, very agree on point 1, will explore point 2, thanks :) | |
| 14:52:37 | superdan | I have found gmail useful for not very much | |
| 14:54:57 | artom | superdan, what do you use for the gerrit spam? | |
| 14:55:09 | superdan | artom: sieve :) | |
| 14:55:51 | cdent | sieve is too new and fancy, I use procmail :) | |
| 14:56:07 | superdan | procmail > gmail | |
| 14:56:19 | openstackgerrit | Sean Dague proposed openstack/nova master: Verify project id for flavor access calls https://review.openstack.org/435432 | |
| 14:56:19 | superdan | well, sieve > sliced bread > procmail > gmail | |
| 14:56:20 | superdan | to be complete | |
| 14:56:20 | openstackgerrit | Sean Dague proposed openstack/nova master: Verify project_id when quotas are checked https://review.openstack.org/435010 | |
| 14:56:33 | artom | superdan, oh, you're one of those | |
| 14:56:38 | artom | With their own email server | |
| 14:56:47 | artom | Do you also grow your own wheat for bread? ;) | |
| 14:57:02 | superdan | artom: I would if the store stopped selling good bread | |
| 14:57:31 | artom | But the store is giving the bread away | |
| 14:57:45 | artom | It just asks that you store all your personal paperwork in their vault | |
| 14:57:50 | superdan | it's giving away bean bread | |
| 14:58:03 | superdan | which is not really bread | |
| 14:58:11 | superdan | it doesn't have slices, although it has lines to look like slices | |
| 14:58:48 | artom | This comparison is starting to break down, and I'm very confused | |
| 14:59:08 | superdan | no real folders in gmail == no slices | |
| 14:59:24 | superdan | anyway, you keep using your store bought bread and I'll keep filtering gerrit spam | |
| 14:59:41 | cdent | artom: that (This comparison...) is what the special guest on the superdan weeky comedy hour always says at the end of the show. | |
| 15:00:38 | artom | cdent, wait, there's a comedy show at the bread store now? | |
| 15:00:55 | artom | How does email fit into that? Is it the heckler? | |
| 15:02:00 | cdent | My brain is starting to break down, and I'm very confused. | |
| 15:18:38 | des_consolado | gah I'm trying to create instances and they just get stuck in the Spawning state and then eventually fail after ages, saying failed to provision instance | |
| 15:18:42 | openstackgerrit | John Garbutt proposed openstack/nova master: POC: improved policy functional tests https://review.openstack.org/435484 | |
| 15:18:43 | openstackgerrit | John Garbutt proposed openstack/nova master: POC: add context.check_scope https://review.openstack.org/435485 | |
| 15:18:50 | des_consolado | something or other timed out etc | |
| 15:18:59 | des_consolado | I'm tailing every nova log and nothing interesting is there | |
| 15:23:52 | artom | des_consolado, you're probably better off asking in #openstack, as this channel is for development, but it could be waiting for an external event. I've seen these symptoms before where a network-plugged event from Neutron didn't arrive, and the spawn timed out. | |
| 15:25:48 | des_consolado | oh yeah I just read the topic, sorry | |
| 15:26:33 | des_consolado | the other openstack project channels don't seem to make as much of a point about that | |
| 15:27:07 | des_consolado | I also noticed the developers of given projects tend to have all the answers :P | |
| 15:29:11 | mriedem | des_consolado: if it's a virtual interface exception / timeout thing in the n-cpu logs, then yes it's timing out waiting for the external vif plugged callback event from neutron as artom points out | |
| 15:29:30 | mriedem | which probably means something is failing on the neutron side, check the neutron agent health status and logs | |
| 15:30:33 | sdague | johnthetubaguy: I respun with the drop on the delete call | |
| 15:32:45 | cdent | mriedem: was there a change you pushed up as a result of your kvm-on-the-subnode debugging last night? I'd like to look at it if so. | |
| 15:33:18 | mriedem | yeah, sec | |
| 15:33:33 | mriedem | cdent: https://review.openstack.org/#/c/435154/ | |
| 15:33:38 | cdent | thanks | |
| 15:33:41 | mriedem | your googling about nested kvm tipped me off | |
| 15:33:55 | mriedem | then i asked in infra and clarkb confirmed the nested kvm issue, and we found the problem in d-g | |
| 15:33:57 | mriedem | mega bash | |
| 15:34:00 | mriedem | what could go wrong | |
| 15:34:56 | cdent | your change was interesting enough to pull jo*go? | |
| 15:40:54 | cdent | mriedem: were you a good boy and search for 'localrc' where $localrc_file ought to be in the rest of the file, or only fix the presenting problem? | |
| 15:41:41 | mriedem | cdent: i pinged him | |
| 15:42:34 | mriedem | cdent: i did | |
| 15:43:49 | cdent | 🍪 | |
| 16:01:47 | mriedem | yikes http://logs.openstack.org/11/349011/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial-ocata/bee08f9/logs/screen-n-api.txt.gz?level=TRACE#_2017-02-14_22_13_03_345 | |
| 16:01:55 | mriedem | Passing insecure dynamic vendordata requests because of missing or incorrect service account configuration. | |
| 16:01:57 | mriedem | all over the logs | |
| 16:02:38 | melwitt | I have noticed that too | |
| 16:03:01 | melwitt | haven't made time to look into it yet | |
| 16:04:54 | mriedem | http://git.openstack.org/cgit/openstack/nova/tree/nova/api/metadata/vendordata_dynamic.py#n52 | |
| 16:04:58 | mriedem | we should just log that once | |
| 16:05:01 | mriedem | i'm reporting a bug | |
| 16:05:10 | mriedem | if LP will stop timing out | |
| 16:07:22 | melwitt | nice | |
| 16:12:54 | sdague | mriedem: isn't that feature opt in? | |
| 16:13:03 | sdague | so if it's off, shouldn't we just not log | |
| 16:13:14 | openstack | Launchpad bug 1665693 in OpenStack Compute (nova) ""Passing insecure dynamic vendordata requests because of missing or incorrect service account configuration." warnings all over n-api logs" [Medium,Confirmed] | |
| 16:13:14 | mriedem | https://bugs.launchpad.net/nova/+bug/1665693 | |
| 16:13:21 | mriedem | sdague: maybe, i haven't dug in | |
| 16:14:38 | sdague | mriedem: I do agree, it's logging a lot | |
| 16:19:40 | sdague | mriedem: if you get bored - https://review.openstack.org/#/c/435010/ is the code for the project_id enforcement | |
| 16:20:07 | sdague | we get some review on it and I could probably have that in land state for next week. Early blueprint completion for the win. | |
| 16:25:33 | mriedem | sfinucan: did i answer your questions here? https://review.openstack.org/#/c/380433/ | |
| 16:25:46 | mriedem | sdague: ok | |
| 16:30:22 | mriedem | sdague: when do you get into ATL? | |
| 16:30:26 | mriedem | mtreinish: ^ | |
| 16:30:40 | sdague | mriedem: like 9pm on Sunday | |
| 16:31:02 | mriedem | geez | |
| 16:31:35 | sdague | I can send you my tripit info if you like | |
| 16:33:23 | sdague | mriedem: why, when are you getting in? | |
| 16:34:49 | sdague | I think my reasonable options were this flight, or a super early in the morning one on Sunday, so I went with not having to wake up at unusual times | |
| 16:36:22 | mriedem | sdague: comments in https://review.openstack.org/#/c/435010/ | |
| 16:36:28 | mriedem | sdague: 2:45 on sunday | |
| 16:41:44 | mriedem | i know why we're getting the billions of vendordata warnings then, it's because it's hit on each init of the InstanceMetadata object | |
| 16:41:51 | mriedem | which is every server that gets created with config drive | |
| 16:44:23 | mriedem | sdague: so can we just pick one of these options to tell if we can safely assume dynamic vendordata is just not configured to work? http://logs.openstack.org/11/349011/3/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial-ocata/bee08f9/logs/screen-n-api.txt.gz#_2017-02-14_21_31_00_838 | |
| 16:44:33 | mriedem | like auth_section or auth_type? | |
| 16:44:35 | mriedem | jamielennox: ^ | |
| 16:45:39 | mriedem | sounds like auth_section is optional | |