| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-08-31 | |||
| 18:52:16 | openstackgerrit | Merged openstack/nova master: Fix reshaper report client functonal test nits https://review.openstack.org/598330 | |
| 18:55:28 | cfriesen | any chance of a second core looking at https://review.openstack.org/#/c/588657/ ? It's a fairly straightforward change related to image properties, claims, and evacuate. | |
| 18:58:53 | mriedem | that is an excellent patch | |
| 19:01:23 | leakypipes | cfriesen: ack, I'll review shortly. | |
| 19:07:30 | cfriesen | leakypipes: much appreciated | |
| 19:08:07 | leakypipes | cfriesen: you KNOW how much I love the instance migration/evacuate/shelve/funkychicken code paths. | |
| 19:08:42 | cfriesen | just the thing for a friday | |
| 19:11:15 | sean-k-mooney | cfriesen: so the decorator alone went from 0m3.535s to 1.128s | |
| 19:11:43 | cfriesen | cool | |
| 19:33:54 | leakypipes | cfriesen: +W | |
| 19:34:22 | cfriesen | leakypipes: sweet, thx | |
| 19:43:29 | openstack | Launchpad bug 1790204 in OpenStack Compute (nova) "Allocations are "doubled up" on same host resize even though there is only 1 server on the host" [Medium,Triaged] | |
| 19:43:29 | mriedem | fried_rice: you wanted to know when i reported this https://bugs.launchpad.net/nova/+bug/1790204 | |
| 19:43:40 | mriedem | cfriesen: ^ fyi | |
| 19:44:05 | dansmith | mriedem: shall we? https://review.openstack.org/#/c/598353 | |
| 19:44:26 | mriedem | dansmith: see my comment on the test? | |
| 19:44:42 | dansmith | oh, sure | |
| 19:44:48 | mriedem | iow, if i remove the fix the test would still pass i think | |
| 19:44:49 | fried_rice | mriedem: ack, thx | |
| 19:44:59 | dansmith | mriedem: yep probably | |
| 19:45:15 | dansmith | mriedem: the way the gate is that makes this probably tuesday before it's in | |
| 19:45:24 | dansmith | I dunno what the fail rate is | |
| 19:45:50 | mriedem | my gut says the pass rate is not great | |
| 19:46:09 | dansmith | fail rate? | |
| 19:46:22 | mriedem | but this has also been this way since queens i think when i changed devstack to use [upgrade_levels]compute=auto so what's a few more days | |
| 19:47:00 | mriedem | i don't actually know what the pass/fail rate is right now | |
| 19:47:32 | mriedem | heh http://grafana.openstack.org/d/QBHIN5Smk/tempest-failure-rate?orgId=1 | |
| 19:48:27 | mriedem | these dashboards are all using old job names | |
| 19:49:55 | dansmith | okay i thought this was spiking in the gate based on the discussion | |
| 19:50:07 | mriedem | not it's definitely not our worst failure | |
| 19:50:19 | dansmith | ack | |
| 19:50:25 | mriedem | http://status.openstack.org/elastic-recheck/#1789484 | |
| 19:50:27 | openstackgerrit | Dan Smith proposed openstack/nova master: Move conductor wait_until_ready() delay before manager init https://review.openstack.org/598353 | |
| 19:50:31 | mriedem | it's not nothing either | |
| 20:05:47 | mriedem | dansmith: +2 | |
| 20:13:31 | openstack | Launchpad bug 1790204 in OpenStack Compute (nova) "Allocations are "doubled up" on same host resize even though there is only 1 server on the host" [Medium,Triaged] | |
| 20:13:31 | mriedem | fried_rice: more details https://bugs.launchpad.net/nova/+bug/1790204/comments/1 - i expect reschedules would make any solution for that bug even messier | |
| 20:13:59 | fried_rice | mriedem: ack. I'm subscribed. | |
| 20:17:20 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Fix image-defined numa claims during evacuate https://review.openstack.org/599062 | |
| 20:17:51 | mriedem | we've got an easy gate fix here https://review.openstack.org/598353 | |
| 20:17:58 | mriedem | would be good to get that in given the gate borkages of late | |
| 20:19:12 | fried_rice | mriedem, dansmith: +A | |
| 20:20:28 | mriedem | thanks | |
| 20:22:07 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/rocky: Move conductor wait_until_ready() delay before manager init https://review.openstack.org/599064 | |
| 20:51:58 | openstackgerrit | Eric Fried proposed openstack/nova master: Other host allocs may appear in gafpt during evac https://review.openstack.org/597301 | |
| 20:55:10 | openstackgerrit | Eric Fried proposed openstack/nova master: Other host allocs may appear in gafpt during evac https://review.openstack.org/597301 | |
| 20:55:45 | openstackgerrit | sean mooney proposed openstack/nova master: add caching to _build_regex_range https://review.openstack.org/599071 | |
| 21:10:50 | openstack | Launchpad bug 1790221 in OpenStack Compute (nova) "shelved offloaded server still shows old AZ while shelved" [Low,Triaged] | |
| 21:10:50 | mriedem | that wily old shelve https://bugs.launchpad.net/nova/+bug/1790221 | |
| 21:12:06 | cfriesen | mriedem: why is that bad? | |
| 21:12:22 | cfriesen | the unshelve api doesn't say anything about selecting a new AZ | |
| 21:12:41 | mriedem | cfriesen: a shelved instance isn't on a host, | |
| 21:12:49 | mriedem | note that the server details don't show a host or node when it's shelved | |
| 21:13:00 | mriedem | if it's not on a host, it's clearly not in an AZ | |
| 21:13:00 | cfriesen | mriedem: sure, but the AZ was selected at boot time as part of the boot criteria | |
| 21:13:06 | mriedem | nope | |
| 21:13:13 | mriedem | i didn't create the server with an az | |
| 21:13:23 | mriedem | so when i unshelve it, it can go into any othre az | |
| 21:14:02 | mriedem | related https://review.openstack.org/#/c/567701/ | |
| 21:15:10 | cfriesen | I had thought that once we pick an AZ at boot it might have implications on which cinder backends are available, so you couldn't leave it afterwards | |
| 21:15:23 | mriedem | oh fuck no | |
| 21:15:36 | mriedem | related https://review.openstack.org/#/c/469675/ | |
| 21:15:37 | cfriesen | cool, learned something new | |
| 21:15:59 | mriedem | we only give a shit about volume az if cinder.cross_az_attach=False, which it's not by default | |
| 21:16:09 | mriedem | if it is, well, good luck friend | |
| 21:16:12 | mriedem | b/c nova sucks at handling that | |
| 21:16:39 | mriedem | https://review.openstack.org/#/c/467674/ will show you exactly why | |
| 21:17:02 | mriedem | if you remove that nova fix as a dependency, you can't create a server with a pre-existing volume at all | |
| 21:17:08 | mriedem | because 'nova' != None | |
| 21:17:11 | mriedem | KABLAMMO | |
| 21:18:40 | mriedem | granted, my patch for that cross_az_attach fix is fugly | |
| 22:20:11 | openstackgerrit | Matt Riedemann proposed openstack/nova master: Null out instance.availability_zone on shelve offload https://review.openstack.org/599087 | |
| #openstack-nova - 2018-09-01 | |||
| 00:12:07 | openstackgerrit | Merged openstack/nova master: Fix image-defined numa claims during evacuate https://review.openstack.org/588657 | |
| 00:37:43 | openstackgerrit | Merged openstack/nova master: Move conductor wait_until_ready() delay before manager init https://review.openstack.org/598353 | |
| 21:25:25 | openstackgerrit | Matt Riedemann proposed openstack/nova stable/queens: Move conductor wait_until_ready() delay before manager init https://review.openstack.org/599200 | |
| #openstack-nova - 2018-09-02 | |||
| 00:35:10 | openstackgerrit | Matt Riedemann proposed openstack/nova master: libvirt: implement reshaper for vgpu https://review.openstack.org/599208 | |
| 00:35:15 | mriedem | fried_rice: bauzas: welcome to reshape city, population: libvirt ^ | |
| 14:35:43 | openstackgerrit | Matt Riedemann proposed openstack/nova master: libvirt: implement reshaper for vgpu https://review.openstack.org/599208 | |
| #openstack-nova - 2018-09-03 | |||
| 00:16:08 | openstackgerrit | Takashi NATSUME proposed openstack/nova master: Fix a failure to format config sample https://review.openstack.org/597986 | |
| 02:57:35 | openstackgerrit | Brin Zhang proposed openstack/nova master: Need further updates, no need to review https://review.openstack.org/599276 | |
| 03:33:16 | openstackgerrit | Chen proposed openstack/nova master: Fix SOFT_DELETE vm_state string https://review.openstack.org/598482 | |
| 06:29:48 | prometheanfire | https://github.com/openstack/nova/commit/50658eee4fe26a55854642119beeff46c0d0108a seems to be causing problems | |
| 06:30:00 | prometheanfire | 2018-09-03 01:29:14.620 11567 ERROR nova.objects.cell_mapping [req-0b912c05-d2bf-4e68-bcdf-7953c87dcc88 - - - - -] Failed to parse [database]/connection to format cell mapping: ValueError: expected ':' after conversion specifier | |
| 06:30:10 | prometheanfire | tonyb: think I found another one ^ | |
| 06:30:44 | prometheanfire | not sure what's wrong with my db | |
| 06:30:52 | prometheanfire | I'm guessing my password isn't being escaped | |
| 06:32:04 | tonyb | prometheanfire: can you run nova in a venv and import cell_mapping.py and check the parse results with your netloc? | |
| 06:32:23 | prometheanfire | 2018-09-03 01:29:14.919 11567 ERROR oslo_db.sqlalchemy.exc_filters [req-0b912c05-d2bf-4e68-bcdf-7953c87dcc88 - - - - -] DBAPIError exception wrapped from (psycopg2.ProgrammingError) relation "projects" does not exist | |
| 06:32:23 | prometheanfire | maybe the root? | |
| 06:32:36 | prometheanfire | don't have a venv atm | |
| 06:33:02 | prometheanfire | another thing to blame not testing on postgres? | |
| 06:33:02 | tonyb | prometheanfire: venvs are cheap, but if you hav nova installed as a site package you can just use that | |
| 06:33:04 | prometheanfire | ya | |
| 06:33:25 | tonyb | prometheanfire: No I doubt that a postgres thing | |
| 06:34:58 | prometheanfire | my password actually is fine for the one in question | |
| 06:35:04 | prometheanfire | so probably not that | |
| 06:37:37 | tonyb | prometheanfire: :( Well I guess double check you're pointing at the right DB | |
| 06:39:57 | prometheanfire | it worked before the upgrade | |
| 06:43:34 | prometheanfire | not seeing anything in upgrade nodes or deprication notes or https://docs.openstack.org/nova/rocky/user/upgrade.html denoting any change needed | |
| 06:43:36 | tonyb | prometheanfire: ... Okay but that doesn't mean it wasn't using a deprecated feature that has gone between queens and rocky | |