| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-nova - 2018-03-09 | |||
| 10:27:28 | bauwser | zigo: devstack can help | |
| 10:27:44 | zigo | bauwser: How can it help me doing that setup with packages? | |
| 10:27:55 | zigo | Do you mean, i should read devstack's scripts? | |
| 10:27:59 | bauwser | by looking on how it's setup | |
| 10:28:00 | bauwser | yeah | |
| 10:28:03 | zigo | k | |
| 10:28:23 | finucannot | It's a horrible answer, but yeah. It's that or use some other tool to install this stuff :( | |
| 10:28:56 | finucannot | I will note that DevStack configures multiple nova.conf files. nova.conf, nova-cpu.conf, nova_cell1.conf, ... | |
| 10:28:56 | zigo | bauwser: finucannot: Should I attempt to just implement this on my single server setup? https://docs.openstack.org/nova/latest/_images/graphviz-609e99b08abf22927d47c939873591359f7e50e3.png | |
| 10:29:27 | zigo | (ie: single conductor, 1 db for each of cell0 and cell1) | |
| 10:30:10 | bauwser | zigo: finucannot: AFAIK, we pass the transport_url when we create the cell as a parameter | |
| 10:31:43 | bauwser | zigo: so, there are 2 points : one is the MQ, the other is the DB | |
| 10:32:09 | bauwser | Nova requires 3 logical DBs, but both can share the same DB engine | |
| 10:32:16 | zigo | bauwser: How do I get the cell0 db populated with tables? Is there some kind of cell-db-sync ? | |
| 10:32:43 | Roamer` | is there a way to let Nova know that the new host that just appeared is actually a renamed version of an old host that it knew about, but that it shows as down now? :) | |
| 10:32:51 | Roamer` | (short of mucking around in the MySQL database, I mean...) | |
| 10:33:20 | Roamer` | I guess I could just delete the database record for the old host, but I wonder what inconsistencies this will cause :) | |
| 10:33:45 | bauwser | zigo: sec, there are docs for that | |
| 10:33:55 | zigo | Thanks a lot. | |
| 10:34:27 | zigo | I'm sure all of what I'm asking for will end up being just a few lines in my shell script, but those aren't easy to find out. | |
| 10:34:29 | bauwser | zigo: https://docs.openstack.org/nova/latest/install/controller-install-ubuntu.html#install-and-configure-components | |
| 10:34:55 | bauwser | zigo: and https://docs.openstack.org/nova/latest/install/compute-install-ubuntu.html#add-the-compute-node-to-the-cell-database | |
| 10:35:57 | zigo | Allright, I'm back to the original issue. | |
| 10:36:26 | zigo | When I do a nova-manage db sync, I get this: | |
| 10:36:30 | zigo | http://paste.openstack.org/show/696077/ | |
| 10:37:03 | zigo | Indeed, my novadb_cell0 is completely empty, that's to be expected. | |
| 10:37:34 | zigo | How come "nova-manage db sync" doesn't get that? | |
| 10:37:37 | zigo | How to fix? | |
| 10:44:55 | cdent | zigo: there's yet another page about cells, with some additional steps https://docs.openstack.org/nova/latest/user/cells.html#setup-of-cells-v2 (or better https://docs.openstack.org/nova/latest/user/cells.html#step-by-step-for-common-use-cases ) | |
| 10:45:22 | zigo | cdent: Thanks! | |
| 10:45:45 | zigo | THAT's what I was looking for ! :) | |
| 10:45:58 | cdent | :) | |
| 10:46:14 | zigo | Hum... Still... | |
| 10:46:25 | zigo | cdent: cell0 should point to the "normal" novadb, or ... ? | |
| 10:46:42 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Rename '_numa_get_constraints_XXX' functions https://review.openstack.org/385072 | |
| 10:46:43 | openstackgerrit | Stephen Finucane proposed openstack/nova master: Standardize '_get_XXX_constraints' functions https://review.openstack.org/385071 | |
| 10:47:29 | cdent | zigo: if you go up the page to "first time setup" there's some info on what database cell0 gets (its own) | |
| 10:47:53 | cdent | if don't use --database-connection a default will be chosen | |
| 10:48:23 | zigo | cdent: Then I'm back to square 1, with db-sync failing because there's no migrate_version table. | |
| 10:48:48 | zigo | ie: paste.openstack.org/show/696077/ | |
| 10:48:57 | zigo | pymysql.err.ProgrammingError: (1146, "Table 'novadb_cell0.migrate_version' doesn't exist") | |
| 10:49:00 | zigo | :/ | |
| 10:49:25 | cdent | zigo: I think you need create the db yourself | |
| 10:49:34 | zigo | cdent: I did. | |
| 10:49:41 | cdent | once it exists then those commands will have something to talk to | |
| 10:49:45 | zigo | The db is created with username and password. | |
| 10:50:05 | zigo | Hum... probably it's just a login/pass issue, and I need to fix it? | |
| 10:51:26 | cdent | zigo: probably can compare with what the steps here: https://github.com/openstack-dev/devstack/blob/master/lib/nova#L716 | |
| 10:52:08 | cdent | if you're using user and pass then they probably need to be the same across database, unless you are being explicit and using --database-connection | |
| 10:55:36 | zigo | I checked, my credentials are correct for cell0 | |
| 10:57:41 | zigo | And login / pass is the same for the novadb and novadb_cell0... | |
| 10:57:43 | zigo | So it's not that. | |
| 11:00:44 | zigo | I think I'm getting to it, finally ... | |
| 11:00:47 | zigo | Specified key was too long; max key length is 767 bytes') | |
| 11:00:47 | zigo | 2018-03-09 10:58:43.219 45740 ERROR oslo_db.sqlalchemy.exc_filters [req-e901cb29-70b2-43f9-90a0-83d641462d79 - - - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1071, 'Specified key was too long; max key length is 767 bytes') [SQL: '\nCREATE TABLE migrate_version (\n\trepository_id VARCHAR(250) NOT NULL, \n\trepository_path TEXT, \n\tversion INTEGER, \n\tPRIMARY KEY (repository_id)\n)\n\n']: pymysql.err.InternalError: (1071, ' | |
| 11:00:47 | zigo | Error: (pymysql.err.InternalError) (1071, 'Specified key was too long; max key length is 767 bytes') [SQL: '\nCREATE TABLE migrate_version (\n\trepository_id VARCHAR(250) NOT NULL, \n\trepository_path TEXT, \n\tversion INTEGER, \n\tPRIMARY KEY (repository_id)\n)\n\n'] | |
| 11:00:51 | zigo | This should be the issue. | |
| 11:01:20 | zigo | I wonder why it worked at some point. | |
| 11:05:08 | zigo | Hum... probably an encoding issue ! :) | |
| 11:05:12 | cdent | yeah | |
| 11:05:23 | cdent | what's your default encoding? | |
| 11:05:23 | zigo | This makes the primary key stuff fail ... | |
| 11:05:33 | zigo | I'm checking for that right now. | |
| 11:09:12 | zigo | THERE WE GO !!! :) | |
| 11:09:14 | zigo | Working ... | |
| 11:09:33 | zigo | Adding CHARACTER SET utf8 COLLATE utf8_unicode_ci when creating the db made it work. | |
| 11:09:40 | zigo | This really should be documented somewhere. | |
| 11:09:51 | zigo | I'll write that patch in that somewhere ... :P | |
| 11:11:53 | Spaz-Work | Wanted to play with Gerritt API more today but these tickets today whew | |
| 11:12:33 | openstackgerrit | Rajesh Tailor proposed openstack/nova master: Reset instance status on invalid host https://review.openstack.org/401009 | |
| 11:24:00 | cdent | zigo: I think nova has long asumed a utf8 encoding setup, but yeah, keeping it clear in docs would be nice | |
| 11:34:57 | finucannot | MySQL strikes again | |
| 11:47:46 | zigo | cdent: simple_cell_setup just work if the db is in the correct encoding, though my novadb_cell1 database will stay empty, is that expected? | |
| 11:48:29 | cdent | zigo: empty as in no rows, or empty as in no tables? | |
| 11:48:33 | zigo | It doesn't even create the cell1 ... | |
| 11:48:41 | zigo | cdent: Empty as no tables. | |
| 11:49:06 | cdent | (I've never used simple_cell_setup directory so I don't know from experience, just from reading the docs I pointed you at) | |
| 11:49:21 | zigo | Allright. | |
| 11:49:32 | zigo | Well, I can't find the way to populate the cell1 db ... | |
| 11:49:48 | cdent | discover_hosts eventually does that | |
| 11:49:58 | cdent | but I'm not sure if it will make tables | |
| 11:50:14 | cdent | s/directory/directly/ | |
| 11:51:11 | zigo | running_vms, cn.cpu_info, cn.disk_available_least, cn.host_ip, cn.supported_instances, cn.metrics, cn.pci_stats, cn.extra_resources, cn.stats, cn.numa_topology, cn.ram_allocation_ratio, cn.cpu_allocation_ratio, cn.disk_allocation_ratio, cn.mapped \nFROM compute_nodes AS cn \nWHERE cn.deleted = %(deleted_1)s AND cn.mapped < %(mapped_1)s ORDER BY cn.id ASC'] [parameters: {'deleted_1': 0, 'mapped_1': 1}] | |
| 11:51:11 | zigo | sqlalchemy.exc.ProgrammingError: (pymysql.err.ProgrammingError) (1146, "Table 'novadb_cell1.compute_nodes' doesn't exist") [SQL: 'SELECT cn.created_at, cn.updated_at, cn.deleted_at, cn.deleted, cn.id, cn.service_id, cn.host, cn.uuid, cn.vcpus, cn.memory_mb, cn.local_gb, cn.vcpus_used, cn.memory_mb_used, cn.local_gb_used, cn.hypervisor_type, cn.hypervisor_version, cn.hypervisor_hostname, cn.free_ram_mb, cn.free_disk_gb, cn.current_workload, cn. | |
| 11:51:15 | zigo | That's what it does ... :/ | |
| 11:52:13 | openstackgerrit | Merged openstack/nova master: hardware: Rework '_get_cpu_topology_constraints' https://review.openstack.org/407173 | |
| 11:53:23 | cdent | sorry I'm not more help zigo, not something I've done a lot of work on. I'm also in the midst of writing this week's placement report so attention split | |
| 12:07:38 | openstackgerrit | sahid proposed openstack/nova master: libvirt: slow live-migration to ensure network is ready https://review.openstack.org/497457 | |
| 12:09:01 | openstackgerrit | Merged openstack/nova master: hardware: Rework get_number_of_serial_ports https://review.openstack.org/407174 | |
| 12:16:23 | openstackgerrit | Thomas Goirand proposed openstack/nova master: Make nova build reproducible https://review.openstack.org/551269 | |
| 12:42:25 | openstackgerrit | Zhenyu Zheng proposed openstack/nova master: nova-manage db archive_deleted_rows is not multi-cell aware https://review.openstack.org/507486 | |
| 12:58:42 | Spaz-Work | This must be the most disgusting functional code i've ever written | |
| 13:34:34 | finucannot | bauwser, jaypipes: If you've time today, there's another two of those "clean up and document libvirt stuff" patches here that I'd really like to close out https://review.openstack.org/#/q/topic:feat/numa-refactor+status:open | |
| 13:38:57 | finucannot | zigo: If you can hang around a while longer, someone like dansmith might be able to help you out | |
| 13:39:24 | finucannot | If you'd a question on the libvirt driver, I'd be your guy. This stuff though...ummm... :) | |
| 13:40:38 | kashyap | Hi folks, can anyone double-confirm if this requires a spec? I hope not, it's a single change that introduces a config attribute: https://bugs.launchpad.net/nova/+bug/1750829 | |
| 13:40:39 | openstack | Launchpad bug 1750829 in OpenStack Compute (nova) "RFE: libvirt: Add ability to configure extra CPU flags for named CPU models" [Undecided,In progress] - Assigned to Kashyap Chamarthy (kashyapc) | |
| 13:41:34 | zigo | finucannot: Cheers ! | |
| 13:41:38 | zigo | I'll ask him then. | |
| 13:41:47 | zigo | Maybe late tonight after dinner. | |