Earlier  
Posted Nick Remark
#openstack-nova - 2024-06-24
17:06:26 sean-k-mooney jangutter: so we were thinking of deployign with a/a for our new installer
17:06:39 sean-k-mooney then we found that most service dont work properly id you do
17:06:41 sean-k-mooney mysql_wsrep_sync_wait = 1
17:06:47 jangutter thanks, that makes absolute sense now.
17:07:08 sean-k-mooney might work as that forces galera to ensure that it sync on every read
17:07:28 sean-k-mooney or rather read form the most up to date write set whatever its called internally
17:07:48 jangutter (we'll have to check our performance stats on that of course, but you can't argue against CAP)
17:08:08 sean-k-mooney looking at nova code while we were debuging it i dont think we have the code to proerly handal A/A galare with delayed consitency in nova
17:08:47 sean-k-mooney ya so even if its a few seconds of a replciation dely it make the db nolonger atomic
17:09:11 sean-k-mooney and placemnt which is designed to rely on that for the allcoations really cant tollerate that
17:10:14 sean-k-mooney jangutter: still at workday?
17:10:27 jangutter what gave it away :-p
17:10:44 sean-k-mooney nothing we just have not chatted in a while
17:10:57 sean-k-mooney i was wondering if you were still in dublin and working with them
17:11:44 jangutter correct on both counts, also somehow the amount of board games available has grown....
17:12:13 sean-k-mooney does it ever decrease i tought they just started taking up space in fried houes instead :)
17:12:21 sean-k-mooney *friends
17:13:04 sean-k-mooney jangutter: in case its of use what we ended up doing in our new installer is this https://github.com/openstack-k8s-operators/mariadb-operator/pull/229/files#diff-deca2c41d0839d5052bb1da5ac7ad924f126ef4adcf10fea54d00a1a737f668b
17:13:33 sean-k-mooney jangutter: we reverted to active passive with a script that is invoked by galera when teh leader changes
17:13:48 sean-k-mooney that updated the endpoint in the kubernets service to point only to the new leader
17:15:43 jangutter oh man, I have PTSD about "leader election" and etcd.
17:16:21 jangutter It makes sense, 99% of the time you have a leader, but you want a smooth handover during updates.
17:16:52 sean-k-mooney jangutter: yep and its using a feature of galera that allows it to execute a user script when the leader changes
17:17:42 sean-k-mooney so we are now just providing a script for it to execute and leveragin the fact that k8s adds servie user tokens/config into the pods to allow it to auth and do the service update
17:18:23 sean-k-mooney it kind of sucks that gelera does not just proxy the connection ot the current leader internally but if the hack works...
17:19:00 jangutter we used an analogous way to backup the db by selecting a non-active node and transferring the state from it. the scary thing is that a chunk of this is load-bearing bash scripts.
17:19:32 sean-k-mooney https://imgs.xkcd.com/comics/dependency.png
17:19:48 jangutter 100% true.
17:20:19 sean-k-mooney i wish there was an image macro that would just replace the right arrow
17:31:51 gmann stephenfin: ack, will do 2nd round of reviews.
#openstack-nova - 2024-06-25
09:53:59 opendevreview Takashi Kajinami proposed openstack/nova master: Migrate MEM_ENCRYPTION_CONTEXT from root provider https://review.opendev.org/c/openstack/nova/+/921814
10:05:30 opendevreview Michael Still proposed openstack/nova-specs master: Propose a new API microversion for a spice-direct console. https://review.opendev.org/c/openstack/nova-specs/+/915190
10:06:57 mikal sean-k-mooney: thanks again for your comments, I've replied. I'll take some time in the next couple of days to prototype a flow where Nova requests a connection URL from Kerbside.
10:19:51 sean-k-mooney mikal: ill loop back ot them shortly
14:22:38 bauzas gibi: others, I absolutely forgot I had an appointement at 5:45pm CET today that clashes with the nova meeting
14:22:51 bauzas anyone fancy to run the meeting or I shall I cancel it ?
14:23:50 sean-k-mooney i only had one topic which is i would like to move nova-next to run on noble i ahve a patch up to do that so we can always disucss that in gerrit
14:24:09 sean-k-mooney i didnt have anything else to raise today
14:25:31 bauzas I eventually found the problem with my own mtty patch, it was requiring the devstack plugin to accept noble (we were blindly setting sources.list to jammy)
14:26:06 bauzas shit, I also won't be able to run the meeting on next two tuesdays
14:31:28 bauzas apologies for not having planned it before :(
14:52:51 opendevreview Sylvain Bauza proposed openstack/nova master: WIP : mtty: add devstack compilation for fedora builds https://review.opendev.org/c/openstack/nova/+/918420
14:52:51 opendevreview Sylvain Bauza proposed openstack/nova master: WIP : Enable an experimental job for testing mtty https://review.opendev.org/c/openstack/nova/+/922140
15:02:00 gibi I can run a quick / reduced nova meeting today
15:02:08 gibi bauzas: ^^
15:02:39 bauzas gibi: thanks, I just wrote an email to -discuss, could you please reply to it ?
15:04:54 gibi done
15:50:20 gibi nova meeting starts in 10 minute
15:50:21 gibi s
16:01:40 opendevmeet The meeting name has been set to 'nova'
16:01:40 opendevmeet Useful Commands: #action #agreed #help #info #idea #link #topic #startvote.
16:01:40 opendevmeet Meeting started Tue Jun 25 16:01:40 2024 UTC and is due to finish in 60 minutes. The chair is gibi. Information about MeetBot at http://wiki.debian.org/MeetBot.
16:01:40 gibi #startmeeting nova
16:01:54 fwiesel \o
16:02:07 tkajinam o/
16:02:11 elodilles o/
16:02:32 gibi hi folks. I will be your uprepared host today
16:03:48 gibi #topic Bugs (stuck/critical)
16:03:48 Uggla o/
16:03:53 gibi #info No Critical bug
16:03:57 gibi #info Add yourself in the team bug roster if you want to help https://etherpad.opendev.org/p/nova-bug-triage-roster
16:04:16 gibi any bug that feels critical to discuss here?
16:05:40 gibi if not then
16:05:41 gibi #topic Gate status
16:05:45 gibi #link https://bugs.launchpad.net/nova/+bugs?field.tag=gate-failure Nova gate bugs
16:05:48 gibi #link https://etherpad.opendev.org/p/nova-ci-failures-minimal
16:05:52 gibi #link https://zuul.openstack.org/builds?project=openstack%2Fnova&project=openstack%2Fplacement&pipeline=periodic-weekly Nova&Placement periodic jobs status
16:05:55 gibi #info Please look at the gate failures and file a bug report with the gate-failure tag.
16:05:58 gibi #info Please try to provide meaningful comment when you recheck
16:06:25 gibi is there any gate issue that needs to be raised?
16:07:40 gibi then
16:07:41 gibi #topic Release Planning
16:07:45 gibi #link https://releases.openstack.org/dalmatian/schedule.html
16:07:53 gibi #info Dalmatian-2 is next week
16:07:57 gibi #info Spec review day planned on July 1st https://lists.openstack.org/archives/list/openstack-discuss@lists.openstack.org/thread/JBPORDTEELT5ZVPJAFCYD733IVSMXMKR/
16:08:26 gibi so next Monday we will focus on specs
16:09:01 gibi spec freeze is expected on 18 of July
16:09:12 gibi according to https://releases.openstack.org/dalmatian/schedule.html
16:09:20 gibi any questions?
16:09:42 sean-k-mooney not specifically
16:09:49 sean-k-mooney although there are a few spec that still need review
16:10:21 sean-k-mooney for example this one https://review.opendev.org/c/openstack/nova-specs/+/915190
16:10:40 sean-k-mooney it would be good to get input form others on that on monday
16:10:47 fwiesel Or this one: https://review.opendev.org/c/openstack/nova-specs/+/922201
16:11:12 sean-k-mooney fwiesel: im kind of -1 on that in general by the way
16:11:18 sean-k-mooney i need to reread it
16:11:26 tkajinam I'd also raise https://review.opendev.org/c/openstack/nova-specs/+/907702 :-)
16:11:32 sean-k-mooney but cloud-init internlly depend on it not being lazy loaded
16:11:37 gibi thanks for the pointers
16:11:56 gibi lets move on
16:12:01 sean-k-mooney sure
16:12:09 gibi #topic Review priorities
16:12:15 gibi #link https://etherpad.opendev.org/p/nova-dalmatian-status
16:12:32 gibi nothing new here :)
16:12:35 gibi so moving on
16:12:36 gibi #topic Stable Branches
16:12:49 gibi elodilles: are you around?
16:12:53 elodilles yepp
16:13:04 gibi then please
16:13:07 gibi :)

Earlier   Later