| Posted | Nick | Remark | |
|---|---|---|---|
| #openstack-cyborg - 2026-08-06 | |||
| 10:51:00 | chandankumar | is it just me or anyone else see this issue re not a bot!</title><link rel="stylesheet" href="/.within.website/x/xess/xess.min.css?cachebuster=v1.26.2"><meta name="viewport" content="width=device-width, initial-scale=1.0"><meta name="robots" content="noindex,nofollow"><style> | |
| 10:51:00 | chandankumar | 2026-08-06 09:26:16.414027 | controller | | |
| 10:51:17 | chandankumar | in ci while installing packages from upper contstriants | |
| 10:51:23 | chandankumar | https://paste.openstack.org/raw/bj5g4WQPG35mTz5KLJ6d/ | |
| 10:51:29 | chandankumar | https://64a9355ed099acada607-cd221b105c4d18d37b6dac96e24d6617.ssl.cf1.rackcdn.com/openstack/d5a84ead46ec4021b7091b79dc41590a/job-output.txt | |
| 11:06:02 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMe driver devstack plugin support https://review.opendev.org/c/openstack/cyborg/+/999945 | |
| 13:38:38 | opendevreview | chandan kumar proposed openstack/cyborg master: pci-sim: add NVMe VFIO guest probe and host handoff https://review.opendev.org/c/openstack/cyborg/+/999929 | |
| 13:38:39 | opendevreview | chandan kumar proposed openstack/cyborg master: pci-sim: add DevStack plugin NVMe passthrough support https://review.opendev.org/c/openstack/cyborg/+/999930 | |
| 13:38:39 | opendevreview | chandan kumar proposed openstack/cyborg master: Clarify Nova 422 handling for instant ARQ binds https://review.opendev.org/c/openstack/cyborg/+/999931 | |
| 13:38:40 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVME device type https://review.opendev.org/c/openstack/cyborg/+/999932 | |
| 13:38:40 | opendevreview | chandan kumar proposed openstack/cyborg master: Add device_state to Device model https://review.opendev.org/c/openstack/cyborg/+/999933 | |
| 13:38:41 | opendevreview | chandan kumar proposed openstack/cyborg master: Add online data migration and status check for device_state https://review.opendev.org/c/openstack/cyborg/+/999934 | |
| 13:38:41 | opendevreview | chandan kumar proposed openstack/cyborg master: Add no-op init_host() and cleanup() to GenericDriver https://review.opendev.org/c/openstack/cyborg/+/999935 | |
| 13:38:42 | opendevreview | chandan kumar proposed openstack/cyborg master: Add [nvme] configuration section https://review.opendev.org/c/openstack/cyborg/+/999936 | |
| 13:38:42 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMeDeviceSpec and privsep helpers for nvme-cli https://review.opendev.org/c/openstack/cyborg/+/999937 | |
| 13:38:44 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMeDriver with discover/init_host and agent wiring https://review.opendev.org/c/openstack/cyborg/+/999938 | |
| 13:38:44 | opendevreview | chandan kumar proposed openstack/cyborg master: Add cleanup_device RPC and wire unbind dispatch https://review.opendev.org/c/openstack/cyborg/+/999939 | |
| 13:38:46 | opendevreview | chandan kumar proposed openstack/cyborg master: Implement NVMeDriver.cleanup() with sanitize support https://review.opendev.org/c/openstack/cyborg/+/999940 | |
| 13:38:46 | opendevreview | chandan kumar proposed openstack/cyborg master: Add bind guard and crash recovery for device_state https://review.opendev.org/c/openstack/cyborg/+/999941 | |
| 13:38:48 | opendevreview | chandan kumar proposed openstack/cyborg master: Add device_state API responses and POST clean endpoint https://review.opendev.org/c/openstack/cyborg/+/999942 | |
| 13:38:48 | opendevreview | chandan kumar proposed openstack/cyborg master: Deprecate SSD and Inspur NVMe drivers https://review.opendev.org/c/openstack/cyborg/+/999943 | |
| 13:38:50 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMe driver admin guide and API reference updates https://review.opendev.org/c/openstack/cyborg/+/999944 | |
| 13:38:50 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMe driver devstack plugin support https://review.opendev.org/c/openstack/cyborg/+/999945 | |
| 13:46:07 | opendevreview | chandan kumar proposed openstack/cyborg master: Add bind guard and crash recovery for device_state https://review.opendev.org/c/openstack/cyborg/+/999941 | |
| 13:46:08 | opendevreview | chandan kumar proposed openstack/cyborg master: Add device_state API responses and POST clean endpoint https://review.opendev.org/c/openstack/cyborg/+/999942 | |
| 13:46:08 | opendevreview | chandan kumar proposed openstack/cyborg master: Deprecate SSD and Inspur NVMe drivers https://review.opendev.org/c/openstack/cyborg/+/999943 | |
| 13:46:09 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMe driver admin guide and API reference updates https://review.opendev.org/c/openstack/cyborg/+/999944 | |
| 13:46:09 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMe driver devstack plugin support https://review.opendev.org/c/openstack/cyborg/+/999945 | |
| 14:02:06 | opendevreview | Gihong Lee proposed openstack/cyborg master: Migrate accelerator drivers to shared lspci helpers https://review.opendev.org/c/openstack/cyborg/+/998817 | |
| 14:15:35 | chandankumar | sean-k-mooney: Hello, I need your input on this https://review.opendev.org/c/openstack/cyborg/+/999931 instance using cyborg nvme flavor got stuck with build status | |
| 14:15:48 | chandankumar | Here is the reproducer I came out to reproduce https://paste.openstack.org/raw/bMklG3eeHbHqfDL46a8H/ | |
| 14:16:49 | sean-k-mooney | hum | |
| 14:19:02 | chandankumar | I will log a bug also with the details | |
| 14:19:59 | sean-k-mooney | ok but we need to determin if this i sa cybrog bug or nova one | |
| 14:20:09 | sean-k-mooney | nova is the thing creating the arq | |
| 14:20:41 | sean-k-mooney | and isntance.host i think shoudl be set before we create the arq | |
| 14:20:49 | sean-k-mooney | certenly before we bind it | |
| 14:21:09 | sean-k-mooney | i guess we need to create the arq before that ofr schduling | |
| 14:21:46 | sean-k-mooney | the bidnign happens after schdulign async of the call to create teh vm | |
| 14:22:13 | sean-k-mooney | so there is a race in theory but ya i need to load context to triage this properly | |
| 14:23:06 | chandankumar | It happened for one time or twice , where the instance got stuck in build for long, when I restarted all the services and kicked the tempest tests | |
| 14:23:59 | sean-k-mooney | so there isent really a bug her | |
| 14:24:06 | sean-k-mooney | your just tweakign the log message | |
| 14:24:19 | sean-k-mooney | the code before and after has the same behvior | |
| 14:24:45 | sean-k-mooney | and changing som veirabl names | |
| 14:25:52 | sean-k-mooney | so ya the only real change in that code beside formating | |
| 14:25:57 | sean-k-mooney | is changig the log to debug | |
| 14:26:12 | sean-k-mooney | and wordsmithing the message | |
| 14:26:20 | sean-k-mooney | i dont think that needs a seperate tracker | |
| 14:26:40 | sean-k-mooney | info woudl actully be fine | |
| 14:26:48 | sean-k-mooney | but im not agaisnt downgradign to debug | |
| 14:28:20 | chandankumar | from earlier message, It was not clear so i changed like that | |
| 14:28:36 | chandankumar | that's why I needed your input on this. | |
| 14:28:57 | sean-k-mooney | ```The old code logged this at INFO with a misleading | |
| 14:28:59 | sean-k-mooney | "Ignoring" message that suggested a problem.``` | |
| 14:29:04 | sean-k-mooney | so that i woudl disagree with | |
| 14:29:19 | sean-k-mooney | info level warning are for expected bevhior | |
| 14:29:29 | sean-k-mooney | we never use info to signal a problem | |
| 14:29:34 | sean-k-mooney | that woudl use warning | |
| 14:29:55 | sean-k-mooney | so "ignoring" is informatioal that this happend but its not a problem | |
| 14:30:29 | sean-k-mooney | im ok with the refinement but i woudl not backport this | |
| 14:32:59 | chandankumar | thanks for clarifying on info and warning level | |
| 14:33:13 | chandankumar | I will update the patch to add warning | |
| 14:36:18 | chandankumar | I have one question on nvme generic driver series, Currently I am building the series on top of joan's personality sys fs interface then nvme pci-sim implementation and then the whole nvme generic driver series. | |
| 14:36:37 | chandankumar | Does that stacking looks ok? or do we want to keep pci-sim in the end of he series? | |
| 14:43:56 | sean-k-mooney | no | |
| 14:44:08 | sean-k-mooney | you shoudl not be addign a warning for soemthiing that is expected | |
| 14:44:22 | sean-k-mooney | we only use warning when the admin has to fix something | |
| 14:45:31 | sean-k-mooney | there is nothign to fix here, its expected that nova may not have started proceeing the request on the compute yet so info was correct, debug is also ok | |
| 14:46:20 | sean-k-mooney | so looking at https://review.opendev.org/c/openstack/cyborg/+/999945 | |
| 14:46:23 | sean-k-mooney | yes | |
| 14:46:35 | sean-k-mooney | we want to pul the pf personatlies on top of master | |
| 14:46:49 | sean-k-mooney | and then build up the nvme sersie there | |
| 14:47:10 | sean-k-mooney | but you coudl also move the pci-sim patcher after the drvier if needed | |
| 14:47:32 | sean-k-mooney | for now ill assume we wont need to od that but if we get close to feature freeze | |
| 14:47:41 | sean-k-mooney | we will move the pci-sim code later | |
| 14:47:53 | sean-k-mooney | since that can merge after FeatureFreeze | |
| 14:48:55 | sean-k-mooney | its usful to have the pci-sim supprot earlier for developemntn but it and the ci supprot can come after if we start running out of time | |
| 14:56:42 | chandankumar | Thank you, for now I will keep the series. | |
| 14:57:00 | chandankumar | I will wait till one week before featureFreeze then decide | |
| 14:57:11 | chandankumar | to move the pci-sim code later | |
| 15:18:12 | opendevreview | chandan kumar proposed openstack/cyborg master: Clarify Nova 422 handling for instant ARQ binds https://review.opendev.org/c/openstack/cyborg/+/999931 | |
| 15:22:35 | opendevreview | chandan kumar proposed openstack/cyborg master: Clarify Nova 422 handling for instant ARQ binds https://review.opendev.org/c/openstack/cyborg/+/999931 | |
| 15:23:53 | sean-k-mooney | chandankumar: just to confirm | |
| 15:24:02 | sean-k-mooney | the vme booted even with this log message right | |
| 15:24:39 | chandankumar | yes | |
| 15:25:18 | chandankumar | I will put the notes tomorrow in launchpad, we can take it from there | |
| 15:25:47 | sean-k-mooney | ok i was just confirming after reading https://paste.openstack.org/raw/bMklG3eeHbHqfDL46a8H/ | |
| 15:31:28 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVME device type https://review.opendev.org/c/openstack/cyborg/+/999932 | |
| 15:31:28 | opendevreview | chandan kumar proposed openstack/cyborg master: Add device_state to Device model https://review.opendev.org/c/openstack/cyborg/+/999933 | |
| 15:31:29 | opendevreview | chandan kumar proposed openstack/cyborg master: Add online data migration and status check for device_state https://review.opendev.org/c/openstack/cyborg/+/999934 | |
| 15:31:29 | opendevreview | chandan kumar proposed openstack/cyborg master: Add no-op init_host() and cleanup() to GenericDriver https://review.opendev.org/c/openstack/cyborg/+/999935 | |
| 15:31:30 | opendevreview | chandan kumar proposed openstack/cyborg master: Add [nvme] configuration section https://review.opendev.org/c/openstack/cyborg/+/999936 | |
| 15:31:30 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMeDeviceSpec and privsep helpers for nvme-cli https://review.opendev.org/c/openstack/cyborg/+/999937 | |
| 15:31:31 | opendevreview | chandan kumar proposed openstack/cyborg master: Add NVMeDriver with discover/init_host and agent wiring https://review.opendev.org/c/openstack/cyborg/+/999938 | |
| 15:31:32 | opendevreview | chandan kumar proposed openstack/cyborg master: Add cleanup_device RPC and wire unbind dispatch https://review.opendev.org/c/openstack/cyborg/+/999939 | |
| 15:31:32 | opendevreview | chandan kumar proposed openstack/cyborg master: Implement NVMeDriver.cleanup() with sanitize support https://review.opendev.org/c/openstack/cyborg/+/999940 | |
| 15:31:34 | opendevreview | chandan kumar proposed openstack/cyborg master: Add bind guard and crash recovery for device_state https://review.opendev.org/c/openstack/cyborg/+/999941 | |
| 15:31:34 | opendevreview | chandan kumar proposed openstack/cyborg master: Add device_state API responses and POST clean endpoint https://review.opendev.org/c/openstack/cyborg/+/999942 | |
| 15:31:36 | opendevreview | chandan kumar proposed openstack/cyborg master: Deprecate SSD and Inspur NVMe drivers https://review.opendev.org/c/openstack/cyborg/+/999943 | |