Skip to content

crucible reconcile is sending Nexus too many notifications #1794

@leftwo

Description

@leftwo

During a recent reconciliation:

23:05:09.775Z INFO propolis-server (vm_state_driver): sending reconcile request ReconciliationId(3434)                                      
     = downstairs                                                                                                                           
    client = 0                                                                                                                              
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6                                                                                       
23:05:09.783Z INFO propolis-server (vm_state_driver): notified Nexus of reconcile progress                                                  
    job = notify                                                                                                                            
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6                                                                                       
23:05:09.783Z INFO propolis-server (vm_state_driver): new DNS resolver                                                                      
    addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53]                                              
    job = notify                                                                                                                            
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6                                                                                       
23:05:09.791Z INFO propolis-server (vm_state_driver): notified Nexus of reconcile progress                                                  
    job = notify                                                                                                                            
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6                                                                                       
23:05:09.791Z INFO propolis-server (vm_state_driver): new DNS resolver                                                                      
    addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53]                                              
    job = notify                                                                                                                            
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6                                                                                       
23:05:09.798Z INFO propolis-server (vm_state_driver): notified Nexus of reconcile progress                                                  
    job = notify
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6
23:05:09.798Z INFO propolis-server (vm_state_driver): new DNS resolver 
    addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53]
    job = notify
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6
23:05:09.805Z INFO propolis-server (vm_state_driver): notified Nexus of reconcile progress
    job = notify
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6
23:05:10.286Z INFO propolis-server (vm_state_driver): new DNS resolver 
    addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53]
    job = notify
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6
23:05:10.288Z INFO propolis-server (vm_state_driver): sending reconcile request ReconciliationId(3438)
     = downstairs
    client = 0
    session_id = 54ea0ad5-3e3d-4080-b354-ed0767898da6

It seems like we are sending 4 notified Nexus of reconcile progress between each actual reconciliation request.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions