Hey WSUS forum. This is a repost from the SCCM forums. Didn't learn much more than I already knew over there, however it was nice to see someone step up very quickly. The SCCM forum doesn't believe the update broke WSUS, and the logs I
provided may indicate as such. However, my SOftware Update Points have been running flawlessly for months until I did the upgrade and now they are unable to synchronize with Microsoft Servers. Please pay close attention to the chronological order
of events to see where I'm coming from here. In the original thread, near the end, I indicate that other non-SCCM WSUS servers are experiencing the same issue. At this point, however, after seeing the data provided by our other WSUS admins, I can
see that this is not the case. The original question is below and the thread from the SCCM forum is here: https://social.technet.microsoft.com/Forums/en-US/bc428a9c-740f-43bc-8842-5543a8b36a58/sups-failing-to-synchronize-after-sccm-1602-to-1606-inconsole-upgrade?forum=ConfigMgrCompliance
- I've verified that other non-SCCM integrated WSUS servers (on the same subnet and VLAN) in our environment are synchronizing.
- I've verified via extensive Wireshark and Firewall research, in communication with both our Networks and Security teams, that sync attempts via WSUS console and via SCCM console are reaching Microsoft Servers and that said Microsoft Servers are apparently
resetting the connection (the rejection occurs within the first 3 seconds of the sync attempt).
- Although recent security patches were installed and we had successful syncs afterwards (again, please see the chronological order of events), I still removed and tested without them installed. Removal of recent KBs did not solve issue. KB's
listed below have since be re-installed.
- To sum it up. I've verified to the best of my ability that all in house communications and configurations through SCCM and and native WSUS logs that everything is still set up as it was before the 1602 to 1606 upgrade. Why the WSUS servers
are suddenly unable to synchronize with Microsoft eludes me. The SCCM forum is clear that they believe the upgrade would not cause this, but I want to see the data to prove this at this point by being pointed to a relevant KB article or Technet reference.
- The error found in SCCM's wsyncmgr.log below is just a copy paste from the exact error found in the WSUS console itself in the Synchronizations section. So, there it is.
Otherwise, any insight is greatly appreciated.
_________________________________________________________________________________________________________
Hey All,
Anyone else experienced this? Our two SUPs have been up for some time until now. Am I crazy, or is this an issue connecting to Microsoft Update? Doing everything I can to avoid ripping out and re-building SUP infrastructure...
Chronological events:
10/25 at 5pm - Windows patched and rebooted all SCCM servers in single Primary Site infrastructure including SUPs.
10/26 at 12am - SUPs successfully auto-synchronize. No errors in WCM.log or wsyncmgr.log
10/26 from 6am
to 12pm - SCCM successfully upgraded from 1602 to 1606.
10/27 at 12am - SUPs fail to auto-synchronize.
10/27 afternoon - Rebooting SUPs and manually trying to sync through SCCM console still fails.
- SUP1 (internal, SSL enabled)
- SUP2 (internet facing, SSL enabled)
- SUPSQL (SQL Server containing shared WSUS database)
--Sync failed: UssCommunicationError: WebException: The underlying connection was closed: An unexpected error occurred on a send. ---> System.IO.IOException:
Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host.~~at System.Web.Services.Protocols.WebClientProtocol.GetWebResponse(WebRequest request). Source: Microsoft.SystemsManagementServer.SoftwareUpdatesManagement.WsusSyncAction.WSyncAction.SyncWSUSSMS_WSUS_SYNC_MANAGER10/27/2016 1:35:24 PM14272 (0x37C0)
--STATMSG: ID=6703 SEV=E LEV=M SOURCE="SMS Server" COMP="SMS_WSUS_SYNC_MANAGER" SYS=bleh.bleh.com SITE=MEH PID=26112 TID=14272 GMTDATE=Thu Oct 27 20:35:24.893 2016 ISTR0="Microsoft.SystemsManagementServer.SoftwareUpdatesManagement.WsusSyncAction.WSyncAction.SyncWSUS"
ISTR1="UssCommunicationError: WebException: The underlying connection was closed: An unexpected error occurred on a send. ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the
remote host.~~at System.Web.Services.Protocols.WebClientProtocol.GetWebResponse(WebRequest request)" ISTR2="" ISTR3="" ISTR4="" ISTR5="" ISTR6="" ISTR7="" ISTR8="" ISTR9=""
NUMATTRS=0SMS_WSUS_SYNC_MANAGER10/27/2016 1:35:24 PM14272 (0x37C0)
WCM.log: No Errors
--Wait timed out after 59 minutes while waiting for at least one trigger event.SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:20 PM23008 (0x59E0)
--Timed Out...SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Checking for supported version of WSUS (min WSUS 3.0 SP2 + KB2720211 + KB2734608)SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Checking runtime v4.0.30319...SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Found supported assembly Microsoft.UpdateServices.Administration version 4.0.0.0, file version 6.2.9200.16384SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Found supported assembly Microsoft.UpdateServices.BaseApi version 4.0.0.0, file version 6.2.9200.16384SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Supported WSUS version foundSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Attempting connection to WSUS server: sup1.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Successfully connected to server: sup1.bleh.com,
port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Verify Upstream Server settings on the Active WSUS ServerSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--No changes - WSUS Server settings are correctly configured and Upstream Server is set to Microsoft UpdateSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Attempting connection to WSUS server: sup2.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Successfully
connected to server: sup2.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Refreshing categories from WSUS server SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Attempting connection to WSUS server: sup1.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Successfully connected to server: sup1.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:05:30 PM23008 (0x59E0)
--Successfully refreshed categories from WSUS serverSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:06:26 PM23008 (0x59E0)
--Attempting connection to WSUS server: sup1.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:06:32 PM23008 (0x59E0)
--Successfully connected to server: sup1.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:06:32 PM23008 (0x59E0)
--Attempting connection to WSUS server: sup1.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:06:32 PM23008 (0x59E0)
--Successfully connected to server: sup1.bleh.com, port: 8531, useSSL: TrueSMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:06:32 PM23008 (0x59E0)
--Waiting for changes for 59 minutes SMS_WSUS_CONFIGURATION_MANAGER10/27/2016 2:06:32 PM23008 (0x59E0)
WSUSCtrl.log from parent SUP1: No Errors
--Timed Out...SMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Checking for supported version of WSUS (min WSUS 3.0 SP2 + KB2720211 + KB2734608)SMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Checking runtime v4.0.30319...SMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Found supported assembly Microsoft.UpdateServices.Administration version 4.0.0.0, file version 6.3.9600.16384SMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Found supported assembly Microsoft.UpdateServices.BaseApi version 4.0.0.0, file version 6.3.9600.18324SMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Supported WSUS version foundSMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Attempting connection to local WSUS serverSMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Successfully connected to local WSUS serverSMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--No changes - local WSUS Server Proxy settings are correctly configured as Proxy Name and Proxy Port 80SMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Attempting connection to local WSUS serverSMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Successfully connected to local WSUS serverSMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--There are no unhealthy WSUS Server components on WSUS Server SUP1.BLEH.COMSMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Successfully checked database connection on WSUS server SUP1.BLEH.COMSMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
--Waiting for changes for 57 minutes SMS_WSUS_CONTROL_MANAGER10/27/2016 2:31:09 PM3108 (0x0C24)
SUPSetup.log from parent SUP1 post upgrade: No Errors
<10/26/16 08:28:31> SMSWSUS Setup Started....
<10/26/16 08:28:31> Parameters: \\SUP1.BLEH.COM\E$\SMS\bin\x64\rolesetup.exe /install /siteserver:BLEH SMSWSUS 0
<10/26/16 08:28:31> Installing Pre Reqs for SMSWSUS
<10/26/16 08:28:31> ======== Installing Pre Reqs for Role SMSWSUS ========
<10/26/16 08:28:31> Found 1 Pre Reqs for Role SMSWSUS
<10/26/16 08:28:31> Pre Req SqlNativeClient found.
<10/26/16 08:28:31> SqlNativeClient already installed (Product Code: {49D665A2-4C2A-476E-9AB8-FCC425F526FC}). Would not install again.
<10/26/16 08:28:31> Pre Req SqlNativeClient is already installed. Skipping it.
<10/26/16 08:28:31> ======== Completed Installation of Pre Reqs for Role SMSWSUS ========
<10/26/16 08:28:31> Installing the SMSWSUS
<10/26/16 08:28:31> Checking for supported version of WSUS (min WSUS 3.0 SP2 + KB2720211 + KB2734608)
<10/26/16 08:28:31> Checking runtime v4.0.30319...
<10/26/16 08:28:31> Found supported assembly Microsoft.UpdateServices.Administration version 4.0.0.0, file version 6.3.9600.16384
<10/26/16 08:28:31> Found supported assembly Microsoft.UpdateServices.BaseApi version 4.0.0.0, file version 6.3.9600.18324
<10/26/16 08:28:31> Supported WSUS version found
<10/26/16 08:28:31> Supported WSUS Server version (6.3.9600.18324) is installed.
<10/26/16 08:28:31> CTool::RegisterManagedBinary: run command line: "C:\Windows\Microsoft.NET\Framework64\v2.0.50727\RegAsm.exe" "E:\SMS\bin\x64\wsusmsp.dll"
<10/26/16 08:28:32> CTool::RegisterManagedBinary: Failed to register E:\SMS\bin\x64\wsusmsp.dll with .Net Fx 2.0
<10/26/16 08:28:32> CTool::RegisterManagedBinary: run command line: "C:\Windows\Microsoft.NET\Framework64\v4.0.30319\RegAsm.exe" "E:\SMS\bin\x64\wsusmsp.dll"
<10/26/16 08:28:32> CTool::RegisterManagedBinary: Registered E:\SMS\bin\x64\wsusmsp.dll successfully
<10/26/16 08:28:32> Registered DLL E:\SMS\bin\x64\wsusmsp.dll
<10/26/16 08:28:32> Installation was successful.
<10/26/16 08:28:32> ~RoleSetup().
Updates recently installed on parent SUP1 (Although we had a successful sync after these were installed as seen in chronological events above,
here they are):
October, 2016 Security Only Quality Update for Windows Server 2012 R2 (KB3192392)
October, 2016 Security Monthly Quality Rollup for Windows Server 2012 R2 (KB3185331)
October, 2016 Security and Quality Rollup for .NET Framework 3.5 on Windows 8.1 and Windows Server 2012 R2 for x64 (KB3188732)
Windows Malicious Software Removal Tool for WIndows 8, 8.1, 10 and Windows Server 2012, 2012 R2 x64 Edition - October 2016 (KB890830)
Firewall and AV: I've watched network traffic during manual synchronizations with our Security guys and we're seeing everything move back
and forth freely as usual. No AV upgrades on these servers, etc...
Surface Error in SCCM:
Finally, here are the surface errors in the SCCM console itself from the "Software Update Point Synchronization Status" area:
Site Code: BLEH
Software Update Point: sup1.bleh.com
Synchronization Source: Microsoft Update
Synchronization Status: Failed
Last Synchronization Error Code: 0XFFFFFFFF
Site Code: BLEH
Software Update Point: sup2.bleh.com
Synchronization Source: sup1.bleh.com
Synchronization Status: Failed
Last Synchronization Error Code: 0X80131500