Problem when upgrading tentacles to 3.1

Hello, I’m trying to upgrade our enviorment to 3.1 , But on some tentacles I get the following error:

System.NullReferenceException: Object reference not set to an instance of an object.```

Server stack trace:
at Halibut.ServiceModel.HalibutProxy.Invoke(IMessage msg) in y:\work\7ab39c94136bc5c6\source\Halibut\ServiceModel\HalibutProxy.cs:line 33

Exception rethrown at [0]:
at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
at Octopus.Shared.Contracts.IScriptService.GetStatus(ScriptStatusRequest request)
at Octopus.Worker.Tentacles.ScriptObserver.ObserveUntilComplete(ScriptTicket ticket, Int64 next, ScriptOutputFilter output) in Y:\work\refs\heads\master\source\Octopus.Worker\Tentacles\ScriptObserver.cs:line 53
at Octopus.Worker.Tentacles.ScriptObserver.ObserveUntilComplete(ScriptTicket ticket, Action`1 collectArtifacts) in Y:\work\refs\heads\master\source\Octopus.Worker\Tentacles\ScriptObserver.cs:line 30
at Octopus.Worker.Tentacles.TentacleRemoteEndpointFacade.ExecuteCommand(StartScriptCommand command) in Y:\work\refs\heads\master\source\Octopus.Worker\Tentacles\TentacleRemoteEndpointFacade.cs:line 39
at Octopus.Worker.Tentacles.TentacleUpgradeMediator.TryCheckVersion() in Y:\work\refs\heads\master\source\Octopus.Worker\Tentacles\TentacleUpgradeMediator.cs:line 96
Octopus.Server version 3.1.0 (3.1.0+Branch.master.Sha.18df50358780715ce00240e8ad477127e25869c4)

Hi Patrik

Thanks for getting in touch, and sorry to hear you’re having issues.

Can you please tell me what version you’re upgrading from, and what Operating System (including service packs) you’re having issues with ? How many machines are you upgrading (and how many failing) ?

Regards

Damian

Hey Damian,

We had the same issue as per the screenshot attached, but only when upgrading remotely (via the portal). Given this warning message from the remote upgrade, we upgraded the rest of our tentacles manually (just in case).

To answer the same questions that you asked Patrik, we were upgrading 1 Tentacle from 3.0.13.2386 -> 3.1.1. A health check of the Tentacle done afterwards suggested that the remotely upgraded Tentacle is working fine. so for now I’m not hanging for a solution, instead just letting you guys know that it occurred to us too, and with no apparent side effects for now.

Operating Systems
Octopus Server: Windows Server 2012 R2 Datacenter
Tentacle Server: Windows Server 2012 R2 Standard

Cheers, Alex

Hi,

We are using Octopus version 3.0.19.2485 and we are having the same problems. Not always but just sometimes. Restarting the deployment fixes the issue most of the time.

In our case the deploy was already started and octopus was busy configuring IIS. Half way it failed with the same error:

Object reference not set to an instance of an object.
System.NullReferenceException: Object reference not set to an instance of an object.

Server stack trace: 
   at Halibut.ServiceModel.HalibutProxy.Invoke(IMessage msg) in y:\work\7ab39c94136bc5c6\source\Halibut\ServiceModel\HalibutProxy.cs:line 33

Exception rethrown at [0]: 
   at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
   at Octopus.Shared.Contracts.IScriptService.CompleteScript(CompleteScriptCommand command)
   at Octopus.Worker.Tentacles.ScriptObserver.Finish(ScriptTicket ticket, Int64 next, ScriptOutputFilter output) in Y:\work\refs\heads\master\source\Octopus.Worker\Tentacles\ScriptObserver.cs:line 70
   at Octopus.Worker.Tentacles.ScriptObserver.ObserveUntilComplete(ScriptTicket ticket, Action`1 collectArtifacts) in Y:\work\refs\heads\master\source\Octopus.Worker\Tentacles\ScriptObserver.cs:line 32
   at Octopus.Worker.Tentacles.TentacleFacade.ExecuteCommand(StartScriptCommand command) in Y:\work\refs\heads\master\source\Octopus.Worker\Tentacles\TentacleFacade.cs:line 36
   at Octopus.Server.Orchestration.Deploy.Package.PackageActionHandler.Execute(ActionCommand command, Machine machine) in Y:\work\refs\heads\master\source\Octopus.Server\Orchestration\Deploy\Package\PackageActionHandler.cs:line 25
   at Octopus.Server.Orchestration.Deploy.Guidance.Execute(Action callback) in Y:\work\refs\heads\master\source\Octopus.Server\Orchestration\Deploy\Guidance.cs:line 51
   at Octopus.Server.Orchestration.Deploy.DeploymentTaskController.ExecuteActions(PlannedStep step, Machine machine) in Y:\work\refs\heads\master\source\Octopus.Server\Orchestration\Deploy\DeploymentTaskController.cs:line 192
   at Octopus.Shared.Tasks.OctoThreadClosure`1.Execute() in Y:\work\refs\heads\master\source\Octopus.Shared\Tasks\OctoThreadClosure.cs:line 29
Octopus.Server version 3.0.19.2485

kind regards, Tom