Problem with Check Healt - Calamari extraction failed

Hi, I’ve a problem with the "Check Healt " on my tentacle machine… the logs say: “Calamari extraction failed”.
See attachment please.
Thanks, Andrea

Hi Andrea,
Is it possible that you had several Azure tasks trying to unpack Calamari to the same folder at the same time as we had a problem with that recently that has since been fixed. Are there any other Server logs, Windows logs or stack trace that you can provide to get a little more background on what could have been going on at the time.
Hopefully we get this sorted soon so you can get back to deploying.
Cheers,
Rob

Hi Rob, thank for your answer; I check the windows logs on the target machine and I’ve found this error:

1 FATAL Package not found: D:\Script\Calamari.3.1.0.510.nupkg

The folder exist but i have not packages ( see attachment ) .

it is possible install Calamari manually? I’ve also check the version of tentacle and I’ve the last 3.1.5

thank, Andrea

some suggestions please? Now i’m standstill in my deploy … Thanks
Andrea.

Hi Andrea,
Could you check any of the Octopus Server or Tentacle logs and send through their contents to help debug the problem. Do all of the error items in the event viewer have the same error message there?
Cheers,
Rob

Hi Rob, yes in the events log table on the tentacle machine the errors are the same:

1 FATAL Package not found: D:\Script\Calamari.3.1.0.510.nupkg

I’ve attached all logs (server & target machine).

let me know,
Thanks Andrea

servertasks-465_4qbhcpq476.txt (63 KB)

OctopusTentacle_targhetMachine.txt (23 KB)

Hi,

Well I don’t know if this will help but you asked a question earlier, “it is possible install Calamari manually?”

My answer is yes. What you do is you delete the “Calamari” folder within the tentacle install path.

Then you run a health check on that server. The system will then pick up that calamari isn’t there and re-adds it for you.

Does your deployment target (node) keep disconnecting?

If all else fails then have you considered completely uninstalling the tentacle and then installing it?

Thanks,
Lance

Hi Lance, sorry but i don’t understand … there isn’t any “Calamari” folder in my target machine; now i tried these step:

  • I removed octopus tentacle on target machine from Programs and Features
  • I deleted folder “C:\Octopus” and “C:\Program Files\Octopus Deploy” on the target machine
  • I deleted the window service from the command sc delete “OctopusDeploy Tentacle”

…and then i try to install new version of tentacle, but the issue is present yet :frowning:

Is possible to install “calamari” before to run health check? What are the steps required ?

Thanks, Andrea.

What I have found is that if I delete the folder C:\Octopus\Calamari then when I run a health check the server downloads Calamari and applies it to the target.

Do you have any other deployment targets that are working? If so then you could perhaps try copy the C:\Octopus\Calamari folder from there and apply it to your broken server.

What the health check is looking for is a Success.txt file with regards to Calamari.

Let me know.
Thanks,
Lance

Yes, i’ve another machine that work, but when i try to copy the content in the srvweb05 and run an “health check”, octopus deletes all files in the destination folder.
And then i’ve have only few folders …See attachment please
Thanks Andrea

Hi Andrea,
Could you try stop the Tentacle and copy the all the contents at C:\Octopus\Calamari\3.1.0.510 from a machine with a working tentacle to this problem machine. Observe the folder for a minute to make sure there is no other process on the machine that tries to wipe the files.
Then start the Tentacle service back up again and again wait a minute and make sure it doesn’t get removed before trying the health check again.
Let me know what the results are of this experiment.
Cheers,
Rob

Hi Rob, i try to:

  1. I stopped tentacle service on target machine
  2. I copied calamari folder from another working machine
  3. I ran the tentacle service on target machine and i’m sured that the files exist
  4. I ran any health check on the server machine

…but the issue is present yet :frowning:
I’m sure that is the “health check” operation deleted the file on the target machine.
Have you another suggestions please?
Thanks for the support
Andrea

Andrea,
To clarify some things from your response:

  • Is the Calamari extraction location now empty again?
  • What does 3) & 4) mean?
    When you copied the latest version of Calamari from working machine to broken machine were you able to start the serve? (is this what your screenshot is implying?)
    Rob

Hi Rob, after “health check” operation, the Calamari folder on the tentacle’s machine is partially empty … see the attached file.
Yes, I was able to start the service without problems, both on the server and on the tentacle machine .
in my previous screenshots, you see how to stopping every service the Calamari’s content folder is OK, but when i run the “health check” operation the content of the folder is partially deleted.
Let me know,
Thanks Andrea

Have you tried to delete the tentacle instance and creating a new one?

open the tentacle manager
bottom left is the delete link.

Once you create a new instance you will need to update the thumbprint on the server and the client.

Thanks,
Lance

Hi Lance
yes i have also removed the tentacle on the PC. Message number 7 …but the issue persist.
There is another steps that i can try to do?
Thank.

What you did there doesn’t remove the tentacle instance.

open the tentacle manager
bottom left is the delete link.

It will then take you through the wizard again.

Thanks,
Lance

Hi Lance, can you see the attached file? I have already tried to delete the istance…
After deletion i tried to fill the Calmari folder from another working machine, but the problem is the same; when i perform “health check” from octopus’s server machine the web interface return is:

“C:\Octopus\Work\20151103212555-7\Bootstrap.ps1 : Calamari extraction failed”

…and the content of Calmari folder on tentacle machine is partially empty :frowning:

thanks

Andrea,
It sounds like something is removing those files. Do you have any antivirus process running on that machine which might be interfering?
Could I get you to download Process Monitor and filter for Calamari as shown in the screenshot. Run the health check and see what, if anything, is removing those files. Perhaps export and send the results if nothing stands out.
Cheers,
Rob

2015-11-04_09_28_12-Process_Monitor_Filter.png

What is the policy on here (if any) regarding contact details?

Looks like this may not get solved on this forum. I am willing to help you using alternative communication methods if you are ok with that.

Then once we correct the problem then we can post the resolution.

Let me know,
Lance