Skip to main content

Failed backup has left a snapshot disk behind

Beginner
Posts: 2
Comments: 4

I need to move a VM to another, so I checked the VM folder and discovered that one (out of 3) disks was running off a snapshot.

# grep vmdk SQL01.vmx

scsi0:0.fileName = "SQL01.vmdk"
scsi0:1.fileName = "SQL01_1-000001.vmdk"
scsi0:2.fileName = "SQL01_2.vmdk"

Additionally I discovered that the Acronis appliance had extra disk(s) attached:

# grep vmdk acronis01.vmx

scsi0:0.fileName = "HardDisk_1.vmdk"
scsi1:0.fileName = "HardDisk_2.vmdk"
scsi1:4.fileName = "_dsqnap__SQL01_SQL01_1.vmdk"
scsi1:4.redo = "./_dsqnap__SQL01_SQL01_1.vmdk.REDO_Z6ytPv"

Further findings (according to: https://kb.vmware.com/selfservice/microsites/search.do?language=en_US&c… )

# find /vmfs/volumes/ -iname "*.vmx" -exec grep -HEie "-[0-9]{6}.vmdk" {} \;

/vmfs/volumes/9881eafb-da40f427/SQL01/SQL01.vmx:scsi0:1.fileName = "SQL01_1-000001.vmdk"

# ls -lah /vmfs/devices/deltadisks/

-rw-------    1 root     root      500.0G Jul 13 13:36 184742c3-_dsqnap__SQL01_SQL01_1.vmdk-delta.REDO_Z6ytPv
-rw-------    1 root     root      500.0G Jul 13 13:36 6da24184-SQL01_1-000001-delta.vmdk

# find /vmfs/volumes/ -iname "*delta.vmdk"

/vmfs/volumes/9881eafb-da40f427/SQL01/SQL01_1-000001-delta.vmdk
/vmfs/volumes/588ddc51-b076e1bc-8c9e-1402ec6b7d88/acronis01/_dsqnap__SQL01_SQL01_1-delta.vmdk

How do I go about cleaning this up?

1. Can I remove the extra disk (Delete from disk) from Acronis appliance?
2. Can I cleanup the snapshot by first creating a new snapshot and then remove all snapshots?

Any help is appriciated.

TIA,
Kristian

Error message and log from Acronis backup job:

Failed to open raw hard disk data file '[dsqnap] SQL01/SQL01_1.vmdk'.
Additional info: 
--------------------
Error code: 94
Module: 83
LineInfo: 1b5da992938b2ae1
Fields: 
Message: Failed to open raw hard disk data file '[dsqnap] SQL01/SQL01_1.vmdk'.
--------------------
Error code: 133
Module: 83
LineInfo: c7610e0a857bedc1
Fields: 
Message: Awaiting task 'AttachScsiHardDisk' has failed. Reason: SOAP fault code: '30', 
Description: 'EOF was observed that violates the protocol. The client probably provided invalid authentication information.', 
Detail: 'SSL_connect error in tcp_connect()'.
--------------------

  <evt msg="Task 'SQL01' was started." j="00000534" tm="04/06/17 03:45:04.997" tp="I"/>
  <evt msg="Task 'SQL01' changed its state from 'idle' to 'running'." j="00000000" tm="04/06/17 03:45:04.997" tp="I"/>
  <evt msg="Backup deletion" j="00000534" tm="04/06/17 03:45:06.960" tp="I"/>
  <evt msg="1 backup(s) have been deleted from archive SQL01_.TIB." j="00000534" tm="04/06/17 03:48:08.877" tp="I"/>
  <evt msg="Backup deletion has successfully completed." j="00000534" tm="04/06/17 03:48:08.947" tp="I"/>
  <evt msg="Backing up VM(s)." j="00000534" tm="04/06/17 03:48:08.957" tp="I"/>
  <evt msg="Successfully connected to 'VMware vCenter Server 6.0.0 build-3018523'." j="00000534" tm="04/06/17 03:48:10.049" tp="I"/>
  <evt msg="Successfully connected to 'VMware vCenter Server 6.0.0 build-3018523'." j="00000534" tm="04/06/17 03:48:11.188" tp="I"/>
  <evt msg="Successfully connected to 'VMware ESXi 6.0.0 build-3380124' through VMware vCenter Server." j="00000534" tm="04/06/17 03:48:11.230" tp="I"/>
  <evt msg="Successfully connected to 'VMware ESXi 6.0.0 build-3380124' through VMware vCenter Server." j="00000534" tm="04/06/17 03:48:11.582" tp="I"/>
  <evt msg="Creating snapshot (6/4/17 3:48:12 AM)." j="00000534" tm="04/06/17 03:48:59.421" tp="I"/>
  <evt msg="Loading virtual machine 'vm://81cbeb30-a477-4b58-87be-8f5dc2df66ca/500ece88-b416-759c-ede3-568a36bcbf89?host=host-22&amp;type=vmwesx' into the disk subsystem." j="00000534" tm="04/06/17 03:48:59.647" tp="I"/>
  <evt msg="Adding virtual hard disk '[dsqnap] SQL01/SQL01.vmdk' to '1:3'." j="00000534" tm="04/06/17 03:49:02.848" tp="I"/>
  <evt msg="Adding virtual hard disk '[dsqnap] SQL01/SQL01_1.vmdk' to '1:4'." j="00000534" tm="04/06/17 03:49:24.703" tp="I"/>
  <evt msg="Failed to open raw hard disk data file '[dsqnap] SQL01/SQL01_1.vmdk'.&#10;Additional info: &#10;--------------------&#10;Error code: 94&#10;Module: 83&#10;LineInfo: 1b5da992938b2ae1&#10;Fields: &#10;Message: Failed to open raw hard disk data file '[dsqnap] SQL01/SQL01_1.vmdk'.&#10;--------------------&#10;Error code: 133&#10;Module: 83&#10;LineInfo: c7610e0a857bedc1&#10;Fields: &#10;Message: Awaiting task 'AttachScsiHardDisk' has failed. Reason: SOAP fault code: '30', Description: 'EOF was observed that violates the protocol. The client probably provided invalid authentication information.', Detail: 'SSL_connect error in tcp_connect()'.&#10;--------------------" j="00000534" tm="04/06/17 03:50:11.158" tp="E"/>
  <evt msg="Adding virtual hard disk '[dsqnap] SQL01/SQL01_2.vmdk' to '1:5'." j="00000534" tm="04/06/17 03:50:11.259" tp="I"/>
  <evt msg="Analyzing partition 'C:'..." j="00000534" tm="04/06/17 03:50:42.773" tp="I"/>
  <evt msg="Analyzing partition 'D:'..." j="00000534" tm="04/06/17 03:50:42.832" tp="I"/>
  <evt msg="Analyzing partition 'E:'..." j="00000534" tm="04/06/17 03:50:42.948" tp="I"/>
  <evt msg="Analyzing partition '2-0'..." j="00000534" tm="04/06/17 03:50:46.585" tp="I"/>
  <evt msg="Analyzing partition '2-0'..." j="00000534" tm="04/06/17 03:50:47.194" tp="I"/>
  <evt msg="Create Incremental Backup &#32;From:&#9;Disk '1', Disk '2' To file:&#9;&quot;avfs:/smb?//dfnashq/HQVMBackup02/SQL01_.TIB&quot; Compression:&#9;Normal Exclude:&#9;Files matching mask Match criterion:&#9;&#32;" j="00000534" tm="04/06/17 03:50:52.655" tp="I"/>
  <evt msg="Backing up additional file 'SQL01-000001.vmdk'." j="00000534" tm="04/06/17 03:50:53.198" tp="I"/>
  <evt msg="Backing up additional file 'SQL01.nvram'." j="00000534" tm="04/06/17 03:50:54.180" tp="I"/>
  <evt msg="Backing up additional file 'SQL01.vmdk'." j="00000534" tm="04/06/17 03:50:54.930" tp="I"/>
  <evt msg="Backing up additional file 'SQL01.vmx'." j="00000534" tm="04/06/17 03:50:55.417" tp="I"/>
  <evt msg="Backing up additional file 'SQL01.vmxf'." j="00000534" tm="04/06/17 03:50:56.046" tp="I"/>
  <evt msg="Backing up additional file 'SQL01_1-000001.vmdk'." j="00000534" tm="04/06/17 03:50:56.568" tp="I"/>
  <evt msg="Backing up additional file 'SQL01_1.vmdk'." j="00000534" tm="04/06/17 03:50:57.020" tp="I"/>
  <evt msg="Backing up additional file 'SQL01_2-000001.vmdk'." j="00000534" tm="04/06/17 03:50:57.499" tp="I"/>
  <evt msg="Backing up additional file 'SQL01_2.vmdk'." j="00000534" tm="04/06/17 03:50:58.114" tp="I"/>
  <evt msg="Pending operation 153 started: 'Creating partition image'." j="00000534" tm="04/06/17 03:51:18.552" tp="I"/>
  <evt msg="CBT (Changed Block Tracking) information has been successfully retrieved." j="00000534" tm="04/06/17 03:51:19.095" tp="I"/>
  <evt msg="Pending operation 153 started: 'Creating partition image'." j="00000534" tm="04/06/17 03:52:01.739" tp="I"/>
  <evt msg="CBT (Changed Block Tracking) information has been successfully retrieved." j="00000534" tm="04/06/17 03:52:59.042" tp="I"/>
  <evt msg="Pending operation 153 started: 'Creating partition image'." j="00000534" tm="04/06/17 03:53:43.516" tp="I"/>
  <evt msg="CBT (Changed Block Tracking) information has been successfully retrieved." j="00000534" tm="04/06/17 03:53:48.645" tp="I"/>
  <evt msg="Pending operation 150 started: 'Saving partition structure'." j="00000534" tm="04/06/17 05:02:06.631" tp="I"/>
  <evt msg="Pending operation 150 started: 'Saving partition structure'." j="00000534" tm="04/06/17 05:02:06.651" tp="I"/>
  <evt msg="Detaching hard disk 'SCSI1:5'." j="00000534" tm="04/06/17 05:02:42.617" tp="I"/>
  <evt msg="Detaching hard disk 'SCSI1:3'." j="00000534" tm="04/06/17 05:03:23.529" tp="I"/>
  <evt msg="Remove snapshot (snapshot-5224)." j="00000534" tm="04/06/17 05:03:26.940" tp="I"/>
  <evt msg="Task 'SQL01' changed its state from 'running' to 'idle'." j="00000000" tm="04/06/17 05:03:30.411" tp="I"/>
  <evt msg="Task 'SQL01' succeeded." j="00000534" tm="04/06/17 05:03:31.592" tp="I"/>
Forum Star
Posts: 22
Comments: 2660

Top

Hi Kristian,

The proper cleanup method is to remove the attached disk from appliance configuration (delete from disk):  "_dsqnap__SQL01_SQL01_1.vmdk" - this disk locks the snapshot on the original VM, so it must be removed from appliance first. After that you can create a snapshot of the original backed up VM and remove it - it will effectively consolidate the snapshot file after that.

See also the following KB article describing the process.

Thank you.

Beginner
Posts: 2
Comments: 4

Top

Thank you, Vasily,

That was also what I had planned, but now I am more confident in performing th procedure. :)

For extra security, I am now testing a restore of the lastest backup on another host.

Regards,
Kristian