Vidjil backup: Difference between revisions

From CPB Wiki
Jump to navigation Jump to search
(Restart)
(Sectioning)
 
(4 intermediate revisions by the same user not shown)
Line 1: Line 1:
Storage directory structure:
==Storage directory structure:==
* keep the Vidjil structure
* keep the Vidjil structure
* backup the data directory, including fastq files, analyses, and .vidjil files
* backup the data directory, including fastq files, analyses, and .vidjil files
Line 8: Line 8:
* no need to store raw data from sequencer if not analyzed by Vidjil
* no need to store raw data from sequencer if not analyzed by Vidjil


Backup policy:
==Backup policy:==
* use external hard drives, preferably with 5TB each or more
* use external hard drives, preferably with 5TB each or more
* backup Vidjil's data dir
* backup Vidjil's data dir
Line 15: Line 15:
* Vidjil Backup Restore Day: every year, on the second Wednesday of July
* Vidjil Backup Restore Day: every year, on the second Wednesday of July


Backup restore:
==Backup restore:==
* Have an ISO ready for Ubuntu server (latest LTS)
* Have an ISO ready for Ubuntu server (latest LTS)
* Create a new HyperV Generation 2 virtual machine in host 60, with 8GB of RAM, WAN2 network, with enough disk space to hold the data
* Create a new HyperV Generation 2 virtual machine in host 60, with 8GB of RAM, WAN2 network, with enough disk space to hold the data
Line 23: Line 23:
* Connect to the machine and start it
* Connect to the machine and start it
* Install Ubuntu; you may have to Restart the machine a few times
* Install Ubuntu; you may have to Restart the machine a few times
* Install docker
* Net config:
  - Subnet: 10.10.70.0/24
  - Address: 10.10.70.51 (same as dev-vidjil)
  - Gateway: 10.10.70.1
  - Name servers: 10.10.70.10, 8.8.8.8
  - Search domains: (empty)
* When asked, accept ssh and docker installation
* After installation is complete, remove the DVD and restart
* Clone the Vidjil wrapper code
* Clone the Vidjil wrapper code
* Restore Docker images (docker load client & server)
* Restore Docker images (docker load client & server)

Latest revision as of 11:01, 28 December 2023

Storage directory structure:

  • keep the Vidjil structure
  • backup the data directory, including fastq files, analyses, and .vidjil files
  • check old backups to make sure there's only one backup storage

Files before 2020:

  • store in external hard drives
  • no need to store raw data from sequencer if not analyzed by Vidjil

Backup policy:

  • use external hard drives, preferably with 5TB each or more
  • backup Vidjil's data dir
  • backup Vidjil's mysql dump
  • code is backed up by git
  • Vidjil Backup Restore Day: every year, on the second Wednesday of July

Backup restore:

  • Have an ISO ready for Ubuntu server (latest LTS)
  • Create a new HyperV Generation 2 virtual machine in host 60, with 8GB of RAM, WAN2 network, with enough disk space to hold the data
  • Say you will install the OS later
  • Add a DVD unit to the VM at Configurations pointing to the Ubuntu ISO
  • Change to Microsoft UEFI certificate at Configuration/Security
  • Connect to the machine and start it
  • Install Ubuntu; you may have to Restart the machine a few times
  • Net config:
 - Subnet: 10.10.70.0/24
 - Address: 10.10.70.51 (same as dev-vidjil)
 - Gateway: 10.10.70.1
 - Name servers: 10.10.70.10, 8.8.8.8
 - Search domains: (empty)
  • When asked, accept ssh and docker installation
  • After installation is complete, remove the DVD and restart
  • Clone the Vidjil wrapper code
  • Restore Docker images (docker load client & server)
  • Configure .env and propagate
  • Start Vidjil wrapper and test
  • Restore data dir, except uploads
  • Restore uploads and test
  • Restore mysql dump