Vidjil backup

From CPB Wiki
Jump to navigation Jump to search

Storage directory structure:

  • keep the Vidjil structure
  • backup the data directory, including fastq files, analyses, and .vidjil files
  • check old backups to make sure there's only one backup storage

Files before 2020:

  • store in external hard drives
  • no need to store raw data from sequencer if not analyzed by Vidjil

Backup policy:

  • use external hard drives, preferably with 5TB each or more
  • backup Vidjil's data dir
  • backup Vidjil's mysql dump
  • code is backed up by git
  • Vidjil Backup Restore Day: every year, on the second Wednesday of July

Backup restore:

  • Have an ISO ready for Ubuntu server (latest LTS)
  • Create a new HyperV Generation 2 virtual machine in host 60, with 8GB of RAM, WAN2 network, with enough disk space to hold the data
  • Say you will install the OS later
  • Add a DVD unit to the VM at Configurations pointing to the Ubuntu ISO
  • Change to Microsoft UEFI certificate at Configuration/Security
  • Connect to the machine and start it
  • Install Ubuntu; you may have to Restart the machine a few times
  • Net config:
 - Subnet: 10.10.70.0/24
 - Address: 10.10.70.51 (same as dev-vidjil)
 - Gateway: 10.10.70.1
 - Name servers: 10.10.70.10, 8.8.8.8
 - Search domains: (empty)
  • When asked, accept ssh and docker installation
  • After installation is complete, remove the DVD and restart
  • Clone the Vidjil wrapper code
  • Restore Docker images (docker load client & server)
  • Configure .env and propagate
  • Start Vidjil wrapper and test
  • Restore data dir, except uploads
  • Restore uploads and test
  • Restore mysql dump