Vidjil backup: Difference between revisions
Jump to navigation
Jump to search
(Initial info) |
(Sectioning) |
||
(19 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
Storage directory structure: | ==Storage directory structure:== | ||
* keep the Vidjil structure | |||
* backup the data directory, including fastq files, analyses, and .vidjil files | |||
* check old backups to make sure there's only one backup storage | |||
Files before 2020: | Files before 2020: | ||
* store in external hard drives | |||
* no need to store raw data from sequencer if not analyzed by Vidjil | |||
Backup policy: | ==Backup policy:== | ||
* use external hard drives, preferably with 5TB each or more | |||
* backup Vidjil's data dir | |||
* backup Vidjil's mysql dump | |||
* code is backed up by git | |||
* Vidjil Backup Restore Day: every year, on the second Wednesday of July | |||
==Backup restore:== | |||
* Have an ISO ready for Ubuntu server (latest LTS) | |||
* Create a new HyperV Generation 2 virtual machine in host 60, with 8GB of RAM, WAN2 network, with enough disk space to hold the data | |||
* Say you will install the OS later | |||
* Add a DVD unit to the VM at Configurations pointing to the Ubuntu ISO | |||
* Change to Microsoft UEFI certificate at Configuration/Security | |||
* Connect to the machine and start it | |||
* Install Ubuntu; you may have to Restart the machine a few times | |||
* Net config: | |||
- Subnet: 10.10.70.0/24 | |||
- Address: 10.10.70.51 (same as dev-vidjil) | |||
- Gateway: 10.10.70.1 | |||
- Name servers: 10.10.70.10, 8.8.8.8 | |||
- Search domains: (empty) | |||
* When asked, accept ssh and docker installation | |||
* After installation is complete, remove the DVD and restart | |||
* Clone the Vidjil wrapper code | |||
* Restore Docker images (docker load client & server) | |||
* Configure .env and propagate | |||
* Start Vidjil wrapper and test | |||
* Restore data dir, except uploads | |||
* Restore uploads and test | |||
* Restore mysql dump |
Latest revision as of 11:01, 28 December 2023
Storage directory structure:
- keep the Vidjil structure
- backup the data directory, including fastq files, analyses, and .vidjil files
- check old backups to make sure there's only one backup storage
Files before 2020:
- store in external hard drives
- no need to store raw data from sequencer if not analyzed by Vidjil
Backup policy:
- use external hard drives, preferably with 5TB each or more
- backup Vidjil's data dir
- backup Vidjil's mysql dump
- code is backed up by git
- Vidjil Backup Restore Day: every year, on the second Wednesday of July
Backup restore:
- Have an ISO ready for Ubuntu server (latest LTS)
- Create a new HyperV Generation 2 virtual machine in host 60, with 8GB of RAM, WAN2 network, with enough disk space to hold the data
- Say you will install the OS later
- Add a DVD unit to the VM at Configurations pointing to the Ubuntu ISO
- Change to Microsoft UEFI certificate at Configuration/Security
- Connect to the machine and start it
- Install Ubuntu; you may have to Restart the machine a few times
- Net config:
- Subnet: 10.10.70.0/24 - Address: 10.10.70.51 (same as dev-vidjil) - Gateway: 10.10.70.1 - Name servers: 10.10.70.10, 8.8.8.8 - Search domains: (empty)
- When asked, accept ssh and docker installation
- After installation is complete, remove the DVD and restart
- Clone the Vidjil wrapper code
- Restore Docker images (docker load client & server)
- Configure .env and propagate
- Start Vidjil wrapper and test
- Restore data dir, except uploads
- Restore uploads and test
- Restore mysql dump