OVERVIEW

1 What is Snakedali?

Snakedali is the Snakemake implementation of the multithreaded version of DaliLite v5 to align PDB queries to a pre-built Alphafold database. It is designed to function on HPCs (High-Performance Clusters) and is specifically tailored to work with the SGE workload manager out-of-the-box. It introduces automated input handling and a unified report that aggregates all queries and hits in a single .xlsx.

2 Citation

Yoon, P.H., Zhang, Z., Loi, K.J., Adler, B.A., Lahiri, A., Vohra, K., Shi, H., Rabelo, D.B., Trinidad, M., Boger, R.S. and Al-Shimary, M.J., 2024. Structure-guided discovery of ancestral CRISPR-Cas13 ribonucleases. Science, p.eadq0553.

GETTING STARTED

3 Dependencies

3.1 Anaconda

• Install Miniconda:

• Download the installer at: https://docs.conda.io/projects/miniconda/en/latest/

  bash Miniconda3-latest-<your-OS>.sh
  

• Set up and update conda:

  conda update --all
  conda config --set channel_priority strict
  

3.2 Snakemake

• Snakemake can be installed directly via Anaconda:

  conda install -n base -c conda-forge mamba
  

3.3 DaliLite v5
• Snakedali requires a valid installation of DaliLite v5
• Snakedali defaults to the parallelized implementation of DaliLite

wget http://ekhidna2.biocenter.helsinki.fi/dali/DaliLite.v5.tar.gz
tar -zxvf DaliLite.v5.tar.gz
cd /home/you/DaliLite.v5/bin
make clean
make parallel

• Future updates are planned to include a non-parallel version of Snakedali
• More details on how to acquire the program can be found on the software's page:
  • http://ekhidna2.biocenter.helsinki.fi/dali/README.v5.html#install
3.4 AWS CLI
• Install the AWS CLI to download the snakedali database directly from the command-line interface
• A comprehensive guide on the installation is provided at the AWS page:
• Prerequisites: https://docs.aws.amazon.com/cli/latest/userguide/getting-started-prereqs.html
• Installation Guide: https://docs.aws.amazon.com/cli/latest/userguide/getting-started-install.html

4 Installation

4.1 Database Download

- With AWS CLI installed (see Section 3.4) - Download the pre-built database:

aws s3 cp s3://snakedali.db/pdb_files_DAT.tar.gz <your_local_path>
tar zxf <your_local_path>/pdb_files_DAT.tar.gz

4.2 Standard Git

• Clone repository files

git clone --depth=1 https://github.com/Doudna-lab/nidali.git

4.3 Apptainer SIF

• One singularity/apptainer container is provided for this repository

• This is a workaround to avoid common problems with the import.pl module from Dalilite.

• The user can then download them from google drive:

• Linux Install:

cd snakedali
wget https://drive.google.com/drive/folders/117NRrL1iJ4lb_V3tBZzqC79lvkJvE9cS?usp=drive_link

5 Snakedali Pipeline Setup

5.1 Run Configuration
• Each Snakedali run can be customized based on the configuration file: config/dali_template.yaml
• This file can be replicated, and each subsequent modified yaml file is associated with one Snakedali run.
• From the configuration file users are expected to set up:
  • In-/Output paths for the run
  • pre-built database path
  • query name(s)
  • default DaliLite v5 binary folder path
5.2 Create Environments

• Some steps of Snakedali rely on Anaconda environments.

• Because some HPCs might not be compatible with Anaconda, we implement the conda environments directly on the Snakemake shell.

• To do that, first we create the conda environments:

  conda env create -f envs/biopympi.yaml

5.3 Snakemake Profile

• Snakedali was designed to work with (Sun Grid Engine) SGE job scheduler

• The Snakemake profile can be modified to accommodate other schedulers: /profile/config.yaml

• The default profile includes:

  • cluster job submission: qsub -l h_rt={cluster.time} -j y -pe smp 4 -cwd
  • cluster config path: config/cluster.yaml
  • rerun triggers: mtime
  • n jobs limit: 600
  • latency-wait: 120
  • reason: True
  • rerun-incomplete: True
  • show-failed-logs: True
  • keep-going: True
  • printshellcmds: True
  • jobname: {rule}.{jobid}
  • jobs: 600

• Make sure to adjust the parameters above according to the house rules of your HPC.

6 Run Snakedali

• Once the necessary inputs have been set up in the configuration file, Snakedali shall be called as in:

snakemake --snakefile snakedali_align.smk --configfile config/dali_template.yaml --profile profile_sge/

7 DALI + TCOFFEE Integration

- The DALI + TCOFFEE workflow is broken down into two parts. - 1. The first script, dali_out_to_fasta.py is a python script that takes in a DALI.txt output (that is, the search results for a DALI query against a database in DALI alignment format) and converts them into individual pariwise alignment files in FASTA format. - 2. The second script is a wrapper that calls on the first script to take in an entire directory of DALI.txt output files to convert them into directories with FASTA format alignments. This script then calls TCOFFEE to merge the FASTA format alignments into multiple sequence alignments. One alignment is generated per DALI.txt output (that is, one DALI query searched against a database) such that there is an alignment generated for every single query. The script invokes TCOFFEE one more time to merge all such alignments into one final multiple-sequence alignment.