Unique Count

Count unique sequences present in FASTQ files

Supports FASTQ and FASTQ.GZ files

Unique Count

Function

Unique Count identifies and counts distinct nucleotide sequences present in FASTQ files. It helps estimate sequence diversity and detect redundancy within sequencing datasets.


Input Format

  • FASTQ files (.fastq)
  • Compressed FASTQ files (.fastq.gz)
  • Multiple files may be uploaded simultaneously.

Output Format

  • Total number of unique sequences.
  • Summary of sequence diversity.

Applications

  • Library complexity assessment.
  • Duplicate read detection.
  • Sequencing quality control.
  • Non-redundant dataset generation.
  • Sample comparison across sequencing runs.

Example Usage

Count unique sequences in a FASTQ file:

awk 'NR%4==2' input.fastq | sort -u | wc -l

For compressed FASTQ files:

zcat input.fastq.gz | awk 'NR%4==2' | sort -u | wc -l

Using SeqKit:

seqkit stats input.fastq.gz

seqkit rmdup -s input.fastq.gz \
-o unique.fastq.gz

Suggested Reading


Important Notes:
  • Unique counting is based on sequence content only.
  • Read IDs and quality scores are ignored.
  • Identical sequences with different identifiers are counted once.
  • Very large datasets may require substantial memory for sorting-based approaches.
  • Dedicated tools such as SeqKit are recommended for large-scale analyses.