EventsMOL2NET'17, Conference on Molecular, Biomed., Comput. & Network Science and Engineering, 3rd ed.
Published
This submission belongs to the session 03. USEDAT-03: USA-EU Data Analysis Training Prog. Work., Cambridge, UK-Bilbao, Spain-Duluth, USA, 2017 of the event MOL2NET'17, Conference on Molecular, Biomed., Comput. & Network Science and Engineering, 3rd ed.
Published date
01 Dec, 2017
Citation
Alex Camargo, Diego Rodrigues Mengarda, Vinicius Rosa Seus, Data compression with Python: application of different algorithms with the use of threads in genome files, in Proceedings of MOL2NET'17, Conference on Molecular, Biomed., Comput. & Network Science and Engineering, 3rd ed., 15 January–15 December 2017, MDPI: Basel, Switzerland, doi: 10.3390/mol2net-03-05050
Share
Email
Facebook
Twitter
LinkedIn

Data compression with Python: application of different algorithms with the use of threads in genome files

Diego Rodrigues Mengarda 3
1. FURG
2. UFPEL
3. UNIPAMPA
Abstract

Data compression is an important resource used to deal with the increasing size of files. Many genome analysis projects are currently being developed, especially with the advent of the Human Genome Project. With the large amount of information generated through genetic sequencing as well as the need for its processing and analysis, new technologies and algorithms need to be developed frequently. This work proposes and evaluates an implementation of different algorithms of data compression using the Python programming language allied to the use of threads. As a case study it was used genomic data available from the NCBI (National Center for Biotechnology Information) public database. The results show a compression ratio of approximately 40% in the size of the files after the application of the LZW (Lempel-Ziv-Welch) algorithm, thus presenting considerable superiority over the BW (Burrows-Wheeler) algorithm.

Keywords
Data compression
Python
Genome files
Poster
mol2net- Python.pdf
Optimizing queries via search server ElasticSearch: a study applied to large volumes of genomic data
Applications of Structure Based Drug Design Approaches towards Design and Development of Calcium Channel Blockers