DAT171 File Management - Packing Small Files (Jan 2024)
Aperçu des sections
-
-
DAT171 File Management - Packing Small Files (Jan 2024)
Managing large amounts of data can be a challenging task. Processing large numbers of files incur heavy overhead of IO communications. This course explores several options such as using Apptainer Overlay and SQLite to pack and reduce a large number of files to few files, and hence, improving IO performance. Python scripts are used throughout the course.
Format: Virtual
Date: Mon, 15 Jan 2024 - 1:00 pmData Science Credits: 3Events:File Management - Packing Small Files - Monday, 15 January, 1:00 PM » 4:00 PM
-
-