LiberTEM/LiberTEM: 0.6.0
Zenodo (CERN European Organization for Nuclear Research)
Abstract
Homepage: https://libertem.github.io/LiberTEM/ GitHub repository: https://github.com/LiberTEM/LiberTEM/ PyPI: https://pypi.org/project/libertem/ LiberTEM is an open source platform for high-throughput distributed processing of large-scale binary data sets using a simplified MapReduce programming model. The current focus is pixelated scanning transmission electron microscopy (STEM) and scanning electron beam diffraction data. It is designed for high throughput and scalability on PCs, single server nodes, clusters and cloud services. On clusters it can use fast distributed local storage on high-performance SSDs. That way it achieves very high aggregate IO performance on a compact and cost-efficient system built from stock components. All CPU cores and CUDA devices in a system can be used in parallel. LiberTEM is supported on Linux, Mac OS X and Windows. Other platforms that allow installation of Python 3.6+ and the required packages will likely work as well. The GUI is running in a web browser. Installation The short version: $ virtualenv -p python3 ~/libertem-venv/ $ source ~/libertem-venv/bin/activate (libertem) $ python -m pip install "libertem[torch]" # optional for GPU support (libertem) $ python -m pip install cupy Please see our documentation for details! Deployment as a single-node system for a local user is thoroughly tested and can be considered stable. Deployment on a cluster is experimental and still requires some additional work, see Issue #105. Applications Virtual detectors (virtual bright field, virtual HAADF, center of mass , custom shapes via masks) Analysis of amorphous materials Strain mapping Custom analysis functions (user-defined functions) Off-axis electron holography reconstruction Please see the applications section of our documentation for details! The Python API and user-defined functions (UDFs) can be used for more complex operations with arbitrary masks and other features like data export. There are example Jupyter notebooks available in the examples directory. If you are having trouble running the examples, please let us know, either by filing an issue or by joining our Gitter chat. LiberTEM is suitable as a high-performance processing backend for other applications, including live data streams. Contact us if you are interested! LiberTEM is evolving rapidly and prioritizes features following user demand and contributions. In the future we'd like to implement live acquisition, and more analysis methods for all applications of pixelated STEM and other large-scale detector data. If you like to influence the direction this project is taking, or if you'd like to contribute, please join our gitter chat and our general mailing list. File formats LiberTEM currently opens most file formats used for pixelated STEM. See our general information on loading data and format-specific documentation for more information! Raw binary files Thermo Fisher EMPAD detector files Quantum Detectors MIB format Nanomegas .blo block files Direct Electron DE5 files (HDF5-based) and Norpix SEQ files for DE-Series detectors Gatan K2 IS raw format Stacks of Gatan DM3 and DM4 files (via openNCEM) FRMS6 from PNDetector pnCCD cameras (currently alpha, gain correction still needs UI changes) FEI SER files (via openNCEM) MRC (via openNCEM) HDF5-based formats such as Hyperspy files, NeXus and EMD Please contact us if you are interested in support for an additional format! License LiberTEM is licensed under GPLv3. The I/O parts are also available under the MIT license, please see LICENSE files in the subdirectories for details.
Authors 20
-
Forschungszentrum Jülich · Ernst Ruska Centre
Affiliation as printed
Jülich Research Centre, Ernst Ruska Centre
-
Forschungszentrum Jülich · Ernst Ruska Centre
Affiliation as printed
Jülich Research Centre, Ernst Ruska Centre
-
Forschungszentrum Jülich · Ernst Ruska Centre
Affiliation as printed
Jülich Research Centre, Ernst Ruska Centre
-
Forschungszentrum Jülich · Ernst Ruska Centre · RWTH Aachen University
Affiliation as printed
RWTH Aachen University, Jülich Research Centre, Ernst Ruska Centre
-
Affiliation as printed
Government Engineering College Sreekrishnapuram
-
Affiliation as printed
Government Engineering College Sreekrishnapuram
-
Forschungszentrum Jülich · Ernst Ruska Centre
Affiliation as printed
Jülich Research Centre, Ernst Ruska Centre
-
Affiliation as printed
Chandigarh University
-
Affiliation as printed
Siliguri Institute of Technology
-
Affiliation as printed
Jadavpur University
-
University of Illinois Urbana-Champaign
Affiliation as printed
University of Illinois at Urbana-Champaign
-
Direct Electron (United States)
Affiliation as printed
Direct Electron
-
Affiliation as printed
University of Antwerp
-
Lawrence Berkeley National Laboratory
Affiliation as printed
Lawrence Berkeley National Laboratory
-
Affiliation as printed
Monash University eResearch Centre
-
Affiliation as printed
ETH Zürich
-
Affiliation as printed
Columbia University
-
Forschungszentrum Jülich · Ernst Ruska Centre
Affiliation as printed
Jülich Research Centre, Ernst Ruska Centre
-
Forschungszentrum Jülich · Ernst Ruska Centre
Affiliation as printed
Jülich Research Centre, Ernst Ruska Centre
Cited by 0 stored of 0
No patents citing this paper on Lens.org (checked 2026-10-06).