Data Servers Processing and Handling

Data Servers Processing and Handling
Data Servers Processing and Handling
Algorithms, Data Management, Routers, Servers, Storage
Synchronization, Archival, Validation, and IP Exchange (Save)
Save is a high-availability framework that manages IP addresses shared between multiple servers. It also monitors the health of those servers to determine which one should be actively servicing requests at any given time. Synchronization mechanisms allow configuration files to be kept consistent between systems and also allow commands to be executed across all servers of a particular type. Archival mechanisms provide automatic version control of configuration files to aid in recovery in case of errant configuration.
Open Source
Perl 6 DBPg PostgreSQL module
PostgreSQL ( is an Open Source Relational Database Management System (RDBMS). It includes a C library (libpq) for interacting with the server over the network ( This module provides a rich interface to the PostgreSQL libpq library for Perl 6. It includes capabilities for prepared query caching, database connection caching, exception handling, flexible type conversion (including Boolean, Date, DateTime, Byte Arrays, etc. as well as custom types), bulk data copy in and out, listen/notify, transactions, and cursors for large query processing.
Open Source
Heat Analysis Manager (HAM), a Thermal Desktop API Based Heat Map Generation Software
Thermal engineers often create custom heat maps to analyze their thermal models. However, generating a heat map is difficult because thermal simulations only readily provide certain attributes of simulated nodes, such as temperature, capacitance, and heat generation, along with a network of conductances. Heat flow values are quantities derived from these nodal attributes, and the difficulty in data processing and management of heat flow between nodes quickly grows as node count increases for large models. Deriving a network of heat flow values requires a vast amount of calculations and data handling, and the heat map generation process generally suffers from processing speed, loss of accuracy, and/or presentation of data in a clear and concise format. Heat Analysis Manager (HAM) is a Thermal Desktop (TD) based free multi-purpose tool developed to aid thermal engineers in analyzing thermal models which includes a heat map generation utility. HAMs heat map generator retains accuracy and fast processing speed by utilizing TDs application programming interface (API) and TDs built-in post-processor routine Qflow from Results. Furthermore, HAMs heat map output is presented in an easily customizable format in Excel, allowing users to create various custom visual heat maps. A full description of how HAM utilizes TDs API to create a customizable heat map is provided. A simple model demonstration is included along with step-by-step procedures for creating custom heat maps. HAMs heat map output has been verified against TD and other heat map generation software, and the verification methods used are shown.
U.S. Release Only
GeneLab Amplicon and Metagenomics Data Processing Pipelines
This technology details each step in GeneLab's standard pipelines for processing Amplicon and Metagenomics sequence data. These processing protocols have been wrapped into Snakemake workflows that utilize Conda environments. Instructions for installing and implementing these Snakemake workflows are included along with example processed datasets.
Open Source
CODE-A Software Framework For Control and Observation In Distributed Environments
CODE is a framework for the control and observation of resources, services, and applications. The technology supports the secure and scalable transmission of observed information to other programs, and it enables the secure execution of actions on remote computer systems.
Open Source
Earth Observing System (EOS) Data Gateway (EDG)
The Earth Observing System Data Gateway (EDG) provides the earth science community with a single interface that will search for data granules from distributed data archives. The innovation enables users to explore, discover, and order available data from geographically distributed providers. For more information, please visit:
Open Source
NASA Vision Workbench (VW), Version 3
Vision Workbench (VW) is a modular, extensible computer vision framework that supports a range of tasks, including automated science and engineering analysis, large satellite image processing, and 2D/3D environment reconstruction. The framework provides a rapid C development environment as well as a flexible, multi-platform system to deploy computer vision applications. The module interface allows new capabilities to be rapidly integrated, and the dataflow architecture allows image-processing pipelines to be quickly developed and reconfigured.
Open Source
Ballast: Balancing Load Across Systems
Ballast is a tool for balancing user load across Secure Shell Handler (SSH) servers. The system includes a load-balancing client, a lightweight data server, scripts for collecting system load, and scripts for analyzing user behavior. Because Ballast is invoked as part of the SSH login process, it has access to user names. This capability, which is not available in traditional approaches, enables Ballast to perform user-specific load balancing. In addition, Ballast is easy to install, induces near-zero overhead, and has fault-tolerant features in its architectures that will eliminate single points of failure.
Open Source
The NASA UNIX Tool Kit contains three components that all work together to form a single technology for UNIX administration: (1) Secure, Web-Based UNIX System Administration Tools (KSC-12269) ease the administration of a large, distributed UNIX system, providing a secure mechanism for creating, modifying, locking, and deleting users. (2) The second component of the software kit is the Client/Server to Create, Modify, and Query VERITAS File System Quotas on an NFS-Mounted File System with a Secure Web-Based Interface (KSC-12268). In this technology, the client (which exists on an internal secure platform with a secure interface) can be accessed from any authorized platform capable of running a Web browser. The server software exists on a UNIX platform configured with the VERITAS file system. (3) The Web-Based IP Address Tool (KSC-12271) provides an easy-to-use system for maintaining IP address information for a network of computers.
U.S. Release Only
View more software
Stay up to date, follow NASA's Technology Transfer Program on:
facebook twitter linkedin youtube
Facebook Logo Twitter Logo Linkedin Logo Youtube Logo