DMS plans to use Grafana (Credit: https://grafana.com/) to provide vibrant graphics for displayed engineering data.
DMS plans to use Grafana (Credit: https://grafana.com/) to provide vibrant graphics for displayed engineering data.
Scientists will use data from the Thirty Meter Telescope (TMT) to unlock groundbreaking discoveries and answer questions about the universe around us. These data will feature images, spectra, and more from the objects astronomers will study with the TMT, and as such, the data management system (DMS) is critical for the science of TMT to be realized. The DMS must ensure the data are safe and secure, and have all the metadata attached to the data files themselves that astronomers will use to explore the inner workings of the universe. In addition, the DMS will gather engineering data on the function of the telescope, allowing TMT engineers to explore operations and catch things before they cause trouble on the sky. On 2024 November 7–8, the TMT DMS team passed their final design review, marking the way for the development of this powerful system.
The DMS team, led by Kim Gillies (TIO software architect) and Jason Weiss (TIO senior software developer), along with experts from India TMT Coordination Center (ITCC), ThoughtWorks, and Brighton Software, has designed a system that is tuned to handle the diverse and complex datasets produced by TMT’s cutting-edge astronomical instruments. The DMS is engineered to meticulously capture, store, and organize astronomical data, ensuring every observation is enriched with essential metadata in order to maximize its usefulness to the global scientific community. This system leverages advanced data integrity features, seamless data transfers, and compliance with international data standards to provide a comprehensive solution for managing the enormous data output from TMT’s instruments. This design ensures that researchers can access and explore data with ease, unlocking new opportunities for collaboration and discovery.
One of the key achievements of the DMS is its scalable data architecture that maintains high standards of data integrity and metadata management. Moreover, the system has been built with flexibility to adapt to emerging technologies and changing data demands, making it a resilient platform for astronomical research. With a focus on correctness and reliability, the DMS integrates redundancy measures to safeguard the invaluable astronomical data gathered during operations, paving the way for future scientific breakthroughs.
The DMS team's innovative approach has positioned the system as a critical asset for the 51吃瓜Pro. Its capabilities extend beyond data storage to enable enriched data exploration and future integration with the US-ELTP archive, fostering a deeper understanding of our universe through collaborative efforts among scientists worldwide.
A panel of experts from NOIRLab, Keck Observatory, and the Canadian Astronomical Data Centre at National Research Council Canada (NRC) reviewed the final design and commended the team for their comprehensive design, while offering recommendations to further enhance integration and performance. This milestone reflects the strength of international collaboration and the dedicated efforts of all involved, setting a solid foundation for the next phase of DMS development.
DMS design team, reviewers and observers
