rucio-dataset-mon-go

command module

v0.0.0-...-21bfe33 Latest Latest Go to latest Published: Aug 5, 2022 License: MIT Imports: 12 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/dmwm/CMSMonitoring

README ¶

rucio-dataset-mon-go package

The rucio-dataset-mon-go package serves Rucio aggregated data, imported to MongoDB, using JQuery datatables.

Package development is in still progress. You may see test page from : rocket: here 🚀 , beware that some functionalities not there yet.

Docs

Bug Report & Contribution

Please open GitHub issue

References

Special Thanks

Special thanks to Valentin for his suggestions, reviews and guidance.
Many thanks to Danilo Piparo for bringing up the idea of this project

Documentation ¶

Overview ¶

Package main

Rucio dataset monitoring using aggregated Spark data ¶

What is this

Main aim of the project is to show all Rucio dataset information in a web page with required functionalities

What is used

DataTables: very popular JQuery library to show pretty tables with nice UI and search/query functionalities
MongoDB: used to store following data in separate collections
            - aggregated Rucio datasets results,
            - detailed dataset results,
            - short url hash_id:request binding
            - data source timestamp
         multiple MongoDB indexes are created to use full performance of it
JQuery/JS: to manipulate and customize DataTables, JQuery and JS used

What Go service provide

`gin-gonic` web framework is used to both
    - MongoDB APIs, see `routes.main_router`
    - serve html pages using Go templates

Main page functionalities

Main page provides
    - Sort
    - Detailed RSE functionality: green "+" button
    - Paging
    - Count of search result
    - Search using SearchBuilder conditions: "Add condition". Even though SB allows nested conditions, now it supports depth=1
    - Buttons:copy, excel,PDF,column visibility
    - Short URL: which is the advanced functionality of this service. Please see its documentation for more details.

Source Files ¶

View all Source files

main.go

Directories ¶

Path	Synopsis
controllers Package controllers contains all get functions of controllers	Package controllers contains all get functions of controllers
models
mongo
routes
search_builder
short_url Package short_url This controller creates short url using incoming request's MD5 hash and MongoDB collection to store hash and request match	Package short_url This controller creates short url using incoming request's MD5 hash and MongoDB collection to store hash and request match
utils

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL