- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Critical Metadata for Spectroscopy Field Campaigns
摘要： A field spectroscopy metadata standard is defined as those data elements that explicitly document the spectroscopy dataset and field protocols, sampling strategies, instrument properties and environmental and logistical variables. Standards for field spectroscopy metadata affect the quality, completeness, reliability, and usability of datasets created in situ. Currently there is no standardized methodology for documentation of in situ spectroscopy data or metadata. This paper presents results of an international experiment comprising a web-based survey and expert panel evaluation that investigated critical metadata in field spectroscopy. The survey participants were a diverse group of scientists experienced in gathering spectroscopy data across a wide range of disciplines. Overall, respondents were in agreement about a core metadataset for generic campaign metadata, allowing for a prioritization of critical metadata elements to be proposed including those relating to viewing geometry, location, general target and sampling properties, illumination, instrument properties, reference standards, calibration, hyperspectral signal properties, atmospheric conditions, and general project details. Consensus was greatest among individual expert groups in specific application domains. The results allow the identification of a core set of metadata fields that enforce long term data storage and serve as a foundation for a metadata standard. This paper is part one in a series about the core elements of a robust and flexible field spectroscopy metadata standard.
关键词： field spectroscopy,data quality,metadata,databases
更新于2025-09-23 15:22:29
-
[IEEE 2019 IEEE 46th Photovoltaic Specialists Conference (PVSC) - Chicago, IL, USA (2019.6.16-2019.6.21)] 2019 IEEE 46th Photovoltaic Specialists Conference (PVSC) - Data-integrity Checks and Balances in Monitoring of a Solar PV System
摘要： This paper proposes to perform certain integrity checks and balances to omit the wrong data in the monitoring of a solar PV plant. Further, these checks and balances are segregated into three types: basic, specific, and pattern checks. The former is performed on the data collected from all the types of sensors. However, the second check is performed on the data collected from the specific instruments. These checks are specific to the site, instrument, parameter, etc. The third check verifies the shape of profiles between the data of different sections of the PV system. For the data-inclusion/deletion purpose, the parameters of PV plant are segregated into a triangle-hierarchy of highest-least priority. Some of the proposed checks are performed on the raw data collected from a grid-tied 271 kW PV plant and 6.4 kW test PV plant. The results have indeed identified some of the bad data and validated the proposed checks.
关键词： photovoltaic (PV),PV plant health monitoring,data quality,data integrity,PV plant data,maximum power point tracking (MPPT)
更新于2025-09-23 15:21:01
-
Development of a coupled aerosol lidar data quality assurance and control scheme with Monte Carlo analysis and bilateral filtering
摘要： Mie-scatter lidar can capture the vertical distribution of aerosols, and a high degree of quantification of lidar data would be capable of coupling with a chemical transport model (CTM). Thus, we develop a data quality assurance and control scheme for aerosol lidar (TRANSFER) that mainly includes a Monte Carlo uncertainty analysis (MCA) and bilateral filtering (BF). The AErosol RObotic NETwork (AERONET) aerosol optical depth (AOD) is utilized as the ground truth to evaluate the validity of TRANSFER, and the result exhibits a sharp 41% (0.36) decrease in root mean square error (RMSE), elucidating an acceptable overall performance of TRANSFER. The maximum removal of uncertainties appears in MCA with an RMSE of 0.08 km-1, followed by denoising (DN) with 50% of MCA in RMSE. BF can smooth interior data without destroying the edge of the structure. The most noteworthy correction occurs in summer with an RMSE of 0.15 km-1 and Pearson correlation coefficient of 0.8, and the least correction occurs in winter with values of 0.07 km-1 and 0.93, respectively. Overestimations of raw data are mostly identified, and representative values occur with weak southerly winds, low visibility, high relative humidity (RH) and high concentrations of both ground fine particulate matter (PM2.5) and ozone. Apart from long-term variations, the intuitional variation in a typical overestimated pollution episode, especially represented by vertical profiles, shows a favorable performance of TRANSFER during stages of transport and local accumulation, as verified by backward trajectories. Few underestimation cases are mainly attributed to BF smoothing data with a sudden decrease. The main limitation of TRANSFER is the zigzag profiles found in a few cases with very small extinction coefficients. As a supplement to the research community of aerosol lidar and an exploration under complicated pollution in China, TRANSFER can aid in the preprocessing of lidar data-powered applications.
关键词： Aerosol Lidar,Bilateral filtering,North China Plain,Monte Carlo,data quality control
更新于2025-09-23 15:19:57
-
[IEEE 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC) - Munich, Germany (2019.6.23-2019.6.27)] 2019 Conference on Lasers and Electro-Optics Europe & European Quantum Electronics Conference (CLEO/Europe-EQEC) - Generating Quantum States of Surface Plasmon-Polariton Pairs with a Nonlinear Nanoparticle
摘要： The use of freely available online data is rapidly increasing, as companies have detected the possibilities and the value of these data in their businesses. In particular, data from social media are seen as interesting as they can, when properly treated, assist in achieving customer insight into business decision making. However, the unstructured and uncertain nature of this kind of big data presents a new kind of challenge: how to evaluate the quality of data and manage the value of data within a big data architecture? This paper contributes to addressing this challenge by introducing a new architectural solution to evaluate and manage the quality of social media data in each processing phase of the big data pipeline. The proposed solution improves business decision making by providing real-time, validated data for the user. The solution is validated with an industrial case example, in which the customer insight is extracted from social media data in order to determine the customer satisfaction regarding the quality of a product.
关键词： metadata,big data,Architecture,quality of data,quality attribute
更新于2025-09-19 17:13:59
-
[IEEE 2020 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus) - St. Petersburg and Moscow, Russia (2020.1.27-2020.1.30)] 2020 IEEE Conference of Russian Young Researchers in Electrical and Electronic Engineering (EIConRus) - Real-Time Measurement of Biological Tissue Thermal Diffusivity During Laser Welding
摘要： Recently, there has been a renovated interest in functional dependencies due to the possibility of employing them in several advanced database operations, such as data cleaning, query relaxation, record matching, and so forth. In particular, the constraints defined for canonical functional dependencies have been relaxed to capture inconsistencies in real data, patterns of semantically related data, or semantic relationships in complex data types. In this paper, we have surveyed 35 of such functional dependencies, providing a classification criteria, motivating examples, and a systematic analysis of them.
关键词： data quality,Functional dependencies,approximate match,axiomatization
更新于2025-09-19 17:13:59
-
[IEEE 2019 18th International Conference on Optical Communications and Networks (ICOCN) - Huangshan, China (2019.8.5-2019.8.8)] 2019 18th International Conference on Optical Communications and Networks (ICOCN) - Design and Implementation of Communication Data Quality Analysis Software System
摘要： This paper mainly introduces the design method of communication data quality analysis software based on Linux system, and implements the software under Qt environment. The software can automatically analyze the communication data generated by the ocean-going survey ship. It can automatically check the abnormal situation of communication data (including re-frame and the abnormal situation frame according to the content transcribed by users' needs. It can also provide the drawing function of specified format data and the auxiliary function of data analysis. The application results show that the data quality analysis software system can meet the daily use needs, greatly reduce the time of manual data analysis and improve the accuracy of the results.
关键词： Communication data,automatic analysis,Linux system,data quality
更新于2025-09-16 10:30:52
-
The progress of laser ranging technology at Shanghai Astronomical Observatory
摘要： As an important station of International Laser Ranging Service (ILRS), Shanghai Astronomical Observatory (SHAO) has upgraded Satellite Laser Ranging (SLR) system with high repetition rate and achieved some technological progress. There are a lot of improvements for overall system performance, such as annual observation passes, measurement precision and quality of observation data. SLR technology with repetition rate of 10 kHz is accomplished ?rstly in China, and space debris laser ranging technology with 200 Hz laser is promoted and proved to be more detective for weak echo, which lead to successful measurement for 40,000 km satellites and space debris within 3000 km. At the same time, SLR based on multi-telescopes and 1064 nm wavelength are planned to make a breakthrough of detection capabilities, and also to expand its application ?elds. These progresses will be introduced in this paper in detail.
关键词： Detection capability,Satellite laser ranging,Space debris,Data quality
更新于2025-09-12 10:27:22
-
PHOTOMETRIC ANALYSIS OF PI OF THE SKY DATA
摘要： Pi of the Sky is a system of two wide ?eld of view robotic telescopes, which search for short timescale astrophysical phenomena, especially for prompt optical GRB emissions. The system was designed for autonomous operation, monitoring a large fraction of the sky with 12m–13m range and time resolution of the order of 1–10 seconds. Two fully automatic Pi of the Sky detectors located in Spain (INTA — INTA El Arenosillo Test Centre in Mazagón, near Huelva.) and Chile (SPDA — San Pedro de Atacama Observatory.) have been observing the sky almost every night in search of rare optical phenomena. They also collect a lot of useful observations which include e.g. many kinds of variable stars. To be able to draw proper conclusions from the data received, adequate quality of the data is very important. Pi of the Sky data is subject to systematic errors caused by various factors, such as cloud cover, seen as signi?cant ?uctuations in the number of stars observed by the detector, problems with conducting mounting, a strong background of the moon or the passing of a bright object, e.g., a planet, near the observed star. Some of these adverse e?ects have already been detected during the cataloging of individual measurements, but the quality of our data was still not satisfactory for us. In order to improve the quality of our data, we have developed two new procedures based on two di?erent approaches. In this article we will report on these procedures, give some examples, and we will show how these procedures improve the quality of our data[1].
关键词： variable stars,photometry,data quality,robotic telescopes,astrometry,photometric corrections,Gamma Ray Burst (GRB)
更新于2025-09-04 15:30:14