EBAS 3.00.08 Release Notes¶
Author: | PE/ATMOS <pe@nilu.no> |
---|
See also
Special Note¶
Release 3.00.08 is an untypical release. After V.3.00.07, a major V.3.01.00 was planned and development started as a new branch. However 3.01.00 was stuffed with too many new features and development progressed only very slow. Over time, many minor change requests were demanded urgently and development split into a post 3.00.07 agile branch where development cycles were very short and changes pushed into production without tagging and documenting a proper release.
At the end of this phase, before releasing V.3.01.00, this agile changes are retrospectively collected into a formal release with proper documentation.
Features¶
All ebas commandline programs: new selection criteria.
--diff
Especially useful for differential extract, but the functionality is available in all commandline programs.
All ebas commandline programs: new selection criteria
--datalevel
Issue Description: EWB-461Fix: svn r1472ebas_insert: added option
--skip-variables
Issue Description: EWB-451Fix: svn r1441ebas_insert: Check for all-missing, all-equal values for a variable are now ERROR instead of WARNING
Issue Description: EWB-452Fix: svn r1442 (bugfixes r1444, r1445)ebas_insert: added
identical-values
toebas_insert --ignore=identical-values
Issue Description: EWB-452Fix: svn r1442 (bugfixes r1444, r1445)ebas_insert: added possibility to automatically ignore
identical-values
for certain metadata combinationsIssue Description: EWB-469Fix: svn r1535currently defined (but may be extended anytime):
- instrument type
optical_particle_size_spectrometer
, component particle_number_size_distribution
and particle size bin >400 nm
values may all be 0.00 (no big particles measured)
- instrument type
instrument type
TEOM
and componenttemperature
values may be constant
data level
0
, instrument typesdmps
andsmps
- component
status
,temperature
,flow_rate
or particle_diameter
values may be constant
- component
component
particle_number_concentration
and size bin number >25
values may all be 0.0 (no big particles measured)
ebas_insert: Conversion on import now adds a comment to the metadata
Issue Description: EWB-454Fix: svn r1452ebas_insert / ebas_extract: Additional components which are converted on import and export:
add conversion for component
ethanal
Issue Description: EWB-453Fix: svn r1453add conversion for component
temperature
matrixmet
fromK
toC
(import only)Issue Description: EWB-465Fix: svn r1557add conversion for component
SO2
matrixair
fromnmol/mol
toug S/m3
Issue Description: EWB-466Fix: svn r1551conversion for component
ozone
: standard temperature changed from273.15 K
to293.15 K
Issue Description: EWB-449Fix: svn r1450
ebas_insert: added range check for
Volume std. temperature
andVolume std. pressure
Issue Description: EWB-467Fix: svn r1517ebas_insert: Value/flag consistency: new exceptions for auxiliary datasets
Issue Description: EWB-411Fix: svn r1446ebas_insert: all file checks can now make exceptions based on the data level. Needed for level 0 file checks - especially in ebas-submit-tool. We can now, based on data level:
- accept additional, non standard values for all master data (special
parameters only allowed in certain data levels, additional component
characteristics, etc.) E.g. component
NO_#counts
(NOxy level 0 template) orequivalent_black_carbon_loading
(filter_absorption_photometer level 0 template) - accept additional, non standard metadata elements only allowed
in certain data levels. E.g. metadata element
Duration of stay in converter or bypass line
which is only allowed in the NOxy level 0 template
Those are exceptions for checking files which are not meant to be stored in the database. The exceptions are only used for the file check routines. Those data can still not be actually stored in the database unless the exceptions are properly implemented in the database.
Issue Description: EWB-479Fix: svn r1563- accept additional, non standard values for all master data (special
parameters only allowed in certain data levels, additional component
characteristics, etc.) E.g. component
ebas_insert: NasaAmes1001: convert
no break space
automatically to normal blank in all file read operationsIssue Description: EWB-444Fix: svn r1402ebas_insert: prevent that the same instrument is used at the same time at different stations
ebas_extract: added differential extracts using
ebas_extract --diff
andebas_extract --diffxml
Issue Description: EWB-384Fix: svn r1181, r1182, r1187, r1198, r1198, r1202, r1203, r1208ebas_extract: added
--metadata_option setkey
to add ds_setkey to the metadata output.Issue Description: EWB-374Fix: svn r1164ebas_extract: new output file format
NetCDF
(prototype)Issue Description: EWB-314Fix: svn r1522ebas_list_ds: Data level is now included in the dataset list
Issue Description: EWB-460Fix: svn r1470ebas_list_ds: HFI metadata are now included in
ebas_list_ds --verbose
output (instrument manufacturer, instrument model, instrument serial number)Issue Description: EWB-476Fix: svn r1543ebas_list_ds: Submision metadata are now included in
ebas_list_ds --verbose
output (revision, submitter, originator, importer)Issue Description: EWB-477Fix: svn 1559new program ebas_plot
Bugfix:¶
All ebas commandline programs: time criteria with additional HVM and HDP critera: false positives when HVM and HDP time intervals do not overlap.
Issue Description: EWB-392Fix: svn r1181ebas_insert: bug when inserting NRT data before existing data in the data coverage with the same HFI or HVM metadata: HFI and HVM intervals are duplicated (and not aggregated as expected). When exporting those data, multiple export files are generated for the interval fragments.
Issue Description: EWB-393Fix: svn r1172ebas_insert: check metadata: length check missing for some string metadata
Issue Description: EWB-306Fix: svn r1317ebas_insert: check laboratory code
ebas_insert: detection limit and uncertainty in scientific notation does not work
Issue Description: EWB-425Fix: svn r1348, r1349ebas_insert: some PS (DO and DS) generated twice
Issue Description: EWB-432Fix: svn r1440ebas_insert: finds non-exact matching DS, but does not list them
Issue Description: EWB-439Fix: svn r1386ebas_insert: Erroneus boundary check (Missing values are wrongly rejected as below lower bound)
Issue Description: EWB-442Fix: svn r1438ebas_insert: crash when reading file without data lines
Issue Description: EWB-462Fix: svn r1476, r1481ebas_insert: crash when a newline is found inside a quoted string
Issue Description: EWB-415Fix: svn r1449ebas_insert: check sample times not in the future
Issue Description: EWB-468Fix: svn r1518ebas_insert: crash when meta data
Method ref
is missingebas_insert: file read: flags are rounded in some cases
ebas_insert: unit conversion crashes
ebas_insert: crash when using 2 different instrument types for the same instrument ref
ebas_extract: extracting NRT data: revision date sometimes older than data
Issue Description: EWB-394Fix: svn r1174, r1177ebas_extract: crashes on instrument names containing
/
(slash)Issue Description: EWB-320Fix: svn r1447ebas_extract: flag error when extracting multicolumn
Issue Description: EWB-440Fix: svn r1406ebas_extract: crash when converting units on export
ebas_extract: unit convert: problems with historic data (too little precision)
Issue Description: EWB-455Fix: svn r1451ebas_delete: crash when deleting a whole interval including project associations
Issue Description: EWB-441Fix: svn r1392ebas_delete: full delete of NRT datasets crashes
Issue Description: EWB-487Fix: svn r1602, r1603not completely fixed (workaround for now, final fix is postponed)
ebas.io: problems when reading ebas nas files with user libraries (ebas-io)
Issue Description: EWB-396Fix: svn r1279
Backported from future releases¶
ebas_extract: Format XML: gml:id is sometimes not unique