Doubled output timestamps when automerging from multiple CSV data sources
When trying to automerge two CSV datasets, the output *smet file contains each timestamp twice, with the data from each of the CSV files in one. When trying to use this file to run SNOWPACK, MeteoI fails to parse, because "[TimeFilters.cc:552] [E] timestamp error for station "Weissfluhjoch" (WFJ2) at time 2021-10-01T00:30:00 : timestamps must be unique! (either correct your data or declare a time filter)"
Find attached a minimal example to reproduce. Execute for example: meteoio_timeseries -c io_base.ini -b 2021-10-01T00:00 -e 2021-10-01T12:00
Inspect the output file WFJ2.smet. Now you can see the doubled timestamps:
SMET 1.1 ASCII
[HEADER]
station_id = WFJ2
station_name = Weissfluhjoch
latitude = 46.829620
longitude = 9.809340
altitude = 2540.0
easting = 780852.881374
northing = 189229.088308
epsg = 21781
nodata = -999
tz = 1
plot_unit = time - - - ° m - - - W/m2 K - - - - - K - - m/s m/s -
plot_description = time - - - Wind_Direction Snow_Height - - Relative_Humidity Reflected_Short_Wave_Radiation Air_Temperature - - - - - Surface_Temperature - - Wind_Velocity Gust_Wind_Velocity -
plot_color = - - - - 0x64DD78 0x000000 - - 0x50CBDB 0x7D643A 0x8324A4 - - - - - 0xFA72B7 - - 0x297E24 0x244A22 -
plot_min = -999 -999 -999 -999 0 0 -999 -999 0 0 253.15 -999 -999 -999 -999 -999 253.15 -999 -999 0 0 -999
plot_max = -999 -999 -999 -999 360 3 -999 -999 1 1400 283.15 -999 -999 -999 -999 -999 283.15 -999 -999 30 30 -999
fields = timestamp ASWDIFD_S ASWDIR_S ATHD_S DW HS PS QV RH RSWR TA TOT_PREC TS0 TS100 TS25 TS50 TSS T_2M U_10M VW VW_MAX V_10M
[DATA]
2021-10-01T00:00:00 -999 -999 -999 -999 -999 -999 -999 -999 -999 -999 0.000 -999 -999 -999 -999 -999 -999 -999 -999 -999 -999
2021-10-01T00:00:00 -999 -999 -999 303 2.300 -999 -999 73.300 0 3.50 0.000 -0.200 2.200 0.700 1.600 0.10 -999 -999 0.5 1.5 -999
2021-10-01T01:00:00 0.000 0.000 235.070 -999 -999 76053.000 0.005 -999 -999 -999 0.000 -999 -999 -999 -999 -999 275.680 2.334 -999 -999 1.772
2021-10-01T01:00:00 -999 -999 -999 266 1.900 -999 -999 73.300 0 3.60 0.000 -0.200 2.500 1.100 1.900 -0.10 -999 -999 1.2 2.3 -999