ATSS

atss is a stream ats file (the successor of the old data format of metronix since 1998, “advanced time series”).

An .atss file contains a stream of IEEE 754 double numbers. That is the default format on most computers and is also the default format of C/C++, Python numpy and Matlab. A double is always 64bit.

The doubles representing units as given in the header, e.g. mV/km for electric field and mV for the magnetic.

JSON

RFC 8259 and ECMA-404 European Computer Manufacturers Association specified JSON format is an UTF-8 encoded text file, used for describing the contents of the stream.

Directory Tree

The directory tree HDF5 is the same as in the MTH5 survey.

Filename

The run number is obtained from the parent directory.

The filename (and run number) are split by underscores “_”.

nnnSystem_SystemName_ChannelNo_TypeOfData_SamplingRate .atss or .json

As a limitation you can NOT provide names with underscores or spaces like “ADU _ 08e”.

run_001/084_ADU-08e_C02_THx_2s.atss … the binary data stream
run_001/084_ADU-08e_C02_THx_2s.json … the JSON header
run_002/084_ADU-08e_C02_THx_1024Hz.atss … the binary data stream
run_002/084_ADU-08e_C02_THx_1024Hz.json … the JSON header

additional there may appear atmm mask files:

run_001/084_ADU-08e_C02_THx_2s.atmm … the mask file
run_002/084_ADU-08e_C02_THx_1024Hz.atmm … the mask file

File Entries

serial number > 0
System Name (without space and underscore)
C NN channel number >= 0
T channel Type
Sample Rate with Unit (can be a double); Units: Hz and s

Entries

datetime: ISO 8601, UTC time the stream started, can contain fractions of seconds like 13:22:01.5
latitude: ISO 6709, North latitude is positive, decimal fractions
longitude: ISO 6709, East longitude is positive, decimal fractions
elevation: in meter, e.g. WGS84 referenced
angle: North to East of the measured direction; 0 = North, 90 = East
dip: positive downwards; 0 = horizontal, 90 positive down
units: text string, e.g. mV/km or mV
source: text string, e.g. empty or CSAMT
sensor: name of sensor like EFP-06, MFS-06e and so on
serial: positive number
chopper: 1 chopper is on, 0 chopper is off or nothing
units_frequency: Hz in Hertz, do not use other units
units_amplitude: mV, should be mV since the timeseries are in mV by default
units_phase: degrees
datetime: date of calibration, use “1970-01-01T00:00:00” when unknown
Operator: person or institute carried out the calibration
f: []: frequency data
a: []: amplitude data
p: []: phase data

… and where are stop date & samples ???

It is the common and fatal mistake in programming to have redundant information. $$samples == file \ size \ [bytes] \big/ 8$$stop date == \frac{samples}{sample \ rate} + datetime == \frac{file \ size \ [bytes]}{8 \cdot sample \ rate} + datetime$$

It is obvious that the system can write (append) data to the stream without touching the JSON header: a stream has not stop date, he exists as long recorded.

When the system splits the recording into (for example) hourly segments you simply concatenate the streams and use the first header for the newly assembled stream. Hence that the system writes scaled data, so mV/km for the electric field, and therefore the even the electric field can be concatenated.

Header

For the electric field without calibration the entries for f, a, p are there but empty.

{
"datetime": "2009-08-20T13:22:01",
"latitude": 39.026196666666664,
"longitude": 29.123953333333333,
"elevation": 1088.31,
"angle": 0.0,
"dip": 0.0,
"units": "mV/km",
"source": "",
"sensor_calibration": {
   "sensor": "EFP-06",
   "serial": 0,
   "chopper": 1,
   "units_frequency": "Hz",
   "units_amplitude": "mV",
   "units_phase": "degrees",
   "datetime": "1970-01-01T00:00:00",
   "Operator": "",
   "f": [],
   "a": [],
   "p": []
}
}

For a magnetic file with calibration:

{
"datetime": "2009-08-20T13:22:01",
"latitude": 39.026196666666664,
"longitude": 29.123953333333333,
"elevation": 1088.31,
"angle": 0.0,
"dip": 0.0,
"units": "mV",
"source": "",
"sensor_calibration": {
   "sensor": "MFS-06",
   "serial": 26,
   "chopper": 1,
   "units_frequency": "Hz",
   "units_amplitude": "mV/nT",
   "units_phase": "degrees",
   "datetime": "2006-12-01T11:23:02",
   "Operator": "",
   "f": [
1,
12589,
15849,
19953,
25119,
31623,
39811,
50119,
63095,
7943,
0,
2589,
5849,
9952,
5119,
1623,
981,
0118,
3095,
943,
0,
589,
849,
952,
119,
622,
81,
118,
095,
43,
0,
89,
49,
52,
18,
22,
1,
18,
94,
3,
0,
9,
9,
2,
8,
2,
0,
7,
4,
0,
5,
0
   ],
   "a": [
027,
170446600000002,
751886599999995,
8980188,
2405119,
1068588,
1203814,
68167910000001,
92179050000001,
881375,
79,
38148599999997,
517428,
03384,
38418599999994,
8373230000001,
0156400000001,
796948,
87121,
25092,
36,
780202,
1669499999999,
35048,
9452370000001,
0455119999999,
89826,
714604,
0397399999999,
81946,
9499999999999,
0288859999999,
17062,
8659359999999,
044708,
75719,
7532699999999,
6368520000001,
862444,
03532,
2,
477653,
814452,
637616,
636084,
12518,
46645,
542651,
601532,
911412,
094144,
0699999999999
   ],
   "p": [
566,
187,
711,
177,
459,
487,
447,
992,
233,
055,
345,
954,
03,
201,
69,
571,
212,
399,
074,
567,
507,
198,
529,
635,
0507,
133,
5026,
6917,
2486,
2856,
3903,
8116,
21197,
      -0.5109,
      -1.217,
      -2.3402,
      -2.8624,
      -3.7097,
      -4.8118,
      -6.1635,
      -7.8127,
      -9.8044,
      -12.075,
      -14.807,
      -23.519,
      -27.61,
      -34.118,
      -40.321,
      -36.267,
      -40.999,
      -51.017,
      -51.019
   ]
}
}

ATMM

Files ending with .atmm contain a vector of boolean. In the software this is realized using a char or uint8_t. As a consequence the size of the vector<char> contains samples/8 chars (in case it fits) or (samples/8 + 1) chars else.

The implementation returns true in case the sample is excluded from processing.

You use .atmm files for excluding data from processing; this is the case when a cable was chopped. You also can use it to mask spikes.