ncas-ceilometer-3-software

Campbell Scientific CS135 : https://www.campbellsci.com/cs135

Code for creating AMOF-compliant netCDF files for ncas-ceilometer-3 instrument.

Requirements

• python 3.8-3.12
• modules:
  • numpy
  • pandas
  • datetime
  • netCDF4
  • csv
  • ncas_amof_netcdf_template > 2.4.0

Installation

Clone the git repo

git clone https://github.com/ncasuk/ncas-ceilometer-3-software.git

Install required modules using conda install --file requirements.txt or pip install -r requirements.txt

Usage

python process_ceilometer.py /path/to/datafile.csv -m metadata.csv

where metadata.csv includes additional metadata for the netCDF file.

Additional flags that can be given for each python script:

• -o or --ncfile-location - where to write the netCDF files to. If not given, default is '.'
• -v or --verbose - print additional information as the script runs

A description of all the available options can be obtained using the -h flag, for example

python process_ceilometer.py -h

BASH scripts

Three scripts are provided for easy use:

• make_netcdf.sh - makes netCDF file for a given date: ./make_netcdf.sh YYYYmmdd
• make_today_netcdf.sh - makes netCDF file for today's data: ./make_today_netcdf.sh
• make_yesterday_netcdf.sh - makes netCDF file for yesterday's data: ./make_yesterday_netcdf.sh

Within make_netcdf.sh, the following may need adjusting:

• netcdf_path="/gws/...": replace file path with where to write netCDF files.
• datapath="/gws/...": replace file path with path to data.
• metadata_file="${SCRIPT_DIR}/../metadata.csv: replace if using different metadata file.
• logfilepath=/home...: replace with path of where to write logs

Further Information

• read_ceilometer.py contains the code that actually reads the raw data. This is called from within process_ceilometer.py
• No quality control is currently done on the raw data.
• See ncas_amof_netcdf_template for more information on how the netCDF file is created, and the additional useful functions it contains.