Updating dictionaries

[theisuru]

Hi,
I tried to browse UKB showcase and find updated dictionaries (lookups). But I could only find updated dictionary for all fields (df_lkp_fields.tsv). So I am missing updated values for encoding and stats. Is it possible to update the readme file with links to these files.
Thanks

[spiros]

Hey - df_lkp_encodings.csv is basically an concatenated version of all the individual lookup files - you can easily regenerate it doing something like this:

import pandas as pd

base_url = 'http://biobank.ctsu.ox.ac.uk/crystal/scdown.cgi?fmt=txt&id='
files = [ '11', '12', '5', '6' ]

df_lkp_encodings = pd.concat(
   [ pd.read_csv(base_url+f, sep="\t", encoding="latin-1") for f in files ], sort=True
)

df_lkp_encodings['code_id'] = df_lkp_encodings['code_id'].astype('Int64')
df_lkp_encodings = df_lkp_encodings[['encoding_id', 'code_id', 'value', 'meaning', 'selectable']]
df_lkp_encodings.to_csv('df_lkp_encodings.csv', index=False)

The descriptive stats file is a bit more complicated - you need to scrape the UKB portal and then extract it from there. Happy to share the code but probably best to do this in private, could you get in touch?