This repo contains JSON data in the Popolo open government data specification for elected councillors at local governments in Australia.
The data is generated using a fork of the CSV to Popolo converter which was originally created for EveryPolitician.
The data has been collected by scrapers hosted on morph.io. It has been exported from morph.io in CSV format and imported into a Google Spreadsheet to be cleaned up and updated.
To update or add to this data follow these steps:
- Make your changes in the Google Spreadsheet.
- If you don’t feel comfortable with the following steps, simply open a new issue to let us know you’ve made changes to the spreadsheet, e.g. “Snowy River Councillors waiting in the spreadsheet”.
- Run
bundleto install the Gem dependencies. - Run
bundle exec raketo pull data from the Spreadsheet into JSON files in this repository. Hint: runbundle exec rake -Tto see the state specific tasks. - Inspect the diff to verify the changes to the JSON files and check for errors before committing them. Are all the councillors you expect to see there?
- Submit a pull request with your changes with an explanation of what they are and why you have made them.
As the years come and go, so to do the people we elect as our local councillors.
When an person is no longer a councillor add the date that they left the position as their end_date.
Don't remove their record from the spreadsheet; we want to keep information about former councillors too.
When a new person becomes a councillor add a new row with all their standard details.
Set their start_date to be the date they took up the position.
Use the format yyyy-mm-dd for all dates, e.g. 2017-04-10.
It might be hard to pin-point a specific date when councillors change over after an election.
You might no be able to find an official "swearing in" date you can use, use the date after an election as the start_date and the day of the election as the end_date for outgoing councillors.
d21fb6f is an example
of the JSON generated after adding councillors and setting start and end dates in the spreadsheet.
Note that no councillors were removed from the data, just end_dates added.
The best place to find information about local councillors is the council’s official website. Most council websites have a page listing all the councillors and their information. Wikipedia can be a good source of information about the councillors’ political party, if it’s not on the council website.
The minimum information we need is the councillor’s email. Next important is the url for an image of them. Next important is their political party. The source of where you got most of the information is also important so we can go back and update or fill in details in the future. Any other information you can collect that has a collumn in the spreadsheet is wonderfut—but if you’re in a hurry just grab what’s necessary.
Remove titles, prefixes and memberships from names, such as “Dr” or “OAM”. For example “Dr Louise Hill OAM” should be listed as “Louise Hill”.
We used the following web scrapers hosted on morph.io to collect a lot of raw data to start this collection. We don’t recommend rerunning these and merging their output into the Google sheet. If you do this, then generate the JSON and try to merge the changes in here, the diff will be extremely hard to read. This makes checking the data very difficult. It’s preferable to update the councillors one-by-one, unless you can come up with a way to produce useful git diffs, or split the results into individual Pull Requests for the changes to each authority’s councillors.
- South Australian Councillors https://morph.io/equivalentideas/sa_lg_councillors
- NSW Councillors https://morph.io/equivalentideas/nsw_lg_directory_councillors
- Victorian Councillors https://morph.io/equivalentideas/vic_lg_directory_councillors
- Queensland Councillors https://morph.io/openaustralia/qld_lg_directory_councillors
- Tasmania https://morph.io/openaustralia/tas_lg_directory_councillors
- Western Australia https://morph.io/openaustralia/west_australian_local_councillors