-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
downsampled motion corrected movie #16
Comments
@saskiad This issue relates to the lack of down sampled motion corrected movie in LIMS correct? |
@saskiad is the scope of this a specific project or is it related to all projects? |
@DowntonCrabby I would like this for any project I'm involved in (VIP SSN, V1 omFISH, SSF, etc). If other people don't find it helpful, I'm not going to dictate they use it |
The down-sampled motion corrected movies aren't well known files so I don't believe there was an obligation from the technology team to keep generating them or store them in a specific location. However, the full motion corrected movies are well known files so we should (in theory) be able to easily access those. Is there any way to adapt the qc you used to do on the down sampled movies to work on the full movies? Or is the fact that they are down sampled the really integral part of how you did qc and manual review? |
The sampling rate really helps. full movies are really large and thus hard to open in a meaningful way. Regardless, there's no avi of the full movie either. |
Can you provide the lims project codes for each of these projects? That would help me look up their structure & build lims queries |
omFISHGad2Pilot |
@saskiad are you able to view the .webm downsampled motion corrected movies that are in lims? like this one, which is from a deepscope experiment: "\allen\programs\mindscope\production\omfish\prod0\specimen_1124090831\ophys_session_1131498234\ophys_experiment_1131799880\processed\1131799880_suite2p_motion_preview.webm" |
I am able to view them. They don't serve the needs that I have. |
is anything happening on this? |
I think we need more specific documentation of requirements to move forward. Some information that would help make a game plan:
|
one consideration is availability of team Pika to do the work required to change the output to .avi instead of .webm (or add an .avi in addition). Tagging @wbwakeman |
|
also, @wbwakeman may know whether there was a reason to switch to .webm instead of .avi, perhaps a file size / storage issue? i dont recall why the switch was made |
we do need to keep the 2 panel view for QC purposes though (ophys operators are using this regularly now i believe - maybe this is why we moved to webm?) so we should only add to, not replace, the current view. |
@saskiad Do you mind looking at the files here /allen/aibs/informatics/danielsf/downsampling_example I created some mp4s from an experiment whose motion correction I'm starting to doubt (it is a part of the prototype segmentation we've been working on for SSF). There are downsampled movies generated from legacy motion correction and Suite2P motion correction (you should be able to tell which is which from the file names). I used essentially the same spatial and temporal sampling routine we use to create the max projection images to create this movie. I can go into more detail if desired. I added red grid lines to help guide my eye. There are versions with and without grid lines. My questions are:
|
@saskiad @matchings Just tagging the above comment, since it came in right before the winter break and might have gotten missed. |
Pika has added a tool to our codebase to generate spatiotemporally downsampled TIFF files representing motion corrected movies AllenInstitute/ophys_etl_pipelines#433 Jun Zhuang has already verified that these artifacts fit his use case for validating motion correction. Pika has not yet made these artifacts an automatic output of our motion correction pipeline. We know that is something we need to talk about. Before we do, I would like to ask (though I'm not sure who I should be asking or where): is there any reason to continue producing the .webm videos, or are those a dead end? |
@everythingevolves is to check this out to see if this solution works or to work with @danielsf to get the proper file format |
You can see examples of these files in the subdirectories of
e.g.
(each directory corresponds to a different ophys_experiment_id associated with the SSF project) |
Yeah, the 2Hz_side_by_side_with_reticle version is what we need for this purpose. However, there is also a desire to have an easier/faster file format available (avi or webm version), because loading the tiffs when looking at many datasets is really cumbersome. |
@everythingevolves Are the current webms being produced by this pipeline sufficient, or do you want something about them changed? |
If all of the experiments will get the downsampled version of the webm file, it might be okay as is. [I believe in the past there was a non-downsampled version that took a very long time to load.] |
@everythingevolves is there an update on if the down sampled webm file is working for you? I'd like to get some clarity and closure on this ticket if possible. |
From my perspective, you can go ahead and close this ticket. |
I'm not sure this ticket should be closed yet. My interpretation of this conversation is that Pika needs to update the existing motion correction pipeline to automatically produces the 2Hz_side_by_side_with_reticle TIFFs in addition to the webm files. I've opened this ticket AllenInstitute/ophys_etl_pipelines#483 to encapsulate that work. |
Perfect, thanks! |
Is your feature request related to a problem? Please describe.
We used to have an avi of the downsampled (4Hz) motion corrected movie. This was extremely valuable for troubleshooting all sorts of issues related to motion correction, signal quality, image stability, etc. Not sure why this was removed, but not having it makes a lot of qc difficult.
Describe the solution you'd like
I'd like an avi of the downsampled motion corrected movie
The text was updated successfully, but these errors were encountered: