Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data pre-processing #20

Open
LightA2 opened this issue Jun 1, 2023 · 1 comment
Open

Data pre-processing #20

LightA2 opened this issue Jun 1, 2023 · 1 comment

Comments

@LightA2
Copy link

LightA2 commented Jun 1, 2023

Hello, the author has the honor to communicate with you, inspired by your work, recently in the study of modal synthesis work, the process encountered some problems, I hope to get your answer!
The problem is: when one mode generates another, we need to splice the two modes together. For example, when a T1 mode generates a T2 mode, we splice the slices of the two modes together horizontally, and what happens when we need multiple modes to generate a single mode? For example, the T1 and T2 modes generate Flair modes. Do we need to splice the data of these three modes horizontally together, or is it some other processing method.
I sincerely hope to get your answer!

@onat-dalmaz
Copy link
Member

In case of task-specific models, to generate FLAIR modality from T1 and T2, first T1 and T2 images are concatenated in channel dimension. Then, networks is fed with this multi-channel input to generate a FLAIR image with only one channel.

For unified models, each modality has a specific channel in a multi-channel input/output framework. For instance:
[T1,T2,0]->network->[T1,T2,FLAIR]

I hope this addresses your inquiry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants