Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: adding mplugdocowl #31059

Draft
wants to merge 55 commits into
base: main
Choose a base branch
from
Draft

feat: adding mplugdocowl #31059

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
b311e5e
feat: adding mplugdocowl
danaaubakirova May 27, 2024
aa0ec04
feat: added separate file for the mPLUGDocOwl language model
danaaubakirova May 27, 2024
cc7e9b3
feat: added vision encoder for mplugdocowl
danaaubakirova May 27, 2024
204daba
fix: changed the attention mechanism in clip vision, renamed to MPLUG…
danaaubakirova May 28, 2024
6e144e5
feat: added hreducer and new things in config, changed vision embeddi…
danaaubakirova May 28, 2024
9f94d2c
fix: converted hreducer module related tensors to contiguous
danaaubakirova May 29, 2024
19ffc83
feat: added shape adaptive module
danaaubakirova May 31, 2024
85dce8d
feat: added new image_processing script
danaaubakirova Jun 3, 2024
0f5fb87
Update src/transformers/models/mplugdocowl/image_processing_mplugdoco…
danaaubakirova Jun 4, 2024
53aca6d
fix: small fix
danaaubakirova Jun 4, 2024
cb25b05
Merge branch 'mplugdocowl' of github.com:danaaubakirova/transformers …
danaaubakirova Jun 4, 2024
1debae3
feat: added the additional keys to the output of the data
danaaubakirova Jun 4, 2024
66b849d
feat: made major modifications to image_processing script. added the …
danaaubakirova Jun 6, 2024
1716668
feat: refactored shape_adaptive_cropping function and resolved the is…
danaaubakirova Jun 10, 2024
452ebf5
feat: testing forward
danaaubakirova Jun 11, 2024
1e7f386
feat: corrected image tag
danaaubakirova Jun 12, 2024
8577f35
fix: attention mask handling is fixed, .forward works
danaaubakirova Jun 13, 2024
f546fbc
feat: updates in vision architecture
danaaubakirova Jun 18, 2024
edc358d
Update src/transformers/models/mplugdocowl/language_modeling_mplugdoc…
danaaubakirova Jun 19, 2024
9003d59
fix: renaming the model
danaaubakirova Jun 19, 2024
9f688d9
grand fix: fixed hreducer, the firstgenerated token is correct. forw…
danaaubakirova Jun 21, 2024
30c8a2b
fix: need to fix prepare_inputs_for_generation()
danaaubakirova Jun 24, 2024
5483f82
fix: fixed prepare_inputs_for_generation()
danaaubakirova Jun 24, 2024
413ddad
Merge branch 'main' into mplugdocowl
danaaubakirova Jun 25, 2024
7546063
testing phase
danaaubakirova Jun 25, 2024
e3cc222
removed copied from ..
danaaubakirova Jun 25, 2024
4f4f219
small fixes
danaaubakirova Jun 25, 2024
661bd75
removed some things from the config
danaaubakirova Jun 26, 2024
8aded38
small fixes
danaaubakirova Jun 27, 2024
19e0a35
update
danaaubakirova Jun 27, 2024
8300463
small fix
danaaubakirova Jun 27, 2024
f0c87d8
Update tests/models/mplugdocowl/test_modeling_mplugdocowl.py
danaaubakirova Jun 27, 2024
b75b2b9
Update src/transformers/models/mplugdocowl/modeling_mplugdocowl.py
danaaubakirova Jun 27, 2024
2aae5ca
Update tests/models/mplugdocowl/test_modeling_mplugdocowl.py
danaaubakirova Jun 27, 2024
105b5e1
Update tests/models/mplugdocowl/test_modeling_mplugdocowl.py
danaaubakirova Jun 27, 2024
7a2f434
Update tests/models/mplugdocowl/test_modeling_mplugdocowl.py
danaaubakirova Jun 27, 2024
205e345
Update tests/models/mplugdocowl/test_modeling_mplugdocowl.py
danaaubakirova Jun 27, 2024
0f5ba22
Update src/transformers/models/mplugdocowl/processing_mplugdocowl.py
danaaubakirova Jun 27, 2024
c0e241a
Update src/transformers/models/mplugdocowl/processing_mplugdocowl.py
danaaubakirova Jun 27, 2024
1555e04
Update src/transformers/models/mplugdocowl/processing_mplugdocowl.py
danaaubakirova Jun 27, 2024
219d866
Update src/transformers/models/mplugdocowl/image_processing_mplugdoco…
danaaubakirova Jun 27, 2024
4600f75
Update src/transformers/models/mplugdocowl/convert_mplugdocowl_weight…
danaaubakirova Jun 27, 2024
cb55d49
Update src/transformers/models/mplugdocowl/language_modeling_mplugdoc…
danaaubakirova Jun 27, 2024
c4c711c
model card is updated. tips to be added
danaaubakirova Jun 28, 2024
3007178
fix
danaaubakirova Jun 28, 2024
cdcf2f6
added documentation,updated rotary embedding function, added ModelTest
danaaubakirova Jun 28, 2024
cc7681f
updated
danaaubakirova Jul 1, 2024
c8c8b14
fixes
danaaubakirova Jul 2, 2024
6897da5
update
danaaubakirova Jul 2, 2024
0f0e517
deleted test.py
danaaubakirova Jul 2, 2024
046e2bd
filled in the types and docstrings
danaaubakirova Jul 2, 2024
1c498fc
nit
danaaubakirova Jul 2, 2024
6b5af5e
fixes
danaaubakirova Jul 2, 2024
e8cebb5
update
danaaubakirova Jul 2, 2024
dd0f8ce
new
danaaubakirova Jul 3, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading