[BUG]: MessageMeta.copy_dataframe() renames keys in array[dict] columns

[dagardner-nv]

Version

24.03

Which installation method(s) does this occur on?

Source

Describe the bug.

Happens when C++ mode is enabled

Minimum reproducible example

import cudf

from morpheus.config import CppConfig
from morpheus.messages import MessageMeta

def test():
    data = {'checklist': [{'question': 'q1', 'response': 'r1'},  {'question': 'q2', 'response': 'r2'}]}

    df = cudf.DataFrame(data)
    m = MessageMeta(df)

    print(f"\nmessage.copy_dataframe()\n{m.copy_dataframe()}")


CppConfig.set_should_use_cpp(False)
print("C++ Disabled")
test()

CppConfig.set_should_use_cpp(True)
print("C++ Enabled")
test()

Relevant log output

C++ Disabled

message.copy_dataframe()
                              checklist
0  {'question': 'q1', 'response': 'r1'}
1  {'question': 'q2', 'response': 'r2'}
C++ Enabled

message.copy_dataframe()
                 checklist
""                        
0   {'0': 'q1', '1': 'r1'}
1   {'0': 'q2', '1': 'r2'}

Full env printout

Click here to see environment details

[Paste the results of print_env.sh here, it will be hidden by default]

Other/Misc.

No response

Code of Conduct

• I agree to follow Morpheus' Code of Conduct
• I have searched the open bugs and have found no duplicates for this bug report

[dagardner-nv]

Duplicate of #1527