Question about text input to model

[ashok-arjun]

Hi @kage08 @haoxin1998 ,

From this line, it seems that batch_text has a shape of (batch_size, 2), due to duplicating the text. This is because there is a duplicate Final_Output column created in the dataloader here. Therefore, the prompt created in the following line looks like this:

["<|start_prompt|Make predictions about the future based on the following information: ['Based on the provided textual information, I predict that the upcoming influenza season in the United States will likely be severe, with a high risk of widespread infection, hospitalizations, and mortality, particularly among vulnerable populations such as the elderly and those with compromised immune systems.'\n 'Based on the provided textual information, I predict that the upcoming influenza season in the United States will likely be severe, with a high risk of widespread infection, hospitalizations, and mortality, particularly among vulnerable populations such as the elderly and those with compromised immune systems.']<|<end_prompt>|>"]

The text is duplicated in the prompt.

Is this intended behaviour or is this a bug?