You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I expect outputs to be same as when using "pipeline" and contain "summary_text" keyword. Outputs are fully rubbish - as though only decoder is used without encoder in TGI.
The text was updated successfully, but these errors were encountered:
maiiabocharova
changed the title
summarization using fine-tuned T5 model in TGI outputs "generated text" instead of "summary_text" and are incorrect
summarization using fine-tuned T5 model in TGI outputs "generated text" instead of "summary_text" and outputs are completely different
Jan 7, 2025
maiiabocharova
changed the title
summarization using fine-tuned T5 model in TGI outputs "generated text" instead of "summary_text" and outputs are completely different
summarization using fine-tuned flan-t5 model in TGI outputs "generated text" instead of "summary_text" and outputs are completely different
Jan 7, 2025
System Info
ghcr.io/huggingface/text-generation-inference:3.0.1
Information
Tasks
Reproduction
Equivalent curl command:
Expected behavior
I expect outputs to be same as when using "pipeline" and contain "summary_text" keyword. Outputs are fully rubbish - as though only decoder is used without encoder in TGI.
The text was updated successfully, but these errors were encountered: